Nov 28 10:44:58 user nova-compute[74994]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74994) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74994) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74994) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 28 10:44:58 user nova-compute[74994]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:44:58 user nova-compute[74994]: INFO nova.virt.driver [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 28 10:44:58 user nova-compute[74994]: INFO nova.compute.provider_config [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] Acquiring lock "singleton_lock" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] Acquired lock "singleton_lock" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] Releasing lock "singleton_lock" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] Full set of CONF: {{(pid=74994) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] ******************************************************************************** {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] Configuration options gathered from: {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] ================================================================================ {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] allow_resize_to_same_host      = True {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] arq_binding_timeout            = 300 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] backdoor_port                  = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] backdoor_socket                = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] block_device_allocate_retries  = 300 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] block_device_allocate_retries_interval = 5 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cert                           = self.pem {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] compute_monitors               = [] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] config_dir                     = [] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] config_drive_format            = iso9660 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] config_source                  = [] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] console_host                   = user {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] control_exchange               = nova {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cpu_allocation_ratio           = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] daemon                         = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] debug                          = True {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] default_access_ip_network_name = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] default_availability_zone      = nova {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] default_ephemeral_format       = ext4 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] default_green_pool_size        = 1000 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] default_schedule_zone          = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] disk_allocation_ratio          = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] enable_new_services            = True {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] enabled_apis                   = ['osapi_compute'] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] enabled_ssl_apis               = [] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] flat_injected                  = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] force_config_drive             = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] force_raw_images               = True {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] graceful_shutdown_timeout      = 5 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] heal_instance_info_cache_interval = 60 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] host                           = user {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] instance_build_timeout         = 0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] instance_delete_interval       = 300 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] instance_name_template         = instance-%08x {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] instance_usage_audit           = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] instance_usage_audit_period    = month {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] internal_service_availability_zone = internal {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] key                            = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] live_migration_retry_count     = 30 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] log_config_append              = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] log_dir                        = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] log_file                       = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] log_options                    = True {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] log_rotate_interval            = 1 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] log_rotate_interval_type       = days {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] log_rotation_type              = none {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] long_rpc_timeout               = 1800 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] max_concurrent_builds          = 10 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] max_concurrent_live_migrations = 1 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] max_concurrent_snapshots       = 5 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] max_local_block_devices        = 3 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] max_logfile_count              = 30 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] max_logfile_size_mb            = 200 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] maximum_instance_delete_attempts = 5 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] metadata_listen                = 0.0.0.0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] metadata_listen_port           = 8775 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] metadata_workers               = 3 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] migrate_max_retries            = -1 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] mkisofs_cmd                    = genisoimage {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] my_ip                          = 10.0.0.210 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] network_allocate_retries       = 0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] osapi_compute_listen_port      = 8774 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] osapi_compute_unique_server_name_scope =  {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] osapi_compute_workers          = 3 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] password_length                = 12 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] periodic_enable                = True {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] periodic_fuzzy_delay           = 60 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] pointer_model                  = ps2mouse {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] preallocate_images             = none {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] publish_errors                 = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] pybasedir                      = /opt/stack/nova {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] ram_allocation_ratio           = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] rate_limit_burst               = 0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] rate_limit_except_level        = CRITICAL {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] rate_limit_interval            = 0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] reboot_timeout                 = 0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] reclaim_instance_interval      = 0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] record                         = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] reimage_timeout_per_gb         = 60 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] report_interval                = 120 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] rescue_timeout                 = 0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] reserved_host_cpus             = 0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] reserved_host_disk_mb          = 0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] reserved_host_memory_mb        = 512 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] reserved_huge_pages            = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] resize_confirm_window          = 0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] resize_fs_using_block_device   = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] resume_guests_state_on_host_boot = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] rpc_response_timeout           = 60 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] run_external_periodic_tasks    = True {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] running_deleted_instance_action = reap {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] running_deleted_instance_poll_interval = 1800 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] running_deleted_instance_timeout = 0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] scheduler_instance_sync_interval = 120 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] service_down_time              = 720 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] servicegroup_driver            = db {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] shelved_offload_time           = 0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] shelved_poll_interval          = 3600 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] shutdown_timeout               = 0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] source_is_ipv6                 = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] ssl_only                       = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] state_path                     = /opt/stack/data/nova {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] sync_power_state_interval      = 600 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] sync_power_state_pool_size     = 1000 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] syslog_log_facility            = LOG_USER {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] tempdir                        = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] timeout_nbd                    = 10 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] transport_url                  = **** {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] update_resources_interval      = 0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] use_cow_images                 = True {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] use_eventlog                   = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] use_journal                    = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] use_json                       = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] use_rootwrap_daemon            = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] use_stderr                     = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] use_syslog                     = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vcpu_pin_set                   = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vif_plugging_is_fatal          = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vif_plugging_timeout           = 0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] virt_mkfs                      = [] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] volume_usage_poll_interval     = 0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] watch_log_file                 = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] web                            = /usr/share/spice-html5 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_concurrency.disable_process_locking = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] api.auth_strategy              = keystone {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] api.compute_link_prefix        = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] api.dhcp_domain                = novalocal {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] api.enable_instance_password   = True {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] api.glance_link_prefix         = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] api.instance_list_per_project_cells = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] api.list_records_by_skipping_down_cells = True {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] api.local_metadata_per_cell    = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] api.max_limit                  = 1000 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] api.metadata_cache_expiration  = 15 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] api.neutron_default_tenant_id  = default {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] api.use_forwarded_for          = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] api.use_neutron_default_nets   = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] api.vendordata_dynamic_targets = [] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] api.vendordata_jsonfile_path   = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cache.backend                  = dogpile.cache.memcached {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cache.backend_argument         = **** {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cache.config_prefix            = cache.oslo {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cache.dead_timeout             = 60.0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cache.debug_cache_backend      = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cache.enable_retry_client      = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cache.enable_socket_keepalive  = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cache.enabled                  = True {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cache.expiration_time          = 600 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cache.hashclient_retry_attempts = 2 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cache.memcache_dead_retry      = 300 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cache.memcache_password        =  {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cache.memcache_sasl_enabled    = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cache.memcache_username        =  {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cache.proxies                  = [] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cache.retry_attempts           = 2 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cache.retry_delay              = 0.0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cache.socket_keepalive_count   = 1 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cache.socket_keepalive_idle    = 1 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cache.socket_keepalive_interval = 1 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cache.tls_allowed_ciphers      = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cache.tls_cafile               = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cache.tls_certfile             = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cache.tls_enabled              = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cache.tls_keyfile              = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cinder.auth_section            = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cinder.auth_type               = password {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cinder.cafile                  = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cinder.certfile                = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cinder.collect_timing          = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cinder.cross_az_attach         = True {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cinder.debug                   = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cinder.endpoint_template       = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cinder.http_retries            = 3 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cinder.insecure                = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cinder.keyfile                 = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cinder.os_region_name          = RegionOne {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cinder.split_loggers           = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cinder.timeout                 = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] compute.cpu_dedicated_set      = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] compute.cpu_shared_set         = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] compute.image_type_exclude_list = [] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] compute.max_concurrent_disk_ops = 0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] compute.max_disk_devices_to_attach = -1 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] compute.resource_provider_association_refresh = 300 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] compute.shutdown_retry_interval = 10 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] conductor.workers              = 3 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] console.allowed_origins        = [] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] console.ssl_ciphers            = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] console.ssl_minimum_version    = default {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] consoleauth.token_ttl          = 600 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cyborg.cafile                  = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cyborg.certfile                = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cyborg.collect_timing          = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cyborg.connect_retries         = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cyborg.connect_retry_delay     = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cyborg.endpoint_override       = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cyborg.insecure                = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cyborg.keyfile                 = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cyborg.max_version             = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cyborg.min_version             = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cyborg.region_name             = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cyborg.service_name            = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cyborg.service_type            = accelerator {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cyborg.split_loggers           = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cyborg.status_code_retries     = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cyborg.status_code_retry_delay = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cyborg.timeout                 = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] cyborg.version                 = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] database.backend               = sqlalchemy {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] database.connection            = **** {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] database.connection_debug      = 0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] database.connection_parameters =  {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] database.connection_recycle_time = 3600 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] database.connection_trace      = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] database.db_inc_retry_interval = True {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] database.db_max_retries        = 20 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] database.db_max_retry_interval = 10 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] database.db_retry_interval     = 1 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] database.max_overflow          = 50 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] database.max_pool_size         = 5 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] database.max_retries           = 10 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] database.mysql_wsrep_sync_wait = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] database.pool_timeout          = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] database.retry_interval        = 10 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] database.slave_connection      = **** {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] database.sqlite_synchronous    = True {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] api_database.backend           = sqlalchemy {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] api_database.connection        = **** {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] api_database.connection_debug  = 0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] api_database.connection_parameters =  {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] api_database.connection_recycle_time = 3600 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] api_database.connection_trace  = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] api_database.db_inc_retry_interval = True {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] api_database.db_max_retries    = 20 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] api_database.db_max_retry_interval = 10 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] api_database.db_retry_interval = 1 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] api_database.max_overflow      = 50 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] api_database.max_pool_size     = 5 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] api_database.max_retries       = 10 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] api_database.pool_timeout      = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] api_database.retry_interval    = 10 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] api_database.slave_connection  = **** {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] api_database.sqlite_synchronous = True {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] devices.enabled_mdev_types     = [] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] ephemeral_storage_encryption.enabled = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] glance.api_servers             = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] glance.cafile                  = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] glance.certfile                = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] glance.collect_timing          = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] glance.connect_retries         = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] glance.connect_retry_delay     = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] glance.debug                   = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] glance.default_trusted_certificate_ids = [] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] glance.enable_certificate_validation = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] glance.enable_rbd_download     = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] glance.endpoint_override       = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] glance.insecure                = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] glance.keyfile                 = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] glance.max_version             = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] glance.min_version             = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] glance.num_retries             = 3 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] glance.rbd_ceph_conf           =  {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] glance.rbd_connect_timeout     = 5 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] glance.rbd_pool                =  {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] glance.rbd_user                =  {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] glance.region_name             = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] glance.service_name            = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] glance.service_type            = image {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] glance.split_loggers           = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] glance.status_code_retries     = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] glance.status_code_retry_delay = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] glance.timeout                 = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] glance.verify_glance_signatures = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] glance.version                 = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] guestfs.debug                  = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] hyperv.config_drive_cdrom      = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] hyperv.config_drive_inject_password = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] hyperv.enable_instance_metrics_collection = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] hyperv.enable_remotefx         = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] hyperv.instances_path_share    =  {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] hyperv.iscsi_initiator_list    = [] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] hyperv.limit_cpu_features      = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] hyperv.power_state_check_timeframe = 60 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] hyperv.use_multipath_io        = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] hyperv.volume_attach_retry_count = 10 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] hyperv.vswitch_name            = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] mks.enabled                    = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] image_cache.manager_interval   = 2400 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] image_cache.precache_concurrency = 1 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] image_cache.remove_unused_base_images = True {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] image_cache.subdirectory_name  = _base {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] ironic.api_max_retries         = 60 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] ironic.api_retry_interval      = 2 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] ironic.auth_section            = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] ironic.auth_type               = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] ironic.cafile                  = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] ironic.certfile                = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] ironic.collect_timing          = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] ironic.conductor_group         = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] ironic.connect_retries         = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] ironic.connect_retry_delay     = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] ironic.endpoint_override       = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] ironic.insecure                = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] ironic.keyfile                 = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] ironic.max_version             = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] ironic.min_version             = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] ironic.peer_list               = [] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] ironic.region_name             = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] ironic.serial_console_state_timeout = 10 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] ironic.service_name            = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] ironic.service_type            = baremetal {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] ironic.split_loggers           = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] ironic.status_code_retries     = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] ironic.status_code_retry_delay = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] ironic.timeout                 = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] ironic.version                 = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] key_manager.fixed_key          = **** {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] barbican.barbican_api_version  = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] barbican.barbican_endpoint     = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] barbican.barbican_endpoint_type = public {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] barbican.barbican_region_name  = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] barbican.cafile                = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] barbican.certfile              = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] barbican.collect_timing        = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] barbican.insecure              = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] barbican.keyfile               = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] barbican.number_of_retries     = 60 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] barbican.retry_delay           = 1 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] barbican.send_service_user_token = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] barbican.split_loggers         = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] barbican.timeout               = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] barbican.verify_ssl            = True {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] barbican.verify_ssl_path       = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] barbican_service_user.auth_section = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] barbican_service_user.auth_type = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] barbican_service_user.cafile   = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] barbican_service_user.certfile = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] barbican_service_user.collect_timing = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] barbican_service_user.insecure = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] barbican_service_user.keyfile  = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] barbican_service_user.split_loggers = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] barbican_service_user.timeout  = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vault.approle_role_id          = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vault.approle_secret_id        = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vault.cafile                   = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vault.certfile                 = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vault.collect_timing           = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vault.insecure                 = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vault.keyfile                  = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vault.kv_mountpoint            = secret {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vault.kv_path                  = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vault.kv_version               = 2 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vault.namespace                = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vault.root_token_id            = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vault.split_loggers            = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vault.ssl_ca_crt_file          = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vault.timeout                  = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vault.use_ssl                  = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] keystone.auth_section          = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] keystone.auth_type             = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] keystone.cafile                = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] keystone.certfile              = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] keystone.collect_timing        = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] keystone.connect_retries       = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] keystone.connect_retry_delay   = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] keystone.endpoint_override     = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] keystone.insecure              = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] keystone.keyfile               = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] keystone.max_version           = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] keystone.min_version           = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] keystone.region_name           = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] keystone.service_name          = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] keystone.service_type          = identity {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] keystone.split_loggers         = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] keystone.status_code_retries   = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] keystone.status_code_retry_delay = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] keystone.timeout               = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] keystone.version               = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.connection_uri         =  {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.cpu_mode               = custom {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: WARNING oslo_config.cfg [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.cpu_power_governor_high = performance {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.cpu_power_governor_low = powersave {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.cpu_power_management   = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.device_detach_attempts = 8 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.device_detach_timeout  = 20 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.disk_cachemodes        = [] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.disk_prefix            = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.enabled_perf_events    = [] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.file_backed_memory     = 0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.gid_maps               = [] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.hw_disk_discard        = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.hw_machine_type        = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.images_rbd_glance_store_name =  {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.images_rbd_pool        = rbd {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.images_type            = default {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.images_volume_group    = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.inject_key             = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.inject_partition       = -2 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.inject_password        = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.iscsi_iface            = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.iser_use_multipath     = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.live_migration_bandwidth = 0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.live_migration_downtime = 500 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.live_migration_inbound_addr = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.live_migration_permit_post_copy = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.live_migration_scheme  = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.live_migration_timeout_action = abort {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.live_migration_tunnelled = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: WARNING oslo_config.cfg [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 28 10:44:58 user nova-compute[74994]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 28 10:44:58 user nova-compute[74994]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 28 10:44:58 user nova-compute[74994]: and ``live_migration_inbound_addr`` respectively.
Nov 28 10:44:58 user nova-compute[74994]: ).  Its value may be silently ignored in the future.
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.live_migration_with_native_tls = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.max_queues             = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.nfs_mount_options      = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.num_memory_encrypted_guests = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.num_pcie_ports         = 0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.pmem_namespaces        = [] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.quobyte_client_cfg     = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.rbd_secret_uuid        = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.rbd_user               = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.remote_filesystem_transport = ssh {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.rescue_image_id        = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.rescue_kernel_id       = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.rescue_ramdisk_id      = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.rx_queue_size          = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.smbfs_mount_options    =  {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.snapshot_compression   = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.snapshot_image_format  = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.sparse_logical_volumes = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.swtpm_enabled          = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.swtpm_group            = tss {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.swtpm_user             = tss {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.sysinfo_serial         = unique {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.tb_cache_size          = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.tx_queue_size          = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.uid_maps               = [] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.use_virtio_for_bridges = True {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.virt_type              = kvm {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.volume_clear           = zero {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.volume_clear_size      = 0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.volume_use_multipath   = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.vzstorage_cache_path   = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.vzstorage_mount_user   = stack {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] neutron.auth_section           = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] neutron.auth_type              = password {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] neutron.cafile                 = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] neutron.certfile               = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] neutron.collect_timing         = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] neutron.connect_retries        = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] neutron.connect_retry_delay    = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] neutron.default_floating_pool  = public {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] neutron.endpoint_override      = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] neutron.extension_sync_interval = 600 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] neutron.http_retries           = 3 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] neutron.insecure               = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] neutron.keyfile                = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] neutron.max_version            = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] neutron.min_version            = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] neutron.ovs_bridge             = br-int {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] neutron.physnets               = [] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] neutron.region_name            = RegionOne {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] neutron.service_metadata_proxy = True {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] neutron.service_name           = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] neutron.service_type           = network {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] neutron.split_loggers          = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] neutron.status_code_retries    = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] neutron.status_code_retry_delay = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] neutron.timeout                = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] neutron.version                = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] notifications.bdms_in_notifications = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] notifications.default_level    = INFO {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] notifications.notification_format = unversioned {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] notifications.notify_on_state_change = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] pci.alias                      = [] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] pci.device_spec                = [] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] pci.report_in_placement        = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] placement.auth_section         = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] placement.auth_type            = password {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] placement.cafile               = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] placement.certfile             = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] placement.collect_timing       = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] placement.connect_retries      = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] placement.connect_retry_delay  = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] placement.default_domain_id    = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] placement.default_domain_name  = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] placement.domain_id            = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] placement.domain_name          = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] placement.endpoint_override    = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] placement.insecure             = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] placement.keyfile              = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] placement.max_version          = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] placement.min_version          = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] placement.password             = **** {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] placement.project_domain_id    = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] placement.project_domain_name  = Default {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] placement.project_id           = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] placement.project_name         = service {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] placement.region_name          = RegionOne {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] placement.service_name         = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] placement.service_type         = placement {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] placement.split_loggers        = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] placement.status_code_retries  = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] placement.status_code_retry_delay = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] placement.system_scope         = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] placement.timeout              = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] placement.trust_id             = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] placement.user_domain_id       = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] placement.user_domain_name     = Default {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] placement.user_id              = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] placement.username             = placement {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] placement.version              = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] quota.cores                    = 20 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] quota.count_usage_from_placement = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] quota.injected_file_content_bytes = 10240 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] quota.injected_file_path_length = 255 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] quota.injected_files           = 5 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] quota.instances                = 10 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] quota.key_pairs                = 100 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] quota.metadata_items           = 128 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] quota.ram                      = 51200 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] quota.recheck_quota            = True {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] quota.server_group_members     = 10 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] quota.server_groups            = 10 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] rdp.enabled                    = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] scheduler.image_metadata_prefilter = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] scheduler.max_attempts         = 3 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] scheduler.max_placement_results = 1000 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] scheduler.query_placement_for_image_type_support = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] scheduler.workers              = 3 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] filter_scheduler.host_subset_size = 1 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] filter_scheduler.isolated_hosts = [] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] filter_scheduler.isolated_images = [] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] filter_scheduler.pci_in_placement = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] filter_scheduler.track_instance_changes = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] metrics.required               = True {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] metrics.weight_multiplier      = 1.0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] metrics.weight_setting         = [] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] serial_console.enabled         = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] serial_console.port_range      = 10000:20000 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] serial_console.serialproxy_port = 6083 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] service_user.auth_section      = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] service_user.auth_type         = password {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] service_user.cafile            = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] service_user.certfile          = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] service_user.collect_timing    = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] service_user.insecure          = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] service_user.keyfile           = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] service_user.send_service_user_token = True {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] service_user.split_loggers     = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] service_user.timeout           = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] spice.agent_enabled            = True {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] spice.enabled                  = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] spice.html5proxy_port          = 6082 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] spice.image_compression        = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] spice.jpeg_compression         = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] spice.playback_compression     = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] spice.server_listen            = 127.0.0.1 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] spice.streaming_mode           = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] spice.zlib_compression         = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] upgrade_levels.baseapi         = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] upgrade_levels.compute         = auto {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] upgrade_levels.conductor       = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] upgrade_levels.scheduler       = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vendordata_dynamic_auth.auth_section = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vendordata_dynamic_auth.auth_type = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vendordata_dynamic_auth.cafile = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vendordata_dynamic_auth.certfile = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vendordata_dynamic_auth.insecure = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vendordata_dynamic_auth.keyfile = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vendordata_dynamic_auth.timeout = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vmware.api_retry_count         = 10 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vmware.ca_file                 = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vmware.cache_prefix            = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vmware.cluster_name            = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vmware.connection_pool_size    = 10 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vmware.console_delay_seconds   = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vmware.datastore_regex         = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vmware.host_ip                 = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vmware.host_password           = **** {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vmware.host_port               = 443 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vmware.host_username           = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vmware.insecure                = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vmware.integration_bridge      = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vmware.maximum_objects         = 100 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vmware.pbm_default_policy      = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vmware.pbm_enabled             = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vmware.pbm_wsdl_location       = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vmware.serial_port_proxy_uri   = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vmware.serial_port_service_uri = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vmware.task_poll_interval      = 0.5 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vmware.use_linked_clone        = True {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vmware.vnc_keymap              = en-us {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vmware.vnc_port                = 5900 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vmware.vnc_port_total          = 10000 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vnc.auth_schemes               = ['none'] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vnc.enabled                    = True {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vnc.novncproxy_port            = 6080 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vnc.server_listen              = 0.0.0.0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vnc.vencrypt_ca_certs          = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vnc.vencrypt_client_cert       = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vnc.vencrypt_client_key        = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] workarounds.disable_rootwrap   = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] workarounds.enable_numa_live_migration = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] workarounds.libvirt_disable_apic = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:58 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] wsgi.client_socket_timeout     = 900 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] wsgi.default_pool_size         = 1000 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] wsgi.keep_alive                = True {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] wsgi.max_header_line           = 16384 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] wsgi.ssl_ca_file               = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] wsgi.ssl_cert_file             = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] wsgi.ssl_key_file              = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] wsgi.tcp_keepidle              = 600 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] zvm.ca_file                    = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] zvm.cloud_connector_url        = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] zvm.reachable_timeout          = 300 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_policy.enforce_new_defaults = True {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_policy.enforce_scope      = True {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_policy.policy_default_rule = default {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] profiler.connection_string     = messaging:// {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] profiler.enabled               = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] profiler.es_doc_type           = notification {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] profiler.es_scroll_size        = 10000 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] profiler.es_scroll_time        = 2m {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] profiler.filter_error_trace    = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] profiler.hmac_keys             = **** {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] profiler.sentinel_service_name = mymaster {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] profiler.socket_timeout        = 0.1 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] profiler.trace_requests        = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] profiler.trace_sqlalchemy      = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] profiler_jaeger.process_tags   = {} {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] profiler_jaeger.service_name_prefix = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] profiler_otlp.service_name_prefix = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] remote_debug.host              = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] remote_debug.port              = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_messaging_notifications.retry = -1 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_limit.auth_section        = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_limit.auth_type           = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_limit.cafile              = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_limit.certfile            = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_limit.collect_timing      = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_limit.connect_retries     = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_limit.connect_retry_delay = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_limit.endpoint_id         = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_limit.endpoint_override   = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_limit.insecure            = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_limit.keyfile             = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_limit.max_version         = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_limit.min_version         = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_limit.region_name         = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_limit.service_name        = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_limit.service_type        = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_limit.split_loggers       = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_limit.status_code_retries = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_limit.status_code_retry_delay = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_limit.timeout             = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_limit.valid_interfaces    = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_limit.version             = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_reports.file_event_handler = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] oslo_reports.log_dir           = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vif_plug_ovs_privileged.group  = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] vif_plug_ovs_privileged.user   = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] os_vif_linux_bridge.flat_interface = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] os_vif_ovs.isolate_vif         = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] os_vif_ovs.per_port_bridge     = False {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] os_brick.lock_path             = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] privsep_osbrick.capabilities   = [21] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] privsep_osbrick.group          = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] privsep_osbrick.helper_command = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] privsep_osbrick.user           = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] nova_sys_admin.group           = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] nova_sys_admin.helper_command  = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] nova_sys_admin.user            = None {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG oslo_service.service [None req-137dfe5a-083d-48e6-a367-e7f675f9d020 None None] ******************************************************************************** {{(pid=74994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 28 10:44:59 user nova-compute[74994]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 28 10:44:59 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Connecting to libvirt: qemu:///system {{(pid=74994) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:508}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fb95c022440> {{(pid=74994) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:514}}
Nov 28 10:44:59 user nova-compute[74994]: libvirt:  error : internal error: could not initialize domain event timer
Nov 28 10:44:59 user nova-compute[74994]: WARNING nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 28 10:44:59 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fb95c022440> {{(pid=74994) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:535}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Starting native event thread {{(pid=74994) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:494}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Starting green dispatch thread {{(pid=74994) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:500}}
Nov 28 10:44:59 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Starting connection event dispatch thread {{(pid=74994) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Nov 28 10:44:59 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Connection event '1' reason 'None'
Nov 28 10:44:59 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 28 10:44:59 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.mount [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Initialising _HostMountState generation 0 {{(pid=74994) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 28 10:45:06 user nova-compute[74994]: INFO nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Libvirt host capabilities <capabilities>
Nov 28 10:45:06 user nova-compute[74994]:   <host>
Nov 28 10:45:06 user nova-compute[74994]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 28 10:45:06 user nova-compute[74994]:     <cpu>
Nov 28 10:45:06 user nova-compute[74994]:       <arch>x86_64</arch>
Nov 28 10:45:06 user nova-compute[74994]:       <model>IvyBridge-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <vendor>Intel</vendor>
Nov 28 10:45:06 user nova-compute[74994]:       <microcode version='1070'/>
Nov 28 10:45:06 user nova-compute[74994]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 28 10:45:06 user nova-compute[74994]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature name='ss'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature name='vmx'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature name='pcid'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature name='osxsave'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature name='hypervisor'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature name='arat'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature name='tsc_adjust'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature name='md-clear'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature name='stibp'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature name='arch-capabilities'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature name='ssbd'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature name='invtsc'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature name='rsba'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature name='skip-l1dfl-vmentry'/>
Nov 28 10:45:06 user nova-compute[74994]:       <pages unit='KiB' size='4'/>
Nov 28 10:45:06 user nova-compute[74994]:       <pages unit='KiB' size='2048'/>
Nov 28 10:45:06 user nova-compute[74994]:     </cpu>
Nov 28 10:45:06 user nova-compute[74994]:     <power_management>
Nov 28 10:45:06 user nova-compute[74994]:       <suspend_mem/>
Nov 28 10:45:06 user nova-compute[74994]:       <suspend_disk/>
Nov 28 10:45:06 user nova-compute[74994]:       <suspend_hybrid/>
Nov 28 10:45:06 user nova-compute[74994]:     </power_management>
Nov 28 10:45:06 user nova-compute[74994]:     <iommu support='no'/>
Nov 28 10:45:06 user nova-compute[74994]:     <migration_features>
Nov 28 10:45:06 user nova-compute[74994]:       <live/>
Nov 28 10:45:06 user nova-compute[74994]:       <uri_transports>
Nov 28 10:45:06 user nova-compute[74994]:         <uri_transport>tcp</uri_transport>
Nov 28 10:45:06 user nova-compute[74994]:         <uri_transport>rdma</uri_transport>
Nov 28 10:45:06 user nova-compute[74994]:       </uri_transports>
Nov 28 10:45:06 user nova-compute[74994]:     </migration_features>
Nov 28 10:45:06 user nova-compute[74994]:     <topology>
Nov 28 10:45:06 user nova-compute[74994]:       <cells num='2'>
Nov 28 10:45:06 user nova-compute[74994]:         <cell id='0'>
Nov 28 10:45:06 user nova-compute[74994]:           <memory unit='KiB'>8189224</memory>
Nov 28 10:45:06 user nova-compute[74994]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 28 10:45:06 user nova-compute[74994]:           <pages unit='KiB' size='2048'>0</pages>
Nov 28 10:45:06 user nova-compute[74994]:           <distances>
Nov 28 10:45:06 user nova-compute[74994]:             <sibling id='0' value='10'/>
Nov 28 10:45:06 user nova-compute[74994]:             <sibling id='1' value='20'/>
Nov 28 10:45:06 user nova-compute[74994]:           </distances>
Nov 28 10:45:06 user nova-compute[74994]:           <cpus num='6'>
Nov 28 10:45:06 user nova-compute[74994]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 28 10:45:06 user nova-compute[74994]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 28 10:45:06 user nova-compute[74994]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 28 10:45:06 user nova-compute[74994]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 28 10:45:06 user nova-compute[74994]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 28 10:45:06 user nova-compute[74994]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 28 10:45:06 user nova-compute[74994]:           </cpus>
Nov 28 10:45:06 user nova-compute[74994]:         </cell>
Nov 28 10:45:06 user nova-compute[74994]:         <cell id='1'>
Nov 28 10:45:06 user nova-compute[74994]:           <memory unit='KiB'>8206460</memory>
Nov 28 10:45:06 user nova-compute[74994]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 28 10:45:06 user nova-compute[74994]:           <pages unit='KiB' size='2048'>0</pages>
Nov 28 10:45:06 user nova-compute[74994]:           <distances>
Nov 28 10:45:06 user nova-compute[74994]:             <sibling id='0' value='20'/>
Nov 28 10:45:06 user nova-compute[74994]:             <sibling id='1' value='10'/>
Nov 28 10:45:06 user nova-compute[74994]:           </distances>
Nov 28 10:45:06 user nova-compute[74994]:           <cpus num='6'>
Nov 28 10:45:06 user nova-compute[74994]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 28 10:45:06 user nova-compute[74994]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 28 10:45:06 user nova-compute[74994]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 28 10:45:06 user nova-compute[74994]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 28 10:45:06 user nova-compute[74994]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 28 10:45:06 user nova-compute[74994]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 28 10:45:06 user nova-compute[74994]:           </cpus>
Nov 28 10:45:06 user nova-compute[74994]:         </cell>
Nov 28 10:45:06 user nova-compute[74994]:       </cells>
Nov 28 10:45:06 user nova-compute[74994]:     </topology>
Nov 28 10:45:06 user nova-compute[74994]:     <cache>
Nov 28 10:45:06 user nova-compute[74994]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 28 10:45:06 user nova-compute[74994]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 28 10:45:06 user nova-compute[74994]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 28 10:45:06 user nova-compute[74994]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 28 10:45:06 user nova-compute[74994]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 28 10:45:06 user nova-compute[74994]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 28 10:45:06 user nova-compute[74994]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 28 10:45:06 user nova-compute[74994]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 28 10:45:06 user nova-compute[74994]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 28 10:45:06 user nova-compute[74994]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 28 10:45:06 user nova-compute[74994]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 28 10:45:06 user nova-compute[74994]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 28 10:45:06 user nova-compute[74994]:     </cache>
Nov 28 10:45:06 user nova-compute[74994]:     <secmodel>
Nov 28 10:45:06 user nova-compute[74994]:       <model>apparmor</model>
Nov 28 10:45:06 user nova-compute[74994]:       <doi>0</doi>
Nov 28 10:45:06 user nova-compute[74994]:     </secmodel>
Nov 28 10:45:06 user nova-compute[74994]:     <secmodel>
Nov 28 10:45:06 user nova-compute[74994]:       <model>dac</model>
Nov 28 10:45:06 user nova-compute[74994]:       <doi>0</doi>
Nov 28 10:45:06 user nova-compute[74994]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 28 10:45:06 user nova-compute[74994]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 28 10:45:06 user nova-compute[74994]:     </secmodel>
Nov 28 10:45:06 user nova-compute[74994]:   </host>
Nov 28 10:45:06 user nova-compute[74994]:   <guest>
Nov 28 10:45:06 user nova-compute[74994]:     <os_type>hvm</os_type>
Nov 28 10:45:06 user nova-compute[74994]:     <arch name='alpha'>
Nov 28 10:45:06 user nova-compute[74994]:       <wordsize>64</wordsize>
Nov 28 10:45:06 user nova-compute[74994]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='4'>clipper</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <domain type='qemu'/>
Nov 28 10:45:06 user nova-compute[74994]:     </arch>
Nov 28 10:45:06 user nova-compute[74994]:     <features>
Nov 28 10:45:06 user nova-compute[74994]:       <cpuselection/>
Nov 28 10:45:06 user nova-compute[74994]:       <deviceboot/>
Nov 28 10:45:06 user nova-compute[74994]:       <disksnapshot default='on' toggle='no'/>
Nov 28 10:45:06 user nova-compute[74994]:     </features>
Nov 28 10:45:06 user nova-compute[74994]:   </guest>
Nov 28 10:45:06 user nova-compute[74994]:   <guest>
Nov 28 10:45:06 user nova-compute[74994]:     <os_type>hvm</os_type>
Nov 28 10:45:06 user nova-compute[74994]:     <arch name='armv6l'>
Nov 28 10:45:06 user nova-compute[74994]:       <wordsize>32</wordsize>
Nov 28 10:45:06 user nova-compute[74994]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>integratorcp</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>borzoi</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>spitz</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2'>nuri</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2'>musca-b1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>versatileab</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>kzm</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2'>musca-a</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2'>smdkc210</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>sx1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>z2</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>tosa</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='4'>sabrelite</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>realview-eb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>n810</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>n800</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>versatilepb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>terrier</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>mainstone</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='4'>midway</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>musicpal</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>microbit</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>cubieboard</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>verdex</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>netduino2</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='4'>raspi2b</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>cheetah</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='4'>highbank</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>akita</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>connex</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>collie</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>raspi0</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <domain type='qemu'/>
Nov 28 10:45:06 user nova-compute[74994]:     </arch>
Nov 28 10:45:06 user nova-compute[74994]:     <features>
Nov 28 10:45:06 user nova-compute[74994]:       <cpuselection/>
Nov 28 10:45:06 user nova-compute[74994]:       <deviceboot/>
Nov 28 10:45:06 user nova-compute[74994]:       <disksnapshot default='on' toggle='no'/>
Nov 28 10:45:06 user nova-compute[74994]:     </features>
Nov 28 10:45:06 user nova-compute[74994]:   </guest>
Nov 28 10:45:06 user nova-compute[74994]:   <guest>
Nov 28 10:45:06 user nova-compute[74994]:     <os_type>hvm</os_type>
Nov 28 10:45:06 user nova-compute[74994]:     <arch name='armv7l'>
Nov 28 10:45:06 user nova-compute[74994]:       <wordsize>32</wordsize>
Nov 28 10:45:06 user nova-compute[74994]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>integratorcp</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>borzoi</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>spitz</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2'>nuri</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2'>musca-b1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>versatileab</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>kzm</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2'>musca-a</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2'>smdkc210</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>sx1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>z2</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>tosa</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='4'>sabrelite</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>realview-eb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>n810</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>n800</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>versatilepb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>terrier</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>mainstone</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='4'>midway</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>musicpal</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>microbit</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>cubieboard</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>verdex</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>netduino2</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='4'>raspi2b</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>cheetah</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='4'>highbank</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>akita</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>connex</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>collie</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>raspi0</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <domain type='qemu'/>
Nov 28 10:45:06 user nova-compute[74994]:     </arch>
Nov 28 10:45:06 user nova-compute[74994]:     <features>
Nov 28 10:45:06 user nova-compute[74994]:       <cpuselection/>
Nov 28 10:45:06 user nova-compute[74994]:       <deviceboot/>
Nov 28 10:45:06 user nova-compute[74994]:       <disksnapshot default='on' toggle='no'/>
Nov 28 10:45:06 user nova-compute[74994]:     </features>
Nov 28 10:45:06 user nova-compute[74994]:   </guest>
Nov 28 10:45:06 user nova-compute[74994]:   <guest>
Nov 28 10:45:06 user nova-compute[74994]:     <os_type>hvm</os_type>
Nov 28 10:45:06 user nova-compute[74994]:     <arch name='aarch64'>
Nov 28 10:45:06 user nova-compute[74994]:       <wordsize>64</wordsize>
Nov 28 10:45:06 user nova-compute[74994]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>integratorcp</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>borzoi</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>spitz</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2'>nuri</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2'>musca-b1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>versatileab</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>kzm</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2'>musca-a</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2'>smdkc210</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>sx1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>z2</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>tosa</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='4'>sabrelite</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>realview-eb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>n810</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>n800</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>versatilepb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>terrier</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>mainstone</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='4'>midway</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>musicpal</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>microbit</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>cubieboard</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>verdex</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>netduino2</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='4'>raspi3b</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='4'>raspi2b</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>cheetah</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='4'>highbank</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>akita</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>connex</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>collie</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>raspi0</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <domain type='qemu'/>
Nov 28 10:45:06 user nova-compute[74994]:     </arch>
Nov 28 10:45:06 user nova-compute[74994]:     <features>
Nov 28 10:45:06 user nova-compute[74994]:       <acpi default='on' toggle='yes'/>
Nov 28 10:45:06 user nova-compute[74994]:       <cpuselection/>
Nov 28 10:45:06 user nova-compute[74994]:       <deviceboot/>
Nov 28 10:45:06 user nova-compute[74994]:       <disksnapshot default='on' toggle='no'/>
Nov 28 10:45:06 user nova-compute[74994]:     </features>
Nov 28 10:45:06 user nova-compute[74994]:   </guest>
Nov 28 10:45:06 user nova-compute[74994]:   <guest>
Nov 28 10:45:06 user nova-compute[74994]:     <os_type>hvm</os_type>
Nov 28 10:45:06 user nova-compute[74994]:     <arch name='cris'>
Nov 28 10:45:06 user nova-compute[74994]:       <wordsize>32</wordsize>
Nov 28 10:45:06 user nova-compute[74994]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <domain type='qemu'/>
Nov 28 10:45:06 user nova-compute[74994]:     </arch>
Nov 28 10:45:06 user nova-compute[74994]:     <features>
Nov 28 10:45:06 user nova-compute[74994]:       <cpuselection/>
Nov 28 10:45:06 user nova-compute[74994]:       <deviceboot/>
Nov 28 10:45:06 user nova-compute[74994]:       <disksnapshot default='on' toggle='no'/>
Nov 28 10:45:06 user nova-compute[74994]:     </features>
Nov 28 10:45:06 user nova-compute[74994]:   </guest>
Nov 28 10:45:06 user nova-compute[74994]:   <guest>
Nov 28 10:45:06 user nova-compute[74994]:     <os_type>hvm</os_type>
Nov 28 10:45:06 user nova-compute[74994]:     <arch name='i686'>
Nov 28 10:45:06 user nova-compute[74994]:       <wordsize>32</wordsize>
Nov 28 10:45:06 user nova-compute[74994]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>x-remote</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>isapc</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>microvm</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <domain type='qemu'/>
Nov 28 10:45:06 user nova-compute[74994]:       <domain type='kvm'/>
Nov 28 10:45:06 user nova-compute[74994]:     </arch>
Nov 28 10:45:06 user nova-compute[74994]:     <features>
Nov 28 10:45:06 user nova-compute[74994]:       <pae/>
Nov 28 10:45:06 user nova-compute[74994]:       <nonpae/>
Nov 28 10:45:06 user nova-compute[74994]:       <acpi default='on' toggle='yes'/>
Nov 28 10:45:06 user nova-compute[74994]:       <apic default='on' toggle='no'/>
Nov 28 10:45:06 user nova-compute[74994]:       <cpuselection/>
Nov 28 10:45:06 user nova-compute[74994]:       <deviceboot/>
Nov 28 10:45:06 user nova-compute[74994]:       <disksnapshot default='on' toggle='no'/>
Nov 28 10:45:06 user nova-compute[74994]:     </features>
Nov 28 10:45:06 user nova-compute[74994]:   </guest>
Nov 28 10:45:06 user nova-compute[74994]:   <guest>
Nov 28 10:45:06 user nova-compute[74994]:     <os_type>hvm</os_type>
Nov 28 10:45:06 user nova-compute[74994]:     <arch name='m68k'>
Nov 28 10:45:06 user nova-compute[74994]:       <wordsize>32</wordsize>
Nov 28 10:45:06 user nova-compute[74994]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>an5206</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>q800</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>next-cube</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <domain type='qemu'/>
Nov 28 10:45:06 user nova-compute[74994]:     </arch>
Nov 28 10:45:06 user nova-compute[74994]:     <features>
Nov 28 10:45:06 user nova-compute[74994]:       <cpuselection/>
Nov 28 10:45:06 user nova-compute[74994]:       <deviceboot/>
Nov 28 10:45:06 user nova-compute[74994]:       <disksnapshot default='on' toggle='no'/>
Nov 28 10:45:06 user nova-compute[74994]:     </features>
Nov 28 10:45:06 user nova-compute[74994]:   </guest>
Nov 28 10:45:06 user nova-compute[74994]:   <guest>
Nov 28 10:45:06 user nova-compute[74994]:     <os_type>hvm</os_type>
Nov 28 10:45:06 user nova-compute[74994]:     <arch name='microblaze'>
Nov 28 10:45:06 user nova-compute[74994]:       <wordsize>32</wordsize>
Nov 28 10:45:06 user nova-compute[74994]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <domain type='qemu'/>
Nov 28 10:45:06 user nova-compute[74994]:     </arch>
Nov 28 10:45:06 user nova-compute[74994]:     <features>
Nov 28 10:45:06 user nova-compute[74994]:       <cpuselection/>
Nov 28 10:45:06 user nova-compute[74994]:       <deviceboot/>
Nov 28 10:45:06 user nova-compute[74994]:       <disksnapshot default='on' toggle='no'/>
Nov 28 10:45:06 user nova-compute[74994]:     </features>
Nov 28 10:45:06 user nova-compute[74994]:   </guest>
Nov 28 10:45:06 user nova-compute[74994]:   <guest>
Nov 28 10:45:06 user nova-compute[74994]:     <os_type>hvm</os_type>
Nov 28 10:45:06 user nova-compute[74994]:     <arch name='microblazeel'>
Nov 28 10:45:06 user nova-compute[74994]:       <wordsize>32</wordsize>
Nov 28 10:45:06 user nova-compute[74994]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <domain type='qemu'/>
Nov 28 10:45:06 user nova-compute[74994]:     </arch>
Nov 28 10:45:06 user nova-compute[74994]:     <features>
Nov 28 10:45:06 user nova-compute[74994]:       <cpuselection/>
Nov 28 10:45:06 user nova-compute[74994]:       <deviceboot/>
Nov 28 10:45:06 user nova-compute[74994]:       <disksnapshot default='on' toggle='no'/>
Nov 28 10:45:06 user nova-compute[74994]:     </features>
Nov 28 10:45:06 user nova-compute[74994]:   </guest>
Nov 28 10:45:06 user nova-compute[74994]:   <guest>
Nov 28 10:45:06 user nova-compute[74994]:     <os_type>hvm</os_type>
Nov 28 10:45:06 user nova-compute[74994]:     <arch name='mips'>
Nov 28 10:45:06 user nova-compute[74994]:       <wordsize>32</wordsize>
Nov 28 10:45:06 user nova-compute[74994]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='16'>malta</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>mipssim</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <domain type='qemu'/>
Nov 28 10:45:06 user nova-compute[74994]:     </arch>
Nov 28 10:45:06 user nova-compute[74994]:     <features>
Nov 28 10:45:06 user nova-compute[74994]:       <cpuselection/>
Nov 28 10:45:06 user nova-compute[74994]:       <deviceboot/>
Nov 28 10:45:06 user nova-compute[74994]:       <disksnapshot default='on' toggle='no'/>
Nov 28 10:45:06 user nova-compute[74994]:     </features>
Nov 28 10:45:06 user nova-compute[74994]:   </guest>
Nov 28 10:45:06 user nova-compute[74994]:   <guest>
Nov 28 10:45:06 user nova-compute[74994]:     <os_type>hvm</os_type>
Nov 28 10:45:06 user nova-compute[74994]:     <arch name='mipsel'>
Nov 28 10:45:06 user nova-compute[74994]:       <wordsize>32</wordsize>
Nov 28 10:45:06 user nova-compute[74994]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='16'>malta</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>mipssim</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <domain type='qemu'/>
Nov 28 10:45:06 user nova-compute[74994]:     </arch>
Nov 28 10:45:06 user nova-compute[74994]:     <features>
Nov 28 10:45:06 user nova-compute[74994]:       <cpuselection/>
Nov 28 10:45:06 user nova-compute[74994]:       <deviceboot/>
Nov 28 10:45:06 user nova-compute[74994]:       <disksnapshot default='on' toggle='no'/>
Nov 28 10:45:06 user nova-compute[74994]:     </features>
Nov 28 10:45:06 user nova-compute[74994]:   </guest>
Nov 28 10:45:06 user nova-compute[74994]:   <guest>
Nov 28 10:45:06 user nova-compute[74994]:     <os_type>hvm</os_type>
Nov 28 10:45:06 user nova-compute[74994]:     <arch name='mips64'>
Nov 28 10:45:06 user nova-compute[74994]:       <wordsize>64</wordsize>
Nov 28 10:45:06 user nova-compute[74994]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='16'>malta</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>mipssim</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>pica61</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>magnum</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <domain type='qemu'/>
Nov 28 10:45:06 user nova-compute[74994]:     </arch>
Nov 28 10:45:06 user nova-compute[74994]:     <features>
Nov 28 10:45:06 user nova-compute[74994]:       <cpuselection/>
Nov 28 10:45:06 user nova-compute[74994]:       <deviceboot/>
Nov 28 10:45:06 user nova-compute[74994]:       <disksnapshot default='on' toggle='no'/>
Nov 28 10:45:06 user nova-compute[74994]:     </features>
Nov 28 10:45:06 user nova-compute[74994]:   </guest>
Nov 28 10:45:06 user nova-compute[74994]:   <guest>
Nov 28 10:45:06 user nova-compute[74994]:     <os_type>hvm</os_type>
Nov 28 10:45:06 user nova-compute[74994]:     <arch name='mips64el'>
Nov 28 10:45:06 user nova-compute[74994]:       <wordsize>64</wordsize>
Nov 28 10:45:06 user nova-compute[74994]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='16'>malta</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>mipssim</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>pica61</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>magnum</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='16'>boston</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <domain type='qemu'/>
Nov 28 10:45:06 user nova-compute[74994]:     </arch>
Nov 28 10:45:06 user nova-compute[74994]:     <features>
Nov 28 10:45:06 user nova-compute[74994]:       <cpuselection/>
Nov 28 10:45:06 user nova-compute[74994]:       <deviceboot/>
Nov 28 10:45:06 user nova-compute[74994]:       <disksnapshot default='on' toggle='no'/>
Nov 28 10:45:06 user nova-compute[74994]:     </features>
Nov 28 10:45:06 user nova-compute[74994]:   </guest>
Nov 28 10:45:06 user nova-compute[74994]:   <guest>
Nov 28 10:45:06 user nova-compute[74994]:     <os_type>hvm</os_type>
Nov 28 10:45:06 user nova-compute[74994]:     <arch name='ppc'>
Nov 28 10:45:06 user nova-compute[74994]:       <wordsize>32</wordsize>
Nov 28 10:45:06 user nova-compute[74994]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>g3beige</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>mac99</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='32'>ppce500</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>pegasos2</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>sam460ex</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>bamboo</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>40p</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>ref405ep</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>taihu</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <domain type='qemu'/>
Nov 28 10:45:06 user nova-compute[74994]:     </arch>
Nov 28 10:45:06 user nova-compute[74994]:     <features>
Nov 28 10:45:06 user nova-compute[74994]:       <cpuselection/>
Nov 28 10:45:06 user nova-compute[74994]:       <deviceboot/>
Nov 28 10:45:06 user nova-compute[74994]:       <disksnapshot default='on' toggle='no'/>
Nov 28 10:45:06 user nova-compute[74994]:     </features>
Nov 28 10:45:06 user nova-compute[74994]:   </guest>
Nov 28 10:45:06 user nova-compute[74994]:   <guest>
Nov 28 10:45:06 user nova-compute[74994]:     <os_type>hvm</os_type>
Nov 28 10:45:06 user nova-compute[74994]:     <arch name='ppc64'>
Nov 28 10:45:06 user nova-compute[74994]:       <wordsize>64</wordsize>
Nov 28 10:45:06 user nova-compute[74994]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2048'>powernv9</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>taihu</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2048'>powernv10</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='32'>ppce500</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>40p</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>pegasos2</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>bamboo</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>g3beige</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>mac99</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>sam460ex</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>ref405ep</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2048'>powernv8</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <domain type='qemu'/>
Nov 28 10:45:06 user nova-compute[74994]:     </arch>
Nov 28 10:45:06 user nova-compute[74994]:     <features>
Nov 28 10:45:06 user nova-compute[74994]:       <cpuselection/>
Nov 28 10:45:06 user nova-compute[74994]:       <deviceboot/>
Nov 28 10:45:06 user nova-compute[74994]:       <disksnapshot default='on' toggle='no'/>
Nov 28 10:45:06 user nova-compute[74994]:     </features>
Nov 28 10:45:06 user nova-compute[74994]:   </guest>
Nov 28 10:45:06 user nova-compute[74994]:   <guest>
Nov 28 10:45:06 user nova-compute[74994]:     <os_type>hvm</os_type>
Nov 28 10:45:06 user nova-compute[74994]:     <arch name='ppc64le'>
Nov 28 10:45:06 user nova-compute[74994]:       <wordsize>64</wordsize>
Nov 28 10:45:06 user nova-compute[74994]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2048'>powernv9</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>taihu</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2048'>powernv10</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='32'>ppce500</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>40p</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>pegasos2</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>bamboo</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>g3beige</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>mac99</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>sam460ex</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>ref405ep</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2048'>powernv8</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <domain type='qemu'/>
Nov 28 10:45:06 user nova-compute[74994]:     </arch>
Nov 28 10:45:06 user nova-compute[74994]:     <features>
Nov 28 10:45:06 user nova-compute[74994]:       <cpuselection/>
Nov 28 10:45:06 user nova-compute[74994]:       <deviceboot/>
Nov 28 10:45:06 user nova-compute[74994]:       <disksnapshot default='on' toggle='no'/>
Nov 28 10:45:06 user nova-compute[74994]:     </features>
Nov 28 10:45:06 user nova-compute[74994]:   </guest>
Nov 28 10:45:06 user nova-compute[74994]:   <guest>
Nov 28 10:45:06 user nova-compute[74994]:     <os_type>hvm</os_type>
Nov 28 10:45:06 user nova-compute[74994]:     <arch name='riscv32'>
Nov 28 10:45:06 user nova-compute[74994]:       <wordsize>32</wordsize>
Nov 28 10:45:06 user nova-compute[74994]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='8'>spike</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>opentitan</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='5'>sifive_u</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>sifive_e</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='8'>virt</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <domain type='qemu'/>
Nov 28 10:45:06 user nova-compute[74994]:     </arch>
Nov 28 10:45:06 user nova-compute[74994]:     <features>
Nov 28 10:45:06 user nova-compute[74994]:       <cpuselection/>
Nov 28 10:45:06 user nova-compute[74994]:       <deviceboot/>
Nov 28 10:45:06 user nova-compute[74994]:       <disksnapshot default='on' toggle='no'/>
Nov 28 10:45:06 user nova-compute[74994]:     </features>
Nov 28 10:45:06 user nova-compute[74994]:   </guest>
Nov 28 10:45:06 user nova-compute[74994]:   <guest>
Nov 28 10:45:06 user nova-compute[74994]:     <os_type>hvm</os_type>
Nov 28 10:45:06 user nova-compute[74994]:     <arch name='riscv64'>
Nov 28 10:45:06 user nova-compute[74994]:       <wordsize>64</wordsize>
Nov 28 10:45:06 user nova-compute[74994]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='8'>spike</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='5'>sifive_u</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>shakti_c</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>sifive_e</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='8'>virt</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <domain type='qemu'/>
Nov 28 10:45:06 user nova-compute[74994]:     </arch>
Nov 28 10:45:06 user nova-compute[74994]:     <features>
Nov 28 10:45:06 user nova-compute[74994]:       <cpuselection/>
Nov 28 10:45:06 user nova-compute[74994]:       <deviceboot/>
Nov 28 10:45:06 user nova-compute[74994]:       <disksnapshot default='on' toggle='no'/>
Nov 28 10:45:06 user nova-compute[74994]:     </features>
Nov 28 10:45:06 user nova-compute[74994]:   </guest>
Nov 28 10:45:06 user nova-compute[74994]:   <guest>
Nov 28 10:45:06 user nova-compute[74994]:     <os_type>hvm</os_type>
Nov 28 10:45:06 user nova-compute[74994]:     <arch name='s390x'>
Nov 28 10:45:06 user nova-compute[74994]:       <wordsize>64</wordsize>
Nov 28 10:45:06 user nova-compute[74994]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <domain type='qemu'/>
Nov 28 10:45:06 user nova-compute[74994]:     </arch>
Nov 28 10:45:06 user nova-compute[74994]:     <features>
Nov 28 10:45:06 user nova-compute[74994]:       <cpuselection/>
Nov 28 10:45:06 user nova-compute[74994]:       <deviceboot/>
Nov 28 10:45:06 user nova-compute[74994]:       <disksnapshot default='on' toggle='no'/>
Nov 28 10:45:06 user nova-compute[74994]:     </features>
Nov 28 10:45:06 user nova-compute[74994]:   </guest>
Nov 28 10:45:06 user nova-compute[74994]:   <guest>
Nov 28 10:45:06 user nova-compute[74994]:     <os_type>hvm</os_type>
Nov 28 10:45:06 user nova-compute[74994]:     <arch name='sh4'>
Nov 28 10:45:06 user nova-compute[74994]:       <wordsize>32</wordsize>
Nov 28 10:45:06 user nova-compute[74994]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>shix</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>r2d</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <domain type='qemu'/>
Nov 28 10:45:06 user nova-compute[74994]:     </arch>
Nov 28 10:45:06 user nova-compute[74994]:     <features>
Nov 28 10:45:06 user nova-compute[74994]:       <cpuselection/>
Nov 28 10:45:06 user nova-compute[74994]:       <deviceboot/>
Nov 28 10:45:06 user nova-compute[74994]:       <disksnapshot default='on' toggle='no'/>
Nov 28 10:45:06 user nova-compute[74994]:     </features>
Nov 28 10:45:06 user nova-compute[74994]:   </guest>
Nov 28 10:45:06 user nova-compute[74994]:   <guest>
Nov 28 10:45:06 user nova-compute[74994]:     <os_type>hvm</os_type>
Nov 28 10:45:06 user nova-compute[74994]:     <arch name='sh4eb'>
Nov 28 10:45:06 user nova-compute[74994]:       <wordsize>64</wordsize>
Nov 28 10:45:06 user nova-compute[74994]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>shix</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>r2d</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <domain type='qemu'/>
Nov 28 10:45:06 user nova-compute[74994]:     </arch>
Nov 28 10:45:06 user nova-compute[74994]:     <features>
Nov 28 10:45:06 user nova-compute[74994]:       <cpuselection/>
Nov 28 10:45:06 user nova-compute[74994]:       <deviceboot/>
Nov 28 10:45:06 user nova-compute[74994]:       <disksnapshot default='on' toggle='no'/>
Nov 28 10:45:06 user nova-compute[74994]:     </features>
Nov 28 10:45:06 user nova-compute[74994]:   </guest>
Nov 28 10:45:06 user nova-compute[74994]:   <guest>
Nov 28 10:45:06 user nova-compute[74994]:     <os_type>hvm</os_type>
Nov 28 10:45:06 user nova-compute[74994]:     <arch name='sparc'>
Nov 28 10:45:06 user nova-compute[74994]:       <wordsize>32</wordsize>
Nov 28 10:45:06 user nova-compute[74994]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>SS-5</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='4'>SS-20</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>LX</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>SS-4</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='4'>SS-10</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>Voyager</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <domain type='qemu'/>
Nov 28 10:45:06 user nova-compute[74994]:     </arch>
Nov 28 10:45:06 user nova-compute[74994]:     <features>
Nov 28 10:45:06 user nova-compute[74994]:       <cpuselection/>
Nov 28 10:45:06 user nova-compute[74994]:       <deviceboot/>
Nov 28 10:45:06 user nova-compute[74994]:       <disksnapshot default='on' toggle='no'/>
Nov 28 10:45:06 user nova-compute[74994]:     </features>
Nov 28 10:45:06 user nova-compute[74994]:   </guest>
Nov 28 10:45:06 user nova-compute[74994]:   <guest>
Nov 28 10:45:06 user nova-compute[74994]:     <os_type>hvm</os_type>
Nov 28 10:45:06 user nova-compute[74994]:     <arch name='sparc64'>
Nov 28 10:45:06 user nova-compute[74994]:       <wordsize>64</wordsize>
Nov 28 10:45:06 user nova-compute[74994]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>sun4u</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>niagara</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>sun4v</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <domain type='qemu'/>
Nov 28 10:45:06 user nova-compute[74994]:     </arch>
Nov 28 10:45:06 user nova-compute[74994]:     <features>
Nov 28 10:45:06 user nova-compute[74994]:       <cpuselection/>
Nov 28 10:45:06 user nova-compute[74994]:       <deviceboot/>
Nov 28 10:45:06 user nova-compute[74994]:       <disksnapshot default='on' toggle='no'/>
Nov 28 10:45:06 user nova-compute[74994]:     </features>
Nov 28 10:45:06 user nova-compute[74994]:   </guest>
Nov 28 10:45:06 user nova-compute[74994]:   <guest>
Nov 28 10:45:06 user nova-compute[74994]:     <os_type>hvm</os_type>
Nov 28 10:45:06 user nova-compute[74994]:     <arch name='x86_64'>
Nov 28 10:45:06 user nova-compute[74994]:       <wordsize>64</wordsize>
Nov 28 10:45:06 user nova-compute[74994]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>x-remote</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='1'>isapc</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>microvm</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <domain type='qemu'/>
Nov 28 10:45:06 user nova-compute[74994]:       <domain type='kvm'/>
Nov 28 10:45:06 user nova-compute[74994]:     </arch>
Nov 28 10:45:06 user nova-compute[74994]:     <features>
Nov 28 10:45:06 user nova-compute[74994]:       <acpi default='on' toggle='yes'/>
Nov 28 10:45:06 user nova-compute[74994]:       <apic default='on' toggle='no'/>
Nov 28 10:45:06 user nova-compute[74994]:       <cpuselection/>
Nov 28 10:45:06 user nova-compute[74994]:       <deviceboot/>
Nov 28 10:45:06 user nova-compute[74994]:       <disksnapshot default='on' toggle='no'/>
Nov 28 10:45:06 user nova-compute[74994]:     </features>
Nov 28 10:45:06 user nova-compute[74994]:   </guest>
Nov 28 10:45:06 user nova-compute[74994]:   <guest>
Nov 28 10:45:06 user nova-compute[74994]:     <os_type>hvm</os_type>
Nov 28 10:45:06 user nova-compute[74994]:     <arch name='xtensa'>
Nov 28 10:45:06 user nova-compute[74994]:       <wordsize>32</wordsize>
Nov 28 10:45:06 user nova-compute[74994]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='4'>sim</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='32'>kc705</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='32'>ml605</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='32'>virt</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='32'>lx200</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='32'>lx60</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <domain type='qemu'/>
Nov 28 10:45:06 user nova-compute[74994]:     </arch>
Nov 28 10:45:06 user nova-compute[74994]:     <features>
Nov 28 10:45:06 user nova-compute[74994]:       <cpuselection/>
Nov 28 10:45:06 user nova-compute[74994]:       <deviceboot/>
Nov 28 10:45:06 user nova-compute[74994]:       <disksnapshot default='on' toggle='no'/>
Nov 28 10:45:06 user nova-compute[74994]:     </features>
Nov 28 10:45:06 user nova-compute[74994]:   </guest>
Nov 28 10:45:06 user nova-compute[74994]:   <guest>
Nov 28 10:45:06 user nova-compute[74994]:     <os_type>hvm</os_type>
Nov 28 10:45:06 user nova-compute[74994]:     <arch name='xtensaeb'>
Nov 28 10:45:06 user nova-compute[74994]:       <wordsize>32</wordsize>
Nov 28 10:45:06 user nova-compute[74994]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='4'>sim</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='32'>kc705</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='32'>ml605</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='32'>virt</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='32'>lx200</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='32'>lx60</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 28 10:45:06 user nova-compute[74994]:       <domain type='qemu'/>
Nov 28 10:45:06 user nova-compute[74994]:     </arch>
Nov 28 10:45:06 user nova-compute[74994]:     <features>
Nov 28 10:45:06 user nova-compute[74994]:       <cpuselection/>
Nov 28 10:45:06 user nova-compute[74994]:       <deviceboot/>
Nov 28 10:45:06 user nova-compute[74994]:       <disksnapshot default='on' toggle='no'/>
Nov 28 10:45:06 user nova-compute[74994]:     </features>
Nov 28 10:45:06 user nova-compute[74994]:   </guest>
Nov 28 10:45:06 user nova-compute[74994]: </capabilities>
Nov 28 10:45:06 user nova-compute[74994]: 
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'ubuntu', 'q35', 'pc'} {{(pid=74994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 28 10:45:06 user nova-compute[74994]: <domainCapabilities>
Nov 28 10:45:06 user nova-compute[74994]:   <path>/usr/bin/qemu-system-i386</path>
Nov 28 10:45:06 user nova-compute[74994]:   <domain>kvm</domain>
Nov 28 10:45:06 user nova-compute[74994]:   <machine>pc-q35-jammy</machine>
Nov 28 10:45:06 user nova-compute[74994]:   <arch>i686</arch>
Nov 28 10:45:06 user nova-compute[74994]:   <vcpu max='288'/>
Nov 28 10:45:06 user nova-compute[74994]:   <iothreads supported='yes'/>
Nov 28 10:45:06 user nova-compute[74994]:   <os supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:     <enum name='firmware'/>
Nov 28 10:45:06 user nova-compute[74994]:     <loader supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 28 10:45:06 user nova-compute[74994]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 28 10:45:06 user nova-compute[74994]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 28 10:45:06 user nova-compute[74994]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 28 10:45:06 user nova-compute[74994]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='type'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>rom</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>pflash</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='readonly'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>yes</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>no</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='secure'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>no</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </loader>
Nov 28 10:45:06 user nova-compute[74994]:   </os>
Nov 28 10:45:06 user nova-compute[74994]:   <cpu>
Nov 28 10:45:06 user nova-compute[74994]:     <mode name='host-passthrough' supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='hostPassthroughMigratable'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>off</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </mode>
Nov 28 10:45:06 user nova-compute[74994]:     <mode name='maximum' supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='maximumMigratable'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>on</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>off</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </mode>
Nov 28 10:45:06 user nova-compute[74994]:     <mode name='host-model' supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <vendor>Intel</vendor>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='ss'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='vmx'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='pcid'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='hypervisor'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='arat'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='umip'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='md-clear'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='stibp'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='ssbd'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='ibpb'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='ibrs'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='amd-stibp'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='disable' name='erms'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='disable' name='lm'/>
Nov 28 10:45:06 user nova-compute[74994]:     </mode>
Nov 28 10:45:06 user nova-compute[74994]:     <mode name='custom' supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>qemu64</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>qemu32</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>phenom</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>pentium3</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>pentium2</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>pentium</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>n270</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>kvm64</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>kvm32</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>coreduo</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>core2duo</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>athlon</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Westmere-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Westmere</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Snowridge</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Skylake-Server</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Skylake-Client</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>SandyBridge</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Penryn</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Opteron_G5</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Opteron_G4</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Opteron_G3</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Opteron_G2</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Opteron_G1</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Nehalem-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Nehalem</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>IvyBridge</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Icelake-Server</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Haswell</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>EPYC-Rome</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>EPYC-Milan</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>EPYC</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Dhyana</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Cooperlake</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Conroe</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Broadwell</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>486</model>
Nov 28 10:45:06 user nova-compute[74994]:     </mode>
Nov 28 10:45:06 user nova-compute[74994]:   </cpu>
Nov 28 10:45:06 user nova-compute[74994]:   <memoryBacking supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:     <enum name='sourceType'>
Nov 28 10:45:06 user nova-compute[74994]:       <value>file</value>
Nov 28 10:45:06 user nova-compute[74994]:       <value>anonymous</value>
Nov 28 10:45:06 user nova-compute[74994]:       <value>memfd</value>
Nov 28 10:45:06 user nova-compute[74994]:     </enum>
Nov 28 10:45:06 user nova-compute[74994]:   </memoryBacking>
Nov 28 10:45:06 user nova-compute[74994]:   <devices>
Nov 28 10:45:06 user nova-compute[74994]:     <disk supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='diskDevice'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>disk</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>cdrom</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>floppy</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>lun</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='bus'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>fdc</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>scsi</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>usb</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>sata</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='model'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio-transitional</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio-non-transitional</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </disk>
Nov 28 10:45:06 user nova-compute[74994]:     <graphics supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='type'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>sdl</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>vnc</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>spice</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>egl-headless</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </graphics>
Nov 28 10:45:06 user nova-compute[74994]:     <video supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='modelType'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>vga</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>cirrus</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>vmvga</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>qxl</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>none</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>bochs</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>ramfb</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </video>
Nov 28 10:45:06 user nova-compute[74994]:     <hostdev supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='mode'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>subsystem</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='startupPolicy'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>default</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>mandatory</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>requisite</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>optional</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='subsysType'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>usb</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>pci</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>scsi</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='capsType'/>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='pciBackend'/>
Nov 28 10:45:06 user nova-compute[74994]:     </hostdev>
Nov 28 10:45:06 user nova-compute[74994]:     <rng supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='model'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio-transitional</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio-non-transitional</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='backendModel'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>random</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>egd</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>builtin</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </rng>
Nov 28 10:45:06 user nova-compute[74994]:     <filesystem supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='driverType'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>path</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>handle</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtiofs</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </filesystem>
Nov 28 10:45:06 user nova-compute[74994]:     <tpm supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='model'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>tpm-tis</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>tpm-crb</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='backendModel'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>passthrough</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>emulator</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </tpm>
Nov 28 10:45:06 user nova-compute[74994]:   </devices>
Nov 28 10:45:06 user nova-compute[74994]:   <features>
Nov 28 10:45:06 user nova-compute[74994]:     <gic supported='no'/>
Nov 28 10:45:06 user nova-compute[74994]:     <vmcoreinfo supported='yes'/>
Nov 28 10:45:06 user nova-compute[74994]:     <genid supported='yes'/>
Nov 28 10:45:06 user nova-compute[74994]:     <backingStoreInput supported='yes'/>
Nov 28 10:45:06 user nova-compute[74994]:     <backup supported='yes'/>
Nov 28 10:45:06 user nova-compute[74994]:     <sev supported='no'/>
Nov 28 10:45:06 user nova-compute[74994]:   </features>
Nov 28 10:45:06 user nova-compute[74994]: </domainCapabilities>
Nov 28 10:45:06 user nova-compute[74994]:  {{(pid=74994) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 28 10:45:06 user nova-compute[74994]: <domainCapabilities>
Nov 28 10:45:06 user nova-compute[74994]:   <path>/usr/bin/qemu-system-i386</path>
Nov 28 10:45:06 user nova-compute[74994]:   <domain>kvm</domain>
Nov 28 10:45:06 user nova-compute[74994]:   <machine>pc-i440fx-jammy</machine>
Nov 28 10:45:06 user nova-compute[74994]:   <arch>i686</arch>
Nov 28 10:45:06 user nova-compute[74994]:   <vcpu max='255'/>
Nov 28 10:45:06 user nova-compute[74994]:   <iothreads supported='yes'/>
Nov 28 10:45:06 user nova-compute[74994]:   <os supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:     <enum name='firmware'/>
Nov 28 10:45:06 user nova-compute[74994]:     <loader supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 28 10:45:06 user nova-compute[74994]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 28 10:45:06 user nova-compute[74994]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 28 10:45:06 user nova-compute[74994]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 28 10:45:06 user nova-compute[74994]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='type'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>rom</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>pflash</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='readonly'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>yes</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>no</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='secure'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>no</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </loader>
Nov 28 10:45:06 user nova-compute[74994]:   </os>
Nov 28 10:45:06 user nova-compute[74994]:   <cpu>
Nov 28 10:45:06 user nova-compute[74994]:     <mode name='host-passthrough' supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='hostPassthroughMigratable'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>off</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </mode>
Nov 28 10:45:06 user nova-compute[74994]:     <mode name='maximum' supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='maximumMigratable'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>on</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>off</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </mode>
Nov 28 10:45:06 user nova-compute[74994]:     <mode name='host-model' supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <vendor>Intel</vendor>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='ss'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='vmx'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='pcid'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='hypervisor'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='arat'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='umip'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='md-clear'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='stibp'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='ssbd'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='ibpb'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='ibrs'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='amd-stibp'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='disable' name='erms'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='disable' name='lm'/>
Nov 28 10:45:06 user nova-compute[74994]:     </mode>
Nov 28 10:45:06 user nova-compute[74994]:     <mode name='custom' supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>qemu64</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>qemu32</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>phenom</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>pentium3</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>pentium2</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>pentium</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>n270</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>kvm64</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>kvm32</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>coreduo</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>core2duo</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>athlon</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Westmere-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Westmere</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Snowridge</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Skylake-Server</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Skylake-Client</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>SandyBridge</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Penryn</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Opteron_G5</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Opteron_G4</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Opteron_G3</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Opteron_G2</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Opteron_G1</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Nehalem-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Nehalem</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>IvyBridge</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Icelake-Server</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Haswell</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>EPYC-Rome</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>EPYC-Milan</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>EPYC</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Dhyana</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Cooperlake</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Conroe</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Broadwell</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>486</model>
Nov 28 10:45:06 user nova-compute[74994]:     </mode>
Nov 28 10:45:06 user nova-compute[74994]:   </cpu>
Nov 28 10:45:06 user nova-compute[74994]:   <memoryBacking supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:     <enum name='sourceType'>
Nov 28 10:45:06 user nova-compute[74994]:       <value>file</value>
Nov 28 10:45:06 user nova-compute[74994]:       <value>anonymous</value>
Nov 28 10:45:06 user nova-compute[74994]:       <value>memfd</value>
Nov 28 10:45:06 user nova-compute[74994]:     </enum>
Nov 28 10:45:06 user nova-compute[74994]:   </memoryBacking>
Nov 28 10:45:06 user nova-compute[74994]:   <devices>
Nov 28 10:45:06 user nova-compute[74994]:     <disk supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='diskDevice'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>disk</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>cdrom</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>floppy</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>lun</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='bus'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>ide</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>fdc</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>scsi</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>usb</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>sata</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='model'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio-transitional</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio-non-transitional</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </disk>
Nov 28 10:45:06 user nova-compute[74994]:     <graphics supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='type'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>sdl</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>vnc</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>spice</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>egl-headless</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </graphics>
Nov 28 10:45:06 user nova-compute[74994]:     <video supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='modelType'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>vga</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>cirrus</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>vmvga</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>qxl</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>none</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>bochs</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>ramfb</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </video>
Nov 28 10:45:06 user nova-compute[74994]:     <hostdev supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='mode'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>subsystem</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='startupPolicy'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>default</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>mandatory</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>requisite</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>optional</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='subsysType'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>usb</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>pci</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>scsi</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='capsType'/>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='pciBackend'/>
Nov 28 10:45:06 user nova-compute[74994]:     </hostdev>
Nov 28 10:45:06 user nova-compute[74994]:     <rng supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='model'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio-transitional</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio-non-transitional</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='backendModel'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>random</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>egd</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>builtin</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </rng>
Nov 28 10:45:06 user nova-compute[74994]:     <filesystem supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='driverType'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>path</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>handle</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtiofs</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </filesystem>
Nov 28 10:45:06 user nova-compute[74994]:     <tpm supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='model'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>tpm-tis</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>tpm-crb</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='backendModel'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>passthrough</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>emulator</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </tpm>
Nov 28 10:45:06 user nova-compute[74994]:   </devices>
Nov 28 10:45:06 user nova-compute[74994]:   <features>
Nov 28 10:45:06 user nova-compute[74994]:     <gic supported='no'/>
Nov 28 10:45:06 user nova-compute[74994]:     <vmcoreinfo supported='yes'/>
Nov 28 10:45:06 user nova-compute[74994]:     <genid supported='yes'/>
Nov 28 10:45:06 user nova-compute[74994]:     <backingStoreInput supported='yes'/>
Nov 28 10:45:06 user nova-compute[74994]:     <backup supported='yes'/>
Nov 28 10:45:06 user nova-compute[74994]:     <sev supported='no'/>
Nov 28 10:45:06 user nova-compute[74994]:   </features>
Nov 28 10:45:06 user nova-compute[74994]: </domainCapabilities>
Nov 28 10:45:06 user nova-compute[74994]:  {{(pid=74994) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 28 10:45:06 user nova-compute[74994]: <domainCapabilities>
Nov 28 10:45:06 user nova-compute[74994]:   <path>/usr/bin/qemu-system-i386</path>
Nov 28 10:45:06 user nova-compute[74994]:   <domain>kvm</domain>
Nov 28 10:45:06 user nova-compute[74994]:   <machine>pc-q35-6.2</machine>
Nov 28 10:45:06 user nova-compute[74994]:   <arch>i686</arch>
Nov 28 10:45:06 user nova-compute[74994]:   <vcpu max='288'/>
Nov 28 10:45:06 user nova-compute[74994]:   <iothreads supported='yes'/>
Nov 28 10:45:06 user nova-compute[74994]:   <os supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:     <enum name='firmware'/>
Nov 28 10:45:06 user nova-compute[74994]:     <loader supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 28 10:45:06 user nova-compute[74994]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 28 10:45:06 user nova-compute[74994]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 28 10:45:06 user nova-compute[74994]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 28 10:45:06 user nova-compute[74994]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='type'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>rom</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>pflash</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='readonly'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>yes</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>no</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='secure'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>no</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </loader>
Nov 28 10:45:06 user nova-compute[74994]:   </os>
Nov 28 10:45:06 user nova-compute[74994]:   <cpu>
Nov 28 10:45:06 user nova-compute[74994]:     <mode name='host-passthrough' supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='hostPassthroughMigratable'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>off</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </mode>
Nov 28 10:45:06 user nova-compute[74994]:     <mode name='maximum' supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='maximumMigratable'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>on</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>off</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </mode>
Nov 28 10:45:06 user nova-compute[74994]:     <mode name='host-model' supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <vendor>Intel</vendor>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='ss'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='vmx'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='pcid'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='hypervisor'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='arat'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='umip'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='md-clear'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='stibp'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='ssbd'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='ibpb'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='ibrs'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='amd-stibp'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='disable' name='erms'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='disable' name='lm'/>
Nov 28 10:45:06 user nova-compute[74994]:     </mode>
Nov 28 10:45:06 user nova-compute[74994]:     <mode name='custom' supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>qemu64</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>qemu32</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>phenom</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>pentium3</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>pentium2</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>pentium</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>n270</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>kvm64</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>kvm32</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>coreduo</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>core2duo</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>athlon</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Westmere-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Westmere</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Snowridge</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Skylake-Server</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Skylake-Client</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>SandyBridge</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Penryn</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Opteron_G5</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Opteron_G4</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Opteron_G3</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Opteron_G2</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Opteron_G1</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Nehalem-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Nehalem</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>IvyBridge</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Icelake-Server</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Haswell</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>EPYC-Rome</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>EPYC-Milan</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>EPYC</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Dhyana</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Cooperlake</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Conroe</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Broadwell</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>486</model>
Nov 28 10:45:06 user nova-compute[74994]:     </mode>
Nov 28 10:45:06 user nova-compute[74994]:   </cpu>
Nov 28 10:45:06 user nova-compute[74994]:   <memoryBacking supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:     <enum name='sourceType'>
Nov 28 10:45:06 user nova-compute[74994]:       <value>file</value>
Nov 28 10:45:06 user nova-compute[74994]:       <value>anonymous</value>
Nov 28 10:45:06 user nova-compute[74994]:       <value>memfd</value>
Nov 28 10:45:06 user nova-compute[74994]:     </enum>
Nov 28 10:45:06 user nova-compute[74994]:   </memoryBacking>
Nov 28 10:45:06 user nova-compute[74994]:   <devices>
Nov 28 10:45:06 user nova-compute[74994]:     <disk supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='diskDevice'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>disk</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>cdrom</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>floppy</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>lun</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='bus'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>fdc</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>scsi</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>usb</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>sata</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='model'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio-transitional</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio-non-transitional</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </disk>
Nov 28 10:45:06 user nova-compute[74994]:     <graphics supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='type'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>sdl</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>vnc</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>spice</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>egl-headless</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </graphics>
Nov 28 10:45:06 user nova-compute[74994]:     <video supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='modelType'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>vga</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>cirrus</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>vmvga</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>qxl</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>none</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>bochs</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>ramfb</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </video>
Nov 28 10:45:06 user nova-compute[74994]:     <hostdev supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='mode'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>subsystem</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='startupPolicy'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>default</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>mandatory</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>requisite</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>optional</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='subsysType'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>usb</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>pci</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>scsi</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='capsType'/>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='pciBackend'/>
Nov 28 10:45:06 user nova-compute[74994]:     </hostdev>
Nov 28 10:45:06 user nova-compute[74994]:     <rng supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='model'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio-transitional</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio-non-transitional</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='backendModel'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>random</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>egd</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>builtin</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </rng>
Nov 28 10:45:06 user nova-compute[74994]:     <filesystem supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='driverType'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>path</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>handle</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtiofs</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </filesystem>
Nov 28 10:45:06 user nova-compute[74994]:     <tpm supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='model'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>tpm-tis</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>tpm-crb</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='backendModel'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>passthrough</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>emulator</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </tpm>
Nov 28 10:45:06 user nova-compute[74994]:   </devices>
Nov 28 10:45:06 user nova-compute[74994]:   <features>
Nov 28 10:45:06 user nova-compute[74994]:     <gic supported='no'/>
Nov 28 10:45:06 user nova-compute[74994]:     <vmcoreinfo supported='yes'/>
Nov 28 10:45:06 user nova-compute[74994]:     <genid supported='yes'/>
Nov 28 10:45:06 user nova-compute[74994]:     <backingStoreInput supported='yes'/>
Nov 28 10:45:06 user nova-compute[74994]:     <backup supported='yes'/>
Nov 28 10:45:06 user nova-compute[74994]:     <sev supported='no'/>
Nov 28 10:45:06 user nova-compute[74994]:   </features>
Nov 28 10:45:06 user nova-compute[74994]: </domainCapabilities>
Nov 28 10:45:06 user nova-compute[74994]:  {{(pid=74994) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 28 10:45:06 user nova-compute[74994]: <domainCapabilities>
Nov 28 10:45:06 user nova-compute[74994]:   <path>/usr/bin/qemu-system-i386</path>
Nov 28 10:45:06 user nova-compute[74994]:   <domain>kvm</domain>
Nov 28 10:45:06 user nova-compute[74994]:   <machine>pc-i440fx-6.2</machine>
Nov 28 10:45:06 user nova-compute[74994]:   <arch>i686</arch>
Nov 28 10:45:06 user nova-compute[74994]:   <vcpu max='255'/>
Nov 28 10:45:06 user nova-compute[74994]:   <iothreads supported='yes'/>
Nov 28 10:45:06 user nova-compute[74994]:   <os supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:     <enum name='firmware'/>
Nov 28 10:45:06 user nova-compute[74994]:     <loader supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 28 10:45:06 user nova-compute[74994]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 28 10:45:06 user nova-compute[74994]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 28 10:45:06 user nova-compute[74994]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 28 10:45:06 user nova-compute[74994]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='type'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>rom</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>pflash</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='readonly'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>yes</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>no</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='secure'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>no</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </loader>
Nov 28 10:45:06 user nova-compute[74994]:   </os>
Nov 28 10:45:06 user nova-compute[74994]:   <cpu>
Nov 28 10:45:06 user nova-compute[74994]:     <mode name='host-passthrough' supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='hostPassthroughMigratable'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>off</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </mode>
Nov 28 10:45:06 user nova-compute[74994]:     <mode name='maximum' supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='maximumMigratable'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>on</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>off</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </mode>
Nov 28 10:45:06 user nova-compute[74994]:     <mode name='host-model' supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <vendor>Intel</vendor>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='ss'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='vmx'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='pcid'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='hypervisor'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='arat'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='umip'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='md-clear'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='stibp'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='ssbd'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='ibpb'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='ibrs'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='amd-stibp'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='disable' name='erms'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='disable' name='lm'/>
Nov 28 10:45:06 user nova-compute[74994]:     </mode>
Nov 28 10:45:06 user nova-compute[74994]:     <mode name='custom' supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>qemu64</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>qemu32</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>phenom</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>pentium3</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>pentium2</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>pentium</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>n270</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>kvm64</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>kvm32</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>coreduo</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>core2duo</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>athlon</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Westmere-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Westmere</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Snowridge</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Skylake-Server</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Skylake-Client</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>SandyBridge</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Penryn</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Opteron_G5</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Opteron_G4</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Opteron_G3</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Opteron_G2</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Opteron_G1</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Nehalem-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Nehalem</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>IvyBridge</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Icelake-Server</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Haswell</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>EPYC-Rome</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>EPYC-Milan</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>EPYC</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Dhyana</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Cooperlake</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Conroe</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Broadwell</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>486</model>
Nov 28 10:45:06 user nova-compute[74994]:     </mode>
Nov 28 10:45:06 user nova-compute[74994]:   </cpu>
Nov 28 10:45:06 user nova-compute[74994]:   <memoryBacking supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:     <enum name='sourceType'>
Nov 28 10:45:06 user nova-compute[74994]:       <value>file</value>
Nov 28 10:45:06 user nova-compute[74994]:       <value>anonymous</value>
Nov 28 10:45:06 user nova-compute[74994]:       <value>memfd</value>
Nov 28 10:45:06 user nova-compute[74994]:     </enum>
Nov 28 10:45:06 user nova-compute[74994]:   </memoryBacking>
Nov 28 10:45:06 user nova-compute[74994]:   <devices>
Nov 28 10:45:06 user nova-compute[74994]:     <disk supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='diskDevice'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>disk</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>cdrom</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>floppy</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>lun</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='bus'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>ide</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>fdc</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>scsi</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>usb</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>sata</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='model'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio-transitional</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio-non-transitional</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </disk>
Nov 28 10:45:06 user nova-compute[74994]:     <graphics supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='type'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>sdl</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>vnc</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>spice</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>egl-headless</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </graphics>
Nov 28 10:45:06 user nova-compute[74994]:     <video supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='modelType'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>vga</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>cirrus</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>vmvga</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>qxl</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>none</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>bochs</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>ramfb</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </video>
Nov 28 10:45:06 user nova-compute[74994]:     <hostdev supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='mode'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>subsystem</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='startupPolicy'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>default</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>mandatory</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>requisite</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>optional</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='subsysType'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>usb</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>pci</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>scsi</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='capsType'/>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='pciBackend'/>
Nov 28 10:45:06 user nova-compute[74994]:     </hostdev>
Nov 28 10:45:06 user nova-compute[74994]:     <rng supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='model'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio-transitional</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio-non-transitional</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='backendModel'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>random</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>egd</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>builtin</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </rng>
Nov 28 10:45:06 user nova-compute[74994]:     <filesystem supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='driverType'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>path</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>handle</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtiofs</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </filesystem>
Nov 28 10:45:06 user nova-compute[74994]:     <tpm supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='model'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>tpm-tis</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>tpm-crb</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='backendModel'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>passthrough</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>emulator</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </tpm>
Nov 28 10:45:06 user nova-compute[74994]:   </devices>
Nov 28 10:45:06 user nova-compute[74994]:   <features>
Nov 28 10:45:06 user nova-compute[74994]:     <gic supported='no'/>
Nov 28 10:45:06 user nova-compute[74994]:     <vmcoreinfo supported='yes'/>
Nov 28 10:45:06 user nova-compute[74994]:     <genid supported='yes'/>
Nov 28 10:45:06 user nova-compute[74994]:     <backingStoreInput supported='yes'/>
Nov 28 10:45:06 user nova-compute[74994]:     <backup supported='yes'/>
Nov 28 10:45:06 user nova-compute[74994]:     <sev supported='no'/>
Nov 28 10:45:06 user nova-compute[74994]:   </features>
Nov 28 10:45:06 user nova-compute[74994]: </domainCapabilities>
Nov 28 10:45:06 user nova-compute[74994]:  {{(pid=74994) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=74994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=74994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'ubuntu', 'q35', 'pc'} {{(pid=74994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 28 10:45:06 user nova-compute[74994]: <domainCapabilities>
Nov 28 10:45:06 user nova-compute[74994]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 28 10:45:06 user nova-compute[74994]:   <domain>kvm</domain>
Nov 28 10:45:06 user nova-compute[74994]:   <machine>pc-q35-jammy</machine>
Nov 28 10:45:06 user nova-compute[74994]:   <arch>x86_64</arch>
Nov 28 10:45:06 user nova-compute[74994]:   <vcpu max='288'/>
Nov 28 10:45:06 user nova-compute[74994]:   <iothreads supported='yes'/>
Nov 28 10:45:06 user nova-compute[74994]:   <os supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:     <enum name='firmware'>
Nov 28 10:45:06 user nova-compute[74994]:       <value>efi</value>
Nov 28 10:45:06 user nova-compute[74994]:     </enum>
Nov 28 10:45:06 user nova-compute[74994]:     <loader supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 28 10:45:06 user nova-compute[74994]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 28 10:45:06 user nova-compute[74994]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='type'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>rom</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>pflash</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='readonly'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>yes</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>no</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='secure'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>yes</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>no</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </loader>
Nov 28 10:45:06 user nova-compute[74994]:   </os>
Nov 28 10:45:06 user nova-compute[74994]:   <cpu>
Nov 28 10:45:06 user nova-compute[74994]:     <mode name='host-passthrough' supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='hostPassthroughMigratable'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>on</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>off</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </mode>
Nov 28 10:45:06 user nova-compute[74994]:     <mode name='maximum' supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='maximumMigratable'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>on</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>off</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </mode>
Nov 28 10:45:06 user nova-compute[74994]:     <mode name='host-model' supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <vendor>Intel</vendor>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='ss'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='vmx'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='pcid'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='hypervisor'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='arat'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='umip'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='md-clear'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='stibp'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='ssbd'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='invtsc'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='ibpb'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='ibrs'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='amd-stibp'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='rsba'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='pschange-mc-no'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='disable' name='erms'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 10:45:06 user nova-compute[74994]:     </mode>
Nov 28 10:45:06 user nova-compute[74994]:     <mode name='custom' supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>qemu64</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>qemu32</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>phenom</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>pentium3</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>pentium2</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>pentium</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>n270</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>kvm64</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>kvm32</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>coreduo</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>core2duo</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>athlon</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>Westmere-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>Westmere</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Snowridge</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Skylake-Server</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Skylake-Client</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>SandyBridge</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>Penryn</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Opteron_G5</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Opteron_G4</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Opteron_G3</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Opteron_G2</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>Opteron_G1</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>Nehalem</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>IvyBridge</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Icelake-Server</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Haswell</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>EPYC-Rome</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>EPYC-Milan</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>EPYC</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Dhyana</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Cooperlake</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>Conroe</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Broadwell</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>486</model>
Nov 28 10:45:06 user nova-compute[74994]:     </mode>
Nov 28 10:45:06 user nova-compute[74994]:   </cpu>
Nov 28 10:45:06 user nova-compute[74994]:   <memoryBacking supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:     <enum name='sourceType'>
Nov 28 10:45:06 user nova-compute[74994]:       <value>file</value>
Nov 28 10:45:06 user nova-compute[74994]:       <value>anonymous</value>
Nov 28 10:45:06 user nova-compute[74994]:       <value>memfd</value>
Nov 28 10:45:06 user nova-compute[74994]:     </enum>
Nov 28 10:45:06 user nova-compute[74994]:   </memoryBacking>
Nov 28 10:45:06 user nova-compute[74994]:   <devices>
Nov 28 10:45:06 user nova-compute[74994]:     <disk supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='diskDevice'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>disk</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>cdrom</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>floppy</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>lun</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='bus'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>fdc</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>scsi</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>usb</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>sata</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='model'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio-transitional</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio-non-transitional</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </disk>
Nov 28 10:45:06 user nova-compute[74994]:     <graphics supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='type'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>sdl</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>vnc</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>spice</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>egl-headless</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </graphics>
Nov 28 10:45:06 user nova-compute[74994]:     <video supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='modelType'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>vga</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>cirrus</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>vmvga</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>qxl</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>none</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>bochs</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>ramfb</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </video>
Nov 28 10:45:06 user nova-compute[74994]:     <hostdev supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='mode'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>subsystem</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='startupPolicy'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>default</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>mandatory</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>requisite</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>optional</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='subsysType'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>usb</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>pci</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>scsi</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='capsType'/>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='pciBackend'/>
Nov 28 10:45:06 user nova-compute[74994]:     </hostdev>
Nov 28 10:45:06 user nova-compute[74994]:     <rng supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='model'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio-transitional</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio-non-transitional</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='backendModel'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>random</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>egd</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>builtin</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </rng>
Nov 28 10:45:06 user nova-compute[74994]:     <filesystem supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='driverType'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>path</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>handle</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtiofs</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </filesystem>
Nov 28 10:45:06 user nova-compute[74994]:     <tpm supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='model'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>tpm-tis</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>tpm-crb</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='backendModel'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>passthrough</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>emulator</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </tpm>
Nov 28 10:45:06 user nova-compute[74994]:   </devices>
Nov 28 10:45:06 user nova-compute[74994]:   <features>
Nov 28 10:45:06 user nova-compute[74994]:     <gic supported='no'/>
Nov 28 10:45:06 user nova-compute[74994]:     <vmcoreinfo supported='yes'/>
Nov 28 10:45:06 user nova-compute[74994]:     <genid supported='yes'/>
Nov 28 10:45:06 user nova-compute[74994]:     <backingStoreInput supported='yes'/>
Nov 28 10:45:06 user nova-compute[74994]:     <backup supported='yes'/>
Nov 28 10:45:06 user nova-compute[74994]:     <sev supported='no'/>
Nov 28 10:45:06 user nova-compute[74994]:   </features>
Nov 28 10:45:06 user nova-compute[74994]: </domainCapabilities>
Nov 28 10:45:06 user nova-compute[74994]:  {{(pid=74994) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 28 10:45:06 user nova-compute[74994]: <domainCapabilities>
Nov 28 10:45:06 user nova-compute[74994]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 28 10:45:06 user nova-compute[74994]:   <domain>kvm</domain>
Nov 28 10:45:06 user nova-compute[74994]:   <machine>pc-i440fx-jammy</machine>
Nov 28 10:45:06 user nova-compute[74994]:   <arch>x86_64</arch>
Nov 28 10:45:06 user nova-compute[74994]:   <vcpu max='255'/>
Nov 28 10:45:06 user nova-compute[74994]:   <iothreads supported='yes'/>
Nov 28 10:45:06 user nova-compute[74994]:   <os supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:     <enum name='firmware'>
Nov 28 10:45:06 user nova-compute[74994]:       <value>efi</value>
Nov 28 10:45:06 user nova-compute[74994]:     </enum>
Nov 28 10:45:06 user nova-compute[74994]:     <loader supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='type'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>rom</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>pflash</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='readonly'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>yes</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>no</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='secure'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>no</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </loader>
Nov 28 10:45:06 user nova-compute[74994]:   </os>
Nov 28 10:45:06 user nova-compute[74994]:   <cpu>
Nov 28 10:45:06 user nova-compute[74994]:     <mode name='host-passthrough' supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='hostPassthroughMigratable'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>on</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>off</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </mode>
Nov 28 10:45:06 user nova-compute[74994]:     <mode name='maximum' supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='maximumMigratable'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>on</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>off</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </mode>
Nov 28 10:45:06 user nova-compute[74994]:     <mode name='host-model' supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <vendor>Intel</vendor>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='ss'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='vmx'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='pcid'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='hypervisor'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='arat'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='umip'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='md-clear'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='stibp'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='ssbd'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='invtsc'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='ibpb'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='ibrs'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='amd-stibp'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='rsba'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='pschange-mc-no'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='disable' name='erms'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 10:45:06 user nova-compute[74994]:     </mode>
Nov 28 10:45:06 user nova-compute[74994]:     <mode name='custom' supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>qemu64</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>qemu32</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>phenom</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>pentium3</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>pentium2</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>pentium</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>n270</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>kvm64</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>kvm32</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>coreduo</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>core2duo</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>athlon</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>Westmere-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>Westmere</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Snowridge</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Skylake-Server</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Skylake-Client</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>SandyBridge</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>Penryn</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Opteron_G5</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Opteron_G4</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Opteron_G3</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Opteron_G2</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>Opteron_G1</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>Nehalem</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>IvyBridge</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Icelake-Server</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Haswell</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>EPYC-Rome</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>EPYC-Milan</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>EPYC</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Dhyana</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Cooperlake</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>Conroe</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Broadwell</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>486</model>
Nov 28 10:45:06 user nova-compute[74994]:     </mode>
Nov 28 10:45:06 user nova-compute[74994]:   </cpu>
Nov 28 10:45:06 user nova-compute[74994]:   <memoryBacking supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:     <enum name='sourceType'>
Nov 28 10:45:06 user nova-compute[74994]:       <value>file</value>
Nov 28 10:45:06 user nova-compute[74994]:       <value>anonymous</value>
Nov 28 10:45:06 user nova-compute[74994]:       <value>memfd</value>
Nov 28 10:45:06 user nova-compute[74994]:     </enum>
Nov 28 10:45:06 user nova-compute[74994]:   </memoryBacking>
Nov 28 10:45:06 user nova-compute[74994]:   <devices>
Nov 28 10:45:06 user nova-compute[74994]:     <disk supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='diskDevice'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>disk</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>cdrom</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>floppy</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>lun</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='bus'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>ide</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>fdc</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>scsi</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>usb</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>sata</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='model'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio-transitional</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio-non-transitional</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </disk>
Nov 28 10:45:06 user nova-compute[74994]:     <graphics supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='type'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>sdl</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>vnc</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>spice</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>egl-headless</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </graphics>
Nov 28 10:45:06 user nova-compute[74994]:     <video supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='modelType'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>vga</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>cirrus</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>vmvga</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>qxl</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>none</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>bochs</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>ramfb</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </video>
Nov 28 10:45:06 user nova-compute[74994]:     <hostdev supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='mode'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>subsystem</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='startupPolicy'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>default</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>mandatory</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>requisite</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>optional</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='subsysType'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>usb</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>pci</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>scsi</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='capsType'/>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='pciBackend'/>
Nov 28 10:45:06 user nova-compute[74994]:     </hostdev>
Nov 28 10:45:06 user nova-compute[74994]:     <rng supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='model'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio-transitional</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio-non-transitional</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='backendModel'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>random</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>egd</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>builtin</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </rng>
Nov 28 10:45:06 user nova-compute[74994]:     <filesystem supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='driverType'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>path</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>handle</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtiofs</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </filesystem>
Nov 28 10:45:06 user nova-compute[74994]:     <tpm supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='model'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>tpm-tis</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>tpm-crb</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='backendModel'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>passthrough</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>emulator</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </tpm>
Nov 28 10:45:06 user nova-compute[74994]:   </devices>
Nov 28 10:45:06 user nova-compute[74994]:   <features>
Nov 28 10:45:06 user nova-compute[74994]:     <gic supported='no'/>
Nov 28 10:45:06 user nova-compute[74994]:     <vmcoreinfo supported='yes'/>
Nov 28 10:45:06 user nova-compute[74994]:     <genid supported='yes'/>
Nov 28 10:45:06 user nova-compute[74994]:     <backingStoreInput supported='yes'/>
Nov 28 10:45:06 user nova-compute[74994]:     <backup supported='yes'/>
Nov 28 10:45:06 user nova-compute[74994]:     <sev supported='no'/>
Nov 28 10:45:06 user nova-compute[74994]:   </features>
Nov 28 10:45:06 user nova-compute[74994]: </domainCapabilities>
Nov 28 10:45:06 user nova-compute[74994]:  {{(pid=74994) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 28 10:45:06 user nova-compute[74994]: <domainCapabilities>
Nov 28 10:45:06 user nova-compute[74994]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 28 10:45:06 user nova-compute[74994]:   <domain>kvm</domain>
Nov 28 10:45:06 user nova-compute[74994]:   <machine>pc-q35-6.2</machine>
Nov 28 10:45:06 user nova-compute[74994]:   <arch>x86_64</arch>
Nov 28 10:45:06 user nova-compute[74994]:   <vcpu max='288'/>
Nov 28 10:45:06 user nova-compute[74994]:   <iothreads supported='yes'/>
Nov 28 10:45:06 user nova-compute[74994]:   <os supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:     <enum name='firmware'>
Nov 28 10:45:06 user nova-compute[74994]:       <value>efi</value>
Nov 28 10:45:06 user nova-compute[74994]:     </enum>
Nov 28 10:45:06 user nova-compute[74994]:     <loader supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 28 10:45:06 user nova-compute[74994]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 28 10:45:06 user nova-compute[74994]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='type'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>rom</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>pflash</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='readonly'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>yes</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>no</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='secure'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>yes</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>no</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </loader>
Nov 28 10:45:06 user nova-compute[74994]:   </os>
Nov 28 10:45:06 user nova-compute[74994]:   <cpu>
Nov 28 10:45:06 user nova-compute[74994]:     <mode name='host-passthrough' supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='hostPassthroughMigratable'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>on</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>off</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </mode>
Nov 28 10:45:06 user nova-compute[74994]:     <mode name='maximum' supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='maximumMigratable'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>on</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>off</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </mode>
Nov 28 10:45:06 user nova-compute[74994]:     <mode name='host-model' supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <vendor>Intel</vendor>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='ss'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='vmx'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='pcid'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='hypervisor'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='arat'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='umip'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='md-clear'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='stibp'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='ssbd'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='invtsc'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='ibpb'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='ibrs'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='amd-stibp'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='rsba'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='pschange-mc-no'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='disable' name='erms'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 10:45:06 user nova-compute[74994]:     </mode>
Nov 28 10:45:06 user nova-compute[74994]:     <mode name='custom' supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>qemu64</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>qemu32</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>phenom</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>pentium3</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>pentium2</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>pentium</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>n270</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>kvm64</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>kvm32</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>coreduo</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>core2duo</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>athlon</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>Westmere-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>Westmere</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Snowridge</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Skylake-Server</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Skylake-Client</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>SandyBridge</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>Penryn</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Opteron_G5</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Opteron_G4</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Opteron_G3</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Opteron_G2</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>Opteron_G1</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>Nehalem</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>IvyBridge</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Icelake-Server</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Haswell</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>EPYC-Rome</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>EPYC-Milan</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>EPYC</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Dhyana</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Cooperlake</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>Conroe</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Broadwell</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>486</model>
Nov 28 10:45:06 user nova-compute[74994]:     </mode>
Nov 28 10:45:06 user nova-compute[74994]:   </cpu>
Nov 28 10:45:06 user nova-compute[74994]:   <memoryBacking supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:     <enum name='sourceType'>
Nov 28 10:45:06 user nova-compute[74994]:       <value>file</value>
Nov 28 10:45:06 user nova-compute[74994]:       <value>anonymous</value>
Nov 28 10:45:06 user nova-compute[74994]:       <value>memfd</value>
Nov 28 10:45:06 user nova-compute[74994]:     </enum>
Nov 28 10:45:06 user nova-compute[74994]:   </memoryBacking>
Nov 28 10:45:06 user nova-compute[74994]:   <devices>
Nov 28 10:45:06 user nova-compute[74994]:     <disk supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='diskDevice'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>disk</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>cdrom</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>floppy</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>lun</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='bus'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>fdc</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>scsi</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>usb</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>sata</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='model'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio-transitional</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio-non-transitional</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </disk>
Nov 28 10:45:06 user nova-compute[74994]:     <graphics supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='type'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>sdl</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>vnc</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>spice</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>egl-headless</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </graphics>
Nov 28 10:45:06 user nova-compute[74994]:     <video supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='modelType'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>vga</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>cirrus</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>vmvga</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>qxl</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>none</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>bochs</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>ramfb</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </video>
Nov 28 10:45:06 user nova-compute[74994]:     <hostdev supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='mode'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>subsystem</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='startupPolicy'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>default</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>mandatory</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>requisite</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>optional</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='subsysType'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>usb</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>pci</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>scsi</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='capsType'/>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='pciBackend'/>
Nov 28 10:45:06 user nova-compute[74994]:     </hostdev>
Nov 28 10:45:06 user nova-compute[74994]:     <rng supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='model'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio-transitional</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio-non-transitional</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='backendModel'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>random</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>egd</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>builtin</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </rng>
Nov 28 10:45:06 user nova-compute[74994]:     <filesystem supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='driverType'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>path</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>handle</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtiofs</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </filesystem>
Nov 28 10:45:06 user nova-compute[74994]:     <tpm supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='model'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>tpm-tis</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>tpm-crb</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='backendModel'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>passthrough</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>emulator</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </tpm>
Nov 28 10:45:06 user nova-compute[74994]:   </devices>
Nov 28 10:45:06 user nova-compute[74994]:   <features>
Nov 28 10:45:06 user nova-compute[74994]:     <gic supported='no'/>
Nov 28 10:45:06 user nova-compute[74994]:     <vmcoreinfo supported='yes'/>
Nov 28 10:45:06 user nova-compute[74994]:     <genid supported='yes'/>
Nov 28 10:45:06 user nova-compute[74994]:     <backingStoreInput supported='yes'/>
Nov 28 10:45:06 user nova-compute[74994]:     <backup supported='yes'/>
Nov 28 10:45:06 user nova-compute[74994]:     <sev supported='no'/>
Nov 28 10:45:06 user nova-compute[74994]:   </features>
Nov 28 10:45:06 user nova-compute[74994]: </domainCapabilities>
Nov 28 10:45:06 user nova-compute[74994]:  {{(pid=74994) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 28 10:45:06 user nova-compute[74994]: <domainCapabilities>
Nov 28 10:45:06 user nova-compute[74994]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 28 10:45:06 user nova-compute[74994]:   <domain>kvm</domain>
Nov 28 10:45:06 user nova-compute[74994]:   <machine>pc-i440fx-6.2</machine>
Nov 28 10:45:06 user nova-compute[74994]:   <arch>x86_64</arch>
Nov 28 10:45:06 user nova-compute[74994]:   <vcpu max='255'/>
Nov 28 10:45:06 user nova-compute[74994]:   <iothreads supported='yes'/>
Nov 28 10:45:06 user nova-compute[74994]:   <os supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:     <enum name='firmware'>
Nov 28 10:45:06 user nova-compute[74994]:       <value>efi</value>
Nov 28 10:45:06 user nova-compute[74994]:     </enum>
Nov 28 10:45:06 user nova-compute[74994]:     <loader supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='type'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>rom</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>pflash</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='readonly'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>yes</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>no</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='secure'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>no</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </loader>
Nov 28 10:45:06 user nova-compute[74994]:   </os>
Nov 28 10:45:06 user nova-compute[74994]:   <cpu>
Nov 28 10:45:06 user nova-compute[74994]:     <mode name='host-passthrough' supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='hostPassthroughMigratable'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>on</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>off</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </mode>
Nov 28 10:45:06 user nova-compute[74994]:     <mode name='maximum' supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='maximumMigratable'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>on</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>off</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </mode>
Nov 28 10:45:06 user nova-compute[74994]:     <mode name='host-model' supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <vendor>Intel</vendor>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='ss'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='vmx'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='pcid'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='hypervisor'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='arat'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='umip'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='md-clear'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='stibp'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='ssbd'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='invtsc'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='ibpb'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='ibrs'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='amd-stibp'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='rsba'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='require' name='pschange-mc-no'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='disable' name='erms'/>
Nov 28 10:45:06 user nova-compute[74994]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 10:45:06 user nova-compute[74994]:     </mode>
Nov 28 10:45:06 user nova-compute[74994]:     <mode name='custom' supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>qemu64</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>qemu32</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>phenom</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>pentium3</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>pentium2</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>pentium</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>n270</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>kvm64</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>kvm32</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>coreduo</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>core2duo</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>athlon</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>Westmere-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>Westmere</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Snowridge</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Skylake-Server</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Skylake-Client</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>SandyBridge</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>Penryn</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Opteron_G5</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Opteron_G4</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Opteron_G3</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Opteron_G2</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>Opteron_G1</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>Nehalem</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>IvyBridge</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Icelake-Server</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Haswell</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>EPYC-Rome</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>EPYC-Milan</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>EPYC</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Dhyana</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Cooperlake</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>Conroe</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='no'>Broadwell</model>
Nov 28 10:45:06 user nova-compute[74994]:       <model usable='yes'>486</model>
Nov 28 10:45:06 user nova-compute[74994]:     </mode>
Nov 28 10:45:06 user nova-compute[74994]:   </cpu>
Nov 28 10:45:06 user nova-compute[74994]:   <memoryBacking supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:     <enum name='sourceType'>
Nov 28 10:45:06 user nova-compute[74994]:       <value>file</value>
Nov 28 10:45:06 user nova-compute[74994]:       <value>anonymous</value>
Nov 28 10:45:06 user nova-compute[74994]:       <value>memfd</value>
Nov 28 10:45:06 user nova-compute[74994]:     </enum>
Nov 28 10:45:06 user nova-compute[74994]:   </memoryBacking>
Nov 28 10:45:06 user nova-compute[74994]:   <devices>
Nov 28 10:45:06 user nova-compute[74994]:     <disk supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='diskDevice'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>disk</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>cdrom</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>floppy</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>lun</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='bus'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>ide</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>fdc</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>scsi</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>usb</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>sata</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='model'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio-transitional</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio-non-transitional</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </disk>
Nov 28 10:45:06 user nova-compute[74994]:     <graphics supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='type'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>sdl</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>vnc</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>spice</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>egl-headless</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </graphics>
Nov 28 10:45:06 user nova-compute[74994]:     <video supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='modelType'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>vga</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>cirrus</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>vmvga</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>qxl</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>none</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>bochs</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>ramfb</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </video>
Nov 28 10:45:06 user nova-compute[74994]:     <hostdev supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='mode'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>subsystem</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='startupPolicy'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>default</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>mandatory</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>requisite</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>optional</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='subsysType'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>usb</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>pci</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>scsi</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='capsType'/>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='pciBackend'/>
Nov 28 10:45:06 user nova-compute[74994]:     </hostdev>
Nov 28 10:45:06 user nova-compute[74994]:     <rng supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='model'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio-transitional</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtio-non-transitional</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='backendModel'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>random</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>egd</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>builtin</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </rng>
Nov 28 10:45:06 user nova-compute[74994]:     <filesystem supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='driverType'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>path</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>handle</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>virtiofs</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </filesystem>
Nov 28 10:45:06 user nova-compute[74994]:     <tpm supported='yes'>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='model'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>tpm-tis</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>tpm-crb</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:       <enum name='backendModel'>
Nov 28 10:45:06 user nova-compute[74994]:         <value>passthrough</value>
Nov 28 10:45:06 user nova-compute[74994]:         <value>emulator</value>
Nov 28 10:45:06 user nova-compute[74994]:       </enum>
Nov 28 10:45:06 user nova-compute[74994]:     </tpm>
Nov 28 10:45:06 user nova-compute[74994]:   </devices>
Nov 28 10:45:06 user nova-compute[74994]:   <features>
Nov 28 10:45:06 user nova-compute[74994]:     <gic supported='no'/>
Nov 28 10:45:06 user nova-compute[74994]:     <vmcoreinfo supported='yes'/>
Nov 28 10:45:06 user nova-compute[74994]:     <genid supported='yes'/>
Nov 28 10:45:06 user nova-compute[74994]:     <backingStoreInput supported='yes'/>
Nov 28 10:45:06 user nova-compute[74994]:     <backup supported='yes'/>
Nov 28 10:45:06 user nova-compute[74994]:     <sev supported='no'/>
Nov 28 10:45:06 user nova-compute[74994]:   </features>
Nov 28 10:45:06 user nova-compute[74994]: </domainCapabilities>
Nov 28 10:45:06 user nova-compute[74994]:  {{(pid=74994) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74994) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74994) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Checking secure boot support for host arch (x86_64) {{(pid=74994) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 28 10:45:06 user nova-compute[74994]: INFO nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Secure Boot support detected
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] cpu compare xml: <cpu match="exact">
Nov 28 10:45:06 user nova-compute[74994]:   <model>Nehalem</model>
Nov 28 10:45:06 user nova-compute[74994]: </cpu>
Nov 28 10:45:06 user nova-compute[74994]:  {{(pid=74994) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10020}}
Nov 28 10:45:06 user nova-compute[74994]: INFO nova.virt.node [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Generated node identity fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a
Nov 28 10:45:06 user nova-compute[74994]: INFO nova.virt.node [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Wrote node identity fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a to /opt/stack/data/nova/compute_id
Nov 28 10:45:06 user nova-compute[74994]: WARNING nova.compute.manager [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Compute nodes ['fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 28 10:45:06 user nova-compute[74994]: INFO nova.compute.manager [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 28 10:45:06 user nova-compute[74994]: WARNING nova.compute.manager [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 28 10:45:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 10:45:06 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:45:06 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Hypervisor/Node resource view: name=user free_ram=11018MB free_disk=26.134422302246094GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:45:06 user nova-compute[74994]: WARNING nova.compute.resource_tracker [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] No compute node record for user:fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a could not be found.
Nov 28 10:45:06 user nova-compute[74994]: INFO nova.compute.resource_tracker [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Compute node record created for user:user with uuid: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 10:45:06 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] [req-694d8e80-0802-43d3-be63-2a6b493292cb] Created resource provider record via placement API for resource provider with UUID fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a and name user.
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74994) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1797}}
Nov 28 10:45:06 user nova-compute[74994]: INFO nova.virt.libvirt.host [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] kernel doesn't support AMD SEV
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Updating inventory in ProviderTree for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 10:45:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Libvirt baseline CPU <cpu>
Nov 28 10:45:06 user nova-compute[74994]:   <arch>x86_64</arch>
Nov 28 10:45:06 user nova-compute[74994]:   <model>Nehalem</model>
Nov 28 10:45:06 user nova-compute[74994]:   <vendor>Intel</vendor>
Nov 28 10:45:06 user nova-compute[74994]:   <topology sockets="6" cores="1" threads="1"/>
Nov 28 10:45:06 user nova-compute[74994]: </cpu>
Nov 28 10:45:06 user nova-compute[74994]:  {{(pid=74994) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12510}}
Nov 28 10:45:07 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Updated inventory for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 28 10:45:07 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Updating resource provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a generation from 0 to 1 during operation: update_inventory {{(pid=74994) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 28 10:45:07 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Updating inventory in ProviderTree for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 10:45:07 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Updating resource provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a generation from 1 to 2 during operation: update_traits {{(pid=74994) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 28 10:45:07 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 10:45:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.633s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:45:07 user nova-compute[74994]: DEBUG nova.service [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Creating RPC server for service compute {{(pid=74994) start /opt/stack/nova/nova/service.py:182}}
Nov 28 10:45:07 user nova-compute[74994]: DEBUG nova.service [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] Join ServiceGroup membership for this service compute {{(pid=74994) start /opt/stack/nova/nova/service.py:199}}
Nov 28 10:45:07 user nova-compute[74994]: DEBUG nova.servicegroup.drivers.db [None req-b79d420c-2797-4d4b-a8ca-e8cc9e894298 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74994) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 28 10:45:26 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:45:26 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:45:58 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:45:58 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:45:58 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 10:45:58 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Rebuilding the list of instances to heal {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 10:45:58 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Didn't find any instances for network info cache update. {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 10:45:58 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:45:58 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:45:58 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:45:58 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:45:58 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:45:58 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:45:58 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 10:45:58 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:45:58 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:45:58 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:45:58 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:45:58 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 10:45:58 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:45:58 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:45:58 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=10445MB free_disk=26.038047790527344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 10:45:58 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:45:58 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:45:58 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 10:45:58 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 10:45:58 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:45:58 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:45:58 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 10:45:58 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:46:58 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:46:58 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:46:59 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:46:59 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:46:59 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:46:59 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 10:46:59 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:46:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:46:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:46:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:46:59 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 10:46:59 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:46:59 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:46:59 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=10370MB free_disk=26.102649688720703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 10:46:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:46:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:46:59 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 10:46:59 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 10:46:59 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:46:59 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:46:59 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 10:46:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.182s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:47:00 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:47:00 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 10:47:00 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Rebuilding the list of instances to heal {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 10:47:00 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Didn't find any instances for network info cache update. {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 10:47:00 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:47:00 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:47:00 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:47:59 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:47:59 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:48:00 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:48:00 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:48:00 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:48:00 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:48:00 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:48:00 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 10:48:00 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:48:00 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:48:00 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=10404MB free_disk=25.854808807373047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 10:48:00 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:48:00 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:48:00 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 10:48:00 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 10:48:00 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:48:00 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:48:00 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 10:48:00 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.269s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:48:01 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:48:01 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 10:48:02 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:48:02 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 10:48:02 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Rebuilding the list of instances to heal {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 10:48:02 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Didn't find any instances for network info cache update. {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 10:48:02 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:48:02 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:48:02 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:48:59 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:49:01 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:49:01 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:49:01 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:49:01 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:49:01 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 10:49:01 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:49:01 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:01 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:01 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:01 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 10:49:01 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:49:01 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:49:01 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=9648MB free_disk=25.87527847290039GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 10:49:01 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:01 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:01 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 10:49:01 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 10:49:01 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:49:01 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:49:01 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 10:49:01 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.113s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:02 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:49:02 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 10:49:02 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Rebuilding the list of instances to heal {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 10:49:02 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Didn't find any instances for network info cache update. {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 10:49:02 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:49:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:03 user nova-compute[74994]: DEBUG nova.compute.manager [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 10:49:03 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:49:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:03 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 10:49:03 user nova-compute[74994]: INFO nova.compute.claims [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Claim successful on node user
Nov 28 10:49:03 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:49:03 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:49:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.352s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:03 user nova-compute[74994]: DEBUG nova.compute.manager [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 10:49:04 user nova-compute[74994]: DEBUG nova.compute.manager [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 10:49:04 user nova-compute[74994]: DEBUG nova.network.neutron [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 10:49:04 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 10:49:04 user nova-compute[74994]: DEBUG nova.compute.manager [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 10:49:04 user nova-compute[74994]: DEBUG nova.compute.manager [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 10:49:04 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 10:49:04 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Creating image(s)
Nov 28 10:49:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "/opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "/opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "/opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.003s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:04 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:49:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188.part --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:05 user nova-compute[74994]: DEBUG nova.policy [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c49cba00cff4c4b80080c5f917b4176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612ae9ec21ad40a4b68e0926843874ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 10:49:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Acquiring lock "a8b4b5dc-0696-4a01-8318-7d3ec2014d6e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Lock "a8b4b5dc-0696-4a01-8318-7d3ec2014d6e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:05 user nova-compute[74994]: DEBUG nova.compute.manager [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 10:49:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188.part --force-share --output=json" returned: 0 in 0.205s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:05 user nova-compute[74994]: DEBUG nova.virt.images [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] aa939d1b-b8a6-4391-935b-0191bf5ccd0a was qcow2, converting to raw {{(pid=74994) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 10:49:05 user nova-compute[74994]: DEBUG nova.privsep.utils [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74994) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 10:49:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188.part /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188.converted {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:05 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 10:49:05 user nova-compute[74994]: INFO nova.compute.claims [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Claim successful on node user
Nov 28 10:49:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188.part /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188.converted" returned: 0 in 0.392s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188.converted --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:05 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:49:05 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:49:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188.converted --force-share --output=json" returned: 0 in 0.189s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.494s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:05 user nova-compute[74994]: INFO oslo.privsep.daemon [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpnq5xtncf/privsep.sock']
Nov 28 10:49:05 user sudo[84308]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpnq5xtncf/privsep.sock
Nov 28 10:49:05 user sudo[84308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 28 10:49:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.529s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:05 user nova-compute[74994]: DEBUG nova.compute.manager [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 10:49:05 user nova-compute[74994]: DEBUG nova.compute.manager [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 10:49:05 user nova-compute[74994]: DEBUG nova.network.neutron [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 10:49:05 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 10:49:05 user nova-compute[74994]: DEBUG nova.compute.manager [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 10:49:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquiring lock "bf357856-2d97-42e8-928d-71d0378f48c8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "bf357856-2d97-42e8-928d-71d0378f48c8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:06 user nova-compute[74994]: DEBUG nova.compute.manager [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 10:49:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquiring lock "279e1c4c-36f9-492f-ab3f-1b587347eadd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "279e1c4c-36f9-492f-ab3f-1b587347eadd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:06 user nova-compute[74994]: DEBUG nova.compute.manager [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 10:49:06 user nova-compute[74994]: DEBUG nova.compute.manager [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 10:49:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 10:49:06 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Creating image(s)
Nov 28 10:49:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Acquiring lock "/opt/stack/data/nova/instances/a8b4b5dc-0696-4a01-8318-7d3ec2014d6e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Lock "/opt/stack/data/nova/instances/a8b4b5dc-0696-4a01-8318-7d3ec2014d6e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Lock "/opt/stack/data/nova/instances/a8b4b5dc-0696-4a01-8318-7d3ec2014d6e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:06 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 10:49:06 user nova-compute[74994]: INFO nova.compute.claims [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Claim successful on node user
Nov 28 10:49:06 user nova-compute[74994]: DEBUG nova.policy [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cbb3e2a69e66423e8bfe8f60d1cfa3e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00249c339d324b7990aac48ea640d770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 10:49:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:06 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:49:06 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:49:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.375s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:06 user nova-compute[74994]: DEBUG nova.compute.manager [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 10:49:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.328s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:06 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 10:49:06 user nova-compute[74994]: INFO nova.compute.claims [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Claim successful on node user
Nov 28 10:49:06 user nova-compute[74994]: DEBUG nova.compute.manager [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 10:49:06 user nova-compute[74994]: DEBUG nova.network.neutron [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 10:49:06 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 10:49:06 user nova-compute[74994]: DEBUG nova.compute.manager [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 10:49:07 user nova-compute[74994]: DEBUG nova.compute.manager [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 10:49:07 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 10:49:07 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Creating image(s)
Nov 28 10:49:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquiring lock "/opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "/opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "/opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:07 user nova-compute[74994]: DEBUG nova.network.neutron [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Successfully created port: 6b1a991d-033b-45ab-839c-7b6b98082667 {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 10:49:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Acquiring lock "5b51d690-8198-4748-807d-1902e75564b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Lock "5b51d690-8198-4748-807d-1902e75564b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:07 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:49:07 user nova-compute[74994]: DEBUG nova.compute.manager [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 10:49:07 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:49:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.582s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:07 user nova-compute[74994]: DEBUG nova.compute.manager [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 10:49:07 user nova-compute[74994]: DEBUG nova.policy [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6b5c1a1f2efc4a2faf8b82d467681d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77126f6f39db4a628b74551ea7d0aa21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 10:49:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:07 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 10:49:07 user nova-compute[74994]: INFO nova.compute.claims [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Claim successful on node user
Nov 28 10:49:07 user sudo[84308]: pam_unix(sudo:session): session closed for user root
Nov 28 10:49:07 user nova-compute[74994]: DEBUG nova.compute.manager [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 10:49:07 user nova-compute[74994]: DEBUG nova.network.neutron [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 10:49:07 user nova-compute[74994]: INFO oslo.privsep.daemon [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Spawned new privsep daemon via rootwrap
Nov 28 10:49:07 user nova-compute[74994]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 28 10:49:07 user nova-compute[74994]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 28 10:49:07 user nova-compute[74994]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 28 10:49:07 user nova-compute[74994]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84318
Nov 28 10:49:07 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 10:49:07 user nova-compute[74994]: WARNING oslo_privsep.priv_context [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] privsep daemon already running
Nov 28 10:49:07 user nova-compute[74994]: WARNING oslo_privsep.priv_context [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] privsep daemon already running
Nov 28 10:49:07 user nova-compute[74994]: DEBUG nova.compute.manager [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 10:49:07 user nova-compute[74994]: DEBUG nova.compute.manager [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 10:49:07 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 10:49:07 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Creating image(s)
Nov 28 10:49:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquiring lock "/opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "/opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "/opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.163s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Acquiring lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:07 user nova-compute[74994]: DEBUG nova.policy [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6b5c1a1f2efc4a2faf8b82d467681d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77126f6f39db4a628b74551ea7d0aa21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 10:49:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.208s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:07 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:49:07 user nova-compute[74994]: DEBUG nova.network.neutron [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Successfully created port: 2f85c58c-a67a-435e-95bd-ae59a03c7a14 {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 10:49:07 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:49:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.229s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.265s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquiring lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquiring lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.181s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/a8b4b5dc-0696-4a01-8318-7d3ec2014d6e/disk 1073741824 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.632s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:07 user nova-compute[74994]: DEBUG nova.compute.manager [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 10:49:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/a8b4b5dc-0696-4a01-8318-7d3ec2014d6e/disk 1073741824" returned: 0 in 0.055s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.210s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG nova.compute.manager [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG nova.network.neutron [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: 5b51d690-8198-4748-807d-1902e75564b9] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 10:49:08 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 10:49:08 user nova-compute[74994]: DEBUG nova.compute.manager [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.227s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a8b4b5dc-0696-4a01-8318-7d3ec2014d6e/disk. size=1073741824 {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b4b5dc-0696-4a01-8318-7d3ec2014d6e/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.221s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk 1073741824 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk 1073741824" returned: 0 in 0.046s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.431s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b4b5dc-0696-4a01-8318-7d3ec2014d6e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Cannot resize image /opt/stack/data/nova/instances/a8b4b5dc-0696-4a01-8318-7d3ec2014d6e/disk to a smaller size. {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Created local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Ensure instance console log exists: /opt/stack/data/nova/instances/a8b4b5dc-0696-4a01-8318-7d3ec2014d6e/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG nova.compute.manager [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 10:49:08 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Creating image(s)
Nov 28 10:49:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Acquiring lock "/opt/stack/data/nova/instances/5b51d690-8198-4748-807d-1902e75564b9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Lock "/opt/stack/data/nova/instances/5b51d690-8198-4748-807d-1902e75564b9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Lock "/opt/stack/data/nova/instances/5b51d690-8198-4748-807d-1902e75564b9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG nova.policy [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3c29f1c4e20e4bfd80b1d565b58330aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c23e61575784c8baffda1deda7812fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.192s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Checking if we can resize image /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk. size=1073741824 {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.197s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk 1073741824 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk 1073741824" returned: 0 in 0.044s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.716s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.205s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Acquiring lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Cannot resize image /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk to a smaller size. {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Created local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Ensure instance console log exists: /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.199s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Checking if we can resize image /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk. size=1073741824 {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.203s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk 1073741824 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk 1073741824" returned: 0 in 0.049s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.241s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Cannot resize image /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk to a smaller size. {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Created local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Ensure instance console log exists: /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.180s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:09 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk. size=1073741824 {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 10:49:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.186s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/5b51d690-8198-4748-807d-1902e75564b9/disk 1073741824 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/5b51d690-8198-4748-807d-1902e75564b9/disk 1073741824" returned: 0 in 0.064s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:09 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Cannot resize image /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk to a smaller size. {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 10:49:09 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Created local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 10:49:09 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Ensure instance console log exists: /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 10:49:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:09 user nova-compute[74994]: DEBUG nova.network.neutron [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Successfully created port: aeaddf62-0ca1-40d1-9228-897ee0015d4a {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 10:49:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.204s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:09 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5b51d690-8198-4748-807d-1902e75564b9/disk. size=1073741824 {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 10:49:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b51d690-8198-4748-807d-1902e75564b9/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b51d690-8198-4748-807d-1902e75564b9/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:09 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Cannot resize image /opt/stack/data/nova/instances/5b51d690-8198-4748-807d-1902e75564b9/disk to a smaller size. {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 10:49:09 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Created local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 10:49:09 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Ensure instance console log exists: /opt/stack/data/nova/instances/5b51d690-8198-4748-807d-1902e75564b9/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 10:49:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:09 user nova-compute[74994]: DEBUG nova.network.neutron [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Successfully updated port: 6b1a991d-033b-45ab-839c-7b6b98082667 {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 10:49:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "refresh_cache-76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:49:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquired lock "refresh_cache-76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:49:09 user nova-compute[74994]: DEBUG nova.network.neutron [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 10:49:09 user nova-compute[74994]: DEBUG nova.network.neutron [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 10:49:09 user nova-compute[74994]: DEBUG nova.network.neutron [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Successfully created port: 6a884296-8f6f-4647-b4c6-09d7f4e92887 {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 10:49:10 user nova-compute[74994]: DEBUG nova.compute.manager [req-19f5f218-50a3-4c7b-a07b-ae8d0306f962 req-4230eb48-189f-4477-aca0-0095fbd25cee service nova] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Received event network-changed-6b1a991d-033b-45ab-839c-7b6b98082667 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:49:10 user nova-compute[74994]: DEBUG nova.compute.manager [req-19f5f218-50a3-4c7b-a07b-ae8d0306f962 req-4230eb48-189f-4477-aca0-0095fbd25cee service nova] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Refreshing instance network info cache due to event network-changed-6b1a991d-033b-45ab-839c-7b6b98082667. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:49:10 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-19f5f218-50a3-4c7b-a07b-ae8d0306f962 req-4230eb48-189f-4477-aca0-0095fbd25cee service nova] Acquiring lock "refresh_cache-76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG nova.network.neutron [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Successfully updated port: aeaddf62-0ca1-40d1-9228-897ee0015d4a {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG nova.network.neutron [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Successfully created port: df20cfaa-368c-4bfd-b535-9192c3f240a0 {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquiring lock "refresh_cache-279e1c4c-36f9-492f-ab3f-1b587347eadd" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquired lock "refresh_cache-279e1c4c-36f9-492f-ab3f-1b587347eadd" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG nova.network.neutron [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG nova.network.neutron [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG nova.network.neutron [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Successfully updated port: 2f85c58c-a67a-435e-95bd-ae59a03c7a14 {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG nova.compute.manager [req-6bda5a33-e18f-4187-808b-00372b2c68c2 req-2ab3354f-7bbb-462a-b9a1-f5e9f95dcd55 service nova] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Received event network-changed-aeaddf62-0ca1-40d1-9228-897ee0015d4a {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG nova.compute.manager [req-6bda5a33-e18f-4187-808b-00372b2c68c2 req-2ab3354f-7bbb-462a-b9a1-f5e9f95dcd55 service nova] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Refreshing instance network info cache due to event network-changed-aeaddf62-0ca1-40d1-9228-897ee0015d4a. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6bda5a33-e18f-4187-808b-00372b2c68c2 req-2ab3354f-7bbb-462a-b9a1-f5e9f95dcd55 service nova] Acquiring lock "refresh_cache-279e1c4c-36f9-492f-ab3f-1b587347eadd" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Acquiring lock "refresh_cache-a8b4b5dc-0696-4a01-8318-7d3ec2014d6e" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Acquired lock "refresh_cache-a8b4b5dc-0696-4a01-8318-7d3ec2014d6e" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG nova.network.neutron [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG nova.network.neutron [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Updating instance_info_cache with network_info: [{"id": "6b1a991d-033b-45ab-839c-7b6b98082667", "address": "fa:16:3e:3c:9f:61", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b1a991d-03", "ovs_interfaceid": "6b1a991d-033b-45ab-839c-7b6b98082667", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG nova.network.neutron [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Releasing lock "refresh_cache-76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG nova.compute.manager [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Instance network_info: |[{"id": "6b1a991d-033b-45ab-839c-7b6b98082667", "address": "fa:16:3e:3c:9f:61", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b1a991d-03", "ovs_interfaceid": "6b1a991d-033b-45ab-839c-7b6b98082667", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-19f5f218-50a3-4c7b-a07b-ae8d0306f962 req-4230eb48-189f-4477-aca0-0095fbd25cee service nova] Acquired lock "refresh_cache-76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG nova.network.neutron [req-19f5f218-50a3-4c7b-a07b-ae8d0306f962 req-4230eb48-189f-4477-aca0-0095fbd25cee service nova] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Refreshing network info cache for port 6b1a991d-033b-45ab-839c-7b6b98082667 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Start _get_guest_xml network_info=[{"id": "6b1a991d-033b-45ab-839c-7b6b98082667", "address": "fa:16:3e:3c:9f:61", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b1a991d-03", "ovs_interfaceid": "6b1a991d-033b-45ab-839c-7b6b98082667", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'aa939d1b-b8a6-4391-935b-0191bf5ccd0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 10:49:11 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:49:11 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:49:11 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG nova.privsep.utils [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74994) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:49:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1762704213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1762704213',id=1,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='612ae9ec21ad40a4b68e0926843874ae',ramdisk_id='',reservation_id='r-12dd9pqk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-332508527',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:49:04Z,user_data=None,user_id='6c49cba00cff4c4b80080c5f917b4176',uuid=76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b1a991d-033b-45ab-839c-7b6b98082667", "address": "fa:16:3e:3c:9f:61", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b1a991d-03", "ovs_interfaceid": "6b1a991d-033b-45ab-839c-7b6b98082667", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Converting VIF {"id": "6b1a991d-033b-45ab-839c-7b6b98082667", "address": "fa:16:3e:3c:9f:61", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b1a991d-03", "ovs_interfaceid": "6b1a991d-033b-45ab-839c-7b6b98082667", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:9f:61,bridge_name='br-int',has_traffic_filtering=True,id=6b1a991d-033b-45ab-839c-7b6b98082667,network=Network(a1692a13-d1d7-4df6-bfc0-54f231846889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b1a991d-03') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG nova.objects.instance [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lazy-loading 'pci_devices' on Instance uuid 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] End _get_guest_xml xml=<domain type="kvm">
Nov 28 10:49:11 user nova-compute[74994]:   <uuid>76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c</uuid>
Nov 28 10:49:11 user nova-compute[74994]:   <name>instance-00000001</name>
Nov 28 10:49:11 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 10:49:11 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 10:49:11 user nova-compute[74994]:   <metadata>
Nov 28 10:49:11 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 10:49:11 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 10:49:11 user nova-compute[74994]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1762704213</nova:name>
Nov 28 10:49:11 user nova-compute[74994]:       <nova:creationTime>2023-11-28 10:49:11</nova:creationTime>
Nov 28 10:49:11 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 10:49:11 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 10:49:11 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 10:49:11 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 10:49:11 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 10:49:11 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 10:49:11 user nova-compute[74994]:       </nova:flavor>
Nov 28 10:49:11 user nova-compute[74994]:       <nova:owner>
Nov 28 10:49:11 user nova-compute[74994]:         <nova:user uuid="6c49cba00cff4c4b80080c5f917b4176">tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member</nova:user>
Nov 28 10:49:11 user nova-compute[74994]:         <nova:project uuid="612ae9ec21ad40a4b68e0926843874ae">tempest-ServerBootFromVolumeStableRescueTest-332508527</nova:project>
Nov 28 10:49:11 user nova-compute[74994]:       </nova:owner>
Nov 28 10:49:11 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 10:49:11 user nova-compute[74994]:       <nova:ports>
Nov 28 10:49:11 user nova-compute[74994]:         <nova:port uuid="6b1a991d-033b-45ab-839c-7b6b98082667">
Nov 28 10:49:11 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 10:49:11 user nova-compute[74994]:         </nova:port>
Nov 28 10:49:11 user nova-compute[74994]:       </nova:ports>
Nov 28 10:49:11 user nova-compute[74994]:     </nova:instance>
Nov 28 10:49:11 user nova-compute[74994]:   </metadata>
Nov 28 10:49:11 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 10:49:11 user nova-compute[74994]:     <system>
Nov 28 10:49:11 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 10:49:11 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 10:49:11 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 10:49:11 user nova-compute[74994]:       <entry name="serial">76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c</entry>
Nov 28 10:49:11 user nova-compute[74994]:       <entry name="uuid">76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c</entry>
Nov 28 10:49:11 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 10:49:11 user nova-compute[74994]:     </system>
Nov 28 10:49:11 user nova-compute[74994]:   </sysinfo>
Nov 28 10:49:11 user nova-compute[74994]:   <os>
Nov 28 10:49:11 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 10:49:11 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 10:49:11 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 10:49:11 user nova-compute[74994]:   </os>
Nov 28 10:49:11 user nova-compute[74994]:   <features>
Nov 28 10:49:11 user nova-compute[74994]:     <acpi/>
Nov 28 10:49:11 user nova-compute[74994]:     <apic/>
Nov 28 10:49:11 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 10:49:11 user nova-compute[74994]:   </features>
Nov 28 10:49:11 user nova-compute[74994]:   <clock offset="utc">
Nov 28 10:49:11 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 10:49:11 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 10:49:11 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 10:49:11 user nova-compute[74994]:   </clock>
Nov 28 10:49:11 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 10:49:11 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 10:49:11 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 10:49:11 user nova-compute[74994]:   </cpu>
Nov 28 10:49:11 user nova-compute[74994]:   <devices>
Nov 28 10:49:11 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 10:49:11 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 10:49:11 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk"/>
Nov 28 10:49:11 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 10:49:11 user nova-compute[74994]:     </disk>
Nov 28 10:49:11 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 10:49:11 user nova-compute[74994]:       <mac address="fa:16:3e:3c:9f:61"/>
Nov 28 10:49:11 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:49:11 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 10:49:11 user nova-compute[74994]:       <target dev="tap6b1a991d-03"/>
Nov 28 10:49:11 user nova-compute[74994]:     </interface>
Nov 28 10:49:11 user nova-compute[74994]:     <serial type="pty">
Nov 28 10:49:11 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/console.log" append="off"/>
Nov 28 10:49:11 user nova-compute[74994]:     </serial>
Nov 28 10:49:11 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 10:49:11 user nova-compute[74994]:     <video>
Nov 28 10:49:11 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:49:11 user nova-compute[74994]:     </video>
Nov 28 10:49:11 user nova-compute[74994]:     <rng model="virtio">
Nov 28 10:49:11 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 10:49:11 user nova-compute[74994]:     </rng>
Nov 28 10:49:11 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 10:49:11 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 10:49:11 user nova-compute[74994]:       <stats period="10"/>
Nov 28 10:49:11 user nova-compute[74994]:     </memballoon>
Nov 28 10:49:11 user nova-compute[74994]:   </devices>
Nov 28 10:49:11 user nova-compute[74994]: </domain>
Nov 28 10:49:11 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:49:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1762704213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1762704213',id=1,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='612ae9ec21ad40a4b68e0926843874ae',ramdisk_id='',reservation_id='r-12dd9pqk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-332508527',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:49:04Z,user_data=None,user_id='6c49cba00cff4c4b80080c5f917b4176',uuid=76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b1a991d-033b-45ab-839c-7b6b98082667", "address": "fa:16:3e:3c:9f:61", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b1a991d-03", "ovs_interfaceid": "6b1a991d-033b-45ab-839c-7b6b98082667", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Converting VIF {"id": "6b1a991d-033b-45ab-839c-7b6b98082667", "address": "fa:16:3e:3c:9f:61", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b1a991d-03", "ovs_interfaceid": "6b1a991d-033b-45ab-839c-7b6b98082667", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:9f:61,bridge_name='br-int',has_traffic_filtering=True,id=6b1a991d-033b-45ab-839c-7b6b98082667,network=Network(a1692a13-d1d7-4df6-bfc0-54f231846889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b1a991d-03') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG os_vif [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:9f:61,bridge_name='br-int',has_traffic_filtering=True,id=6b1a991d-033b-45ab-839c-7b6b98082667,network=Network(a1692a13-d1d7-4df6-bfc0-54f231846889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b1a991d-03') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Created schema index Interface.name {{(pid=74994) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Created schema index Port.name {{(pid=74994) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Created schema index Bridge.name {{(pid=74994) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [POLLOUT] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dbc4d03a-7232-5718-9186-807464bbf76a', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:49:11 user nova-compute[74994]: INFO oslo.privsep.daemon [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp_r112ut0/privsep.sock']
Nov 28 10:49:12 user sudo[84405]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp_r112ut0/privsep.sock
Nov 28 10:49:12 user sudo[84405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 28 10:49:12 user nova-compute[74994]: DEBUG nova.network.neutron [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Updating instance_info_cache with network_info: [{"id": "aeaddf62-0ca1-40d1-9228-897ee0015d4a", "address": "fa:16:3e:bc:02:82", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeaddf62-0c", "ovs_interfaceid": "aeaddf62-0ca1-40d1-9228-897ee0015d4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:49:12 user nova-compute[74994]: DEBUG nova.compute.manager [req-45ccd6cd-4170-46a1-90f4-168a8f8a36db req-d575aa44-0fd4-4089-b896-a549e341b9be service nova] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Received event network-changed-2f85c58c-a67a-435e-95bd-ae59a03c7a14 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:49:12 user nova-compute[74994]: DEBUG nova.compute.manager [req-45ccd6cd-4170-46a1-90f4-168a8f8a36db req-d575aa44-0fd4-4089-b896-a549e341b9be service nova] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Refreshing instance network info cache due to event network-changed-2f85c58c-a67a-435e-95bd-ae59a03c7a14. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:49:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-45ccd6cd-4170-46a1-90f4-168a8f8a36db req-d575aa44-0fd4-4089-b896-a549e341b9be service nova] Acquiring lock "refresh_cache-a8b4b5dc-0696-4a01-8318-7d3ec2014d6e" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:49:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Releasing lock "refresh_cache-279e1c4c-36f9-492f-ab3f-1b587347eadd" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:49:12 user nova-compute[74994]: DEBUG nova.compute.manager [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Instance network_info: |[{"id": "aeaddf62-0ca1-40d1-9228-897ee0015d4a", "address": "fa:16:3e:bc:02:82", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeaddf62-0c", "ovs_interfaceid": "aeaddf62-0ca1-40d1-9228-897ee0015d4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 10:49:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6bda5a33-e18f-4187-808b-00372b2c68c2 req-2ab3354f-7bbb-462a-b9a1-f5e9f95dcd55 service nova] Acquired lock "refresh_cache-279e1c4c-36f9-492f-ab3f-1b587347eadd" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:49:12 user nova-compute[74994]: DEBUG nova.network.neutron [req-6bda5a33-e18f-4187-808b-00372b2c68c2 req-2ab3354f-7bbb-462a-b9a1-f5e9f95dcd55 service nova] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Refreshing network info cache for port aeaddf62-0ca1-40d1-9228-897ee0015d4a {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:49:12 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Start _get_guest_xml network_info=[{"id": "aeaddf62-0ca1-40d1-9228-897ee0015d4a", "address": "fa:16:3e:bc:02:82", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeaddf62-0c", "ovs_interfaceid": "aeaddf62-0ca1-40d1-9228-897ee0015d4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'aa939d1b-b8a6-4391-935b-0191bf5ccd0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 10:49:12 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:49:12 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:49:12 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 10:49:12 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 10:49:12 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 10:49:12 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 10:49:12 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 10:49:12 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 10:49:12 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 10:49:12 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 10:49:12 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 10:49:12 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 10:49:12 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 10:49:12 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 10:49:12 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 10:49:12 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 10:49:12 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 10:49:12 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 10:49:12 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:49:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-262139967',display_name='tempest-ServerRescueNegativeTestJSON-server-262139967',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-262139967',id=4,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77126f6f39db4a628b74551ea7d0aa21',ramdisk_id='',reservation_id='r-xeb42ckc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1900175697',owner_user_name='tempest-ServerRescueNegativeTestJSON-1900175697-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:49:07Z,user_data=None,user_id='6b5c1a1f2efc4a2faf8b82d467681d45',uuid=279e1c4c-36f9-492f-ab3f-1b587347eadd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aeaddf62-0ca1-40d1-9228-897ee0015d4a", "address": "fa:16:3e:bc:02:82", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeaddf62-0c", "ovs_interfaceid": "aeaddf62-0ca1-40d1-9228-897ee0015d4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:49:12 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Converting VIF {"id": "aeaddf62-0ca1-40d1-9228-897ee0015d4a", "address": "fa:16:3e:bc:02:82", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeaddf62-0c", "ovs_interfaceid": "aeaddf62-0ca1-40d1-9228-897ee0015d4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:49:12 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:02:82,bridge_name='br-int',has_traffic_filtering=True,id=aeaddf62-0ca1-40d1-9228-897ee0015d4a,network=Network(77bc68aa-1654-4e4d-9c65-7515fe6f4b2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeaddf62-0c') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:49:12 user nova-compute[74994]: DEBUG nova.objects.instance [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lazy-loading 'pci_devices' on Instance uuid 279e1c4c-36f9-492f-ab3f-1b587347eadd {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:49:12 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] End _get_guest_xml xml=<domain type="kvm">
Nov 28 10:49:12 user nova-compute[74994]:   <uuid>279e1c4c-36f9-492f-ab3f-1b587347eadd</uuid>
Nov 28 10:49:12 user nova-compute[74994]:   <name>instance-00000004</name>
Nov 28 10:49:12 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 10:49:12 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 10:49:12 user nova-compute[74994]:   <metadata>
Nov 28 10:49:12 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 10:49:12 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 10:49:12 user nova-compute[74994]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-262139967</nova:name>
Nov 28 10:49:12 user nova-compute[74994]:       <nova:creationTime>2023-11-28 10:49:12</nova:creationTime>
Nov 28 10:49:12 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 10:49:12 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 10:49:12 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 10:49:12 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 10:49:12 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 10:49:12 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 10:49:12 user nova-compute[74994]:       </nova:flavor>
Nov 28 10:49:12 user nova-compute[74994]:       <nova:owner>
Nov 28 10:49:12 user nova-compute[74994]:         <nova:user uuid="6b5c1a1f2efc4a2faf8b82d467681d45">tempest-ServerRescueNegativeTestJSON-1900175697-project-member</nova:user>
Nov 28 10:49:12 user nova-compute[74994]:         <nova:project uuid="77126f6f39db4a628b74551ea7d0aa21">tempest-ServerRescueNegativeTestJSON-1900175697</nova:project>
Nov 28 10:49:12 user nova-compute[74994]:       </nova:owner>
Nov 28 10:49:12 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 10:49:12 user nova-compute[74994]:       <nova:ports>
Nov 28 10:49:12 user nova-compute[74994]:         <nova:port uuid="aeaddf62-0ca1-40d1-9228-897ee0015d4a">
Nov 28 10:49:12 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 10:49:12 user nova-compute[74994]:         </nova:port>
Nov 28 10:49:12 user nova-compute[74994]:       </nova:ports>
Nov 28 10:49:12 user nova-compute[74994]:     </nova:instance>
Nov 28 10:49:12 user nova-compute[74994]:   </metadata>
Nov 28 10:49:12 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 10:49:12 user nova-compute[74994]:     <system>
Nov 28 10:49:12 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 10:49:12 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 10:49:12 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 10:49:12 user nova-compute[74994]:       <entry name="serial">279e1c4c-36f9-492f-ab3f-1b587347eadd</entry>
Nov 28 10:49:12 user nova-compute[74994]:       <entry name="uuid">279e1c4c-36f9-492f-ab3f-1b587347eadd</entry>
Nov 28 10:49:12 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 10:49:12 user nova-compute[74994]:     </system>
Nov 28 10:49:12 user nova-compute[74994]:   </sysinfo>
Nov 28 10:49:12 user nova-compute[74994]:   <os>
Nov 28 10:49:12 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 10:49:12 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 10:49:12 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 10:49:12 user nova-compute[74994]:   </os>
Nov 28 10:49:12 user nova-compute[74994]:   <features>
Nov 28 10:49:12 user nova-compute[74994]:     <acpi/>
Nov 28 10:49:12 user nova-compute[74994]:     <apic/>
Nov 28 10:49:12 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 10:49:12 user nova-compute[74994]:   </features>
Nov 28 10:49:12 user nova-compute[74994]:   <clock offset="utc">
Nov 28 10:49:12 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 10:49:12 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 10:49:12 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 10:49:12 user nova-compute[74994]:   </clock>
Nov 28 10:49:12 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 10:49:12 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 10:49:12 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 10:49:12 user nova-compute[74994]:   </cpu>
Nov 28 10:49:12 user nova-compute[74994]:   <devices>
Nov 28 10:49:12 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 10:49:12 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 10:49:12 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk"/>
Nov 28 10:49:12 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 10:49:12 user nova-compute[74994]:     </disk>
Nov 28 10:49:12 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 10:49:12 user nova-compute[74994]:       <mac address="fa:16:3e:bc:02:82"/>
Nov 28 10:49:12 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:49:12 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 10:49:12 user nova-compute[74994]:       <target dev="tapaeaddf62-0c"/>
Nov 28 10:49:12 user nova-compute[74994]:     </interface>
Nov 28 10:49:12 user nova-compute[74994]:     <serial type="pty">
Nov 28 10:49:12 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/console.log" append="off"/>
Nov 28 10:49:12 user nova-compute[74994]:     </serial>
Nov 28 10:49:12 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 10:49:12 user nova-compute[74994]:     <video>
Nov 28 10:49:12 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:49:12 user nova-compute[74994]:     </video>
Nov 28 10:49:12 user nova-compute[74994]:     <rng model="virtio">
Nov 28 10:49:12 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 10:49:12 user nova-compute[74994]:     </rng>
Nov 28 10:49:12 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 10:49:12 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 10:49:12 user nova-compute[74994]:       <stats period="10"/>
Nov 28 10:49:12 user nova-compute[74994]:     </memballoon>
Nov 28 10:49:12 user nova-compute[74994]:   </devices>
Nov 28 10:49:12 user nova-compute[74994]: </domain>
Nov 28 10:49:12 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 10:49:12 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:49:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-262139967',display_name='tempest-ServerRescueNegativeTestJSON-server-262139967',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-262139967',id=4,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77126f6f39db4a628b74551ea7d0aa21',ramdisk_id='',reservation_id='r-xeb42ckc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1900175697',owner_user_name='tempest-ServerRescueNegativeTestJSON-1900175697-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:49:07Z,user_data=None,user_id='6b5c1a1f2efc4a2faf8b82d467681d45',uuid=279e1c4c-36f9-492f-ab3f-1b587347eadd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aeaddf62-0ca1-40d1-9228-897ee0015d4a", "address": "fa:16:3e:bc:02:82", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeaddf62-0c", "ovs_interfaceid": "aeaddf62-0ca1-40d1-9228-897ee0015d4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 10:49:12 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Converting VIF {"id": "aeaddf62-0ca1-40d1-9228-897ee0015d4a", "address": "fa:16:3e:bc:02:82", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeaddf62-0c", "ovs_interfaceid": "aeaddf62-0ca1-40d1-9228-897ee0015d4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:49:12 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:02:82,bridge_name='br-int',has_traffic_filtering=True,id=aeaddf62-0ca1-40d1-9228-897ee0015d4a,network=Network(77bc68aa-1654-4e4d-9c65-7515fe6f4b2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeaddf62-0c') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:49:12 user nova-compute[74994]: DEBUG os_vif [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:02:82,bridge_name='br-int',has_traffic_filtering=True,id=aeaddf62-0ca1-40d1-9228-897ee0015d4a,network=Network(77bc68aa-1654-4e4d-9c65-7515fe6f4b2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeaddf62-0c') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 10:49:12 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:12 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:12 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 10:49:12 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:12 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '818d0c8a-baa8-5174-84ce-a2fbf762c155', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:12 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:12 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:49:12 user nova-compute[74994]: DEBUG nova.network.neutron [req-6bda5a33-e18f-4187-808b-00372b2c68c2 req-2ab3354f-7bbb-462a-b9a1-f5e9f95dcd55 service nova] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Updated VIF entry in instance network info cache for port aeaddf62-0ca1-40d1-9228-897ee0015d4a. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 10:49:12 user nova-compute[74994]: DEBUG nova.network.neutron [req-6bda5a33-e18f-4187-808b-00372b2c68c2 req-2ab3354f-7bbb-462a-b9a1-f5e9f95dcd55 service nova] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Updating instance_info_cache with network_info: [{"id": "aeaddf62-0ca1-40d1-9228-897ee0015d4a", "address": "fa:16:3e:bc:02:82", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeaddf62-0c", "ovs_interfaceid": "aeaddf62-0ca1-40d1-9228-897ee0015d4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:49:13 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6bda5a33-e18f-4187-808b-00372b2c68c2 req-2ab3354f-7bbb-462a-b9a1-f5e9f95dcd55 service nova] Releasing lock "refresh_cache-279e1c4c-36f9-492f-ab3f-1b587347eadd" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:49:13 user nova-compute[74994]: DEBUG nova.network.neutron [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Successfully updated port: 6a884296-8f6f-4647-b4c6-09d7f4e92887 {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 10:49:13 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquiring lock "refresh_cache-bf357856-2d97-42e8-928d-71d0378f48c8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:49:13 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquired lock "refresh_cache-bf357856-2d97-42e8-928d-71d0378f48c8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:49:13 user nova-compute[74994]: DEBUG nova.network.neutron [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 10:49:13 user nova-compute[74994]: DEBUG nova.network.neutron [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 10:49:13 user sudo[84405]: pam_unix(sudo:session): session closed for user root
Nov 28 10:49:13 user nova-compute[74994]: DEBUG nova.compute.manager [req-07e64bac-2908-4bb9-89ed-caa46943c041 req-2abae61d-446e-4f60-91f5-774f15c6c99d service nova] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Received event network-changed-6a884296-8f6f-4647-b4c6-09d7f4e92887 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:49:13 user nova-compute[74994]: DEBUG nova.compute.manager [req-07e64bac-2908-4bb9-89ed-caa46943c041 req-2abae61d-446e-4f60-91f5-774f15c6c99d service nova] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Refreshing instance network info cache due to event network-changed-6a884296-8f6f-4647-b4c6-09d7f4e92887. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:49:13 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-07e64bac-2908-4bb9-89ed-caa46943c041 req-2abae61d-446e-4f60-91f5-774f15c6c99d service nova] Acquiring lock "refresh_cache-bf357856-2d97-42e8-928d-71d0378f48c8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:49:13 user nova-compute[74994]: INFO oslo.privsep.daemon [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Spawned new privsep daemon via rootwrap
Nov 28 10:49:13 user nova-compute[74994]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 28 10:49:13 user nova-compute[74994]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 28 10:49:13 user nova-compute[74994]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 28 10:49:13 user nova-compute[74994]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84408
Nov 28 10:49:13 user nova-compute[74994]: DEBUG nova.network.neutron [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Updating instance_info_cache with network_info: [{"id": "2f85c58c-a67a-435e-95bd-ae59a03c7a14", "address": "fa:16:3e:96:7b:84", "network": {"id": "99dc7b50-b4f4-4cdd-83fa-8efbdcdac028", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1822691421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00249c339d324b7990aac48ea640d770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f85c58c-a6", "ovs_interfaceid": "2f85c58c-a67a-435e-95bd-ae59a03c7a14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:49:13 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Releasing lock "refresh_cache-a8b4b5dc-0696-4a01-8318-7d3ec2014d6e" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:49:13 user nova-compute[74994]: DEBUG nova.compute.manager [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Instance network_info: |[{"id": "2f85c58c-a67a-435e-95bd-ae59a03c7a14", "address": "fa:16:3e:96:7b:84", "network": {"id": "99dc7b50-b4f4-4cdd-83fa-8efbdcdac028", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1822691421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00249c339d324b7990aac48ea640d770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f85c58c-a6", "ovs_interfaceid": "2f85c58c-a67a-435e-95bd-ae59a03c7a14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 10:49:13 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-45ccd6cd-4170-46a1-90f4-168a8f8a36db req-d575aa44-0fd4-4089-b896-a549e341b9be service nova] Acquired lock "refresh_cache-a8b4b5dc-0696-4a01-8318-7d3ec2014d6e" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:49:13 user nova-compute[74994]: DEBUG nova.network.neutron [req-45ccd6cd-4170-46a1-90f4-168a8f8a36db req-d575aa44-0fd4-4089-b896-a549e341b9be service nova] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Refreshing network info cache for port 2f85c58c-a67a-435e-95bd-ae59a03c7a14 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:49:13 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Start _get_guest_xml network_info=[{"id": "2f85c58c-a67a-435e-95bd-ae59a03c7a14", "address": "fa:16:3e:96:7b:84", "network": {"id": "99dc7b50-b4f4-4cdd-83fa-8efbdcdac028", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1822691421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00249c339d324b7990aac48ea640d770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f85c58c-a6", "ovs_interfaceid": "2f85c58c-a67a-435e-95bd-ae59a03c7a14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'aa939d1b-b8a6-4391-935b-0191bf5ccd0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 10:49:13 user nova-compute[74994]: WARNING oslo_privsep.priv_context [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] privsep daemon already running
Nov 28 10:49:13 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:49:13 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:49:13 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 10:49:13 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 10:49:13 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 10:49:13 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 10:49:13 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 10:49:13 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 10:49:13 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 10:49:13 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 10:49:13 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 10:49:13 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 10:49:13 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 10:49:13 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 10:49:13 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 10:49:13 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 10:49:13 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 10:49:13 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 10:49:13 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:49:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-575516577',display_name='tempest-DeleteServersTestJSON-server-575516577',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-575516577',id=2,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='00249c339d324b7990aac48ea640d770',ramdisk_id='',reservation_id='r-wbt1ltyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-156220800',owner_user_name='tempest-DeleteServersTestJSON-156220800-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:49:06Z,user_data=None,user_id='cbb3e2a69e66423e8bfe8f60d1cfa3e3',uuid=a8b4b5dc-0696-4a01-8318-7d3ec2014d6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f85c58c-a67a-435e-95bd-ae59a03c7a14", "address": "fa:16:3e:96:7b:84", "network": {"id": "99dc7b50-b4f4-4cdd-83fa-8efbdcdac028", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1822691421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00249c339d324b7990aac48ea640d770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f85c58c-a6", "ovs_interfaceid": "2f85c58c-a67a-435e-95bd-ae59a03c7a14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:49:13 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Converting VIF {"id": "2f85c58c-a67a-435e-95bd-ae59a03c7a14", "address": "fa:16:3e:96:7b:84", "network": {"id": "99dc7b50-b4f4-4cdd-83fa-8efbdcdac028", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1822691421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00249c339d324b7990aac48ea640d770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f85c58c-a6", "ovs_interfaceid": "2f85c58c-a67a-435e-95bd-ae59a03c7a14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:49:13 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:7b:84,bridge_name='br-int',has_traffic_filtering=True,id=2f85c58c-a67a-435e-95bd-ae59a03c7a14,network=Network(99dc7b50-b4f4-4cdd-83fa-8efbdcdac028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f85c58c-a6') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:49:13 user nova-compute[74994]: DEBUG nova.objects.instance [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Lazy-loading 'pci_devices' on Instance uuid a8b4b5dc-0696-4a01-8318-7d3ec2014d6e {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:49:13 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] End _get_guest_xml xml=<domain type="kvm">
Nov 28 10:49:13 user nova-compute[74994]:   <uuid>a8b4b5dc-0696-4a01-8318-7d3ec2014d6e</uuid>
Nov 28 10:49:13 user nova-compute[74994]:   <name>instance-00000002</name>
Nov 28 10:49:13 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 10:49:13 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 10:49:13 user nova-compute[74994]:   <metadata>
Nov 28 10:49:13 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 10:49:13 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 10:49:13 user nova-compute[74994]:       <nova:name>tempest-DeleteServersTestJSON-server-575516577</nova:name>
Nov 28 10:49:13 user nova-compute[74994]:       <nova:creationTime>2023-11-28 10:49:13</nova:creationTime>
Nov 28 10:49:13 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 10:49:13 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 10:49:13 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 10:49:13 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 10:49:13 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 10:49:13 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 10:49:13 user nova-compute[74994]:       </nova:flavor>
Nov 28 10:49:13 user nova-compute[74994]:       <nova:owner>
Nov 28 10:49:13 user nova-compute[74994]:         <nova:user uuid="cbb3e2a69e66423e8bfe8f60d1cfa3e3">tempest-DeleteServersTestJSON-156220800-project-member</nova:user>
Nov 28 10:49:13 user nova-compute[74994]:         <nova:project uuid="00249c339d324b7990aac48ea640d770">tempest-DeleteServersTestJSON-156220800</nova:project>
Nov 28 10:49:13 user nova-compute[74994]:       </nova:owner>
Nov 28 10:49:13 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 10:49:13 user nova-compute[74994]:       <nova:ports>
Nov 28 10:49:13 user nova-compute[74994]:         <nova:port uuid="2f85c58c-a67a-435e-95bd-ae59a03c7a14">
Nov 28 10:49:13 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 28 10:49:13 user nova-compute[74994]:         </nova:port>
Nov 28 10:49:13 user nova-compute[74994]:       </nova:ports>
Nov 28 10:49:13 user nova-compute[74994]:     </nova:instance>
Nov 28 10:49:13 user nova-compute[74994]:   </metadata>
Nov 28 10:49:13 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 10:49:13 user nova-compute[74994]:     <system>
Nov 28 10:49:13 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 10:49:13 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 10:49:13 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 10:49:13 user nova-compute[74994]:       <entry name="serial">a8b4b5dc-0696-4a01-8318-7d3ec2014d6e</entry>
Nov 28 10:49:13 user nova-compute[74994]:       <entry name="uuid">a8b4b5dc-0696-4a01-8318-7d3ec2014d6e</entry>
Nov 28 10:49:13 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 10:49:13 user nova-compute[74994]:     </system>
Nov 28 10:49:13 user nova-compute[74994]:   </sysinfo>
Nov 28 10:49:13 user nova-compute[74994]:   <os>
Nov 28 10:49:13 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 10:49:13 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 10:49:13 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 10:49:13 user nova-compute[74994]:   </os>
Nov 28 10:49:13 user nova-compute[74994]:   <features>
Nov 28 10:49:13 user nova-compute[74994]:     <acpi/>
Nov 28 10:49:13 user nova-compute[74994]:     <apic/>
Nov 28 10:49:13 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 10:49:13 user nova-compute[74994]:   </features>
Nov 28 10:49:13 user nova-compute[74994]:   <clock offset="utc">
Nov 28 10:49:13 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 10:49:13 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 10:49:13 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 10:49:13 user nova-compute[74994]:   </clock>
Nov 28 10:49:13 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 10:49:13 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 10:49:13 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 10:49:13 user nova-compute[74994]:   </cpu>
Nov 28 10:49:13 user nova-compute[74994]:   <devices>
Nov 28 10:49:13 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 10:49:13 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 10:49:13 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/a8b4b5dc-0696-4a01-8318-7d3ec2014d6e/disk"/>
Nov 28 10:49:13 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 10:49:13 user nova-compute[74994]:     </disk>
Nov 28 10:49:13 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 10:49:13 user nova-compute[74994]:       <mac address="fa:16:3e:96:7b:84"/>
Nov 28 10:49:13 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:49:13 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 10:49:13 user nova-compute[74994]:       <target dev="tap2f85c58c-a6"/>
Nov 28 10:49:13 user nova-compute[74994]:     </interface>
Nov 28 10:49:13 user nova-compute[74994]:     <serial type="pty">
Nov 28 10:49:13 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/a8b4b5dc-0696-4a01-8318-7d3ec2014d6e/console.log" append="off"/>
Nov 28 10:49:13 user nova-compute[74994]:     </serial>
Nov 28 10:49:13 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 10:49:13 user nova-compute[74994]:     <video>
Nov 28 10:49:13 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:49:13 user nova-compute[74994]:     </video>
Nov 28 10:49:13 user nova-compute[74994]:     <rng model="virtio">
Nov 28 10:49:13 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 10:49:13 user nova-compute[74994]:     </rng>
Nov 28 10:49:13 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 10:49:13 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 10:49:13 user nova-compute[74994]:       <stats period="10"/>
Nov 28 10:49:13 user nova-compute[74994]:     </memballoon>
Nov 28 10:49:13 user nova-compute[74994]:   </devices>
Nov 28 10:49:13 user nova-compute[74994]: </domain>
Nov 28 10:49:13 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 10:49:13 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:49:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-575516577',display_name='tempest-DeleteServersTestJSON-server-575516577',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-575516577',id=2,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='00249c339d324b7990aac48ea640d770',ramdisk_id='',reservation_id='r-wbt1ltyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-156220800',owner_user_name='tempest-DeleteServersTestJSON-156220800-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:49:06Z,user_data=None,user_id='cbb3e2a69e66423e8bfe8f60d1cfa3e3',uuid=a8b4b5dc-0696-4a01-8318-7d3ec2014d6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f85c58c-a67a-435e-95bd-ae59a03c7a14", "address": "fa:16:3e:96:7b:84", "network": {"id": "99dc7b50-b4f4-4cdd-83fa-8efbdcdac028", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1822691421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00249c339d324b7990aac48ea640d770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f85c58c-a6", "ovs_interfaceid": "2f85c58c-a67a-435e-95bd-ae59a03c7a14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 10:49:13 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Converting VIF {"id": "2f85c58c-a67a-435e-95bd-ae59a03c7a14", "address": "fa:16:3e:96:7b:84", "network": {"id": "99dc7b50-b4f4-4cdd-83fa-8efbdcdac028", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1822691421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00249c339d324b7990aac48ea640d770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f85c58c-a6", "ovs_interfaceid": "2f85c58c-a67a-435e-95bd-ae59a03c7a14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:49:13 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:7b:84,bridge_name='br-int',has_traffic_filtering=True,id=2f85c58c-a67a-435e-95bd-ae59a03c7a14,network=Network(99dc7b50-b4f4-4cdd-83fa-8efbdcdac028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f85c58c-a6') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:49:13 user nova-compute[74994]: DEBUG os_vif [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:7b:84,bridge_name='br-int',has_traffic_filtering=True,id=2f85c58c-a67a-435e-95bd-ae59a03c7a14,network=Network(99dc7b50-b4f4-4cdd-83fa-8efbdcdac028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f85c58c-a6') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 10:49:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 10:49:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '093f700e-63dd-5b5c-b70e-444d98663d0c', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:49:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b1a991d-03, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6b1a991d-03, col_values=(('qos', UUID('ca4fcbd0-fc03-451a-93e6-50e5e106fca2')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6b1a991d-03, col_values=(('external_ids', {'iface-id': '6b1a991d-033b-45ab-839c-7b6b98082667', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:9f:61', 'vm-uuid': '76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:14 user nova-compute[74994]: INFO os_vif [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:9f:61,bridge_name='br-int',has_traffic_filtering=True,id=6b1a991d-033b-45ab-839c-7b6b98082667,network=Network(a1692a13-d1d7-4df6-bfc0-54f231846889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b1a991d-03')
Nov 28 10:49:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f85c58c-a6, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2f85c58c-a6, col_values=(('qos', UUID('6148dad5-5701-4db4-9d59-f6afac3d5279')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2f85c58c-a6, col_values=(('external_ids', {'iface-id': '2f85c58c-a67a-435e-95bd-ae59a03c7a14', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:7b:84', 'vm-uuid': 'a8b4b5dc-0696-4a01-8318-7d3ec2014d6e'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:14 user nova-compute[74994]: INFO os_vif [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:7b:84,bridge_name='br-int',has_traffic_filtering=True,id=2f85c58c-a67a-435e-95bd-ae59a03c7a14,network=Network(99dc7b50-b4f4-4cdd-83fa-8efbdcdac028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f85c58c-a6')
Nov 28 10:49:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaeaddf62-0c, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaeaddf62-0c, col_values=(('qos', UUID('3da01f43-31bc-4a60-9a81-c02cb74bbf15')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaeaddf62-0c, col_values=(('external_ids', {'iface-id': 'aeaddf62-0ca1-40d1-9228-897ee0015d4a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:02:82', 'vm-uuid': '279e1c4c-36f9-492f-ab3f-1b587347eadd'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:14 user nova-compute[74994]: INFO os_vif [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:02:82,bridge_name='br-int',has_traffic_filtering=True,id=aeaddf62-0ca1-40d1-9228-897ee0015d4a,network=Network(77bc68aa-1654-4e4d-9c65-7515fe6f4b2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeaddf62-0c')
Nov 28 10:49:14 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] No VIF found with MAC fa:16:3e:3c:9f:61, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG nova.network.neutron [req-19f5f218-50a3-4c7b-a07b-ae8d0306f962 req-4230eb48-189f-4477-aca0-0095fbd25cee service nova] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Updated VIF entry in instance network info cache for port 6b1a991d-033b-45ab-839c-7b6b98082667. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG nova.network.neutron [req-19f5f218-50a3-4c7b-a07b-ae8d0306f962 req-4230eb48-189f-4477-aca0-0095fbd25cee service nova] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Updating instance_info_cache with network_info: [{"id": "6b1a991d-033b-45ab-839c-7b6b98082667", "address": "fa:16:3e:3c:9f:61", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b1a991d-03", "ovs_interfaceid": "6b1a991d-033b-45ab-839c-7b6b98082667", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-19f5f218-50a3-4c7b-a07b-ae8d0306f962 req-4230eb48-189f-4477-aca0-0095fbd25cee service nova] Releasing lock "refresh_cache-76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] No VIF found with MAC fa:16:3e:96:7b:84, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] No VIF found with MAC fa:16:3e:bc:02:82, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG nova.network.neutron [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Updating instance_info_cache with network_info: [{"id": "6a884296-8f6f-4647-b4c6-09d7f4e92887", "address": "fa:16:3e:a2:e1:5b", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a884296-8f", "ovs_interfaceid": "6a884296-8f6f-4647-b4c6-09d7f4e92887", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Releasing lock "refresh_cache-bf357856-2d97-42e8-928d-71d0378f48c8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG nova.compute.manager [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Instance network_info: |[{"id": "6a884296-8f6f-4647-b4c6-09d7f4e92887", "address": "fa:16:3e:a2:e1:5b", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a884296-8f", "ovs_interfaceid": "6a884296-8f6f-4647-b4c6-09d7f4e92887", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-07e64bac-2908-4bb9-89ed-caa46943c041 req-2abae61d-446e-4f60-91f5-774f15c6c99d service nova] Acquired lock "refresh_cache-bf357856-2d97-42e8-928d-71d0378f48c8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG nova.network.neutron [req-07e64bac-2908-4bb9-89ed-caa46943c041 req-2abae61d-446e-4f60-91f5-774f15c6c99d service nova] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Refreshing network info cache for port 6a884296-8f6f-4647-b4c6-09d7f4e92887 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Start _get_guest_xml network_info=[{"id": "6a884296-8f6f-4647-b4c6-09d7f4e92887", "address": "fa:16:3e:a2:e1:5b", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a884296-8f", "ovs_interfaceid": "6a884296-8f6f-4647-b4c6-09d7f4e92887", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'aa939d1b-b8a6-4391-935b-0191bf5ccd0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 10:49:14 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:49:14 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:49:14 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:49:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1148888058',display_name='tempest-ServerRescueNegativeTestJSON-server-1148888058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1148888058',id=3,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77126f6f39db4a628b74551ea7d0aa21',ramdisk_id='',reservation_id='r-kyiocy2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1900175697',owner_user_name='tempest-ServerRescueNegativeTestJSON-1900175697-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:49:07Z,user_data=None,user_id='6b5c1a1f2efc4a2faf8b82d467681d45',uuid=bf357856-2d97-42e8-928d-71d0378f48c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a884296-8f6f-4647-b4c6-09d7f4e92887", "address": "fa:16:3e:a2:e1:5b", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a884296-8f", "ovs_interfaceid": "6a884296-8f6f-4647-b4c6-09d7f4e92887", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Converting VIF {"id": "6a884296-8f6f-4647-b4c6-09d7f4e92887", "address": "fa:16:3e:a2:e1:5b", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a884296-8f", "ovs_interfaceid": "6a884296-8f6f-4647-b4c6-09d7f4e92887", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:e1:5b,bridge_name='br-int',has_traffic_filtering=True,id=6a884296-8f6f-4647-b4c6-09d7f4e92887,network=Network(77bc68aa-1654-4e4d-9c65-7515fe6f4b2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a884296-8f') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG nova.objects.instance [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lazy-loading 'pci_devices' on Instance uuid bf357856-2d97-42e8-928d-71d0378f48c8 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] End _get_guest_xml xml=<domain type="kvm">
Nov 28 10:49:14 user nova-compute[74994]:   <uuid>bf357856-2d97-42e8-928d-71d0378f48c8</uuid>
Nov 28 10:49:14 user nova-compute[74994]:   <name>instance-00000003</name>
Nov 28 10:49:14 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 10:49:14 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 10:49:14 user nova-compute[74994]:   <metadata>
Nov 28 10:49:14 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 10:49:14 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 10:49:14 user nova-compute[74994]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1148888058</nova:name>
Nov 28 10:49:14 user nova-compute[74994]:       <nova:creationTime>2023-11-28 10:49:14</nova:creationTime>
Nov 28 10:49:14 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 10:49:14 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 10:49:14 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 10:49:14 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 10:49:14 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 10:49:14 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 10:49:14 user nova-compute[74994]:       </nova:flavor>
Nov 28 10:49:14 user nova-compute[74994]:       <nova:owner>
Nov 28 10:49:14 user nova-compute[74994]:         <nova:user uuid="6b5c1a1f2efc4a2faf8b82d467681d45">tempest-ServerRescueNegativeTestJSON-1900175697-project-member</nova:user>
Nov 28 10:49:14 user nova-compute[74994]:         <nova:project uuid="77126f6f39db4a628b74551ea7d0aa21">tempest-ServerRescueNegativeTestJSON-1900175697</nova:project>
Nov 28 10:49:14 user nova-compute[74994]:       </nova:owner>
Nov 28 10:49:14 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 10:49:14 user nova-compute[74994]:       <nova:ports>
Nov 28 10:49:14 user nova-compute[74994]:         <nova:port uuid="6a884296-8f6f-4647-b4c6-09d7f4e92887">
Nov 28 10:49:14 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 10:49:14 user nova-compute[74994]:         </nova:port>
Nov 28 10:49:14 user nova-compute[74994]:       </nova:ports>
Nov 28 10:49:14 user nova-compute[74994]:     </nova:instance>
Nov 28 10:49:14 user nova-compute[74994]:   </metadata>
Nov 28 10:49:14 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 10:49:14 user nova-compute[74994]:     <system>
Nov 28 10:49:14 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 10:49:14 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 10:49:14 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 10:49:14 user nova-compute[74994]:       <entry name="serial">bf357856-2d97-42e8-928d-71d0378f48c8</entry>
Nov 28 10:49:14 user nova-compute[74994]:       <entry name="uuid">bf357856-2d97-42e8-928d-71d0378f48c8</entry>
Nov 28 10:49:14 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 10:49:14 user nova-compute[74994]:     </system>
Nov 28 10:49:14 user nova-compute[74994]:   </sysinfo>
Nov 28 10:49:14 user nova-compute[74994]:   <os>
Nov 28 10:49:14 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 10:49:14 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 10:49:14 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 10:49:14 user nova-compute[74994]:   </os>
Nov 28 10:49:14 user nova-compute[74994]:   <features>
Nov 28 10:49:14 user nova-compute[74994]:     <acpi/>
Nov 28 10:49:14 user nova-compute[74994]:     <apic/>
Nov 28 10:49:14 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 10:49:14 user nova-compute[74994]:   </features>
Nov 28 10:49:14 user nova-compute[74994]:   <clock offset="utc">
Nov 28 10:49:14 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 10:49:14 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 10:49:14 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 10:49:14 user nova-compute[74994]:   </clock>
Nov 28 10:49:14 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 10:49:14 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 10:49:14 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 10:49:14 user nova-compute[74994]:   </cpu>
Nov 28 10:49:14 user nova-compute[74994]:   <devices>
Nov 28 10:49:14 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 10:49:14 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 10:49:14 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk"/>
Nov 28 10:49:14 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 10:49:14 user nova-compute[74994]:     </disk>
Nov 28 10:49:14 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 10:49:14 user nova-compute[74994]:       <mac address="fa:16:3e:a2:e1:5b"/>
Nov 28 10:49:14 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:49:14 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 10:49:14 user nova-compute[74994]:       <target dev="tap6a884296-8f"/>
Nov 28 10:49:14 user nova-compute[74994]:     </interface>
Nov 28 10:49:14 user nova-compute[74994]:     <serial type="pty">
Nov 28 10:49:14 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/console.log" append="off"/>
Nov 28 10:49:14 user nova-compute[74994]:     </serial>
Nov 28 10:49:14 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 10:49:14 user nova-compute[74994]:     <video>
Nov 28 10:49:14 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:49:14 user nova-compute[74994]:     </video>
Nov 28 10:49:14 user nova-compute[74994]:     <rng model="virtio">
Nov 28 10:49:14 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 10:49:14 user nova-compute[74994]:     </rng>
Nov 28 10:49:14 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 10:49:14 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 10:49:14 user nova-compute[74994]:       <stats period="10"/>
Nov 28 10:49:14 user nova-compute[74994]:     </memballoon>
Nov 28 10:49:14 user nova-compute[74994]:   </devices>
Nov 28 10:49:14 user nova-compute[74994]: </domain>
Nov 28 10:49:14 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:49:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1148888058',display_name='tempest-ServerRescueNegativeTestJSON-server-1148888058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1148888058',id=3,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77126f6f39db4a628b74551ea7d0aa21',ramdisk_id='',reservation_id='r-kyiocy2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1900175697',owner_user_name='tempest-ServerRescueNegativeTestJSON-1900175697-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:49:07Z,user_data=None,user_id='6b5c1a1f2efc4a2faf8b82d467681d45',uuid=bf357856-2d97-42e8-928d-71d0378f48c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a884296-8f6f-4647-b4c6-09d7f4e92887", "address": "fa:16:3e:a2:e1:5b", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a884296-8f", "ovs_interfaceid": "6a884296-8f6f-4647-b4c6-09d7f4e92887", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Converting VIF {"id": "6a884296-8f6f-4647-b4c6-09d7f4e92887", "address": "fa:16:3e:a2:e1:5b", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a884296-8f", "ovs_interfaceid": "6a884296-8f6f-4647-b4c6-09d7f4e92887", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:e1:5b,bridge_name='br-int',has_traffic_filtering=True,id=6a884296-8f6f-4647-b4c6-09d7f4e92887,network=Network(77bc68aa-1654-4e4d-9c65-7515fe6f4b2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a884296-8f') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG os_vif [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:e1:5b,bridge_name='br-int',has_traffic_filtering=True,id=6a884296-8f6f-4647-b4c6-09d7f4e92887,network=Network(77bc68aa-1654-4e4d-9c65-7515fe6f4b2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a884296-8f') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '13cdd44b-2f02-56bc-b56e-2b014e063db1', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a884296-8f, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6a884296-8f, col_values=(('qos', UUID('8928d74e-2cc5-46da-908e-1b5bf2dd9525')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6a884296-8f, col_values=(('external_ids', {'iface-id': '6a884296-8f6f-4647-b4c6-09d7f4e92887', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:e1:5b', 'vm-uuid': 'bf357856-2d97-42e8-928d-71d0378f48c8'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:14 user nova-compute[74994]: INFO os_vif [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:e1:5b,bridge_name='br-int',has_traffic_filtering=True,id=6a884296-8f6f-4647-b4c6-09d7f4e92887,network=Network(77bc68aa-1654-4e4d-9c65-7515fe6f4b2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a884296-8f')
Nov 28 10:49:14 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:49:14 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] No VIF found with MAC fa:16:3e:a2:e1:5b, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG nova.network.neutron [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Successfully updated port: df20cfaa-368c-4bfd-b535-9192c3f240a0 {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG nova.network.neutron [req-45ccd6cd-4170-46a1-90f4-168a8f8a36db req-d575aa44-0fd4-4089-b896-a549e341b9be service nova] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Updated VIF entry in instance network info cache for port 2f85c58c-a67a-435e-95bd-ae59a03c7a14. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG nova.network.neutron [req-45ccd6cd-4170-46a1-90f4-168a8f8a36db req-d575aa44-0fd4-4089-b896-a549e341b9be service nova] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Updating instance_info_cache with network_info: [{"id": "2f85c58c-a67a-435e-95bd-ae59a03c7a14", "address": "fa:16:3e:96:7b:84", "network": {"id": "99dc7b50-b4f4-4cdd-83fa-8efbdcdac028", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1822691421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00249c339d324b7990aac48ea640d770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f85c58c-a6", "ovs_interfaceid": "2f85c58c-a67a-435e-95bd-ae59a03c7a14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Acquiring lock "refresh_cache-5b51d690-8198-4748-807d-1902e75564b9" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Acquired lock "refresh_cache-5b51d690-8198-4748-807d-1902e75564b9" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG nova.network.neutron [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-45ccd6cd-4170-46a1-90f4-168a8f8a36db req-d575aa44-0fd4-4089-b896-a549e341b9be service nova] Releasing lock "refresh_cache-a8b4b5dc-0696-4a01-8318-7d3ec2014d6e" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG nova.compute.manager [req-c989f0ca-73ca-43d0-b634-97f06f4d7964 req-cfd72d68-8b40-4b7d-9cef-7d61846b895e service nova] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Received event network-changed-df20cfaa-368c-4bfd-b535-9192c3f240a0 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG nova.compute.manager [req-c989f0ca-73ca-43d0-b634-97f06f4d7964 req-cfd72d68-8b40-4b7d-9cef-7d61846b895e service nova] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Refreshing instance network info cache due to event network-changed-df20cfaa-368c-4bfd-b535-9192c3f240a0. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c989f0ca-73ca-43d0-b634-97f06f4d7964 req-cfd72d68-8b40-4b7d-9cef-7d61846b895e service nova] Acquiring lock "refresh_cache-5b51d690-8198-4748-807d-1902e75564b9" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG nova.network.neutron [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "cce813fa-bf97-41f8-8aee-c7a73354e24c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "cce813fa-bf97-41f8-8aee-c7a73354e24c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG nova.compute.manager [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 10:49:15 user nova-compute[74994]: INFO nova.compute.claims [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Claim successful on node user
Nov 28 10:49:15 user nova-compute[74994]: DEBUG nova.network.neutron [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Updating instance_info_cache with network_info: [{"id": "df20cfaa-368c-4bfd-b535-9192c3f240a0", "address": "fa:16:3e:c3:4c:99", "network": {"id": "434398a7-094f-4b01-ae77-ae83f21a8390", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1446659533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c23e61575784c8baffda1deda7812fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf20cfaa-36", "ovs_interfaceid": "df20cfaa-368c-4bfd-b535-9192c3f240a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Releasing lock "refresh_cache-5b51d690-8198-4748-807d-1902e75564b9" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG nova.compute.manager [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Instance network_info: |[{"id": "df20cfaa-368c-4bfd-b535-9192c3f240a0", "address": "fa:16:3e:c3:4c:99", "network": {"id": "434398a7-094f-4b01-ae77-ae83f21a8390", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1446659533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c23e61575784c8baffda1deda7812fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf20cfaa-36", "ovs_interfaceid": "df20cfaa-368c-4bfd-b535-9192c3f240a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c989f0ca-73ca-43d0-b634-97f06f4d7964 req-cfd72d68-8b40-4b7d-9cef-7d61846b895e service nova] Acquired lock "refresh_cache-5b51d690-8198-4748-807d-1902e75564b9" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG nova.network.neutron [req-c989f0ca-73ca-43d0-b634-97f06f4d7964 req-cfd72d68-8b40-4b7d-9cef-7d61846b895e service nova] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Refreshing network info cache for port df20cfaa-368c-4bfd-b535-9192c3f240a0 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Start _get_guest_xml network_info=[{"id": "df20cfaa-368c-4bfd-b535-9192c3f240a0", "address": "fa:16:3e:c3:4c:99", "network": {"id": "434398a7-094f-4b01-ae77-ae83f21a8390", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1446659533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c23e61575784c8baffda1deda7812fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf20cfaa-36", "ovs_interfaceid": "df20cfaa-368c-4bfd-b535-9192c3f240a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'aa939d1b-b8a6-4391-935b-0191bf5ccd0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 10:49:15 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:49:15 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:49:15 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:49:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-64217862',display_name='tempest-ServersNegativeTestJSON-server-64217862',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-64217862',id=5,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c23e61575784c8baffda1deda7812fd',ramdisk_id='',reservation_id='r-9v5we5o3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1243683462',owner_user_name='tempest-ServersNegativeTestJSON-1243683462-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:49:08Z,user_data=None,user_id='3c29f1c4e20e4bfd80b1d565b58330aa',uuid=5b51d690-8198-4748-807d-1902e75564b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df20cfaa-368c-4bfd-b535-9192c3f240a0", "address": "fa:16:3e:c3:4c:99", "network": {"id": "434398a7-094f-4b01-ae77-ae83f21a8390", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1446659533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c23e61575784c8baffda1deda7812fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf20cfaa-36", "ovs_interfaceid": "df20cfaa-368c-4bfd-b535-9192c3f240a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Converting VIF {"id": "df20cfaa-368c-4bfd-b535-9192c3f240a0", "address": "fa:16:3e:c3:4c:99", "network": {"id": "434398a7-094f-4b01-ae77-ae83f21a8390", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1446659533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c23e61575784c8baffda1deda7812fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf20cfaa-36", "ovs_interfaceid": "df20cfaa-368c-4bfd-b535-9192c3f240a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:4c:99,bridge_name='br-int',has_traffic_filtering=True,id=df20cfaa-368c-4bfd-b535-9192c3f240a0,network=Network(434398a7-094f-4b01-ae77-ae83f21a8390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf20cfaa-36') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG nova.objects.instance [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b51d690-8198-4748-807d-1902e75564b9 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: 5b51d690-8198-4748-807d-1902e75564b9] End _get_guest_xml xml=<domain type="kvm">
Nov 28 10:49:15 user nova-compute[74994]:   <uuid>5b51d690-8198-4748-807d-1902e75564b9</uuid>
Nov 28 10:49:15 user nova-compute[74994]:   <name>instance-00000005</name>
Nov 28 10:49:15 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 10:49:15 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 10:49:15 user nova-compute[74994]:   <metadata>
Nov 28 10:49:15 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 10:49:15 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 10:49:15 user nova-compute[74994]:       <nova:name>tempest-ServersNegativeTestJSON-server-64217862</nova:name>
Nov 28 10:49:15 user nova-compute[74994]:       <nova:creationTime>2023-11-28 10:49:15</nova:creationTime>
Nov 28 10:49:15 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 10:49:15 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 10:49:15 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 10:49:15 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 10:49:15 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 10:49:15 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 10:49:15 user nova-compute[74994]:       </nova:flavor>
Nov 28 10:49:15 user nova-compute[74994]:       <nova:owner>
Nov 28 10:49:15 user nova-compute[74994]:         <nova:user uuid="3c29f1c4e20e4bfd80b1d565b58330aa">tempest-ServersNegativeTestJSON-1243683462-project-member</nova:user>
Nov 28 10:49:15 user nova-compute[74994]:         <nova:project uuid="1c23e61575784c8baffda1deda7812fd">tempest-ServersNegativeTestJSON-1243683462</nova:project>
Nov 28 10:49:15 user nova-compute[74994]:       </nova:owner>
Nov 28 10:49:15 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 10:49:15 user nova-compute[74994]:       <nova:ports>
Nov 28 10:49:15 user nova-compute[74994]:         <nova:port uuid="df20cfaa-368c-4bfd-b535-9192c3f240a0">
Nov 28 10:49:15 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 10:49:15 user nova-compute[74994]:         </nova:port>
Nov 28 10:49:15 user nova-compute[74994]:       </nova:ports>
Nov 28 10:49:15 user nova-compute[74994]:     </nova:instance>
Nov 28 10:49:15 user nova-compute[74994]:   </metadata>
Nov 28 10:49:15 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 10:49:15 user nova-compute[74994]:     <system>
Nov 28 10:49:15 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 10:49:15 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 10:49:15 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 10:49:15 user nova-compute[74994]:       <entry name="serial">5b51d690-8198-4748-807d-1902e75564b9</entry>
Nov 28 10:49:15 user nova-compute[74994]:       <entry name="uuid">5b51d690-8198-4748-807d-1902e75564b9</entry>
Nov 28 10:49:15 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 10:49:15 user nova-compute[74994]:     </system>
Nov 28 10:49:15 user nova-compute[74994]:   </sysinfo>
Nov 28 10:49:15 user nova-compute[74994]:   <os>
Nov 28 10:49:15 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 10:49:15 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 10:49:15 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 10:49:15 user nova-compute[74994]:   </os>
Nov 28 10:49:15 user nova-compute[74994]:   <features>
Nov 28 10:49:15 user nova-compute[74994]:     <acpi/>
Nov 28 10:49:15 user nova-compute[74994]:     <apic/>
Nov 28 10:49:15 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 10:49:15 user nova-compute[74994]:   </features>
Nov 28 10:49:15 user nova-compute[74994]:   <clock offset="utc">
Nov 28 10:49:15 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 10:49:15 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 10:49:15 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 10:49:15 user nova-compute[74994]:   </clock>
Nov 28 10:49:15 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 10:49:15 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 10:49:15 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 10:49:15 user nova-compute[74994]:   </cpu>
Nov 28 10:49:15 user nova-compute[74994]:   <devices>
Nov 28 10:49:15 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 10:49:15 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 10:49:15 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/5b51d690-8198-4748-807d-1902e75564b9/disk"/>
Nov 28 10:49:15 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 10:49:15 user nova-compute[74994]:     </disk>
Nov 28 10:49:15 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 10:49:15 user nova-compute[74994]:       <mac address="fa:16:3e:c3:4c:99"/>
Nov 28 10:49:15 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:49:15 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 10:49:15 user nova-compute[74994]:       <target dev="tapdf20cfaa-36"/>
Nov 28 10:49:15 user nova-compute[74994]:     </interface>
Nov 28 10:49:15 user nova-compute[74994]:     <serial type="pty">
Nov 28 10:49:15 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/5b51d690-8198-4748-807d-1902e75564b9/console.log" append="off"/>
Nov 28 10:49:15 user nova-compute[74994]:     </serial>
Nov 28 10:49:15 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 10:49:15 user nova-compute[74994]:     <video>
Nov 28 10:49:15 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:49:15 user nova-compute[74994]:     </video>
Nov 28 10:49:15 user nova-compute[74994]:     <rng model="virtio">
Nov 28 10:49:15 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 10:49:15 user nova-compute[74994]:     </rng>
Nov 28 10:49:15 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 10:49:15 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 10:49:15 user nova-compute[74994]:       <stats period="10"/>
Nov 28 10:49:15 user nova-compute[74994]:     </memballoon>
Nov 28 10:49:15 user nova-compute[74994]:   </devices>
Nov 28 10:49:15 user nova-compute[74994]: </domain>
Nov 28 10:49:15 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:49:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-64217862',display_name='tempest-ServersNegativeTestJSON-server-64217862',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-64217862',id=5,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c23e61575784c8baffda1deda7812fd',ramdisk_id='',reservation_id='r-9v5we5o3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1243683462',owner_user_name='tempest-ServersNegativeTestJSON-1243683462-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:49:08Z,user_data=None,user_id='3c29f1c4e20e4bfd80b1d565b58330aa',uuid=5b51d690-8198-4748-807d-1902e75564b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df20cfaa-368c-4bfd-b535-9192c3f240a0", "address": "fa:16:3e:c3:4c:99", "network": {"id": "434398a7-094f-4b01-ae77-ae83f21a8390", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1446659533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c23e61575784c8baffda1deda7812fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf20cfaa-36", "ovs_interfaceid": "df20cfaa-368c-4bfd-b535-9192c3f240a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Converting VIF {"id": "df20cfaa-368c-4bfd-b535-9192c3f240a0", "address": "fa:16:3e:c3:4c:99", "network": {"id": "434398a7-094f-4b01-ae77-ae83f21a8390", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1446659533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c23e61575784c8baffda1deda7812fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf20cfaa-36", "ovs_interfaceid": "df20cfaa-368c-4bfd-b535-9192c3f240a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:4c:99,bridge_name='br-int',has_traffic_filtering=True,id=df20cfaa-368c-4bfd-b535-9192c3f240a0,network=Network(434398a7-094f-4b01-ae77-ae83f21a8390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf20cfaa-36') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG os_vif [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:4c:99,bridge_name='br-int',has_traffic_filtering=True,id=df20cfaa-368c-4bfd-b535-9192c3f240a0,network=Network(434398a7-094f-4b01-ae77-ae83f21a8390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf20cfaa-36') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '934e2a4b-a7f2-5c5e-99f9-07ff4562056e', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.428s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG nova.compute.manager [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf20cfaa-36, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdf20cfaa-36, col_values=(('qos', UUID('712123c9-c268-4521-9aa5-5b1d078231b7')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdf20cfaa-36, col_values=(('external_ids', {'iface-id': 'df20cfaa-368c-4bfd-b535-9192c3f240a0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:4c:99', 'vm-uuid': '5b51d690-8198-4748-807d-1902e75564b9'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:15 user nova-compute[74994]: INFO os_vif [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:4c:99,bridge_name='br-int',has_traffic_filtering=True,id=df20cfaa-368c-4bfd-b535-9192c3f240a0,network=Network(434398a7-094f-4b01-ae77-ae83f21a8390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf20cfaa-36')
Nov 28 10:49:15 user nova-compute[74994]: DEBUG nova.compute.manager [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG nova.network.neutron [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 10:49:15 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 10:49:15 user nova-compute[74994]: DEBUG nova.compute.manager [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:49:15 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] No VIF found with MAC fa:16:3e:c3:4c:99, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:49:16 user nova-compute[74994]: DEBUG nova.compute.manager [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 10:49:16 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 10:49:16 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Creating image(s)
Nov 28 10:49:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "/opt/stack/data/nova/instances/cce813fa-bf97-41f8-8aee-c7a73354e24c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "/opt/stack/data/nova/instances/cce813fa-bf97-41f8-8aee-c7a73354e24c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "/opt/stack/data/nova/instances/cce813fa-bf97-41f8-8aee-c7a73354e24c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:16 user nova-compute[74994]: DEBUG nova.policy [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa362c35530641a687a33182012c2332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636fa9a1f046425e9332cc3807f8fb46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 10:49:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.210s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.182s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/cce813fa-bf97-41f8-8aee-c7a73354e24c/disk 1073741824 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:16 user nova-compute[74994]: DEBUG nova.network.neutron [req-07e64bac-2908-4bb9-89ed-caa46943c041 req-2abae61d-446e-4f60-91f5-774f15c6c99d service nova] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Updated VIF entry in instance network info cache for port 6a884296-8f6f-4647-b4c6-09d7f4e92887. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 10:49:16 user nova-compute[74994]: DEBUG nova.network.neutron [req-07e64bac-2908-4bb9-89ed-caa46943c041 req-2abae61d-446e-4f60-91f5-774f15c6c99d service nova] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Updating instance_info_cache with network_info: [{"id": "6a884296-8f6f-4647-b4c6-09d7f4e92887", "address": "fa:16:3e:a2:e1:5b", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a884296-8f", "ovs_interfaceid": "6a884296-8f6f-4647-b4c6-09d7f4e92887", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:49:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/cce813fa-bf97-41f8-8aee-c7a73354e24c/disk 1073741824" returned: 0 in 0.054s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-07e64bac-2908-4bb9-89ed-caa46943c041 req-2abae61d-446e-4f60-91f5-774f15c6c99d service nova] Releasing lock "refresh_cache-bf357856-2d97-42e8-928d-71d0378f48c8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:49:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.187s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:16 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cce813fa-bf97-41f8-8aee-c7a73354e24c/disk. size=1073741824 {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 10:49:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce813fa-bf97-41f8-8aee-c7a73354e24c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce813fa-bf97-41f8-8aee-c7a73354e24c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:16 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Cannot resize image /opt/stack/data/nova/instances/cce813fa-bf97-41f8-8aee-c7a73354e24c/disk to a smaller size. {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 10:49:16 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Created local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 10:49:16 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Ensure instance console log exists: /opt/stack/data/nova/instances/cce813fa-bf97-41f8-8aee-c7a73354e24c/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 10:49:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:16 user nova-compute[74994]: DEBUG nova.network.neutron [req-c989f0ca-73ca-43d0-b634-97f06f4d7964 req-cfd72d68-8b40-4b7d-9cef-7d61846b895e service nova] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Updated VIF entry in instance network info cache for port df20cfaa-368c-4bfd-b535-9192c3f240a0. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 10:49:16 user nova-compute[74994]: DEBUG nova.network.neutron [req-c989f0ca-73ca-43d0-b634-97f06f4d7964 req-cfd72d68-8b40-4b7d-9cef-7d61846b895e service nova] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Updating instance_info_cache with network_info: [{"id": "df20cfaa-368c-4bfd-b535-9192c3f240a0", "address": "fa:16:3e:c3:4c:99", "network": {"id": "434398a7-094f-4b01-ae77-ae83f21a8390", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1446659533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c23e61575784c8baffda1deda7812fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf20cfaa-36", "ovs_interfaceid": "df20cfaa-368c-4bfd-b535-9192c3f240a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:49:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c989f0ca-73ca-43d0-b634-97f06f4d7964 req-cfd72d68-8b40-4b7d-9cef-7d61846b895e service nova] Releasing lock "refresh_cache-5b51d690-8198-4748-807d-1902e75564b9" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:49:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Acquiring lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:17 user nova-compute[74994]: DEBUG nova.compute.manager [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 10:49:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:17 user nova-compute[74994]: DEBUG nova.network.neutron [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Successfully created port: 744c3452-d7cd-44a1-83d5-a60e6db5b8b5 {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 10:49:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:19 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:19 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:19 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:19 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:19 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:20 user nova-compute[74994]: DEBUG nova.network.neutron [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Successfully updated port: 744c3452-d7cd-44a1-83d5-a60e6db5b8b5 {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 10:49:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "refresh_cache-cce813fa-bf97-41f8-8aee-c7a73354e24c" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:49:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquired lock "refresh_cache-cce813fa-bf97-41f8-8aee-c7a73354e24c" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:49:20 user nova-compute[74994]: DEBUG nova.network.neutron [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 10:49:20 user nova-compute[74994]: DEBUG nova.compute.manager [req-7077e47c-9a31-4339-8d7b-eaf26da2a641 req-0ea5fb05-5839-494b-848d-68c3e01d1a12 service nova] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Received event network-changed-744c3452-d7cd-44a1-83d5-a60e6db5b8b5 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:49:20 user nova-compute[74994]: DEBUG nova.compute.manager [req-7077e47c-9a31-4339-8d7b-eaf26da2a641 req-0ea5fb05-5839-494b-848d-68c3e01d1a12 service nova] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Refreshing instance network info cache due to event network-changed-744c3452-d7cd-44a1-83d5-a60e6db5b8b5. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:49:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-7077e47c-9a31-4339-8d7b-eaf26da2a641 req-0ea5fb05-5839-494b-848d-68c3e01d1a12 service nova] Acquiring lock "refresh_cache-cce813fa-bf97-41f8-8aee-c7a73354e24c" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:49:20 user nova-compute[74994]: DEBUG nova.network.neutron [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 10:49:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:20 user nova-compute[74994]: DEBUG nova.network.neutron [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Updating instance_info_cache with network_info: [{"id": "744c3452-d7cd-44a1-83d5-a60e6db5b8b5", "address": "fa:16:3e:a0:b1:ed", "network": {"id": "d9bcdec6-69e0-4e65-8a26-1af1f8232365", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1227861580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "636fa9a1f046425e9332cc3807f8fb46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744c3452-d7", "ovs_interfaceid": "744c3452-d7cd-44a1-83d5-a60e6db5b8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:49:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Releasing lock "refresh_cache-cce813fa-bf97-41f8-8aee-c7a73354e24c" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:49:20 user nova-compute[74994]: DEBUG nova.compute.manager [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Instance network_info: |[{"id": "744c3452-d7cd-44a1-83d5-a60e6db5b8b5", "address": "fa:16:3e:a0:b1:ed", "network": {"id": "d9bcdec6-69e0-4e65-8a26-1af1f8232365", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1227861580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "636fa9a1f046425e9332cc3807f8fb46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744c3452-d7", "ovs_interfaceid": "744c3452-d7cd-44a1-83d5-a60e6db5b8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 10:49:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-7077e47c-9a31-4339-8d7b-eaf26da2a641 req-0ea5fb05-5839-494b-848d-68c3e01d1a12 service nova] Acquired lock "refresh_cache-cce813fa-bf97-41f8-8aee-c7a73354e24c" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:49:20 user nova-compute[74994]: DEBUG nova.network.neutron [req-7077e47c-9a31-4339-8d7b-eaf26da2a641 req-0ea5fb05-5839-494b-848d-68c3e01d1a12 service nova] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Refreshing network info cache for port 744c3452-d7cd-44a1-83d5-a60e6db5b8b5 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:49:20 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Start _get_guest_xml network_info=[{"id": "744c3452-d7cd-44a1-83d5-a60e6db5b8b5", "address": "fa:16:3e:a0:b1:ed", "network": {"id": "d9bcdec6-69e0-4e65-8a26-1af1f8232365", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1227861580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "636fa9a1f046425e9332cc3807f8fb46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744c3452-d7", "ovs_interfaceid": "744c3452-d7cd-44a1-83d5-a60e6db5b8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'aa939d1b-b8a6-4391-935b-0191bf5ccd0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 10:49:21 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:21 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:21 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:21 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:22 user nova-compute[74994]: DEBUG nova.network.neutron [req-7077e47c-9a31-4339-8d7b-eaf26da2a641 req-0ea5fb05-5839-494b-848d-68c3e01d1a12 service nova] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Updated VIF entry in instance network info cache for port 744c3452-d7cd-44a1-83d5-a60e6db5b8b5. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 10:49:22 user nova-compute[74994]: DEBUG nova.network.neutron [req-7077e47c-9a31-4339-8d7b-eaf26da2a641 req-0ea5fb05-5839-494b-848d-68c3e01d1a12 service nova] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Updating instance_info_cache with network_info: [{"id": "744c3452-d7cd-44a1-83d5-a60e6db5b8b5", "address": "fa:16:3e:a0:b1:ed", "network": {"id": "d9bcdec6-69e0-4e65-8a26-1af1f8232365", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1227861580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "636fa9a1f046425e9332cc3807f8fb46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744c3452-d7", "ovs_interfaceid": "744c3452-d7cd-44a1-83d5-a60e6db5b8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:49:22 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-7077e47c-9a31-4339-8d7b-eaf26da2a641 req-0ea5fb05-5839-494b-848d-68c3e01d1a12 service nova] Releasing lock "refresh_cache-cce813fa-bf97-41f8-8aee-c7a73354e24c" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:49:22 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:22 user nova-compute[74994]: DEBUG nova.compute.manager [req-a4fef577-08c6-4ab8-98bb-7d3c32124a9f req-c3d146d2-3367-4d77-aef0-b47c448a5ffc service nova] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Received event network-vif-plugged-2f85c58c-a67a-435e-95bd-ae59a03c7a14 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:49:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a4fef577-08c6-4ab8-98bb-7d3c32124a9f req-c3d146d2-3367-4d77-aef0-b47c448a5ffc service nova] Acquiring lock "a8b4b5dc-0696-4a01-8318-7d3ec2014d6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a4fef577-08c6-4ab8-98bb-7d3c32124a9f req-c3d146d2-3367-4d77-aef0-b47c448a5ffc service nova] Lock "a8b4b5dc-0696-4a01-8318-7d3ec2014d6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a4fef577-08c6-4ab8-98bb-7d3c32124a9f req-c3d146d2-3367-4d77-aef0-b47c448a5ffc service nova] Lock "a8b4b5dc-0696-4a01-8318-7d3ec2014d6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:22 user nova-compute[74994]: DEBUG nova.compute.manager [req-a4fef577-08c6-4ab8-98bb-7d3c32124a9f req-c3d146d2-3367-4d77-aef0-b47c448a5ffc service nova] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] No waiting events found dispatching network-vif-plugged-2f85c58c-a67a-435e-95bd-ae59a03c7a14 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:49:22 user nova-compute[74994]: WARNING nova.compute.manager [req-a4fef577-08c6-4ab8-98bb-7d3c32124a9f req-c3d146d2-3367-4d77-aef0-b47c448a5ffc service nova] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Received unexpected event network-vif-plugged-2f85c58c-a67a-435e-95bd-ae59a03c7a14 for instance with vm_state building and task_state spawning.
Nov 28 10:49:22 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.compute.manager [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 10:49:24 user nova-compute[74994]: INFO nova.compute.claims [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Claim successful on node user
Nov 28 10:49:24 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Instance spawned successfully.
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 10:49:24 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:49:24 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:49:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-277000810',display_name='tempest-AttachVolumeNegativeTest-server-277000810',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-277000810',id=6,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqyGoyqq5ybVPtbq9a8ErmsWpHQnEQKLnTRhnq7E2SRAkhGjN5czYMIqSRkI2mBZOGesl4H/Y2EWJXHNPRUARyU8uw6WzMpmGalPoMcIscidM19xIHw1dCacIRcTYXyxQ==',key_name='tempest-keypair-98588548',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='636fa9a1f046425e9332cc3807f8fb46',ramdisk_id='',reservation_id='r-yh7vzi5x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-3431122',owner_user_name='tempest-AttachVolumeNegativeTest-3431122-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:49:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa362c35530641a687a33182012c2332',uuid=cce813fa-bf97-41f8-8aee-c7a73354e24c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "744c3452-d7cd-44a1-83d5-a60e6db5b8b5", "address": "fa:16:3e:a0:b1:ed", "network": {"id": "d9bcdec6-69e0-4e65-8a26-1af1f8232365", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1227861580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "636fa9a1f046425e9332cc3807f8fb46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744c3452-d7", "ovs_interfaceid": "744c3452-d7cd-44a1-83d5-a60e6db5b8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Converting VIF {"id": "744c3452-d7cd-44a1-83d5-a60e6db5b8b5", "address": "fa:16:3e:a0:b1:ed", "network": {"id": "d9bcdec6-69e0-4e65-8a26-1af1f8232365", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1227861580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "636fa9a1f046425e9332cc3807f8fb46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744c3452-d7", "ovs_interfaceid": "744c3452-d7cd-44a1-83d5-a60e6db5b8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b1:ed,bridge_name='br-int',has_traffic_filtering=True,id=744c3452-d7cd-44a1-83d5-a60e6db5b8b5,network=Network(d9bcdec6-69e0-4e65-8a26-1af1f8232365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap744c3452-d7') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.objects.instance [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lazy-loading 'pci_devices' on Instance uuid cce813fa-bf97-41f8-8aee-c7a73354e24c {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] End _get_guest_xml xml=<domain type="kvm">
Nov 28 10:49:24 user nova-compute[74994]:   <uuid>cce813fa-bf97-41f8-8aee-c7a73354e24c</uuid>
Nov 28 10:49:24 user nova-compute[74994]:   <name>instance-00000006</name>
Nov 28 10:49:24 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 10:49:24 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 10:49:24 user nova-compute[74994]:   <metadata>
Nov 28 10:49:24 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 10:49:24 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 10:49:24 user nova-compute[74994]:       <nova:name>tempest-AttachVolumeNegativeTest-server-277000810</nova:name>
Nov 28 10:49:24 user nova-compute[74994]:       <nova:creationTime>2023-11-28 10:49:24</nova:creationTime>
Nov 28 10:49:24 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 10:49:24 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 10:49:24 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 10:49:24 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 10:49:24 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 10:49:24 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 10:49:24 user nova-compute[74994]:       </nova:flavor>
Nov 28 10:49:24 user nova-compute[74994]:       <nova:owner>
Nov 28 10:49:24 user nova-compute[74994]:         <nova:user uuid="aa362c35530641a687a33182012c2332">tempest-AttachVolumeNegativeTest-3431122-project-member</nova:user>
Nov 28 10:49:24 user nova-compute[74994]:         <nova:project uuid="636fa9a1f046425e9332cc3807f8fb46">tempest-AttachVolumeNegativeTest-3431122</nova:project>
Nov 28 10:49:24 user nova-compute[74994]:       </nova:owner>
Nov 28 10:49:24 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 10:49:24 user nova-compute[74994]:       <nova:ports>
Nov 28 10:49:24 user nova-compute[74994]:         <nova:port uuid="744c3452-d7cd-44a1-83d5-a60e6db5b8b5">
Nov 28 10:49:24 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 10:49:24 user nova-compute[74994]:         </nova:port>
Nov 28 10:49:24 user nova-compute[74994]:       </nova:ports>
Nov 28 10:49:24 user nova-compute[74994]:     </nova:instance>
Nov 28 10:49:24 user nova-compute[74994]:   </metadata>
Nov 28 10:49:24 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 10:49:24 user nova-compute[74994]:     <system>
Nov 28 10:49:24 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 10:49:24 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 10:49:24 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 10:49:24 user nova-compute[74994]:       <entry name="serial">cce813fa-bf97-41f8-8aee-c7a73354e24c</entry>
Nov 28 10:49:24 user nova-compute[74994]:       <entry name="uuid">cce813fa-bf97-41f8-8aee-c7a73354e24c</entry>
Nov 28 10:49:24 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 10:49:24 user nova-compute[74994]:     </system>
Nov 28 10:49:24 user nova-compute[74994]:   </sysinfo>
Nov 28 10:49:24 user nova-compute[74994]:   <os>
Nov 28 10:49:24 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 10:49:24 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 10:49:24 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 10:49:24 user nova-compute[74994]:   </os>
Nov 28 10:49:24 user nova-compute[74994]:   <features>
Nov 28 10:49:24 user nova-compute[74994]:     <acpi/>
Nov 28 10:49:24 user nova-compute[74994]:     <apic/>
Nov 28 10:49:24 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 10:49:24 user nova-compute[74994]:   </features>
Nov 28 10:49:24 user nova-compute[74994]:   <clock offset="utc">
Nov 28 10:49:24 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 10:49:24 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 10:49:24 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 10:49:24 user nova-compute[74994]:   </clock>
Nov 28 10:49:24 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 10:49:24 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 10:49:24 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 10:49:24 user nova-compute[74994]:   </cpu>
Nov 28 10:49:24 user nova-compute[74994]:   <devices>
Nov 28 10:49:24 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 10:49:24 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 10:49:24 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/cce813fa-bf97-41f8-8aee-c7a73354e24c/disk"/>
Nov 28 10:49:24 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 10:49:24 user nova-compute[74994]:     </disk>
Nov 28 10:49:24 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 10:49:24 user nova-compute[74994]:       <mac address="fa:16:3e:a0:b1:ed"/>
Nov 28 10:49:24 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:49:24 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 10:49:24 user nova-compute[74994]:       <target dev="tap744c3452-d7"/>
Nov 28 10:49:24 user nova-compute[74994]:     </interface>
Nov 28 10:49:24 user nova-compute[74994]:     <serial type="pty">
Nov 28 10:49:24 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/cce813fa-bf97-41f8-8aee-c7a73354e24c/console.log" append="off"/>
Nov 28 10:49:24 user nova-compute[74994]:     </serial>
Nov 28 10:49:24 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 10:49:24 user nova-compute[74994]:     <video>
Nov 28 10:49:24 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:49:24 user nova-compute[74994]:     </video>
Nov 28 10:49:24 user nova-compute[74994]:     <rng model="virtio">
Nov 28 10:49:24 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 10:49:24 user nova-compute[74994]:     </rng>
Nov 28 10:49:24 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 10:49:24 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 10:49:24 user nova-compute[74994]:       <stats period="10"/>
Nov 28 10:49:24 user nova-compute[74994]:     </memballoon>
Nov 28 10:49:24 user nova-compute[74994]:   </devices>
Nov 28 10:49:24 user nova-compute[74994]: </domain>
Nov 28 10:49:24 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:49:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-277000810',display_name='tempest-AttachVolumeNegativeTest-server-277000810',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-277000810',id=6,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqyGoyqq5ybVPtbq9a8ErmsWpHQnEQKLnTRhnq7E2SRAkhGjN5czYMIqSRkI2mBZOGesl4H/Y2EWJXHNPRUARyU8uw6WzMpmGalPoMcIscidM19xIHw1dCacIRcTYXyxQ==',key_name='tempest-keypair-98588548',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='636fa9a1f046425e9332cc3807f8fb46',ramdisk_id='',reservation_id='r-yh7vzi5x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-3431122',owner_user_name='tempest-AttachVolumeNegativeTest-3431122-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:49:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa362c35530641a687a33182012c2332',uuid=cce813fa-bf97-41f8-8aee-c7a73354e24c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "744c3452-d7cd-44a1-83d5-a60e6db5b8b5", "address": "fa:16:3e:a0:b1:ed", "network": {"id": "d9bcdec6-69e0-4e65-8a26-1af1f8232365", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1227861580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "636fa9a1f046425e9332cc3807f8fb46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744c3452-d7", "ovs_interfaceid": "744c3452-d7cd-44a1-83d5-a60e6db5b8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Converting VIF {"id": "744c3452-d7cd-44a1-83d5-a60e6db5b8b5", "address": "fa:16:3e:a0:b1:ed", "network": {"id": "d9bcdec6-69e0-4e65-8a26-1af1f8232365", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1227861580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "636fa9a1f046425e9332cc3807f8fb46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744c3452-d7", "ovs_interfaceid": "744c3452-d7cd-44a1-83d5-a60e6db5b8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b1:ed,bridge_name='br-int',has_traffic_filtering=True,id=744c3452-d7cd-44a1-83d5-a60e6db5b8b5,network=Network(d9bcdec6-69e0-4e65-8a26-1af1f8232365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap744c3452-d7') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG os_vif [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b1:ed,bridge_name='br-int',has_traffic_filtering=True,id=744c3452-d7cd-44a1-83d5-a60e6db5b8b5,network=Network(d9bcdec6-69e0-4e65-8a26-1af1f8232365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap744c3452-d7') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.compute.manager [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '990bf2e2-663c-57c4-ad8b-0c6a8c7396e2', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.compute.manager [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.compute.manager [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap744c3452-d7, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap744c3452-d7, col_values=(('qos', UUID('a874cf9f-8724-428f-8ca1-ddcda3be07ff')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap744c3452-d7, col_values=(('external_ids', {'iface-id': '744c3452-d7cd-44a1-83d5-a60e6db5b8b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:b1:ed', 'vm-uuid': 'cce813fa-bf97-41f8-8aee-c7a73354e24c'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:49:24 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Instance spawned successfully.
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 10:49:24 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Instance spawned successfully.
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.compute.manager [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 10:49:24 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Instance spawned successfully.
Nov 28 10:49:24 user nova-compute[74994]: INFO os_vif [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b1:ed,bridge_name='br-int',has_traffic_filtering=True,id=744c3452-d7cd-44a1-83d5-a60e6db5b8b5,network=Network(d9bcdec6-69e0-4e65-8a26-1af1f8232365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap744c3452-d7')
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 10:49:24 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Instance spawned successfully.
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] No VIF found with MAC fa:16:3e:a0:b1:ed, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:49:24 user nova-compute[74994]: INFO nova.compute.manager [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Took 20.53 seconds to spawn the instance on the hypervisor.
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.compute.manager [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 10:49:24 user nova-compute[74994]: INFO nova.compute.manager [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Took 18.59 seconds to spawn the instance on the hypervisor.
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.compute.manager [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 10:49:24 user nova-compute[74994]: INFO nova.compute.manager [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Took 16.47 seconds to spawn the instance on the hypervisor.
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.compute.manager [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 10:49:24 user nova-compute[74994]: INFO nova.compute.manager [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Took 17.94 seconds to spawn the instance on the hypervisor.
Nov 28 10:49:24 user nova-compute[74994]: DEBUG nova.compute.manager [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 10:49:25 user nova-compute[74994]: INFO nova.compute.manager [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Took 17.49 seconds to spawn the instance on the hypervisor.
Nov 28 10:49:25 user nova-compute[74994]: DEBUG nova.compute.manager [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 10:49:25 user nova-compute[74994]: DEBUG nova.compute.manager [req-301d896d-7435-4784-a200-bdb33477ee78 req-c15ec215-434e-408c-ae77-20056a69e57b service nova] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Received event network-vif-plugged-2f85c58c-a67a-435e-95bd-ae59a03c7a14 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:49:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-301d896d-7435-4784-a200-bdb33477ee78 req-c15ec215-434e-408c-ae77-20056a69e57b service nova] Acquiring lock "a8b4b5dc-0696-4a01-8318-7d3ec2014d6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-301d896d-7435-4784-a200-bdb33477ee78 req-c15ec215-434e-408c-ae77-20056a69e57b service nova] Lock "a8b4b5dc-0696-4a01-8318-7d3ec2014d6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-301d896d-7435-4784-a200-bdb33477ee78 req-c15ec215-434e-408c-ae77-20056a69e57b service nova] Lock "a8b4b5dc-0696-4a01-8318-7d3ec2014d6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:25 user nova-compute[74994]: DEBUG nova.compute.manager [req-301d896d-7435-4784-a200-bdb33477ee78 req-c15ec215-434e-408c-ae77-20056a69e57b service nova] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] No waiting events found dispatching network-vif-plugged-2f85c58c-a67a-435e-95bd-ae59a03c7a14 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:49:25 user nova-compute[74994]: WARNING nova.compute.manager [req-301d896d-7435-4784-a200-bdb33477ee78 req-c15ec215-434e-408c-ae77-20056a69e57b service nova] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Received unexpected event network-vif-plugged-2f85c58c-a67a-435e-95bd-ae59a03c7a14 for instance with vm_state building and task_state spawning.
Nov 28 10:49:25 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:49:25 user nova-compute[74994]: INFO nova.compute.manager [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Took 17.86 seconds to build instance.
Nov 28 10:49:25 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:49:25 user nova-compute[74994]: INFO nova.compute.manager [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Took 19.97 seconds to build instance.
Nov 28 10:49:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 7.738s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:25 user nova-compute[74994]: DEBUG nova.compute.manager [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 10:49:25 user nova-compute[74994]: INFO nova.compute.manager [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Took 18.95 seconds to build instance.
Nov 28 10:49:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2fdf9534-e6fe-4f68-932a-bf70657d680d tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Lock "a8b4b5dc-0696-4a01-8318-7d3ec2014d6e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.250s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5a2b2ec5-75ab-4a17-b64e-3904c5941318 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "279e1c4c-36f9-492f-ab3f-1b587347eadd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.321s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c1ac895c-6b89-447b-9df6-b5dda6ef4364 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Lock "5b51d690-8198-4748-807d-1902e75564b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.302s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:25 user nova-compute[74994]: INFO nova.compute.manager [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Took 22.08 seconds to build instance.
Nov 28 10:49:25 user nova-compute[74994]: INFO nova.compute.manager [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Took 19.29 seconds to build instance.
Nov 28 10:49:25 user nova-compute[74994]: DEBUG nova.compute.manager [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 10:49:25 user nova-compute[74994]: DEBUG nova.network.neutron [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 10:49:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4db5fd6c-6b4f-4f99-b326-aa6ffee32ba1 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.472s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:25 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 10:49:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3ea5aa7a-ddd0-422f-9eb5-aee92b59d140 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "bf357856-2d97-42e8-928d-71d0378f48c8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.604s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:25 user nova-compute[74994]: DEBUG nova.compute.manager [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 10:49:25 user nova-compute[74994]: DEBUG nova.policy [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0d4253b9511f408a9c62c79cff8fc0d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9bc007c45c84765bb2739844c7af055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 10:49:25 user nova-compute[74994]: DEBUG nova.compute.manager [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 10:49:25 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 10:49:25 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Creating image(s)
Nov 28 10:49:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Acquiring lock "/opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lock "/opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lock "/opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:25 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:26 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.271s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Acquiring lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:26 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:26 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.477s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:26 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk 1073741824 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:26 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk 1073741824" returned: 0 in 0.115s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.603s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:26 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.290s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:27 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk. size=1073741824 {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 10:49:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk --force-share --output=json" returned: 0 in 0.315s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:27 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Cannot resize image /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk to a smaller size. {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 10:49:27 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Created local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 10:49:27 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Ensure instance console log exists: /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 10:49:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.003s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:28 user nova-compute[74994]: DEBUG nova.network.neutron [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Successfully created port: 7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 10:49:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:30 user nova-compute[74994]: DEBUG nova.compute.manager [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 10:49:30 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 10:49:30 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Instance spawned successfully.
Nov 28 10:49:30 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 10:49:30 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:30 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:30 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:30 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:30 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:30 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:31 user nova-compute[74994]: INFO nova.compute.manager [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Took 14.99 seconds to spawn the instance on the hypervisor.
Nov 28 10:49:31 user nova-compute[74994]: DEBUG nova.compute.manager [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 10:49:31 user nova-compute[74994]: INFO nova.compute.manager [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Took 16.01 seconds to build instance.
Nov 28 10:49:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d4381603-69a1-43d4-bf97-f05fd494ad91 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "cce813fa-bf97-41f8-8aee-c7a73354e24c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.179s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:31 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:31 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:32 user nova-compute[74994]: DEBUG nova.compute.manager [req-a93a9e6a-1af6-44c0-94d3-9410863c4642 req-0cca4c09-18ce-4f5c-b246-7803168c8cf6 service nova] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Received event network-vif-plugged-6b1a991d-033b-45ab-839c-7b6b98082667 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:49:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a93a9e6a-1af6-44c0-94d3-9410863c4642 req-0cca4c09-18ce-4f5c-b246-7803168c8cf6 service nova] Acquiring lock "76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a93a9e6a-1af6-44c0-94d3-9410863c4642 req-0cca4c09-18ce-4f5c-b246-7803168c8cf6 service nova] Lock "76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a93a9e6a-1af6-44c0-94d3-9410863c4642 req-0cca4c09-18ce-4f5c-b246-7803168c8cf6 service nova] Lock "76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:32 user nova-compute[74994]: DEBUG nova.compute.manager [req-a93a9e6a-1af6-44c0-94d3-9410863c4642 req-0cca4c09-18ce-4f5c-b246-7803168c8cf6 service nova] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] No waiting events found dispatching network-vif-plugged-6b1a991d-033b-45ab-839c-7b6b98082667 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:49:32 user nova-compute[74994]: WARNING nova.compute.manager [req-a93a9e6a-1af6-44c0-94d3-9410863c4642 req-0cca4c09-18ce-4f5c-b246-7803168c8cf6 service nova] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Received unexpected event network-vif-plugged-6b1a991d-033b-45ab-839c-7b6b98082667 for instance with vm_state active and task_state None.
Nov 28 10:49:33 user nova-compute[74994]: DEBUG nova.network.neutron [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Successfully updated port: 7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 10:49:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Acquiring lock "refresh_cache-2535b6f2-2a4b-4ce1-bd47-0f97d15700fb" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:49:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Acquired lock "refresh_cache-2535b6f2-2a4b-4ce1-bd47-0f97d15700fb" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:49:33 user nova-compute[74994]: DEBUG nova.network.neutron [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 10:49:33 user nova-compute[74994]: DEBUG nova.compute.manager [req-5e8f624c-15c8-4011-9fb6-ae580fdc73a8 req-b0a1992a-31ad-4270-97f4-4cef4d4c0006 service nova] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Received event network-changed-7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:49:33 user nova-compute[74994]: DEBUG nova.compute.manager [req-5e8f624c-15c8-4011-9fb6-ae580fdc73a8 req-b0a1992a-31ad-4270-97f4-4cef4d4c0006 service nova] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Refreshing instance network info cache due to event network-changed-7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:49:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-5e8f624c-15c8-4011-9fb6-ae580fdc73a8 req-b0a1992a-31ad-4270-97f4-4cef4d4c0006 service nova] Acquiring lock "refresh_cache-2535b6f2-2a4b-4ce1-bd47-0f97d15700fb" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:49:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:33 user nova-compute[74994]: DEBUG nova.network.neutron [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 10:49:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:33 user nova-compute[74994]: DEBUG nova.network.neutron [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Updating instance_info_cache with network_info: [{"id": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "address": "fa:16:3e:5d:59:b1", "network": {"id": "670b5fe0-96f5-4414-9425-31ee24eda138", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1327797043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9bc007c45c84765bb2739844c7af055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcb29ac-ee", "ovs_interfaceid": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:49:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Releasing lock "refresh_cache-2535b6f2-2a4b-4ce1-bd47-0f97d15700fb" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:49:33 user nova-compute[74994]: DEBUG nova.compute.manager [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Instance network_info: |[{"id": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "address": "fa:16:3e:5d:59:b1", "network": {"id": "670b5fe0-96f5-4414-9425-31ee24eda138", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1327797043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9bc007c45c84765bb2739844c7af055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcb29ac-ee", "ovs_interfaceid": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 10:49:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-5e8f624c-15c8-4011-9fb6-ae580fdc73a8 req-b0a1992a-31ad-4270-97f4-4cef4d4c0006 service nova] Acquired lock "refresh_cache-2535b6f2-2a4b-4ce1-bd47-0f97d15700fb" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:49:33 user nova-compute[74994]: DEBUG nova.network.neutron [req-5e8f624c-15c8-4011-9fb6-ae580fdc73a8 req-b0a1992a-31ad-4270-97f4-4cef4d4c0006 service nova] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Refreshing network info cache for port 7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:49:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Start _get_guest_xml network_info=[{"id": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "address": "fa:16:3e:5d:59:b1", "network": {"id": "670b5fe0-96f5-4414-9425-31ee24eda138", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1327797043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9bc007c45c84765bb2739844c7af055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcb29ac-ee", "ovs_interfaceid": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'aa939d1b-b8a6-4391-935b-0191bf5ccd0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 10:49:34 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:49:34 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:49:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 10:49:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 10:49:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 10:49:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 10:49:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 10:49:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 10:49:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 10:49:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 10:49:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 10:49:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 10:49:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 10:49:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 10:49:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 10:49:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 10:49:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 10:49:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 10:49:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:49:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-502885888',display_name='tempest-ServerActionsTestOtherB-server-502885888',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-502885888',id=7,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAP2WYAYbmEHvo9gpy8E02p/bOJRkvsKNh1AOdzva6YpAs9spAOOEI0cMhVl9gL/EJuJSrtBF2pmysHal8/jsBIX9uFnmSQR89/cpFlQWiHlWT+1v4Gox5jUD1SpkJCj+g==',key_name='tempest-keypair-1209998822',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9bc007c45c84765bb2739844c7af055',ramdisk_id='',reservation_id='r-w4ylqmii',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-585983328',owner_user_name='tempest-ServerActionsTestOtherB-585983328-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:49:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d4253b9511f408a9c62c79cff8fc0d7',uuid=2535b6f2-2a4b-4ce1-bd47-0f97d15700fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "address": "fa:16:3e:5d:59:b1", "network": {"id": "670b5fe0-96f5-4414-9425-31ee24eda138", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1327797043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9bc007c45c84765bb2739844c7af055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcb29ac-ee", "ovs_interfaceid": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:49:34 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Converting VIF {"id": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "address": "fa:16:3e:5d:59:b1", "network": {"id": "670b5fe0-96f5-4414-9425-31ee24eda138", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1327797043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9bc007c45c84765bb2739844c7af055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcb29ac-ee", "ovs_interfaceid": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:49:34 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:59:b1,bridge_name='br-int',has_traffic_filtering=True,id=7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a,network=Network(670b5fe0-96f5-4414-9425-31ee24eda138),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bcb29ac-ee') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:49:34 user nova-compute[74994]: DEBUG nova.objects.instance [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lazy-loading 'pci_devices' on Instance uuid 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:49:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] End _get_guest_xml xml=<domain type="kvm">
Nov 28 10:49:34 user nova-compute[74994]:   <uuid>2535b6f2-2a4b-4ce1-bd47-0f97d15700fb</uuid>
Nov 28 10:49:34 user nova-compute[74994]:   <name>instance-00000007</name>
Nov 28 10:49:34 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 10:49:34 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 10:49:34 user nova-compute[74994]:   <metadata>
Nov 28 10:49:34 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 10:49:34 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 10:49:34 user nova-compute[74994]:       <nova:name>tempest-ServerActionsTestOtherB-server-502885888</nova:name>
Nov 28 10:49:34 user nova-compute[74994]:       <nova:creationTime>2023-11-28 10:49:34</nova:creationTime>
Nov 28 10:49:34 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 10:49:34 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 10:49:34 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 10:49:34 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 10:49:34 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 10:49:34 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 10:49:34 user nova-compute[74994]:       </nova:flavor>
Nov 28 10:49:34 user nova-compute[74994]:       <nova:owner>
Nov 28 10:49:34 user nova-compute[74994]:         <nova:user uuid="0d4253b9511f408a9c62c79cff8fc0d7">tempest-ServerActionsTestOtherB-585983328-project-member</nova:user>
Nov 28 10:49:34 user nova-compute[74994]:         <nova:project uuid="b9bc007c45c84765bb2739844c7af055">tempest-ServerActionsTestOtherB-585983328</nova:project>
Nov 28 10:49:34 user nova-compute[74994]:       </nova:owner>
Nov 28 10:49:34 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 10:49:34 user nova-compute[74994]:       <nova:ports>
Nov 28 10:49:34 user nova-compute[74994]:         <nova:port uuid="7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a">
Nov 28 10:49:34 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 28 10:49:34 user nova-compute[74994]:         </nova:port>
Nov 28 10:49:34 user nova-compute[74994]:       </nova:ports>
Nov 28 10:49:34 user nova-compute[74994]:     </nova:instance>
Nov 28 10:49:34 user nova-compute[74994]:   </metadata>
Nov 28 10:49:34 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 10:49:34 user nova-compute[74994]:     <system>
Nov 28 10:49:34 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 10:49:34 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 10:49:34 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 10:49:34 user nova-compute[74994]:       <entry name="serial">2535b6f2-2a4b-4ce1-bd47-0f97d15700fb</entry>
Nov 28 10:49:34 user nova-compute[74994]:       <entry name="uuid">2535b6f2-2a4b-4ce1-bd47-0f97d15700fb</entry>
Nov 28 10:49:34 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 10:49:34 user nova-compute[74994]:     </system>
Nov 28 10:49:34 user nova-compute[74994]:   </sysinfo>
Nov 28 10:49:34 user nova-compute[74994]:   <os>
Nov 28 10:49:34 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 10:49:34 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 10:49:34 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 10:49:34 user nova-compute[74994]:   </os>
Nov 28 10:49:34 user nova-compute[74994]:   <features>
Nov 28 10:49:34 user nova-compute[74994]:     <acpi/>
Nov 28 10:49:34 user nova-compute[74994]:     <apic/>
Nov 28 10:49:34 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 10:49:34 user nova-compute[74994]:   </features>
Nov 28 10:49:34 user nova-compute[74994]:   <clock offset="utc">
Nov 28 10:49:34 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 10:49:34 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 10:49:34 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 10:49:34 user nova-compute[74994]:   </clock>
Nov 28 10:49:34 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 10:49:34 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 10:49:34 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 10:49:34 user nova-compute[74994]:   </cpu>
Nov 28 10:49:34 user nova-compute[74994]:   <devices>
Nov 28 10:49:34 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 10:49:34 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 10:49:34 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk"/>
Nov 28 10:49:34 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 10:49:34 user nova-compute[74994]:     </disk>
Nov 28 10:49:34 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 10:49:34 user nova-compute[74994]:       <mac address="fa:16:3e:5d:59:b1"/>
Nov 28 10:49:34 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:49:34 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 10:49:34 user nova-compute[74994]:       <target dev="tap7bcb29ac-ee"/>
Nov 28 10:49:34 user nova-compute[74994]:     </interface>
Nov 28 10:49:34 user nova-compute[74994]:     <serial type="pty">
Nov 28 10:49:34 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/console.log" append="off"/>
Nov 28 10:49:34 user nova-compute[74994]:     </serial>
Nov 28 10:49:34 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 10:49:34 user nova-compute[74994]:     <video>
Nov 28 10:49:34 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:49:34 user nova-compute[74994]:     </video>
Nov 28 10:49:34 user nova-compute[74994]:     <rng model="virtio">
Nov 28 10:49:34 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 10:49:34 user nova-compute[74994]:     </rng>
Nov 28 10:49:34 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 10:49:34 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 10:49:34 user nova-compute[74994]:       <stats period="10"/>
Nov 28 10:49:34 user nova-compute[74994]:     </memballoon>
Nov 28 10:49:34 user nova-compute[74994]:   </devices>
Nov 28 10:49:34 user nova-compute[74994]: </domain>
Nov 28 10:49:34 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 10:49:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:49:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-502885888',display_name='tempest-ServerActionsTestOtherB-server-502885888',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-502885888',id=7,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAP2WYAYbmEHvo9gpy8E02p/bOJRkvsKNh1AOdzva6YpAs9spAOOEI0cMhVl9gL/EJuJSrtBF2pmysHal8/jsBIX9uFnmSQR89/cpFlQWiHlWT+1v4Gox5jUD1SpkJCj+g==',key_name='tempest-keypair-1209998822',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9bc007c45c84765bb2739844c7af055',ramdisk_id='',reservation_id='r-w4ylqmii',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-585983328',owner_user_name='tempest-ServerActionsTestOtherB-585983328-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:49:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d4253b9511f408a9c62c79cff8fc0d7',uuid=2535b6f2-2a4b-4ce1-bd47-0f97d15700fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "address": "fa:16:3e:5d:59:b1", "network": {"id": "670b5fe0-96f5-4414-9425-31ee24eda138", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1327797043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9bc007c45c84765bb2739844c7af055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcb29ac-ee", "ovs_interfaceid": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 10:49:34 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Converting VIF {"id": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "address": "fa:16:3e:5d:59:b1", "network": {"id": "670b5fe0-96f5-4414-9425-31ee24eda138", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1327797043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9bc007c45c84765bb2739844c7af055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcb29ac-ee", "ovs_interfaceid": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:49:34 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:59:b1,bridge_name='br-int',has_traffic_filtering=True,id=7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a,network=Network(670b5fe0-96f5-4414-9425-31ee24eda138),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bcb29ac-ee') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:49:34 user nova-compute[74994]: DEBUG os_vif [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:59:b1,bridge_name='br-int',has_traffic_filtering=True,id=7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a,network=Network(670b5fe0-96f5-4414-9425-31ee24eda138),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bcb29ac-ee') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 10:49:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 10:49:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7f9fa96b-511c-51dd-a4c6-ed21b3371ab7', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:49:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7bcb29ac-ee, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7bcb29ac-ee, col_values=(('qos', UUID('f1e81a78-52c0-4f15-af5e-c738e48dfeeb')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7bcb29ac-ee, col_values=(('external_ids', {'iface-id': '7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:59:b1', 'vm-uuid': '2535b6f2-2a4b-4ce1-bd47-0f97d15700fb'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:49:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:34 user nova-compute[74994]: INFO os_vif [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:59:b1,bridge_name='br-int',has_traffic_filtering=True,id=7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a,network=Network(670b5fe0-96f5-4414-9425-31ee24eda138),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bcb29ac-ee')
Nov 28 10:49:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:49:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] No VIF found with MAC fa:16:3e:5d:59:b1, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:49:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:35 user nova-compute[74994]: DEBUG nova.compute.manager [req-6dcee1b8-9420-4ec5-ae05-1591a520dd93 req-5e7163e4-d5a3-4c7e-926f-4cf4caac4678 service nova] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Received event network-vif-plugged-6b1a991d-033b-45ab-839c-7b6b98082667 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:49:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6dcee1b8-9420-4ec5-ae05-1591a520dd93 req-5e7163e4-d5a3-4c7e-926f-4cf4caac4678 service nova] Acquiring lock "76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6dcee1b8-9420-4ec5-ae05-1591a520dd93 req-5e7163e4-d5a3-4c7e-926f-4cf4caac4678 service nova] Lock "76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6dcee1b8-9420-4ec5-ae05-1591a520dd93 req-5e7163e4-d5a3-4c7e-926f-4cf4caac4678 service nova] Lock "76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:35 user nova-compute[74994]: DEBUG nova.compute.manager [req-6dcee1b8-9420-4ec5-ae05-1591a520dd93 req-5e7163e4-d5a3-4c7e-926f-4cf4caac4678 service nova] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] No waiting events found dispatching network-vif-plugged-6b1a991d-033b-45ab-839c-7b6b98082667 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:49:35 user nova-compute[74994]: WARNING nova.compute.manager [req-6dcee1b8-9420-4ec5-ae05-1591a520dd93 req-5e7163e4-d5a3-4c7e-926f-4cf4caac4678 service nova] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Received unexpected event network-vif-plugged-6b1a991d-033b-45ab-839c-7b6b98082667 for instance with vm_state active and task_state None.
Nov 28 10:49:35 user nova-compute[74994]: DEBUG nova.compute.manager [req-6dcee1b8-9420-4ec5-ae05-1591a520dd93 req-5e7163e4-d5a3-4c7e-926f-4cf4caac4678 service nova] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Received event network-vif-plugged-6a884296-8f6f-4647-b4c6-09d7f4e92887 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:49:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6dcee1b8-9420-4ec5-ae05-1591a520dd93 req-5e7163e4-d5a3-4c7e-926f-4cf4caac4678 service nova] Acquiring lock "bf357856-2d97-42e8-928d-71d0378f48c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6dcee1b8-9420-4ec5-ae05-1591a520dd93 req-5e7163e4-d5a3-4c7e-926f-4cf4caac4678 service nova] Lock "bf357856-2d97-42e8-928d-71d0378f48c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6dcee1b8-9420-4ec5-ae05-1591a520dd93 req-5e7163e4-d5a3-4c7e-926f-4cf4caac4678 service nova] Lock "bf357856-2d97-42e8-928d-71d0378f48c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:35 user nova-compute[74994]: DEBUG nova.compute.manager [req-6dcee1b8-9420-4ec5-ae05-1591a520dd93 req-5e7163e4-d5a3-4c7e-926f-4cf4caac4678 service nova] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] No waiting events found dispatching network-vif-plugged-6a884296-8f6f-4647-b4c6-09d7f4e92887 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:49:35 user nova-compute[74994]: WARNING nova.compute.manager [req-6dcee1b8-9420-4ec5-ae05-1591a520dd93 req-5e7163e4-d5a3-4c7e-926f-4cf4caac4678 service nova] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Received unexpected event network-vif-plugged-6a884296-8f6f-4647-b4c6-09d7f4e92887 for instance with vm_state active and task_state None.
Nov 28 10:49:35 user nova-compute[74994]: DEBUG nova.compute.manager [req-6dcee1b8-9420-4ec5-ae05-1591a520dd93 req-5e7163e4-d5a3-4c7e-926f-4cf4caac4678 service nova] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Received event network-vif-plugged-6a884296-8f6f-4647-b4c6-09d7f4e92887 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:49:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6dcee1b8-9420-4ec5-ae05-1591a520dd93 req-5e7163e4-d5a3-4c7e-926f-4cf4caac4678 service nova] Acquiring lock "bf357856-2d97-42e8-928d-71d0378f48c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6dcee1b8-9420-4ec5-ae05-1591a520dd93 req-5e7163e4-d5a3-4c7e-926f-4cf4caac4678 service nova] Lock "bf357856-2d97-42e8-928d-71d0378f48c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6dcee1b8-9420-4ec5-ae05-1591a520dd93 req-5e7163e4-d5a3-4c7e-926f-4cf4caac4678 service nova] Lock "bf357856-2d97-42e8-928d-71d0378f48c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:35 user nova-compute[74994]: DEBUG nova.compute.manager [req-6dcee1b8-9420-4ec5-ae05-1591a520dd93 req-5e7163e4-d5a3-4c7e-926f-4cf4caac4678 service nova] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] No waiting events found dispatching network-vif-plugged-6a884296-8f6f-4647-b4c6-09d7f4e92887 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:49:35 user nova-compute[74994]: WARNING nova.compute.manager [req-6dcee1b8-9420-4ec5-ae05-1591a520dd93 req-5e7163e4-d5a3-4c7e-926f-4cf4caac4678 service nova] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Received unexpected event network-vif-plugged-6a884296-8f6f-4647-b4c6-09d7f4e92887 for instance with vm_state active and task_state None.
Nov 28 10:49:35 user nova-compute[74994]: DEBUG nova.network.neutron [req-5e8f624c-15c8-4011-9fb6-ae580fdc73a8 req-b0a1992a-31ad-4270-97f4-4cef4d4c0006 service nova] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Updated VIF entry in instance network info cache for port 7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 10:49:35 user nova-compute[74994]: DEBUG nova.network.neutron [req-5e8f624c-15c8-4011-9fb6-ae580fdc73a8 req-b0a1992a-31ad-4270-97f4-4cef4d4c0006 service nova] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Updating instance_info_cache with network_info: [{"id": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "address": "fa:16:3e:5d:59:b1", "network": {"id": "670b5fe0-96f5-4414-9425-31ee24eda138", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1327797043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9bc007c45c84765bb2739844c7af055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcb29ac-ee", "ovs_interfaceid": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:49:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-5e8f624c-15c8-4011-9fb6-ae580fdc73a8 req-b0a1992a-31ad-4270-97f4-4cef4d4c0006 service nova] Releasing lock "refresh_cache-2535b6f2-2a4b-4ce1-bd47-0f97d15700fb" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:49:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Acquiring lock "2e30565c-9f8e-4a87-8054-6c260dac4f48" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lock "2e30565c-9f8e-4a87-8054-6c260dac4f48" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:35 user nova-compute[74994]: DEBUG nova.compute.manager [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 10:49:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:36 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 10:49:36 user nova-compute[74994]: INFO nova.compute.claims [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Claim successful on node user
Nov 28 10:49:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:36 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:49:36 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:49:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.845s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:36 user nova-compute[74994]: DEBUG nova.compute.manager [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 10:49:36 user nova-compute[74994]: DEBUG nova.compute.manager [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 10:49:36 user nova-compute[74994]: DEBUG nova.network.neutron [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 10:49:37 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 10:49:37 user nova-compute[74994]: DEBUG nova.compute.manager [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 10:49:37 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:37 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:37 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:37 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:37 user nova-compute[74994]: DEBUG nova.compute.manager [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 10:49:37 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 10:49:37 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Creating image(s)
Nov 28 10:49:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Acquiring lock "/opt/stack/data/nova/instances/2e30565c-9f8e-4a87-8054-6c260dac4f48/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lock "/opt/stack/data/nova/instances/2e30565c-9f8e-4a87-8054-6c260dac4f48/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lock "/opt/stack/data/nova/instances/2e30565c-9f8e-4a87-8054-6c260dac4f48/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:37 user nova-compute[74994]: DEBUG nova.policy [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5bb3c1cbcd954e789f4a462aca3cf25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf57a964f98428c95cf169927522860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 10:49:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.292s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Acquiring lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.327s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/2e30565c-9f8e-4a87-8054-6c260dac4f48/disk 1073741824 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/2e30565c-9f8e-4a87-8054-6c260dac4f48/disk 1073741824" returned: 0 in 0.096s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.430s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.223s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:38 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2e30565c-9f8e-4a87-8054-6c260dac4f48/disk. size=1073741824 {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 10:49:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e30565c-9f8e-4a87-8054-6c260dac4f48/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e30565c-9f8e-4a87-8054-6c260dac4f48/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:38 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Cannot resize image /opt/stack/data/nova/instances/2e30565c-9f8e-4a87-8054-6c260dac4f48/disk to a smaller size. {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 10:49:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Created local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 10:49:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Ensure instance console log exists: /opt/stack/data/nova/instances/2e30565c-9f8e-4a87-8054-6c260dac4f48/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 10:49:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:39 user nova-compute[74994]: DEBUG nova.compute.manager [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 10:49:39 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 10:49:39 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Instance spawned successfully.
Nov 28 10:49:39 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 10:49:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:39 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:39 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:39 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:39 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:39 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:39 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:39 user nova-compute[74994]: INFO nova.compute.manager [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Took 13.58 seconds to spawn the instance on the hypervisor.
Nov 28 10:49:39 user nova-compute[74994]: DEBUG nova.compute.manager [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 10:49:39 user nova-compute[74994]: DEBUG nova.compute.manager [req-28629ede-83db-4293-b0e7-f9c8078757d7 req-9bcf9cd7-2796-4ee7-b853-a4c9ccbc9b32 service nova] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Received event network-vif-plugged-744c3452-d7cd-44a1-83d5-a60e6db5b8b5 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:49:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-28629ede-83db-4293-b0e7-f9c8078757d7 req-9bcf9cd7-2796-4ee7-b853-a4c9ccbc9b32 service nova] Acquiring lock "cce813fa-bf97-41f8-8aee-c7a73354e24c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-28629ede-83db-4293-b0e7-f9c8078757d7 req-9bcf9cd7-2796-4ee7-b853-a4c9ccbc9b32 service nova] Lock "cce813fa-bf97-41f8-8aee-c7a73354e24c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-28629ede-83db-4293-b0e7-f9c8078757d7 req-9bcf9cd7-2796-4ee7-b853-a4c9ccbc9b32 service nova] Lock "cce813fa-bf97-41f8-8aee-c7a73354e24c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:39 user nova-compute[74994]: DEBUG nova.compute.manager [req-28629ede-83db-4293-b0e7-f9c8078757d7 req-9bcf9cd7-2796-4ee7-b853-a4c9ccbc9b32 service nova] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] No waiting events found dispatching network-vif-plugged-744c3452-d7cd-44a1-83d5-a60e6db5b8b5 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:49:39 user nova-compute[74994]: WARNING nova.compute.manager [req-28629ede-83db-4293-b0e7-f9c8078757d7 req-9bcf9cd7-2796-4ee7-b853-a4c9ccbc9b32 service nova] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Received unexpected event network-vif-plugged-744c3452-d7cd-44a1-83d5-a60e6db5b8b5 for instance with vm_state active and task_state None.
Nov 28 10:49:39 user nova-compute[74994]: INFO nova.compute.manager [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Took 22.33 seconds to build instance.
Nov 28 10:49:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4ab5e2ec-d713-483e-a9ea-8c3aca2272e6 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.522s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:40 user nova-compute[74994]: DEBUG nova.network.neutron [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Successfully created port: 11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3 {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 10:49:41 user nova-compute[74994]: DEBUG nova.compute.manager [req-831b6c26-28d0-4597-a187-8b63e1d89a6b req-6f92b2a5-f010-4018-84dd-d9e0d48460ba service nova] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Received event network-vif-plugged-df20cfaa-368c-4bfd-b535-9192c3f240a0 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:49:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-831b6c26-28d0-4597-a187-8b63e1d89a6b req-6f92b2a5-f010-4018-84dd-d9e0d48460ba service nova] Acquiring lock "5b51d690-8198-4748-807d-1902e75564b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-831b6c26-28d0-4597-a187-8b63e1d89a6b req-6f92b2a5-f010-4018-84dd-d9e0d48460ba service nova] Lock "5b51d690-8198-4748-807d-1902e75564b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-831b6c26-28d0-4597-a187-8b63e1d89a6b req-6f92b2a5-f010-4018-84dd-d9e0d48460ba service nova] Lock "5b51d690-8198-4748-807d-1902e75564b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:41 user nova-compute[74994]: DEBUG nova.compute.manager [req-831b6c26-28d0-4597-a187-8b63e1d89a6b req-6f92b2a5-f010-4018-84dd-d9e0d48460ba service nova] [instance: 5b51d690-8198-4748-807d-1902e75564b9] No waiting events found dispatching network-vif-plugged-df20cfaa-368c-4bfd-b535-9192c3f240a0 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:49:41 user nova-compute[74994]: WARNING nova.compute.manager [req-831b6c26-28d0-4597-a187-8b63e1d89a6b req-6f92b2a5-f010-4018-84dd-d9e0d48460ba service nova] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Received unexpected event network-vif-plugged-df20cfaa-368c-4bfd-b535-9192c3f240a0 for instance with vm_state active and task_state None.
Nov 28 10:49:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Acquiring lock "7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Lock "7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:41 user nova-compute[74994]: DEBUG nova.compute.manager [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 10:49:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:42 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 10:49:42 user nova-compute[74994]: INFO nova.compute.claims [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Claim successful on node user
Nov 28 10:49:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Acquiring lock "c2925833-e88d-4aa7-a477-ff1bc1fcd724" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Lock "c2925833-e88d-4aa7-a477-ff1bc1fcd724" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:42 user nova-compute[74994]: DEBUG nova.compute.manager [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 10:49:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:42 user nova-compute[74994]: DEBUG nova.compute.manager [req-765eed12-f915-4851-9e64-174aff5493d9 req-79f8f6fb-17b9-4314-ac7c-d4277f4933dd service nova] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Received event network-vif-plugged-744c3452-d7cd-44a1-83d5-a60e6db5b8b5 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:49:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-765eed12-f915-4851-9e64-174aff5493d9 req-79f8f6fb-17b9-4314-ac7c-d4277f4933dd service nova] Acquiring lock "cce813fa-bf97-41f8-8aee-c7a73354e24c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-765eed12-f915-4851-9e64-174aff5493d9 req-79f8f6fb-17b9-4314-ac7c-d4277f4933dd service nova] Lock "cce813fa-bf97-41f8-8aee-c7a73354e24c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-765eed12-f915-4851-9e64-174aff5493d9 req-79f8f6fb-17b9-4314-ac7c-d4277f4933dd service nova] Lock "cce813fa-bf97-41f8-8aee-c7a73354e24c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:42 user nova-compute[74994]: DEBUG nova.compute.manager [req-765eed12-f915-4851-9e64-174aff5493d9 req-79f8f6fb-17b9-4314-ac7c-d4277f4933dd service nova] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] No waiting events found dispatching network-vif-plugged-744c3452-d7cd-44a1-83d5-a60e6db5b8b5 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:49:42 user nova-compute[74994]: WARNING nova.compute.manager [req-765eed12-f915-4851-9e64-174aff5493d9 req-79f8f6fb-17b9-4314-ac7c-d4277f4933dd service nova] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Received unexpected event network-vif-plugged-744c3452-d7cd-44a1-83d5-a60e6db5b8b5 for instance with vm_state active and task_state None.
Nov 28 10:49:42 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:49:42 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:49:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.767s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:42 user nova-compute[74994]: DEBUG nova.compute.manager [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 10:49:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.362s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:42 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 10:49:42 user nova-compute[74994]: INFO nova.compute.claims [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Claim successful on node user
Nov 28 10:49:42 user nova-compute[74994]: DEBUG nova.compute.manager [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 10:49:42 user nova-compute[74994]: DEBUG nova.network.neutron [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 10:49:42 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 10:49:42 user nova-compute[74994]: DEBUG nova.compute.manager [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 10:49:43 user nova-compute[74994]: DEBUG nova.compute.manager [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 10:49:43 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 10:49:43 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Creating image(s)
Nov 28 10:49:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Acquiring lock "/opt/stack/data/nova/instances/7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Lock "/opt/stack/data/nova/instances/7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Lock "/opt/stack/data/nova/instances/7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:43 user nova-compute[74994]: DEBUG nova.policy [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '86984721f70d4723b721a424ac3bb7b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8add654139084d4da3e8f2c2586a9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 10:49:43 user nova-compute[74994]: DEBUG nova.compute.manager [req-0f3f4ed7-8023-4933-8434-e3b2417ab43b req-d2b04e46-3d9c-4e90-b5b4-aec32202062f service nova] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Received event network-vif-plugged-df20cfaa-368c-4bfd-b535-9192c3f240a0 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:49:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-0f3f4ed7-8023-4933-8434-e3b2417ab43b req-d2b04e46-3d9c-4e90-b5b4-aec32202062f service nova] Acquiring lock "5b51d690-8198-4748-807d-1902e75564b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-0f3f4ed7-8023-4933-8434-e3b2417ab43b req-d2b04e46-3d9c-4e90-b5b4-aec32202062f service nova] Lock "5b51d690-8198-4748-807d-1902e75564b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-0f3f4ed7-8023-4933-8434-e3b2417ab43b req-d2b04e46-3d9c-4e90-b5b4-aec32202062f service nova] Lock "5b51d690-8198-4748-807d-1902e75564b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:43 user nova-compute[74994]: DEBUG nova.compute.manager [req-0f3f4ed7-8023-4933-8434-e3b2417ab43b req-d2b04e46-3d9c-4e90-b5b4-aec32202062f service nova] [instance: 5b51d690-8198-4748-807d-1902e75564b9] No waiting events found dispatching network-vif-plugged-df20cfaa-368c-4bfd-b535-9192c3f240a0 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:49:43 user nova-compute[74994]: WARNING nova.compute.manager [req-0f3f4ed7-8023-4933-8434-e3b2417ab43b req-d2b04e46-3d9c-4e90-b5b4-aec32202062f service nova] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Received unexpected event network-vif-plugged-df20cfaa-368c-4bfd-b535-9192c3f240a0 for instance with vm_state active and task_state None.
Nov 28 10:49:43 user nova-compute[74994]: DEBUG nova.network.neutron [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Successfully updated port: 11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3 {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 10:49:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Acquiring lock "refresh_cache-2e30565c-9f8e-4a87-8054-6c260dac4f48" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:49:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Acquired lock "refresh_cache-2e30565c-9f8e-4a87-8054-6c260dac4f48" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:49:43 user nova-compute[74994]: DEBUG nova.network.neutron [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 10:49:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.266s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Acquiring lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:43 user nova-compute[74994]: DEBUG nova.network.neutron [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 10:49:43 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:49:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.234s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a/disk 1073741824 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:43 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:49:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a/disk 1073741824" returned: 0 in 0.085s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.323s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.049s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:43 user nova-compute[74994]: DEBUG nova.compute.manager [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 10:49:43 user nova-compute[74994]: DEBUG nova.compute.manager [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 10:49:43 user nova-compute[74994]: DEBUG nova.network.neutron [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 10:49:43 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 10:49:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.202s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:43 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a/disk. size=1073741824 {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 10:49:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG nova.compute.manager [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG nova.policy [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '02983082e29345a491ecd8fe18268b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1413a02a3034130b4a4ec170ca2fc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Cannot resize image /opt/stack/data/nova/instances/7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a/disk to a smaller size. {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Created local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Ensure instance console log exists: /opt/stack/data/nova/instances/7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.008s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG nova.compute.manager [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 10:49:44 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Creating image(s)
Nov 28 10:49:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Acquiring lock "/opt/stack/data/nova/instances/c2925833-e88d-4aa7-a477-ff1bc1fcd724/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Lock "/opt/stack/data/nova/instances/c2925833-e88d-4aa7-a477-ff1bc1fcd724/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Lock "/opt/stack/data/nova/instances/c2925833-e88d-4aa7-a477-ff1bc1fcd724/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.285s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Acquiring lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG nova.network.neutron [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Updating instance_info_cache with network_info: [{"id": "11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3", "address": "fa:16:3e:f3:12:45", "network": {"id": "fcf8118a-9224-4f12-b8cc-2936753d9e61", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1394689629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf57a964f98428c95cf169927522860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a544cf-6a", "ovs_interfaceid": "11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG nova.compute.manager [req-bea093f8-9270-4641-a899-e9f5f73db1d3 req-3aaaf37e-ea1e-40e1-b04f-32c0f07f9aa2 service nova] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Received event network-vif-plugged-7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bea093f8-9270-4641-a899-e9f5f73db1d3 req-3aaaf37e-ea1e-40e1-b04f-32c0f07f9aa2 service nova] Acquiring lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bea093f8-9270-4641-a899-e9f5f73db1d3 req-3aaaf37e-ea1e-40e1-b04f-32c0f07f9aa2 service nova] Lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bea093f8-9270-4641-a899-e9f5f73db1d3 req-3aaaf37e-ea1e-40e1-b04f-32c0f07f9aa2 service nova] Lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG nova.compute.manager [req-bea093f8-9270-4641-a899-e9f5f73db1d3 req-3aaaf37e-ea1e-40e1-b04f-32c0f07f9aa2 service nova] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] No waiting events found dispatching network-vif-plugged-7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:49:44 user nova-compute[74994]: WARNING nova.compute.manager [req-bea093f8-9270-4641-a899-e9f5f73db1d3 req-3aaaf37e-ea1e-40e1-b04f-32c0f07f9aa2 service nova] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Received unexpected event network-vif-plugged-7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a for instance with vm_state active and task_state None.
Nov 28 10:49:44 user nova-compute[74994]: DEBUG nova.compute.manager [req-bea093f8-9270-4641-a899-e9f5f73db1d3 req-3aaaf37e-ea1e-40e1-b04f-32c0f07f9aa2 service nova] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Received event network-vif-plugged-7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bea093f8-9270-4641-a899-e9f5f73db1d3 req-3aaaf37e-ea1e-40e1-b04f-32c0f07f9aa2 service nova] Acquiring lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bea093f8-9270-4641-a899-e9f5f73db1d3 req-3aaaf37e-ea1e-40e1-b04f-32c0f07f9aa2 service nova] Lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bea093f8-9270-4641-a899-e9f5f73db1d3 req-3aaaf37e-ea1e-40e1-b04f-32c0f07f9aa2 service nova] Lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG nova.compute.manager [req-bea093f8-9270-4641-a899-e9f5f73db1d3 req-3aaaf37e-ea1e-40e1-b04f-32c0f07f9aa2 service nova] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] No waiting events found dispatching network-vif-plugged-7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:49:44 user nova-compute[74994]: WARNING nova.compute.manager [req-bea093f8-9270-4641-a899-e9f5f73db1d3 req-3aaaf37e-ea1e-40e1-b04f-32c0f07f9aa2 service nova] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Received unexpected event network-vif-plugged-7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a for instance with vm_state active and task_state None.
Nov 28 10:49:44 user nova-compute[74994]: DEBUG nova.compute.manager [req-bea093f8-9270-4641-a899-e9f5f73db1d3 req-3aaaf37e-ea1e-40e1-b04f-32c0f07f9aa2 service nova] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Received event network-changed-11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG nova.compute.manager [req-bea093f8-9270-4641-a899-e9f5f73db1d3 req-3aaaf37e-ea1e-40e1-b04f-32c0f07f9aa2 service nova] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Refreshing instance network info cache due to event network-changed-11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bea093f8-9270-4641-a899-e9f5f73db1d3 req-3aaaf37e-ea1e-40e1-b04f-32c0f07f9aa2 service nova] Acquiring lock "refresh_cache-2e30565c-9f8e-4a87-8054-6c260dac4f48" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Releasing lock "refresh_cache-2e30565c-9f8e-4a87-8054-6c260dac4f48" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG nova.compute.manager [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Instance network_info: |[{"id": "11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3", "address": "fa:16:3e:f3:12:45", "network": {"id": "fcf8118a-9224-4f12-b8cc-2936753d9e61", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1394689629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf57a964f98428c95cf169927522860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a544cf-6a", "ovs_interfaceid": "11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bea093f8-9270-4641-a899-e9f5f73db1d3 req-3aaaf37e-ea1e-40e1-b04f-32c0f07f9aa2 service nova] Acquired lock "refresh_cache-2e30565c-9f8e-4a87-8054-6c260dac4f48" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG nova.network.neutron [req-bea093f8-9270-4641-a899-e9f5f73db1d3 req-3aaaf37e-ea1e-40e1-b04f-32c0f07f9aa2 service nova] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Refreshing network info cache for port 11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Start _get_guest_xml network_info=[{"id": "11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3", "address": "fa:16:3e:f3:12:45", "network": {"id": "fcf8118a-9224-4f12-b8cc-2936753d9e61", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1394689629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf57a964f98428c95cf169927522860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a544cf-6a", "ovs_interfaceid": "11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'aa939d1b-b8a6-4391-935b-0191bf5ccd0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 10:49:44 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:49:44 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:49:44 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:49:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1305080845',display_name='tempest-VolumesAdminNegativeTest-server-1305080845',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1305080845',id=8,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVpA8rTFjRvnifCkdi8yrmc9eyfPkW2cNZ8tsZ/SaqGCfkVG0g7QzCiZLnpgRBFH3by6Hm22ghShqtT5eEtkDfOKezdC35wwsjX0mermeu/CKAMjc9gEB96fZ8LRCr0+w==',key_name='tempest-keypair-735144918',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5cf57a964f98428c95cf169927522860',ramdisk_id='',reservation_id='r-ubvw8xia',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-230929412',owner_user_name='tempest-VolumesAdminNegativeTest-230929412-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:49:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bb3c1cbcd954e789f4a462aca3cf25d',uuid=2e30565c-9f8e-4a87-8054-6c260dac4f48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3", "address": "fa:16:3e:f3:12:45", "network": {"id": "fcf8118a-9224-4f12-b8cc-2936753d9e61", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1394689629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf57a964f98428c95cf169927522860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a544cf-6a", "ovs_interfaceid": "11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Converting VIF {"id": "11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3", "address": "fa:16:3e:f3:12:45", "network": {"id": "fcf8118a-9224-4f12-b8cc-2936753d9e61", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1394689629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf57a964f98428c95cf169927522860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a544cf-6a", "ovs_interfaceid": "11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:12:45,bridge_name='br-int',has_traffic_filtering=True,id=11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3,network=Network(fcf8118a-9224-4f12-b8cc-2936753d9e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a544cf-6a') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG nova.objects.instance [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e30565c-9f8e-4a87-8054-6c260dac4f48 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG nova.network.neutron [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Successfully created port: 068d74d7-23a6-42b8-8a3c-02ba7ce746a7 {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.266s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/c2925833-e88d-4aa7-a477-ff1bc1fcd724/disk 1073741824 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] End _get_guest_xml xml=<domain type="kvm">
Nov 28 10:49:44 user nova-compute[74994]:   <uuid>2e30565c-9f8e-4a87-8054-6c260dac4f48</uuid>
Nov 28 10:49:44 user nova-compute[74994]:   <name>instance-00000008</name>
Nov 28 10:49:44 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 10:49:44 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 10:49:44 user nova-compute[74994]:   <metadata>
Nov 28 10:49:44 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 10:49:44 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 10:49:44 user nova-compute[74994]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1305080845</nova:name>
Nov 28 10:49:44 user nova-compute[74994]:       <nova:creationTime>2023-11-28 10:49:44</nova:creationTime>
Nov 28 10:49:44 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 10:49:44 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 10:49:44 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 10:49:44 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 10:49:44 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 10:49:44 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 10:49:44 user nova-compute[74994]:       </nova:flavor>
Nov 28 10:49:44 user nova-compute[74994]:       <nova:owner>
Nov 28 10:49:44 user nova-compute[74994]:         <nova:user uuid="5bb3c1cbcd954e789f4a462aca3cf25d">tempest-VolumesAdminNegativeTest-230929412-project-member</nova:user>
Nov 28 10:49:44 user nova-compute[74994]:         <nova:project uuid="5cf57a964f98428c95cf169927522860">tempest-VolumesAdminNegativeTest-230929412</nova:project>
Nov 28 10:49:44 user nova-compute[74994]:       </nova:owner>
Nov 28 10:49:44 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 10:49:44 user nova-compute[74994]:       <nova:ports>
Nov 28 10:49:44 user nova-compute[74994]:         <nova:port uuid="11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3">
Nov 28 10:49:44 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 10:49:44 user nova-compute[74994]:         </nova:port>
Nov 28 10:49:44 user nova-compute[74994]:       </nova:ports>
Nov 28 10:49:44 user nova-compute[74994]:     </nova:instance>
Nov 28 10:49:44 user nova-compute[74994]:   </metadata>
Nov 28 10:49:44 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 10:49:44 user nova-compute[74994]:     <system>
Nov 28 10:49:44 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 10:49:44 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 10:49:44 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 10:49:44 user nova-compute[74994]:       <entry name="serial">2e30565c-9f8e-4a87-8054-6c260dac4f48</entry>
Nov 28 10:49:44 user nova-compute[74994]:       <entry name="uuid">2e30565c-9f8e-4a87-8054-6c260dac4f48</entry>
Nov 28 10:49:44 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 10:49:44 user nova-compute[74994]:     </system>
Nov 28 10:49:44 user nova-compute[74994]:   </sysinfo>
Nov 28 10:49:44 user nova-compute[74994]:   <os>
Nov 28 10:49:44 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 10:49:44 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 10:49:44 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 10:49:44 user nova-compute[74994]:   </os>
Nov 28 10:49:44 user nova-compute[74994]:   <features>
Nov 28 10:49:44 user nova-compute[74994]:     <acpi/>
Nov 28 10:49:44 user nova-compute[74994]:     <apic/>
Nov 28 10:49:44 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 10:49:44 user nova-compute[74994]:   </features>
Nov 28 10:49:44 user nova-compute[74994]:   <clock offset="utc">
Nov 28 10:49:44 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 10:49:44 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 10:49:44 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 10:49:44 user nova-compute[74994]:   </clock>
Nov 28 10:49:44 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 10:49:44 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 10:49:44 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 10:49:44 user nova-compute[74994]:   </cpu>
Nov 28 10:49:44 user nova-compute[74994]:   <devices>
Nov 28 10:49:44 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 10:49:44 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 10:49:44 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/2e30565c-9f8e-4a87-8054-6c260dac4f48/disk"/>
Nov 28 10:49:44 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 10:49:44 user nova-compute[74994]:     </disk>
Nov 28 10:49:44 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 10:49:44 user nova-compute[74994]:       <mac address="fa:16:3e:f3:12:45"/>
Nov 28 10:49:44 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:49:44 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 10:49:44 user nova-compute[74994]:       <target dev="tap11a544cf-6a"/>
Nov 28 10:49:44 user nova-compute[74994]:     </interface>
Nov 28 10:49:44 user nova-compute[74994]:     <serial type="pty">
Nov 28 10:49:44 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/2e30565c-9f8e-4a87-8054-6c260dac4f48/console.log" append="off"/>
Nov 28 10:49:44 user nova-compute[74994]:     </serial>
Nov 28 10:49:44 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 10:49:44 user nova-compute[74994]:     <video>
Nov 28 10:49:44 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:49:44 user nova-compute[74994]:     </video>
Nov 28 10:49:44 user nova-compute[74994]:     <rng model="virtio">
Nov 28 10:49:44 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 10:49:44 user nova-compute[74994]:     </rng>
Nov 28 10:49:44 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 10:49:44 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 10:49:44 user nova-compute[74994]:       <stats period="10"/>
Nov 28 10:49:44 user nova-compute[74994]:     </memballoon>
Nov 28 10:49:44 user nova-compute[74994]:   </devices>
Nov 28 10:49:44 user nova-compute[74994]: </domain>
Nov 28 10:49:44 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:49:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1305080845',display_name='tempest-VolumesAdminNegativeTest-server-1305080845',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1305080845',id=8,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVpA8rTFjRvnifCkdi8yrmc9eyfPkW2cNZ8tsZ/SaqGCfkVG0g7QzCiZLnpgRBFH3by6Hm22ghShqtT5eEtkDfOKezdC35wwsjX0mermeu/CKAMjc9gEB96fZ8LRCr0+w==',key_name='tempest-keypair-735144918',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5cf57a964f98428c95cf169927522860',ramdisk_id='',reservation_id='r-ubvw8xia',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-230929412',owner_user_name='tempest-VolumesAdminNegativeTest-230929412-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:49:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bb3c1cbcd954e789f4a462aca3cf25d',uuid=2e30565c-9f8e-4a87-8054-6c260dac4f48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3", "address": "fa:16:3e:f3:12:45", "network": {"id": "fcf8118a-9224-4f12-b8cc-2936753d9e61", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1394689629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf57a964f98428c95cf169927522860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a544cf-6a", "ovs_interfaceid": "11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Converting VIF {"id": "11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3", "address": "fa:16:3e:f3:12:45", "network": {"id": "fcf8118a-9224-4f12-b8cc-2936753d9e61", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1394689629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf57a964f98428c95cf169927522860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a544cf-6a", "ovs_interfaceid": "11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:12:45,bridge_name='br-int',has_traffic_filtering=True,id=11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3,network=Network(fcf8118a-9224-4f12-b8cc-2936753d9e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a544cf-6a') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG os_vif [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:12:45,bridge_name='br-int',has_traffic_filtering=True,id=11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3,network=Network(fcf8118a-9224-4f12-b8cc-2936753d9e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a544cf-6a') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7cf36fc6-ec1e-5c99-80a0-8d57123bb953', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/c2925833-e88d-4aa7-a477-ff1bc1fcd724/disk 1073741824" returned: 0 in 0.082s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.354s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:44 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:49:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap11a544cf-6a, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap11a544cf-6a, col_values=(('qos', UUID('6391127b-5851-4ef6-9540-6d53f83fd9a9')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap11a544cf-6a, col_values=(('external_ids', {'iface-id': '11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:12:45', 'vm-uuid': '2e30565c-9f8e-4a87-8054-6c260dac4f48'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:49:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:45 user nova-compute[74994]: INFO os_vif [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:12:45,bridge_name='br-int',has_traffic_filtering=True,id=11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3,network=Network(fcf8118a-9224-4f12-b8cc-2936753d9e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a544cf-6a')
Nov 28 10:49:45 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:49:45 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] No VIF found with MAC fa:16:3e:f3:12:45, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:49:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.222s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:45 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c2925833-e88d-4aa7-a477-ff1bc1fcd724/disk. size=1073741824 {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 10:49:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2925833-e88d-4aa7-a477-ff1bc1fcd724/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:45 user nova-compute[74994]: DEBUG nova.network.neutron [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Successfully created port: 752a5c48-15a2-443c-911c-f1a0c33ca925 {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 10:49:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2925833-e88d-4aa7-a477-ff1bc1fcd724/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:45 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Cannot resize image /opt/stack/data/nova/instances/c2925833-e88d-4aa7-a477-ff1bc1fcd724/disk to a smaller size. {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 10:49:45 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Created local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 10:49:45 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Ensure instance console log exists: /opt/stack/data/nova/instances/c2925833-e88d-4aa7-a477-ff1bc1fcd724/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 10:49:45 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:45 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:45 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:45 user nova-compute[74994]: DEBUG nova.network.neutron [req-bea093f8-9270-4641-a899-e9f5f73db1d3 req-3aaaf37e-ea1e-40e1-b04f-32c0f07f9aa2 service nova] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Updated VIF entry in instance network info cache for port 11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 10:49:45 user nova-compute[74994]: DEBUG nova.network.neutron [req-bea093f8-9270-4641-a899-e9f5f73db1d3 req-3aaaf37e-ea1e-40e1-b04f-32c0f07f9aa2 service nova] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Updating instance_info_cache with network_info: [{"id": "11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3", "address": "fa:16:3e:f3:12:45", "network": {"id": "fcf8118a-9224-4f12-b8cc-2936753d9e61", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1394689629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf57a964f98428c95cf169927522860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a544cf-6a", "ovs_interfaceid": "11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:49:45 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bea093f8-9270-4641-a899-e9f5f73db1d3 req-3aaaf37e-ea1e-40e1-b04f-32c0f07f9aa2 service nova] Releasing lock "refresh_cache-2e30565c-9f8e-4a87-8054-6c260dac4f48" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:49:45 user nova-compute[74994]: DEBUG nova.network.neutron [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Successfully updated port: 068d74d7-23a6-42b8-8a3c-02ba7ce746a7 {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 10:49:45 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Acquiring lock "refresh_cache-7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:49:45 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Acquired lock "refresh_cache-7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:49:45 user nova-compute[74994]: DEBUG nova.network.neutron [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.network.neutron [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Successfully updated port: 752a5c48-15a2-443c-911c-f1a0c33ca925 {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.network.neutron [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Acquiring lock "refresh_cache-c2925833-e88d-4aa7-a477-ff1bc1fcd724" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Acquired lock "refresh_cache-c2925833-e88d-4aa7-a477-ff1bc1fcd724" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.network.neutron [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.compute.manager [req-de5903b8-85d8-4968-a0aa-28e7bdd9bf1f req-ed40d140-16fe-4b89-a260-c519890eae29 service nova] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Received event network-changed-752a5c48-15a2-443c-911c-f1a0c33ca925 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.compute.manager [req-de5903b8-85d8-4968-a0aa-28e7bdd9bf1f req-ed40d140-16fe-4b89-a260-c519890eae29 service nova] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Refreshing instance network info cache due to event network-changed-752a5c48-15a2-443c-911c-f1a0c33ca925. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-de5903b8-85d8-4968-a0aa-28e7bdd9bf1f req-ed40d140-16fe-4b89-a260-c519890eae29 service nova] Acquiring lock "refresh_cache-c2925833-e88d-4aa7-a477-ff1bc1fcd724" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.network.neutron [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.network.neutron [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Updating instance_info_cache with network_info: [{"id": "068d74d7-23a6-42b8-8a3c-02ba7ce746a7", "address": "fa:16:3e:de:46:25", "network": {"id": "b7c1f696-fec6-41c2-a173-f6497212eb9d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-130325100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8add654139084d4da3e8f2c2586a9466", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068d74d7-23", "ovs_interfaceid": "068d74d7-23a6-42b8-8a3c-02ba7ce746a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Releasing lock "refresh_cache-7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.compute.manager [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Instance network_info: |[{"id": "068d74d7-23a6-42b8-8a3c-02ba7ce746a7", "address": "fa:16:3e:de:46:25", "network": {"id": "b7c1f696-fec6-41c2-a173-f6497212eb9d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-130325100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8add654139084d4da3e8f2c2586a9466", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068d74d7-23", "ovs_interfaceid": "068d74d7-23a6-42b8-8a3c-02ba7ce746a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Start _get_guest_xml network_info=[{"id": "068d74d7-23a6-42b8-8a3c-02ba7ce746a7", "address": "fa:16:3e:de:46:25", "network": {"id": "b7c1f696-fec6-41c2-a173-f6497212eb9d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-130325100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8add654139084d4da3e8f2c2586a9466", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068d74d7-23", "ovs_interfaceid": "068d74d7-23a6-42b8-8a3c-02ba7ce746a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'aa939d1b-b8a6-4391-935b-0191bf5ccd0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 10:49:46 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:49:46 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:49:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1889492132',display_name='tempest-TestVolumeSwap-server-1889492132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1889492132',id=9,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEKmN0jSdm18k+Aexo02JdEt0XFxDiVLcmHjI0n+gja4c0moLkH+GaofYEgftuA7XyMMU7ng1dgoDUE6/CZSQwmovKyutzGdVza1+RsWUps8Rkjx8rNx3Vrf+qMaesQ3Zw==',key_name='tempest-keypair-572005247',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8add654139084d4da3e8f2c2586a9466',ramdisk_id='',reservation_id='r-asf10y2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-623433662',owner_user_name='tempest-TestVolumeSwap-623433662-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:49:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='86984721f70d4723b721a424ac3bb7b5',uuid=7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "068d74d7-23a6-42b8-8a3c-02ba7ce746a7", "address": "fa:16:3e:de:46:25", "network": {"id": "b7c1f696-fec6-41c2-a173-f6497212eb9d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-130325100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8add654139084d4da3e8f2c2586a9466", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068d74d7-23", "ovs_interfaceid": "068d74d7-23a6-42b8-8a3c-02ba7ce746a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Converting VIF {"id": "068d74d7-23a6-42b8-8a3c-02ba7ce746a7", "address": "fa:16:3e:de:46:25", "network": {"id": "b7c1f696-fec6-41c2-a173-f6497212eb9d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-130325100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8add654139084d4da3e8f2c2586a9466", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068d74d7-23", "ovs_interfaceid": "068d74d7-23a6-42b8-8a3c-02ba7ce746a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:46:25,bridge_name='br-int',has_traffic_filtering=True,id=068d74d7-23a6-42b8-8a3c-02ba7ce746a7,network=Network(b7c1f696-fec6-41c2-a173-f6497212eb9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068d74d7-23') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.objects.instance [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Lazy-loading 'pci_devices' on Instance uuid 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] End _get_guest_xml xml=<domain type="kvm">
Nov 28 10:49:46 user nova-compute[74994]:   <uuid>7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a</uuid>
Nov 28 10:49:46 user nova-compute[74994]:   <name>instance-00000009</name>
Nov 28 10:49:46 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 10:49:46 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 10:49:46 user nova-compute[74994]:   <metadata>
Nov 28 10:49:46 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 10:49:46 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 10:49:46 user nova-compute[74994]:       <nova:name>tempest-TestVolumeSwap-server-1889492132</nova:name>
Nov 28 10:49:46 user nova-compute[74994]:       <nova:creationTime>2023-11-28 10:49:46</nova:creationTime>
Nov 28 10:49:46 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 10:49:46 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 10:49:46 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 10:49:46 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 10:49:46 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 10:49:46 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 10:49:46 user nova-compute[74994]:       </nova:flavor>
Nov 28 10:49:46 user nova-compute[74994]:       <nova:owner>
Nov 28 10:49:46 user nova-compute[74994]:         <nova:user uuid="86984721f70d4723b721a424ac3bb7b5">tempest-TestVolumeSwap-623433662-project-member</nova:user>
Nov 28 10:49:46 user nova-compute[74994]:         <nova:project uuid="8add654139084d4da3e8f2c2586a9466">tempest-TestVolumeSwap-623433662</nova:project>
Nov 28 10:49:46 user nova-compute[74994]:       </nova:owner>
Nov 28 10:49:46 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 10:49:46 user nova-compute[74994]:       <nova:ports>
Nov 28 10:49:46 user nova-compute[74994]:         <nova:port uuid="068d74d7-23a6-42b8-8a3c-02ba7ce746a7">
Nov 28 10:49:46 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 10:49:46 user nova-compute[74994]:         </nova:port>
Nov 28 10:49:46 user nova-compute[74994]:       </nova:ports>
Nov 28 10:49:46 user nova-compute[74994]:     </nova:instance>
Nov 28 10:49:46 user nova-compute[74994]:   </metadata>
Nov 28 10:49:46 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 10:49:46 user nova-compute[74994]:     <system>
Nov 28 10:49:46 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 10:49:46 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 10:49:46 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 10:49:46 user nova-compute[74994]:       <entry name="serial">7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a</entry>
Nov 28 10:49:46 user nova-compute[74994]:       <entry name="uuid">7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a</entry>
Nov 28 10:49:46 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 10:49:46 user nova-compute[74994]:     </system>
Nov 28 10:49:46 user nova-compute[74994]:   </sysinfo>
Nov 28 10:49:46 user nova-compute[74994]:   <os>
Nov 28 10:49:46 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 10:49:46 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 10:49:46 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 10:49:46 user nova-compute[74994]:   </os>
Nov 28 10:49:46 user nova-compute[74994]:   <features>
Nov 28 10:49:46 user nova-compute[74994]:     <acpi/>
Nov 28 10:49:46 user nova-compute[74994]:     <apic/>
Nov 28 10:49:46 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 10:49:46 user nova-compute[74994]:   </features>
Nov 28 10:49:46 user nova-compute[74994]:   <clock offset="utc">
Nov 28 10:49:46 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 10:49:46 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 10:49:46 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 10:49:46 user nova-compute[74994]:   </clock>
Nov 28 10:49:46 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 10:49:46 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 10:49:46 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 10:49:46 user nova-compute[74994]:   </cpu>
Nov 28 10:49:46 user nova-compute[74994]:   <devices>
Nov 28 10:49:46 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 10:49:46 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 10:49:46 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a/disk"/>
Nov 28 10:49:46 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 10:49:46 user nova-compute[74994]:     </disk>
Nov 28 10:49:46 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 10:49:46 user nova-compute[74994]:       <mac address="fa:16:3e:de:46:25"/>
Nov 28 10:49:46 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:49:46 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 10:49:46 user nova-compute[74994]:       <target dev="tap068d74d7-23"/>
Nov 28 10:49:46 user nova-compute[74994]:     </interface>
Nov 28 10:49:46 user nova-compute[74994]:     <serial type="pty">
Nov 28 10:49:46 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a/console.log" append="off"/>
Nov 28 10:49:46 user nova-compute[74994]:     </serial>
Nov 28 10:49:46 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 10:49:46 user nova-compute[74994]:     <video>
Nov 28 10:49:46 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:49:46 user nova-compute[74994]:     </video>
Nov 28 10:49:46 user nova-compute[74994]:     <rng model="virtio">
Nov 28 10:49:46 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 10:49:46 user nova-compute[74994]:     </rng>
Nov 28 10:49:46 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 10:49:46 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 10:49:46 user nova-compute[74994]:       <stats period="10"/>
Nov 28 10:49:46 user nova-compute[74994]:     </memballoon>
Nov 28 10:49:46 user nova-compute[74994]:   </devices>
Nov 28 10:49:46 user nova-compute[74994]: </domain>
Nov 28 10:49:46 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:49:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1889492132',display_name='tempest-TestVolumeSwap-server-1889492132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1889492132',id=9,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEKmN0jSdm18k+Aexo02JdEt0XFxDiVLcmHjI0n+gja4c0moLkH+GaofYEgftuA7XyMMU7ng1dgoDUE6/CZSQwmovKyutzGdVza1+RsWUps8Rkjx8rNx3Vrf+qMaesQ3Zw==',key_name='tempest-keypair-572005247',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8add654139084d4da3e8f2c2586a9466',ramdisk_id='',reservation_id='r-asf10y2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-623433662',owner_user_name='tempest-TestVolumeSwap-623433662-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:49:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='86984721f70d4723b721a424ac3bb7b5',uuid=7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "068d74d7-23a6-42b8-8a3c-02ba7ce746a7", "address": "fa:16:3e:de:46:25", "network": {"id": "b7c1f696-fec6-41c2-a173-f6497212eb9d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-130325100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8add654139084d4da3e8f2c2586a9466", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068d74d7-23", "ovs_interfaceid": "068d74d7-23a6-42b8-8a3c-02ba7ce746a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Converting VIF {"id": "068d74d7-23a6-42b8-8a3c-02ba7ce746a7", "address": "fa:16:3e:de:46:25", "network": {"id": "b7c1f696-fec6-41c2-a173-f6497212eb9d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-130325100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8add654139084d4da3e8f2c2586a9466", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068d74d7-23", "ovs_interfaceid": "068d74d7-23a6-42b8-8a3c-02ba7ce746a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:46:25,bridge_name='br-int',has_traffic_filtering=True,id=068d74d7-23a6-42b8-8a3c-02ba7ce746a7,network=Network(b7c1f696-fec6-41c2-a173-f6497212eb9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068d74d7-23') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG os_vif [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:46:25,bridge_name='br-int',has_traffic_filtering=True,id=068d74d7-23a6-42b8-8a3c-02ba7ce746a7,network=Network(b7c1f696-fec6-41c2-a173-f6497212eb9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068d74d7-23') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd9897932-0120-53d2-b838-ec5245d8adef', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap068d74d7-23, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap068d74d7-23, col_values=(('qos', UUID('235bc249-dd6a-4c99-be10-e102cf03208b')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap068d74d7-23, col_values=(('external_ids', {'iface-id': '068d74d7-23a6-42b8-8a3c-02ba7ce746a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:46:25', 'vm-uuid': '7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:46 user nova-compute[74994]: INFO os_vif [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:46:25,bridge_name='br-int',has_traffic_filtering=True,id=068d74d7-23a6-42b8-8a3c-02ba7ce746a7,network=Network(b7c1f696-fec6-41c2-a173-f6497212eb9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068d74d7-23')
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.network.neutron [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Updating instance_info_cache with network_info: [{"id": "752a5c48-15a2-443c-911c-f1a0c33ca925", "address": "fa:16:3e:a4:4b:1f", "network": {"id": "92ee00e3-fc9c-459d-9dac-4ef40e592023", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2069871364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1413a02a3034130b4a4ec170ca2fc16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap752a5c48-15", "ovs_interfaceid": "752a5c48-15a2-443c-911c-f1a0c33ca925", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Releasing lock "refresh_cache-c2925833-e88d-4aa7-a477-ff1bc1fcd724" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.compute.manager [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Instance network_info: |[{"id": "752a5c48-15a2-443c-911c-f1a0c33ca925", "address": "fa:16:3e:a4:4b:1f", "network": {"id": "92ee00e3-fc9c-459d-9dac-4ef40e592023", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2069871364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1413a02a3034130b4a4ec170ca2fc16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap752a5c48-15", "ovs_interfaceid": "752a5c48-15a2-443c-911c-f1a0c33ca925", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-de5903b8-85d8-4968-a0aa-28e7bdd9bf1f req-ed40d140-16fe-4b89-a260-c519890eae29 service nova] Acquired lock "refresh_cache-c2925833-e88d-4aa7-a477-ff1bc1fcd724" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.network.neutron [req-de5903b8-85d8-4968-a0aa-28e7bdd9bf1f req-ed40d140-16fe-4b89-a260-c519890eae29 service nova] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Refreshing network info cache for port 752a5c48-15a2-443c-911c-f1a0c33ca925 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Start _get_guest_xml network_info=[{"id": "752a5c48-15a2-443c-911c-f1a0c33ca925", "address": "fa:16:3e:a4:4b:1f", "network": {"id": "92ee00e3-fc9c-459d-9dac-4ef40e592023", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2069871364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1413a02a3034130b4a4ec170ca2fc16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap752a5c48-15", "ovs_interfaceid": "752a5c48-15a2-443c-911c-f1a0c33ca925", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'aa939d1b-b8a6-4391-935b-0191bf5ccd0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.compute.manager [req-93da78d2-fe90-4073-9617-3e2d96df1944 req-a19ee4a2-71cb-444a-a55c-eb3ac0a5bd52 service nova] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Received event network-changed-068d74d7-23a6-42b8-8a3c-02ba7ce746a7 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.compute.manager [req-93da78d2-fe90-4073-9617-3e2d96df1944 req-a19ee4a2-71cb-444a-a55c-eb3ac0a5bd52 service nova] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Refreshing instance network info cache due to event network-changed-068d74d7-23a6-42b8-8a3c-02ba7ce746a7. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-93da78d2-fe90-4073-9617-3e2d96df1944 req-a19ee4a2-71cb-444a-a55c-eb3ac0a5bd52 service nova] Acquiring lock "refresh_cache-7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-93da78d2-fe90-4073-9617-3e2d96df1944 req-a19ee4a2-71cb-444a-a55c-eb3ac0a5bd52 service nova] Acquired lock "refresh_cache-7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.network.neutron [req-93da78d2-fe90-4073-9617-3e2d96df1944 req-a19ee4a2-71cb-444a-a55c-eb3ac0a5bd52 service nova] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Refreshing network info cache for port 068d74d7-23a6-42b8-8a3c-02ba7ce746a7 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:49:46 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:49:46 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:49:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-185346772',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-185346772',id=10,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKb7DfQBhl9KQjX/Jy4TL5O6PXWUKL+vLgAOjfX/Q0BbK/dfYX/kuDxa2AyyjG8Tr6w0nPvpMGRLCsCXhPfUwNG1BTBUaGDIyyYhGnKPl0/QavZSldUeJCV0yh5hnereZw==',key_name='tempest-keypair-433898378',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1413a02a3034130b4a4ec170ca2fc16',ramdisk_id='',reservation_id='r-z554pke2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1012374446',owner_user_name='tempest-TaggedAttachmentsTest-1012374446-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:49:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02983082e29345a491ecd8fe18268b84',uuid=c2925833-e88d-4aa7-a477-ff1bc1fcd724,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "752a5c48-15a2-443c-911c-f1a0c33ca925", "address": "fa:16:3e:a4:4b:1f", "network": {"id": "92ee00e3-fc9c-459d-9dac-4ef40e592023", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2069871364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1413a02a3034130b4a4ec170ca2fc16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap752a5c48-15", "ovs_interfaceid": "752a5c48-15a2-443c-911c-f1a0c33ca925", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Converting VIF {"id": "752a5c48-15a2-443c-911c-f1a0c33ca925", "address": "fa:16:3e:a4:4b:1f", "network": {"id": "92ee00e3-fc9c-459d-9dac-4ef40e592023", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2069871364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1413a02a3034130b4a4ec170ca2fc16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap752a5c48-15", "ovs_interfaceid": "752a5c48-15a2-443c-911c-f1a0c33ca925", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:4b:1f,bridge_name='br-int',has_traffic_filtering=True,id=752a5c48-15a2-443c-911c-f1a0c33ca925,network=Network(92ee00e3-fc9c-459d-9dac-4ef40e592023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap752a5c48-15') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.objects.instance [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Lazy-loading 'pci_devices' on Instance uuid c2925833-e88d-4aa7-a477-ff1bc1fcd724 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] No VIF found with MAC fa:16:3e:de:46:25, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] End _get_guest_xml xml=<domain type="kvm">
Nov 28 10:49:46 user nova-compute[74994]:   <uuid>c2925833-e88d-4aa7-a477-ff1bc1fcd724</uuid>
Nov 28 10:49:46 user nova-compute[74994]:   <name>instance-0000000a</name>
Nov 28 10:49:46 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 10:49:46 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 10:49:46 user nova-compute[74994]:   <metadata>
Nov 28 10:49:46 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 10:49:46 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 10:49:46 user nova-compute[74994]:       <nova:name>tempest-device-tagging-server-185346772</nova:name>
Nov 28 10:49:46 user nova-compute[74994]:       <nova:creationTime>2023-11-28 10:49:46</nova:creationTime>
Nov 28 10:49:46 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 10:49:46 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 10:49:46 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 10:49:46 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 10:49:46 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 10:49:46 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 10:49:46 user nova-compute[74994]:       </nova:flavor>
Nov 28 10:49:46 user nova-compute[74994]:       <nova:owner>
Nov 28 10:49:46 user nova-compute[74994]:         <nova:user uuid="02983082e29345a491ecd8fe18268b84">tempest-TaggedAttachmentsTest-1012374446-project-member</nova:user>
Nov 28 10:49:46 user nova-compute[74994]:         <nova:project uuid="a1413a02a3034130b4a4ec170ca2fc16">tempest-TaggedAttachmentsTest-1012374446</nova:project>
Nov 28 10:49:46 user nova-compute[74994]:       </nova:owner>
Nov 28 10:49:46 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 10:49:46 user nova-compute[74994]:       <nova:ports>
Nov 28 10:49:46 user nova-compute[74994]:         <nova:port uuid="752a5c48-15a2-443c-911c-f1a0c33ca925">
Nov 28 10:49:46 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 10:49:46 user nova-compute[74994]:         </nova:port>
Nov 28 10:49:46 user nova-compute[74994]:       </nova:ports>
Nov 28 10:49:46 user nova-compute[74994]:     </nova:instance>
Nov 28 10:49:46 user nova-compute[74994]:   </metadata>
Nov 28 10:49:46 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 10:49:46 user nova-compute[74994]:     <system>
Nov 28 10:49:46 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 10:49:46 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 10:49:46 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 10:49:46 user nova-compute[74994]:       <entry name="serial">c2925833-e88d-4aa7-a477-ff1bc1fcd724</entry>
Nov 28 10:49:46 user nova-compute[74994]:       <entry name="uuid">c2925833-e88d-4aa7-a477-ff1bc1fcd724</entry>
Nov 28 10:49:46 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 10:49:46 user nova-compute[74994]:     </system>
Nov 28 10:49:46 user nova-compute[74994]:   </sysinfo>
Nov 28 10:49:46 user nova-compute[74994]:   <os>
Nov 28 10:49:46 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 10:49:46 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 10:49:46 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 10:49:46 user nova-compute[74994]:   </os>
Nov 28 10:49:46 user nova-compute[74994]:   <features>
Nov 28 10:49:46 user nova-compute[74994]:     <acpi/>
Nov 28 10:49:46 user nova-compute[74994]:     <apic/>
Nov 28 10:49:46 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 10:49:46 user nova-compute[74994]:   </features>
Nov 28 10:49:46 user nova-compute[74994]:   <clock offset="utc">
Nov 28 10:49:46 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 10:49:46 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 10:49:46 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 10:49:46 user nova-compute[74994]:   </clock>
Nov 28 10:49:46 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 10:49:46 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 10:49:46 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 10:49:46 user nova-compute[74994]:   </cpu>
Nov 28 10:49:46 user nova-compute[74994]:   <devices>
Nov 28 10:49:46 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 10:49:46 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 10:49:46 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/c2925833-e88d-4aa7-a477-ff1bc1fcd724/disk"/>
Nov 28 10:49:46 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 10:49:46 user nova-compute[74994]:     </disk>
Nov 28 10:49:46 user nova-compute[74994]:     <disk type="file" device="cdrom">
Nov 28 10:49:46 user nova-compute[74994]:       <driver name="qemu" type="raw" cache="none"/>
Nov 28 10:49:46 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/c2925833-e88d-4aa7-a477-ff1bc1fcd724/disk.config"/>
Nov 28 10:49:46 user nova-compute[74994]:       <target dev="hda" bus="ide"/>
Nov 28 10:49:46 user nova-compute[74994]:     </disk>
Nov 28 10:49:46 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 10:49:46 user nova-compute[74994]:       <mac address="fa:16:3e:a4:4b:1f"/>
Nov 28 10:49:46 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:49:46 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 10:49:46 user nova-compute[74994]:       <target dev="tap752a5c48-15"/>
Nov 28 10:49:46 user nova-compute[74994]:     </interface>
Nov 28 10:49:46 user nova-compute[74994]:     <serial type="pty">
Nov 28 10:49:46 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/c2925833-e88d-4aa7-a477-ff1bc1fcd724/console.log" append="off"/>
Nov 28 10:49:46 user nova-compute[74994]:     </serial>
Nov 28 10:49:46 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 10:49:46 user nova-compute[74994]:     <video>
Nov 28 10:49:46 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:49:46 user nova-compute[74994]:     </video>
Nov 28 10:49:46 user nova-compute[74994]:     <rng model="virtio">
Nov 28 10:49:46 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 10:49:46 user nova-compute[74994]:     </rng>
Nov 28 10:49:46 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 10:49:46 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 10:49:46 user nova-compute[74994]:       <stats period="10"/>
Nov 28 10:49:46 user nova-compute[74994]:     </memballoon>
Nov 28 10:49:46 user nova-compute[74994]:   </devices>
Nov 28 10:49:46 user nova-compute[74994]: </domain>
Nov 28 10:49:46 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:49:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-185346772',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-185346772',id=10,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKb7DfQBhl9KQjX/Jy4TL5O6PXWUKL+vLgAOjfX/Q0BbK/dfYX/kuDxa2AyyjG8Tr6w0nPvpMGRLCsCXhPfUwNG1BTBUaGDIyyYhGnKPl0/QavZSldUeJCV0yh5hnereZw==',key_name='tempest-keypair-433898378',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1413a02a3034130b4a4ec170ca2fc16',ramdisk_id='',reservation_id='r-z554pke2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1012374446',owner_user_name='tempest-TaggedAttachmentsTest-1012374446-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:49:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02983082e29345a491ecd8fe18268b84',uuid=c2925833-e88d-4aa7-a477-ff1bc1fcd724,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "752a5c48-15a2-443c-911c-f1a0c33ca925", "address": "fa:16:3e:a4:4b:1f", "network": {"id": "92ee00e3-fc9c-459d-9dac-4ef40e592023", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2069871364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1413a02a3034130b4a4ec170ca2fc16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap752a5c48-15", "ovs_interfaceid": "752a5c48-15a2-443c-911c-f1a0c33ca925", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Converting VIF {"id": "752a5c48-15a2-443c-911c-f1a0c33ca925", "address": "fa:16:3e:a4:4b:1f", "network": {"id": "92ee00e3-fc9c-459d-9dac-4ef40e592023", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2069871364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1413a02a3034130b4a4ec170ca2fc16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap752a5c48-15", "ovs_interfaceid": "752a5c48-15a2-443c-911c-f1a0c33ca925", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:4b:1f,bridge_name='br-int',has_traffic_filtering=True,id=752a5c48-15a2-443c-911c-f1a0c33ca925,network=Network(92ee00e3-fc9c-459d-9dac-4ef40e592023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap752a5c48-15') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG os_vif [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:4b:1f,bridge_name='br-int',has_traffic_filtering=True,id=752a5c48-15a2-443c-911c-f1a0c33ca925,network=Network(92ee00e3-fc9c-459d-9dac-4ef40e592023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap752a5c48-15') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e6cf52f7-74c1-58a8-b277-a8e7a51b08f9', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap752a5c48-15, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap752a5c48-15, col_values=(('qos', UUID('c5ac5ad6-6df3-4fe8-86d0-4fec1dc40ed4')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap752a5c48-15, col_values=(('external_ids', {'iface-id': '752a5c48-15a2-443c-911c-f1a0c33ca925', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:4b:1f', 'vm-uuid': 'c2925833-e88d-4aa7-a477-ff1bc1fcd724'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:49:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:46 user nova-compute[74994]: INFO os_vif [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:4b:1f,bridge_name='br-int',has_traffic_filtering=True,id=752a5c48-15a2-443c-911c-f1a0c33ca925,network=Network(92ee00e3-fc9c-459d-9dac-4ef40e592023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap752a5c48-15')
Nov 28 10:49:47 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:49:47 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] No BDM found with device name hda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:49:47 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] No VIF found with MAC fa:16:3e:a4:4b:1f, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:49:47 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Using config drive
Nov 28 10:49:47 user nova-compute[74994]: DEBUG nova.network.neutron [req-de5903b8-85d8-4968-a0aa-28e7bdd9bf1f req-ed40d140-16fe-4b89-a260-c519890eae29 service nova] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Updated VIF entry in instance network info cache for port 752a5c48-15a2-443c-911c-f1a0c33ca925. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 10:49:47 user nova-compute[74994]: DEBUG nova.network.neutron [req-de5903b8-85d8-4968-a0aa-28e7bdd9bf1f req-ed40d140-16fe-4b89-a260-c519890eae29 service nova] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Updating instance_info_cache with network_info: [{"id": "752a5c48-15a2-443c-911c-f1a0c33ca925", "address": "fa:16:3e:a4:4b:1f", "network": {"id": "92ee00e3-fc9c-459d-9dac-4ef40e592023", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2069871364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1413a02a3034130b4a4ec170ca2fc16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap752a5c48-15", "ovs_interfaceid": "752a5c48-15a2-443c-911c-f1a0c33ca925", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:49:47 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-de5903b8-85d8-4968-a0aa-28e7bdd9bf1f req-ed40d140-16fe-4b89-a260-c519890eae29 service nova] Releasing lock "refresh_cache-c2925833-e88d-4aa7-a477-ff1bc1fcd724" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:49:47 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:47 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:47 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:47 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:47 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:47 user nova-compute[74994]: DEBUG nova.network.neutron [req-93da78d2-fe90-4073-9617-3e2d96df1944 req-a19ee4a2-71cb-444a-a55c-eb3ac0a5bd52 service nova] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Updated VIF entry in instance network info cache for port 068d74d7-23a6-42b8-8a3c-02ba7ce746a7. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 10:49:47 user nova-compute[74994]: DEBUG nova.network.neutron [req-93da78d2-fe90-4073-9617-3e2d96df1944 req-a19ee4a2-71cb-444a-a55c-eb3ac0a5bd52 service nova] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Updating instance_info_cache with network_info: [{"id": "068d74d7-23a6-42b8-8a3c-02ba7ce746a7", "address": "fa:16:3e:de:46:25", "network": {"id": "b7c1f696-fec6-41c2-a173-f6497212eb9d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-130325100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8add654139084d4da3e8f2c2586a9466", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068d74d7-23", "ovs_interfaceid": "068d74d7-23a6-42b8-8a3c-02ba7ce746a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:49:47 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-93da78d2-fe90-4073-9617-3e2d96df1944 req-a19ee4a2-71cb-444a-a55c-eb3ac0a5bd52 service nova] Releasing lock "refresh_cache-7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:49:47 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Creating config drive at /opt/stack/data/nova/instances/c2925833-e88d-4aa7-a477-ff1bc1fcd724/disk.config
Nov 28 10:49:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c2925833-e88d-4aa7-a477-ff1bc1fcd724/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp3151z6xw {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:47 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c2925833-e88d-4aa7-a477-ff1bc1fcd724/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp3151z6xw" returned: 0 in 0.074s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:49 user nova-compute[74994]: DEBUG nova.compute.manager [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 10:49:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 10:49:49 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Instance spawned successfully.
Nov 28 10:49:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 10:49:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:49 user nova-compute[74994]: INFO nova.compute.manager [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Took 12.16 seconds to spawn the instance on the hypervisor.
Nov 28 10:49:49 user nova-compute[74994]: DEBUG nova.compute.manager [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 10:49:49 user nova-compute[74994]: INFO nova.compute.manager [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Took 13.85 seconds to build instance.
Nov 28 10:49:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-80f1b373-27d5-4a48-a13b-93b53d7875f6 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lock "2e30565c-9f8e-4a87-8054-6c260dac4f48" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.079s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Acquiring lock "6e6a974e-3626-453c-8662-0d160f6e57de" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Lock "6e6a974e-3626-453c-8662-0d160f6e57de" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:49 user nova-compute[74994]: DEBUG nova.compute.manager [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 10:49:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:50 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 10:49:50 user nova-compute[74994]: INFO nova.compute.claims [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Claim successful on node user
Nov 28 10:49:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:50 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:49:50 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:49:50 user nova-compute[74994]: DEBUG nova.compute.manager [req-9c3e748e-e487-4c5b-af1d-808c54050f49 req-be974edc-dc47-45e8-a4b9-aaa57dd3fbde service nova] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Received event network-vif-plugged-aeaddf62-0ca1-40d1-9228-897ee0015d4a {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:49:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9c3e748e-e487-4c5b-af1d-808c54050f49 req-be974edc-dc47-45e8-a4b9-aaa57dd3fbde service nova] Acquiring lock "279e1c4c-36f9-492f-ab3f-1b587347eadd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9c3e748e-e487-4c5b-af1d-808c54050f49 req-be974edc-dc47-45e8-a4b9-aaa57dd3fbde service nova] Lock "279e1c4c-36f9-492f-ab3f-1b587347eadd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9c3e748e-e487-4c5b-af1d-808c54050f49 req-be974edc-dc47-45e8-a4b9-aaa57dd3fbde service nova] Lock "279e1c4c-36f9-492f-ab3f-1b587347eadd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:50 user nova-compute[74994]: DEBUG nova.compute.manager [req-9c3e748e-e487-4c5b-af1d-808c54050f49 req-be974edc-dc47-45e8-a4b9-aaa57dd3fbde service nova] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] No waiting events found dispatching network-vif-plugged-aeaddf62-0ca1-40d1-9228-897ee0015d4a {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:49:50 user nova-compute[74994]: WARNING nova.compute.manager [req-9c3e748e-e487-4c5b-af1d-808c54050f49 req-be974edc-dc47-45e8-a4b9-aaa57dd3fbde service nova] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Received unexpected event network-vif-plugged-aeaddf62-0ca1-40d1-9228-897ee0015d4a for instance with vm_state active and task_state None.
Nov 28 10:49:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.840s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:50 user nova-compute[74994]: DEBUG nova.compute.manager [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 10:49:51 user nova-compute[74994]: DEBUG nova.compute.manager [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 10:49:51 user nova-compute[74994]: DEBUG nova.network.neutron [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 10:49:51 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 10:49:51 user nova-compute[74994]: DEBUG nova.compute.manager [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 10:49:51 user nova-compute[74994]: DEBUG nova.policy [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '789b88ca90ab4772a4b71c3d1dd6efbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e449ba25474e43973c86fedccea8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 10:49:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:51 user nova-compute[74994]: DEBUG nova.compute.manager [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 10:49:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 10:49:51 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Creating image(s)
Nov 28 10:49:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Acquiring lock "/opt/stack/data/nova/instances/6e6a974e-3626-453c-8662-0d160f6e57de/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Lock "/opt/stack/data/nova/instances/6e6a974e-3626-453c-8662-0d160f6e57de/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Lock "/opt/stack/data/nova/instances/6e6a974e-3626-453c-8662-0d160f6e57de/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.260s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Acquiring lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.263s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/6e6a974e-3626-453c-8662-0d160f6e57de/disk 1073741824 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/6e6a974e-3626-453c-8662-0d160f6e57de/disk 1073741824" returned: 0 in 0.090s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.361s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.238s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:52 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6e6a974e-3626-453c-8662-0d160f6e57de/disk. size=1073741824 {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 10:49:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e6a974e-3626-453c-8662-0d160f6e57de/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:49:52 user nova-compute[74994]: DEBUG nova.network.neutron [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Successfully created port: 9854edad-1d5f-4ea8-bced-f1ae510e224a {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 10:49:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e6a974e-3626-453c-8662-0d160f6e57de/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:49:52 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Cannot resize image /opt/stack/data/nova/instances/6e6a974e-3626-453c-8662-0d160f6e57de/disk to a smaller size. {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 10:49:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Created local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 10:49:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Ensure instance console log exists: /opt/stack/data/nova/instances/6e6a974e-3626-453c-8662-0d160f6e57de/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 10:49:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.003s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:52 user nova-compute[74994]: DEBUG nova.compute.manager [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 10:49:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 10:49:52 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Instance spawned successfully.
Nov 28 10:49:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 10:49:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:53 user nova-compute[74994]: DEBUG nova.compute.manager [req-715d6bd6-d25b-4138-9c73-03d4c972cf8a req-93ead32f-5eea-4096-8b06-bf5587923d27 service nova] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Received event network-vif-plugged-aeaddf62-0ca1-40d1-9228-897ee0015d4a {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:49:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-715d6bd6-d25b-4138-9c73-03d4c972cf8a req-93ead32f-5eea-4096-8b06-bf5587923d27 service nova] Acquiring lock "279e1c4c-36f9-492f-ab3f-1b587347eadd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-715d6bd6-d25b-4138-9c73-03d4c972cf8a req-93ead32f-5eea-4096-8b06-bf5587923d27 service nova] Lock "279e1c4c-36f9-492f-ab3f-1b587347eadd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-715d6bd6-d25b-4138-9c73-03d4c972cf8a req-93ead32f-5eea-4096-8b06-bf5587923d27 service nova] Lock "279e1c4c-36f9-492f-ab3f-1b587347eadd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:53 user nova-compute[74994]: DEBUG nova.compute.manager [req-715d6bd6-d25b-4138-9c73-03d4c972cf8a req-93ead32f-5eea-4096-8b06-bf5587923d27 service nova] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] No waiting events found dispatching network-vif-plugged-aeaddf62-0ca1-40d1-9228-897ee0015d4a {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:49:53 user nova-compute[74994]: WARNING nova.compute.manager [req-715d6bd6-d25b-4138-9c73-03d4c972cf8a req-93ead32f-5eea-4096-8b06-bf5587923d27 service nova] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Received unexpected event network-vif-plugged-aeaddf62-0ca1-40d1-9228-897ee0015d4a for instance with vm_state active and task_state None.
Nov 28 10:49:53 user nova-compute[74994]: INFO nova.compute.manager [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Took 9.93 seconds to spawn the instance on the hypervisor.
Nov 28 10:49:53 user nova-compute[74994]: DEBUG nova.compute.manager [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 10:49:53 user nova-compute[74994]: INFO nova.compute.manager [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Took 11.30 seconds to build instance.
Nov 28 10:49:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3cce3186-71a6-45fd-8a82-0d25c7134de0 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Lock "7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.635s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:53 user nova-compute[74994]: DEBUG nova.compute.manager [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 10:49:53 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 10:49:53 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Instance spawned successfully.
Nov 28 10:49:53 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 10:49:53 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:53 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:53 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:53 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:53 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:53 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:53 user nova-compute[74994]: DEBUG nova.compute.manager [req-2b12cf3c-df95-4418-ad70-389fa91e79c9 req-bdf1d254-624d-4fe7-9609-99d0cb6b5cd3 service nova] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Received event network-vif-plugged-752a5c48-15a2-443c-911c-f1a0c33ca925 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:49:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-2b12cf3c-df95-4418-ad70-389fa91e79c9 req-bdf1d254-624d-4fe7-9609-99d0cb6b5cd3 service nova] Acquiring lock "c2925833-e88d-4aa7-a477-ff1bc1fcd724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-2b12cf3c-df95-4418-ad70-389fa91e79c9 req-bdf1d254-624d-4fe7-9609-99d0cb6b5cd3 service nova] Lock "c2925833-e88d-4aa7-a477-ff1bc1fcd724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-2b12cf3c-df95-4418-ad70-389fa91e79c9 req-bdf1d254-624d-4fe7-9609-99d0cb6b5cd3 service nova] Lock "c2925833-e88d-4aa7-a477-ff1bc1fcd724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:53 user nova-compute[74994]: DEBUG nova.compute.manager [req-2b12cf3c-df95-4418-ad70-389fa91e79c9 req-bdf1d254-624d-4fe7-9609-99d0cb6b5cd3 service nova] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] No waiting events found dispatching network-vif-plugged-752a5c48-15a2-443c-911c-f1a0c33ca925 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:49:53 user nova-compute[74994]: WARNING nova.compute.manager [req-2b12cf3c-df95-4418-ad70-389fa91e79c9 req-bdf1d254-624d-4fe7-9609-99d0cb6b5cd3 service nova] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Received unexpected event network-vif-plugged-752a5c48-15a2-443c-911c-f1a0c33ca925 for instance with vm_state building and task_state spawning.
Nov 28 10:49:53 user nova-compute[74994]: INFO nova.compute.manager [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Took 9.19 seconds to spawn the instance on the hypervisor.
Nov 28 10:49:53 user nova-compute[74994]: DEBUG nova.compute.manager [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 10:49:53 user nova-compute[74994]: DEBUG nova.network.neutron [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Successfully updated port: 9854edad-1d5f-4ea8-bced-f1ae510e224a {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 10:49:53 user nova-compute[74994]: INFO nova.compute.manager [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Took 11.23 seconds to build instance.
Nov 28 10:49:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Acquiring lock "refresh_cache-6e6a974e-3626-453c-8662-0d160f6e57de" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:49:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Acquired lock "refresh_cache-6e6a974e-3626-453c-8662-0d160f6e57de" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:49:53 user nova-compute[74994]: DEBUG nova.network.neutron [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 10:49:53 user nova-compute[74994]: DEBUG nova.compute.manager [req-63eb1d5a-6580-420e-a59d-01ea60141777 req-64d53210-f5e4-4c6c-b151-1ba66e52a512 service nova] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Received event network-changed-9854edad-1d5f-4ea8-bced-f1ae510e224a {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:49:53 user nova-compute[74994]: DEBUG nova.compute.manager [req-63eb1d5a-6580-420e-a59d-01ea60141777 req-64d53210-f5e4-4c6c-b151-1ba66e52a512 service nova] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Refreshing instance network info cache due to event network-changed-9854edad-1d5f-4ea8-bced-f1ae510e224a. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:49:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-63eb1d5a-6580-420e-a59d-01ea60141777 req-64d53210-f5e4-4c6c-b151-1ba66e52a512 service nova] Acquiring lock "refresh_cache-6e6a974e-3626-453c-8662-0d160f6e57de" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:49:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-94c29de9-aae6-4877-99be-10ffed068f85 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Lock "c2925833-e88d-4aa7-a477-ff1bc1fcd724" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.488s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:53 user nova-compute[74994]: DEBUG nova.network.neutron [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 10:49:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:54 user nova-compute[74994]: DEBUG nova.network.neutron [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Updating instance_info_cache with network_info: [{"id": "9854edad-1d5f-4ea8-bced-f1ae510e224a", "address": "fa:16:3e:52:d1:90", "network": {"id": "d32e0d40-6adf-48ad-9316-b347b3ba6cf4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-883485495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e449ba25474e43973c86fedccea8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9854edad-1d", "ovs_interfaceid": "9854edad-1d5f-4ea8-bced-f1ae510e224a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:49:54 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Releasing lock "refresh_cache-6e6a974e-3626-453c-8662-0d160f6e57de" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:49:54 user nova-compute[74994]: DEBUG nova.compute.manager [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Instance network_info: |[{"id": "9854edad-1d5f-4ea8-bced-f1ae510e224a", "address": "fa:16:3e:52:d1:90", "network": {"id": "d32e0d40-6adf-48ad-9316-b347b3ba6cf4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-883485495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e449ba25474e43973c86fedccea8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9854edad-1d", "ovs_interfaceid": "9854edad-1d5f-4ea8-bced-f1ae510e224a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 10:49:54 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-63eb1d5a-6580-420e-a59d-01ea60141777 req-64d53210-f5e4-4c6c-b151-1ba66e52a512 service nova] Acquired lock "refresh_cache-6e6a974e-3626-453c-8662-0d160f6e57de" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:49:54 user nova-compute[74994]: DEBUG nova.network.neutron [req-63eb1d5a-6580-420e-a59d-01ea60141777 req-64d53210-f5e4-4c6c-b151-1ba66e52a512 service nova] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Refreshing network info cache for port 9854edad-1d5f-4ea8-bced-f1ae510e224a {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:49:54 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Start _get_guest_xml network_info=[{"id": "9854edad-1d5f-4ea8-bced-f1ae510e224a", "address": "fa:16:3e:52:d1:90", "network": {"id": "d32e0d40-6adf-48ad-9316-b347b3ba6cf4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-883485495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e449ba25474e43973c86fedccea8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9854edad-1d", "ovs_interfaceid": "9854edad-1d5f-4ea8-bced-f1ae510e224a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'aa939d1b-b8a6-4391-935b-0191bf5ccd0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 10:49:54 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:49:54 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:49:54 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 10:49:54 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 10:49:54 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 10:49:54 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 10:49:54 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 10:49:54 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 10:49:54 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 10:49:54 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 10:49:54 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 10:49:54 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 10:49:54 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 10:49:54 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 10:49:54 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 10:49:54 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 10:49:54 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 10:49:54 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 10:49:54 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:49:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-520088525',display_name='tempest-VolumesAssistedSnapshotsTest-server-520088525',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-520088525',id=11,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPo0BQ4NcEgut63xyqujvAXPIH9n9ipaH1zU5pISvY+ug4cvultl1EF5DdU5m0xCHfxRxrpeecbif2F+ggeipqUV4zRtcyknxlsgG3bW60m4ttldMggr5gTp1QPzEOn8gA==',key_name='tempest-keypair-281239307',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47e449ba25474e43973c86fedccea8c0',ramdisk_id='',reservation_id='r-geioep15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1511835418',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1511835418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:49:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='789b88ca90ab4772a4b71c3d1dd6efbf',uuid=6e6a974e-3626-453c-8662-0d160f6e57de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9854edad-1d5f-4ea8-bced-f1ae510e224a", "address": "fa:16:3e:52:d1:90", "network": {"id": "d32e0d40-6adf-48ad-9316-b347b3ba6cf4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-883485495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e449ba25474e43973c86fedccea8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9854edad-1d", "ovs_interfaceid": "9854edad-1d5f-4ea8-bced-f1ae510e224a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:49:54 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Converting VIF {"id": "9854edad-1d5f-4ea8-bced-f1ae510e224a", "address": "fa:16:3e:52:d1:90", "network": {"id": "d32e0d40-6adf-48ad-9316-b347b3ba6cf4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-883485495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e449ba25474e43973c86fedccea8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9854edad-1d", "ovs_interfaceid": "9854edad-1d5f-4ea8-bced-f1ae510e224a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:49:54 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:d1:90,bridge_name='br-int',has_traffic_filtering=True,id=9854edad-1d5f-4ea8-bced-f1ae510e224a,network=Network(d32e0d40-6adf-48ad-9316-b347b3ba6cf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9854edad-1d') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:49:54 user nova-compute[74994]: DEBUG nova.objects.instance [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Lazy-loading 'pci_devices' on Instance uuid 6e6a974e-3626-453c-8662-0d160f6e57de {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:49:54 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] End _get_guest_xml xml=<domain type="kvm">
Nov 28 10:49:54 user nova-compute[74994]:   <uuid>6e6a974e-3626-453c-8662-0d160f6e57de</uuid>
Nov 28 10:49:54 user nova-compute[74994]:   <name>instance-0000000b</name>
Nov 28 10:49:54 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 10:49:54 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 10:49:54 user nova-compute[74994]:   <metadata>
Nov 28 10:49:54 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 10:49:54 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 10:49:54 user nova-compute[74994]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-520088525</nova:name>
Nov 28 10:49:54 user nova-compute[74994]:       <nova:creationTime>2023-11-28 10:49:54</nova:creationTime>
Nov 28 10:49:54 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 10:49:54 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 10:49:54 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 10:49:54 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 10:49:54 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 10:49:54 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 10:49:54 user nova-compute[74994]:       </nova:flavor>
Nov 28 10:49:54 user nova-compute[74994]:       <nova:owner>
Nov 28 10:49:54 user nova-compute[74994]:         <nova:user uuid="789b88ca90ab4772a4b71c3d1dd6efbf">tempest-VolumesAssistedSnapshotsTest-1511835418-project-member</nova:user>
Nov 28 10:49:54 user nova-compute[74994]:         <nova:project uuid="47e449ba25474e43973c86fedccea8c0">tempest-VolumesAssistedSnapshotsTest-1511835418</nova:project>
Nov 28 10:49:54 user nova-compute[74994]:       </nova:owner>
Nov 28 10:49:54 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 10:49:54 user nova-compute[74994]:       <nova:ports>
Nov 28 10:49:54 user nova-compute[74994]:         <nova:port uuid="9854edad-1d5f-4ea8-bced-f1ae510e224a">
Nov 28 10:49:54 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 10:49:54 user nova-compute[74994]:         </nova:port>
Nov 28 10:49:54 user nova-compute[74994]:       </nova:ports>
Nov 28 10:49:54 user nova-compute[74994]:     </nova:instance>
Nov 28 10:49:54 user nova-compute[74994]:   </metadata>
Nov 28 10:49:54 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 10:49:54 user nova-compute[74994]:     <system>
Nov 28 10:49:54 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 10:49:54 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 10:49:54 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 10:49:54 user nova-compute[74994]:       <entry name="serial">6e6a974e-3626-453c-8662-0d160f6e57de</entry>
Nov 28 10:49:54 user nova-compute[74994]:       <entry name="uuid">6e6a974e-3626-453c-8662-0d160f6e57de</entry>
Nov 28 10:49:54 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 10:49:54 user nova-compute[74994]:     </system>
Nov 28 10:49:54 user nova-compute[74994]:   </sysinfo>
Nov 28 10:49:54 user nova-compute[74994]:   <os>
Nov 28 10:49:54 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 10:49:54 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 10:49:54 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 10:49:54 user nova-compute[74994]:   </os>
Nov 28 10:49:54 user nova-compute[74994]:   <features>
Nov 28 10:49:54 user nova-compute[74994]:     <acpi/>
Nov 28 10:49:54 user nova-compute[74994]:     <apic/>
Nov 28 10:49:54 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 10:49:54 user nova-compute[74994]:   </features>
Nov 28 10:49:54 user nova-compute[74994]:   <clock offset="utc">
Nov 28 10:49:54 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 10:49:54 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 10:49:54 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 10:49:54 user nova-compute[74994]:   </clock>
Nov 28 10:49:54 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 10:49:54 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 10:49:54 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 10:49:54 user nova-compute[74994]:   </cpu>
Nov 28 10:49:54 user nova-compute[74994]:   <devices>
Nov 28 10:49:54 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 10:49:54 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 10:49:54 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/6e6a974e-3626-453c-8662-0d160f6e57de/disk"/>
Nov 28 10:49:54 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 10:49:54 user nova-compute[74994]:     </disk>
Nov 28 10:49:54 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 10:49:54 user nova-compute[74994]:       <mac address="fa:16:3e:52:d1:90"/>
Nov 28 10:49:54 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:49:54 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 10:49:54 user nova-compute[74994]:       <target dev="tap9854edad-1d"/>
Nov 28 10:49:54 user nova-compute[74994]:     </interface>
Nov 28 10:49:54 user nova-compute[74994]:     <serial type="pty">
Nov 28 10:49:54 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/6e6a974e-3626-453c-8662-0d160f6e57de/console.log" append="off"/>
Nov 28 10:49:54 user nova-compute[74994]:     </serial>
Nov 28 10:49:54 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 10:49:54 user nova-compute[74994]:     <video>
Nov 28 10:49:54 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:49:54 user nova-compute[74994]:     </video>
Nov 28 10:49:54 user nova-compute[74994]:     <rng model="virtio">
Nov 28 10:49:54 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 10:49:54 user nova-compute[74994]:     </rng>
Nov 28 10:49:54 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 10:49:54 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 10:49:54 user nova-compute[74994]:       <stats period="10"/>
Nov 28 10:49:54 user nova-compute[74994]:     </memballoon>
Nov 28 10:49:54 user nova-compute[74994]:   </devices>
Nov 28 10:49:54 user nova-compute[74994]: </domain>
Nov 28 10:49:54 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 10:49:54 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:49:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-520088525',display_name='tempest-VolumesAssistedSnapshotsTest-server-520088525',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-520088525',id=11,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPo0BQ4NcEgut63xyqujvAXPIH9n9ipaH1zU5pISvY+ug4cvultl1EF5DdU5m0xCHfxRxrpeecbif2F+ggeipqUV4zRtcyknxlsgG3bW60m4ttldMggr5gTp1QPzEOn8gA==',key_name='tempest-keypair-281239307',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47e449ba25474e43973c86fedccea8c0',ramdisk_id='',reservation_id='r-geioep15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1511835418',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1511835418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:49:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='789b88ca90ab4772a4b71c3d1dd6efbf',uuid=6e6a974e-3626-453c-8662-0d160f6e57de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9854edad-1d5f-4ea8-bced-f1ae510e224a", "address": "fa:16:3e:52:d1:90", "network": {"id": "d32e0d40-6adf-48ad-9316-b347b3ba6cf4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-883485495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e449ba25474e43973c86fedccea8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9854edad-1d", "ovs_interfaceid": "9854edad-1d5f-4ea8-bced-f1ae510e224a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 10:49:54 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Converting VIF {"id": "9854edad-1d5f-4ea8-bced-f1ae510e224a", "address": "fa:16:3e:52:d1:90", "network": {"id": "d32e0d40-6adf-48ad-9316-b347b3ba6cf4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-883485495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e449ba25474e43973c86fedccea8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9854edad-1d", "ovs_interfaceid": "9854edad-1d5f-4ea8-bced-f1ae510e224a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:49:54 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:d1:90,bridge_name='br-int',has_traffic_filtering=True,id=9854edad-1d5f-4ea8-bced-f1ae510e224a,network=Network(d32e0d40-6adf-48ad-9316-b347b3ba6cf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9854edad-1d') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:49:54 user nova-compute[74994]: DEBUG os_vif [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:d1:90,bridge_name='br-int',has_traffic_filtering=True,id=9854edad-1d5f-4ea8-bced-f1ae510e224a,network=Network(d32e0d40-6adf-48ad-9316-b347b3ba6cf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9854edad-1d') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 10:49:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 10:49:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9ddec8b1-0937-5264-8dd3-182e7b8b6b56', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:49:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9854edad-1d, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9854edad-1d, col_values=(('qos', UUID('46780b65-1fb8-468b-b409-04ab611030a9')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9854edad-1d, col_values=(('external_ids', {'iface-id': '9854edad-1d5f-4ea8-bced-f1ae510e224a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:d1:90', 'vm-uuid': '6e6a974e-3626-453c-8662-0d160f6e57de'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:49:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:49:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:54 user nova-compute[74994]: INFO os_vif [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:d1:90,bridge_name='br-int',has_traffic_filtering=True,id=9854edad-1d5f-4ea8-bced-f1ae510e224a,network=Network(d32e0d40-6adf-48ad-9316-b347b3ba6cf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9854edad-1d')
Nov 28 10:49:54 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:49:54 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] No VIF found with MAC fa:16:3e:52:d1:90, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:49:54 user nova-compute[74994]: DEBUG nova.network.neutron [req-63eb1d5a-6580-420e-a59d-01ea60141777 req-64d53210-f5e4-4c6c-b151-1ba66e52a512 service nova] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Updated VIF entry in instance network info cache for port 9854edad-1d5f-4ea8-bced-f1ae510e224a. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 10:49:54 user nova-compute[74994]: DEBUG nova.network.neutron [req-63eb1d5a-6580-420e-a59d-01ea60141777 req-64d53210-f5e4-4c6c-b151-1ba66e52a512 service nova] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Updating instance_info_cache with network_info: [{"id": "9854edad-1d5f-4ea8-bced-f1ae510e224a", "address": "fa:16:3e:52:d1:90", "network": {"id": "d32e0d40-6adf-48ad-9316-b347b3ba6cf4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-883485495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e449ba25474e43973c86fedccea8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9854edad-1d", "ovs_interfaceid": "9854edad-1d5f-4ea8-bced-f1ae510e224a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:49:54 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-63eb1d5a-6580-420e-a59d-01ea60141777 req-64d53210-f5e4-4c6c-b151-1ba66e52a512 service nova] Releasing lock "refresh_cache-6e6a974e-3626-453c-8662-0d160f6e57de" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:49:55 user nova-compute[74994]: DEBUG nova.compute.manager [req-8a7c212e-cde9-474d-a11d-2533ea90931b req-b62b7c31-813d-4721-a09c-3209fd442a99 service nova] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Received event network-vif-plugged-752a5c48-15a2-443c-911c-f1a0c33ca925 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:49:55 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8a7c212e-cde9-474d-a11d-2533ea90931b req-b62b7c31-813d-4721-a09c-3209fd442a99 service nova] Acquiring lock "c2925833-e88d-4aa7-a477-ff1bc1fcd724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:55 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8a7c212e-cde9-474d-a11d-2533ea90931b req-b62b7c31-813d-4721-a09c-3209fd442a99 service nova] Lock "c2925833-e88d-4aa7-a477-ff1bc1fcd724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:55 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8a7c212e-cde9-474d-a11d-2533ea90931b req-b62b7c31-813d-4721-a09c-3209fd442a99 service nova] Lock "c2925833-e88d-4aa7-a477-ff1bc1fcd724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:55 user nova-compute[74994]: DEBUG nova.compute.manager [req-8a7c212e-cde9-474d-a11d-2533ea90931b req-b62b7c31-813d-4721-a09c-3209fd442a99 service nova] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] No waiting events found dispatching network-vif-plugged-752a5c48-15a2-443c-911c-f1a0c33ca925 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:49:55 user nova-compute[74994]: WARNING nova.compute.manager [req-8a7c212e-cde9-474d-a11d-2533ea90931b req-b62b7c31-813d-4721-a09c-3209fd442a99 service nova] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Received unexpected event network-vif-plugged-752a5c48-15a2-443c-911c-f1a0c33ca925 for instance with vm_state active and task_state None.
Nov 28 10:49:56 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:56 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:56 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:56 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:57 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:57 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:57 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:57 user nova-compute[74994]: DEBUG nova.compute.manager [req-205e5c4e-ad66-4e69-83fc-704540b26ecc req-29b5d8e5-a4e8-402a-a031-696ad01bf0a3 service nova] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Received event network-vif-plugged-11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:49:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-205e5c4e-ad66-4e69-83fc-704540b26ecc req-29b5d8e5-a4e8-402a-a031-696ad01bf0a3 service nova] Acquiring lock "2e30565c-9f8e-4a87-8054-6c260dac4f48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-205e5c4e-ad66-4e69-83fc-704540b26ecc req-29b5d8e5-a4e8-402a-a031-696ad01bf0a3 service nova] Lock "2e30565c-9f8e-4a87-8054-6c260dac4f48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-205e5c4e-ad66-4e69-83fc-704540b26ecc req-29b5d8e5-a4e8-402a-a031-696ad01bf0a3 service nova] Lock "2e30565c-9f8e-4a87-8054-6c260dac4f48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:57 user nova-compute[74994]: DEBUG nova.compute.manager [req-205e5c4e-ad66-4e69-83fc-704540b26ecc req-29b5d8e5-a4e8-402a-a031-696ad01bf0a3 service nova] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] No waiting events found dispatching network-vif-plugged-11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:49:57 user nova-compute[74994]: WARNING nova.compute.manager [req-205e5c4e-ad66-4e69-83fc-704540b26ecc req-29b5d8e5-a4e8-402a-a031-696ad01bf0a3 service nova] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Received unexpected event network-vif-plugged-11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3 for instance with vm_state active and task_state None.
Nov 28 10:49:57 user nova-compute[74994]: DEBUG nova.compute.manager [req-92aa21f7-4fcf-4d71-a05b-1936786a01e7 req-671f1284-dd55-4a85-9438-9165d1afa7b8 service nova] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Received event network-vif-plugged-9854edad-1d5f-4ea8-bced-f1ae510e224a {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:49:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-92aa21f7-4fcf-4d71-a05b-1936786a01e7 req-671f1284-dd55-4a85-9438-9165d1afa7b8 service nova] Acquiring lock "6e6a974e-3626-453c-8662-0d160f6e57de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-92aa21f7-4fcf-4d71-a05b-1936786a01e7 req-671f1284-dd55-4a85-9438-9165d1afa7b8 service nova] Lock "6e6a974e-3626-453c-8662-0d160f6e57de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-92aa21f7-4fcf-4d71-a05b-1936786a01e7 req-671f1284-dd55-4a85-9438-9165d1afa7b8 service nova] Lock "6e6a974e-3626-453c-8662-0d160f6e57de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:57 user nova-compute[74994]: DEBUG nova.compute.manager [req-92aa21f7-4fcf-4d71-a05b-1936786a01e7 req-671f1284-dd55-4a85-9438-9165d1afa7b8 service nova] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] No waiting events found dispatching network-vif-plugged-9854edad-1d5f-4ea8-bced-f1ae510e224a {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:49:57 user nova-compute[74994]: WARNING nova.compute.manager [req-92aa21f7-4fcf-4d71-a05b-1936786a01e7 req-671f1284-dd55-4a85-9438-9165d1afa7b8 service nova] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Received unexpected event network-vif-plugged-9854edad-1d5f-4ea8-bced-f1ae510e224a for instance with vm_state building and task_state spawning.
Nov 28 10:49:57 user nova-compute[74994]: DEBUG nova.compute.manager [req-92aa21f7-4fcf-4d71-a05b-1936786a01e7 req-671f1284-dd55-4a85-9438-9165d1afa7b8 service nova] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Received event network-vif-plugged-9854edad-1d5f-4ea8-bced-f1ae510e224a {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:49:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-92aa21f7-4fcf-4d71-a05b-1936786a01e7 req-671f1284-dd55-4a85-9438-9165d1afa7b8 service nova] Acquiring lock "6e6a974e-3626-453c-8662-0d160f6e57de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-92aa21f7-4fcf-4d71-a05b-1936786a01e7 req-671f1284-dd55-4a85-9438-9165d1afa7b8 service nova] Lock "6e6a974e-3626-453c-8662-0d160f6e57de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-92aa21f7-4fcf-4d71-a05b-1936786a01e7 req-671f1284-dd55-4a85-9438-9165d1afa7b8 service nova] Lock "6e6a974e-3626-453c-8662-0d160f6e57de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:57 user nova-compute[74994]: DEBUG nova.compute.manager [req-92aa21f7-4fcf-4d71-a05b-1936786a01e7 req-671f1284-dd55-4a85-9438-9165d1afa7b8 service nova] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] No waiting events found dispatching network-vif-plugged-9854edad-1d5f-4ea8-bced-f1ae510e224a {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:49:57 user nova-compute[74994]: WARNING nova.compute.manager [req-92aa21f7-4fcf-4d71-a05b-1936786a01e7 req-671f1284-dd55-4a85-9438-9165d1afa7b8 service nova] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Received unexpected event network-vif-plugged-9854edad-1d5f-4ea8-bced-f1ae510e224a for instance with vm_state building and task_state spawning.
Nov 28 10:49:58 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:49:58 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Cleaning up deleted instances {{(pid=74994) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 10:49:58 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] There are 0 instances to clean {{(pid=74994) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 10:49:58 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:49:58 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74994) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 10:49:58 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:49:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:59 user nova-compute[74994]: DEBUG nova.compute.manager [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 10:49:59 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 10:49:59 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Instance spawned successfully.
Nov 28 10:49:59 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 10:49:59 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:59 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:59 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:59 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:59 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:59 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:49:59 user nova-compute[74994]: INFO nova.compute.manager [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Took 7.87 seconds to spawn the instance on the hypervisor.
Nov 28 10:49:59 user nova-compute[74994]: DEBUG nova.compute.manager [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 10:49:59 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:49:59 user nova-compute[74994]: INFO nova.compute.manager [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Took 9.30 seconds to build instance.
Nov 28 10:49:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-977c9c78-768e-4cd2-8fa5-18ff5ac6c4ba tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Lock "6e6a974e-3626-453c-8662-0d160f6e57de" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.466s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:59 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:49:59 user nova-compute[74994]: DEBUG nova.compute.manager [req-19f406bc-542a-404e-9748-65e8ac762981 req-b3456842-537c-4092-9795-5c1662452050 service nova] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Received event network-vif-plugged-11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:49:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-19f406bc-542a-404e-9748-65e8ac762981 req-b3456842-537c-4092-9795-5c1662452050 service nova] Acquiring lock "2e30565c-9f8e-4a87-8054-6c260dac4f48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-19f406bc-542a-404e-9748-65e8ac762981 req-b3456842-537c-4092-9795-5c1662452050 service nova] Lock "2e30565c-9f8e-4a87-8054-6c260dac4f48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-19f406bc-542a-404e-9748-65e8ac762981 req-b3456842-537c-4092-9795-5c1662452050 service nova] Lock "2e30565c-9f8e-4a87-8054-6c260dac4f48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:59 user nova-compute[74994]: DEBUG nova.compute.manager [req-19f406bc-542a-404e-9748-65e8ac762981 req-b3456842-537c-4092-9795-5c1662452050 service nova] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] No waiting events found dispatching network-vif-plugged-11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:49:59 user nova-compute[74994]: WARNING nova.compute.manager [req-19f406bc-542a-404e-9748-65e8ac762981 req-b3456842-537c-4092-9795-5c1662452050 service nova] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Received unexpected event network-vif-plugged-11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3 for instance with vm_state active and task_state None.
Nov 28 10:49:59 user nova-compute[74994]: DEBUG nova.compute.manager [req-19f406bc-542a-404e-9748-65e8ac762981 req-b3456842-537c-4092-9795-5c1662452050 service nova] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Received event network-vif-plugged-068d74d7-23a6-42b8-8a3c-02ba7ce746a7 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:49:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-19f406bc-542a-404e-9748-65e8ac762981 req-b3456842-537c-4092-9795-5c1662452050 service nova] Acquiring lock "7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-19f406bc-542a-404e-9748-65e8ac762981 req-b3456842-537c-4092-9795-5c1662452050 service nova] Lock "7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-19f406bc-542a-404e-9748-65e8ac762981 req-b3456842-537c-4092-9795-5c1662452050 service nova] Lock "7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:59 user nova-compute[74994]: DEBUG nova.compute.manager [req-19f406bc-542a-404e-9748-65e8ac762981 req-b3456842-537c-4092-9795-5c1662452050 service nova] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] No waiting events found dispatching network-vif-plugged-068d74d7-23a6-42b8-8a3c-02ba7ce746a7 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:49:59 user nova-compute[74994]: WARNING nova.compute.manager [req-19f406bc-542a-404e-9748-65e8ac762981 req-b3456842-537c-4092-9795-5c1662452050 service nova] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Received unexpected event network-vif-plugged-068d74d7-23a6-42b8-8a3c-02ba7ce746a7 for instance with vm_state active and task_state None.
Nov 28 10:49:59 user nova-compute[74994]: DEBUG nova.compute.manager [req-19f406bc-542a-404e-9748-65e8ac762981 req-b3456842-537c-4092-9795-5c1662452050 service nova] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Received event network-vif-plugged-068d74d7-23a6-42b8-8a3c-02ba7ce746a7 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:49:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-19f406bc-542a-404e-9748-65e8ac762981 req-b3456842-537c-4092-9795-5c1662452050 service nova] Acquiring lock "7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:49:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-19f406bc-542a-404e-9748-65e8ac762981 req-b3456842-537c-4092-9795-5c1662452050 service nova] Lock "7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:49:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-19f406bc-542a-404e-9748-65e8ac762981 req-b3456842-537c-4092-9795-5c1662452050 service nova] Lock "7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:49:59 user nova-compute[74994]: DEBUG nova.compute.manager [req-19f406bc-542a-404e-9748-65e8ac762981 req-b3456842-537c-4092-9795-5c1662452050 service nova] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] No waiting events found dispatching network-vif-plugged-068d74d7-23a6-42b8-8a3c-02ba7ce746a7 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:49:59 user nova-compute[74994]: WARNING nova.compute.manager [req-19f406bc-542a-404e-9748-65e8ac762981 req-b3456842-537c-4092-9795-5c1662452050 service nova] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Received unexpected event network-vif-plugged-068d74d7-23a6-42b8-8a3c-02ba7ce746a7 for instance with vm_state active and task_state None.
Nov 28 10:50:01 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:50:01 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 10:50:02 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:50:02 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:50:02 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:50:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:50:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:50:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:50:02 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 10:50:02 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e6a974e-3626-453c-8662-0d160f6e57de/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:02 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e6a974e-3626-453c-8662-0d160f6e57de/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:02 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e6a974e-3626-453c-8662-0d160f6e57de/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:03 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e6a974e-3626-453c-8662-0d160f6e57de/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:03 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:03 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:03 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:03 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:03 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e30565c-9f8e-4a87-8054-6c260dac4f48/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:03 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e30565c-9f8e-4a87-8054-6c260dac4f48/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:03 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e30565c-9f8e-4a87-8054-6c260dac4f48/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e30565c-9f8e-4a87-8054-6c260dac4f48/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b4b5dc-0696-4a01-8318-7d3ec2014d6e/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b4b5dc-0696-4a01-8318-7d3ec2014d6e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b4b5dc-0696-4a01-8318-7d3ec2014d6e/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b4b5dc-0696-4a01-8318-7d3ec2014d6e/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b51d690-8198-4748-807d-1902e75564b9/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b51d690-8198-4748-807d-1902e75564b9/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b51d690-8198-4748-807d-1902e75564b9/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b51d690-8198-4748-807d-1902e75564b9/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce813fa-bf97-41f8-8aee-c7a73354e24c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce813fa-bf97-41f8-8aee-c7a73354e24c/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce813fa-bf97-41f8-8aee-c7a73354e24c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce813fa-bf97-41f8-8aee-c7a73354e24c/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2925833-e88d-4aa7-a477-ff1bc1fcd724/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2925833-e88d-4aa7-a477-ff1bc1fcd724/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2925833-e88d-4aa7-a477-ff1bc1fcd724/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2925833-e88d-4aa7-a477-ff1bc1fcd724/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:07 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:50:07 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:50:07 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=7203MB free_disk=25.60588836669922GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 10:50:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:50:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:50:08 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:50:08 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance bf357856-2d97-42e8-928d-71d0378f48c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:50:08 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance a8b4b5dc-0696-4a01-8318-7d3ec2014d6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:50:08 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 279e1c4c-36f9-492f-ab3f-1b587347eadd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:50:08 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 5b51d690-8198-4748-807d-1902e75564b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:50:08 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance cce813fa-bf97-41f8-8aee-c7a73354e24c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:50:08 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:50:08 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 2e30565c-9f8e-4a87-8054-6c260dac4f48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:50:08 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:50:08 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance c2925833-e88d-4aa7-a477-ff1bc1fcd724 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:50:08 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 6e6a974e-3626-453c-8662-0d160f6e57de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:50:08 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 10:50:08 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 10:50:08 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Refreshing inventories for resource provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 10:50:08 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Updating ProviderTree inventory for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 10:50:08 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Updating inventory in ProviderTree for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 10:50:08 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Refreshing aggregate associations for resource provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a, aggregates: None {{(pid=74994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 10:50:08 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Refreshing trait associations for resource provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=74994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 10:50:08 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:50:08 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:50:08 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 10:50:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.871s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:50:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:09 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:50:09 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 10:50:09 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Rebuilding the list of instances to heal {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 10:50:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "refresh_cache-76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:50:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquired lock "refresh_cache-76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:50:09 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Forcefully refreshing network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 10:50:09 user nova-compute[74994]: DEBUG nova.objects.instance [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lazy-loading 'info_cache' on Instance uuid 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:50:10 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Updating instance_info_cache with network_info: [{"id": "6b1a991d-033b-45ab-839c-7b6b98082667", "address": "fa:16:3e:3c:9f:61", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b1a991d-03", "ovs_interfaceid": "6b1a991d-033b-45ab-839c-7b6b98082667", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:50:10 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Releasing lock "refresh_cache-76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:50:10 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Updated the network info_cache for instance {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 10:50:10 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:50:10 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:50:10 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:50:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:19 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Acquiring lock "af9e5a26-f865-4563-aed9-34b8ed5b6697" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:50:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:50:20 user nova-compute[74994]: DEBUG nova.compute.manager [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 10:50:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:50:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:50:20 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 10:50:20 user nova-compute[74994]: INFO nova.compute.claims [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Claim successful on node user
Nov 28 10:50:21 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:50:21 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:50:21 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.452s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:50:21 user nova-compute[74994]: DEBUG nova.compute.manager [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 10:50:21 user nova-compute[74994]: DEBUG nova.compute.manager [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 10:50:21 user nova-compute[74994]: DEBUG nova.network.neutron [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 10:50:21 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 10:50:21 user nova-compute[74994]: DEBUG nova.compute.manager [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 10:50:21 user nova-compute[74994]: INFO nova.virt.block_device [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Booting with volume 670edcd3-e394-4ce9-8114-837cd58008b0 at /dev/vda
Nov 28 10:50:21 user nova-compute[74994]: DEBUG nova.policy [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9cf909ee96b249c98a98547cab18fcef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd334446f1c65465885717aab3fb6c78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 10:50:21 user nova-compute[74994]: DEBUG os_brick.utils [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:50:21 user nova-compute[74994]: INFO oslo.privsep.daemon [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpi9jxvdy5/privsep.sock']
Nov 28 10:50:21 user sudo[86488]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpi9jxvdy5/privsep.sock
Nov 28 10:50:21 user sudo[86488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 28 10:50:22 user nova-compute[74994]: DEBUG nova.network.neutron [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Successfully created port: 7ca13785-4bcf-42f6-b804-36f3c3cd1b82 {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 10:50:22 user nova-compute[74994]: DEBUG nova.network.neutron [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Successfully created port: e6ce548a-c7d7-4f70-8411-7809489f0a91 {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 10:50:23 user sudo[86488]: pam_unix(sudo:session): session closed for user root
Nov 28 10:50:23 user nova-compute[74994]: INFO oslo.privsep.daemon [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Spawned new privsep daemon via rootwrap
Nov 28 10:50:23 user nova-compute[74994]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 28 10:50:23 user nova-compute[74994]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 28 10:50:23 user nova-compute[74994]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 28 10:50:23 user nova-compute[74994]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86494
Nov 28 10:50:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34641d5-e6c2-43c7-89ab-da90418b5118]: (2,) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:23 user nova-compute[74994]: DEBUG nova.network.neutron [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Successfully created port: 6d482201-d7ff-4dcc-9a23-a399a27c69f3 {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 10:50:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37140a4-e3b0-4217-b1ac-8ba89dd0f5bc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:23 user nova-compute[74994]: WARNING os_brick.initiator.connectors.nvmeof [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 28 10:50:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[297cd19d-08b8-4323-9c24-7b46cfb625d9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[13249f82-9a3d-4630-ac25-53f2d25ab400]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[af72ec82-95a0-48ee-8091-e288477f58c3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:50:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 10:50:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:50:23 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 10:50:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fcda091-baed-4d97-8337-8203bb6749d4]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 10:50:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 10:50:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 10:50:23 user nova-compute[74994]: DEBUG os_brick.utils [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] <== get_connector_properties: return (1869ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:50:23 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Updating existing volume attachment record: 3566cb3c-4bf1-4dc9-865a-9379c2a4dc30 {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 10:50:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:23 user nova-compute[74994]: DEBUG nova.network.neutron [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Successfully created port: da486672-f1e9-4bbe-8d5a-e9f2f0ad5119 {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 10:50:24 user nova-compute[74994]: DEBUG nova.network.neutron [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Successfully created port: 9330afbb-83bf-4674-8eda-d091eb2670e5 {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 10:50:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:25 user nova-compute[74994]: DEBUG nova.network.neutron [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Successfully updated port: 7ca13785-4bcf-42f6-b804-36f3c3cd1b82 {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 10:50:25 user nova-compute[74994]: DEBUG nova.compute.manager [req-40b9cb98-b695-473f-ad56-309af20982e6 req-3aa45751-b79e-4315-957f-7d1ae5ad6165 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received event network-changed-7ca13785-4bcf-42f6-b804-36f3c3cd1b82 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:50:25 user nova-compute[74994]: DEBUG nova.compute.manager [req-40b9cb98-b695-473f-ad56-309af20982e6 req-3aa45751-b79e-4315-957f-7d1ae5ad6165 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Refreshing instance network info cache due to event network-changed-7ca13785-4bcf-42f6-b804-36f3c3cd1b82. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:50:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-40b9cb98-b695-473f-ad56-309af20982e6 req-3aa45751-b79e-4315-957f-7d1ae5ad6165 service nova] Acquiring lock "refresh_cache-af9e5a26-f865-4563-aed9-34b8ed5b6697" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:50:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-40b9cb98-b695-473f-ad56-309af20982e6 req-3aa45751-b79e-4315-957f-7d1ae5ad6165 service nova] Acquired lock "refresh_cache-af9e5a26-f865-4563-aed9-34b8ed5b6697" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:50:25 user nova-compute[74994]: DEBUG nova.network.neutron [req-40b9cb98-b695-473f-ad56-309af20982e6 req-3aa45751-b79e-4315-957f-7d1ae5ad6165 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Refreshing network info cache for port 7ca13785-4bcf-42f6-b804-36f3c3cd1b82 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:50:25 user nova-compute[74994]: DEBUG nova.network.neutron [req-40b9cb98-b695-473f-ad56-309af20982e6 req-3aa45751-b79e-4315-957f-7d1ae5ad6165 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 10:50:25 user nova-compute[74994]: DEBUG nova.network.neutron [req-40b9cb98-b695-473f-ad56-309af20982e6 req-3aa45751-b79e-4315-957f-7d1ae5ad6165 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:50:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-40b9cb98-b695-473f-ad56-309af20982e6 req-3aa45751-b79e-4315-957f-7d1ae5ad6165 service nova] Releasing lock "refresh_cache-af9e5a26-f865-4563-aed9-34b8ed5b6697" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:50:25 user nova-compute[74994]: DEBUG nova.network.neutron [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Successfully updated port: f049d45c-915d-4517-8799-8d8200a45b49 {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 10:50:26 user nova-compute[74994]: DEBUG nova.network.neutron [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Successfully updated port: d8d28630-5645-4f2e-b7d3-2b0ac060ea43 {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 10:50:27 user nova-compute[74994]: DEBUG nova.compute.manager [req-999ea1d7-46b9-4fd7-987b-91e964daee91 req-13f74935-7581-4658-9cb9-e5da66926868 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received event network-changed-f049d45c-915d-4517-8799-8d8200a45b49 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:50:27 user nova-compute[74994]: DEBUG nova.compute.manager [req-999ea1d7-46b9-4fd7-987b-91e964daee91 req-13f74935-7581-4658-9cb9-e5da66926868 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Refreshing instance network info cache due to event network-changed-f049d45c-915d-4517-8799-8d8200a45b49. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:50:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-999ea1d7-46b9-4fd7-987b-91e964daee91 req-13f74935-7581-4658-9cb9-e5da66926868 service nova] Acquiring lock "refresh_cache-af9e5a26-f865-4563-aed9-34b8ed5b6697" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:50:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-999ea1d7-46b9-4fd7-987b-91e964daee91 req-13f74935-7581-4658-9cb9-e5da66926868 service nova] Acquired lock "refresh_cache-af9e5a26-f865-4563-aed9-34b8ed5b6697" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:50:27 user nova-compute[74994]: DEBUG nova.network.neutron [req-999ea1d7-46b9-4fd7-987b-91e964daee91 req-13f74935-7581-4658-9cb9-e5da66926868 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Refreshing network info cache for port f049d45c-915d-4517-8799-8d8200a45b49 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:50:27 user nova-compute[74994]: DEBUG nova.network.neutron [req-999ea1d7-46b9-4fd7-987b-91e964daee91 req-13f74935-7581-4658-9cb9-e5da66926868 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 10:50:27 user nova-compute[74994]: DEBUG nova.network.neutron [req-999ea1d7-46b9-4fd7-987b-91e964daee91 req-13f74935-7581-4658-9cb9-e5da66926868 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:50:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-999ea1d7-46b9-4fd7-987b-91e964daee91 req-13f74935-7581-4658-9cb9-e5da66926868 service nova] Releasing lock "refresh_cache-af9e5a26-f865-4563-aed9-34b8ed5b6697" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:50:27 user nova-compute[74994]: DEBUG nova.compute.manager [req-999ea1d7-46b9-4fd7-987b-91e964daee91 req-13f74935-7581-4658-9cb9-e5da66926868 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received event network-changed-d8d28630-5645-4f2e-b7d3-2b0ac060ea43 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:50:27 user nova-compute[74994]: DEBUG nova.compute.manager [req-999ea1d7-46b9-4fd7-987b-91e964daee91 req-13f74935-7581-4658-9cb9-e5da66926868 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Refreshing instance network info cache due to event network-changed-d8d28630-5645-4f2e-b7d3-2b0ac060ea43. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:50:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-999ea1d7-46b9-4fd7-987b-91e964daee91 req-13f74935-7581-4658-9cb9-e5da66926868 service nova] Acquiring lock "refresh_cache-af9e5a26-f865-4563-aed9-34b8ed5b6697" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:50:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-999ea1d7-46b9-4fd7-987b-91e964daee91 req-13f74935-7581-4658-9cb9-e5da66926868 service nova] Acquired lock "refresh_cache-af9e5a26-f865-4563-aed9-34b8ed5b6697" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:50:27 user nova-compute[74994]: DEBUG nova.network.neutron [req-999ea1d7-46b9-4fd7-987b-91e964daee91 req-13f74935-7581-4658-9cb9-e5da66926868 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Refreshing network info cache for port d8d28630-5645-4f2e-b7d3-2b0ac060ea43 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:50:27 user nova-compute[74994]: DEBUG nova.network.neutron [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Successfully updated port: e6ce548a-c7d7-4f70-8411-7809489f0a91 {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 10:50:27 user nova-compute[74994]: DEBUG nova.network.neutron [req-999ea1d7-46b9-4fd7-987b-91e964daee91 req-13f74935-7581-4658-9cb9-e5da66926868 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 10:50:27 user nova-compute[74994]: DEBUG nova.network.neutron [req-999ea1d7-46b9-4fd7-987b-91e964daee91 req-13f74935-7581-4658-9cb9-e5da66926868 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:50:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-999ea1d7-46b9-4fd7-987b-91e964daee91 req-13f74935-7581-4658-9cb9-e5da66926868 service nova] Releasing lock "refresh_cache-af9e5a26-f865-4563-aed9-34b8ed5b6697" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:50:28 user nova-compute[74994]: DEBUG nova.network.neutron [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Successfully updated port: 6d482201-d7ff-4dcc-9a23-a399a27c69f3 {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 10:50:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:28 user nova-compute[74994]: DEBUG nova.network.neutron [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Successfully updated port: da486672-f1e9-4bbe-8d5a-e9f2f0ad5119 {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 10:50:29 user nova-compute[74994]: DEBUG nova.compute.manager [req-cd5dba50-3c7b-4b55-baec-f95954a12fac req-18fcfbd6-d666-40b7-9f8e-a0de5d3a6a2b service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received event network-changed-e6ce548a-c7d7-4f70-8411-7809489f0a91 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:50:29 user nova-compute[74994]: DEBUG nova.compute.manager [req-cd5dba50-3c7b-4b55-baec-f95954a12fac req-18fcfbd6-d666-40b7-9f8e-a0de5d3a6a2b service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Refreshing instance network info cache due to event network-changed-e6ce548a-c7d7-4f70-8411-7809489f0a91. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:50:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-cd5dba50-3c7b-4b55-baec-f95954a12fac req-18fcfbd6-d666-40b7-9f8e-a0de5d3a6a2b service nova] Acquiring lock "refresh_cache-af9e5a26-f865-4563-aed9-34b8ed5b6697" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:50:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-cd5dba50-3c7b-4b55-baec-f95954a12fac req-18fcfbd6-d666-40b7-9f8e-a0de5d3a6a2b service nova] Acquired lock "refresh_cache-af9e5a26-f865-4563-aed9-34b8ed5b6697" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:50:29 user nova-compute[74994]: DEBUG nova.network.neutron [req-cd5dba50-3c7b-4b55-baec-f95954a12fac req-18fcfbd6-d666-40b7-9f8e-a0de5d3a6a2b service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Refreshing network info cache for port e6ce548a-c7d7-4f70-8411-7809489f0a91 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:50:29 user nova-compute[74994]: DEBUG nova.network.neutron [req-cd5dba50-3c7b-4b55-baec-f95954a12fac req-18fcfbd6-d666-40b7-9f8e-a0de5d3a6a2b service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 10:50:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:29 user nova-compute[74994]: DEBUG nova.network.neutron [req-cd5dba50-3c7b-4b55-baec-f95954a12fac req-18fcfbd6-d666-40b7-9f8e-a0de5d3a6a2b service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:50:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-cd5dba50-3c7b-4b55-baec-f95954a12fac req-18fcfbd6-d666-40b7-9f8e-a0de5d3a6a2b service nova] Releasing lock "refresh_cache-af9e5a26-f865-4563-aed9-34b8ed5b6697" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:50:29 user nova-compute[74994]: DEBUG nova.compute.manager [req-cd5dba50-3c7b-4b55-baec-f95954a12fac req-18fcfbd6-d666-40b7-9f8e-a0de5d3a6a2b service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received event network-changed-6d482201-d7ff-4dcc-9a23-a399a27c69f3 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:50:29 user nova-compute[74994]: DEBUG nova.compute.manager [req-cd5dba50-3c7b-4b55-baec-f95954a12fac req-18fcfbd6-d666-40b7-9f8e-a0de5d3a6a2b service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Refreshing instance network info cache due to event network-changed-6d482201-d7ff-4dcc-9a23-a399a27c69f3. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:50:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-cd5dba50-3c7b-4b55-baec-f95954a12fac req-18fcfbd6-d666-40b7-9f8e-a0de5d3a6a2b service nova] Acquiring lock "refresh_cache-af9e5a26-f865-4563-aed9-34b8ed5b6697" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:50:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-cd5dba50-3c7b-4b55-baec-f95954a12fac req-18fcfbd6-d666-40b7-9f8e-a0de5d3a6a2b service nova] Acquired lock "refresh_cache-af9e5a26-f865-4563-aed9-34b8ed5b6697" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:50:29 user nova-compute[74994]: DEBUG nova.network.neutron [req-cd5dba50-3c7b-4b55-baec-f95954a12fac req-18fcfbd6-d666-40b7-9f8e-a0de5d3a6a2b service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Refreshing network info cache for port 6d482201-d7ff-4dcc-9a23-a399a27c69f3 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:50:30 user nova-compute[74994]: DEBUG nova.network.neutron [req-cd5dba50-3c7b-4b55-baec-f95954a12fac req-18fcfbd6-d666-40b7-9f8e-a0de5d3a6a2b service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 10:50:30 user nova-compute[74994]: DEBUG nova.network.neutron [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Successfully updated port: 9330afbb-83bf-4674-8eda-d091eb2670e5 {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 10:50:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Acquiring lock "refresh_cache-af9e5a26-f865-4563-aed9-34b8ed5b6697" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:50:30 user nova-compute[74994]: INFO nova.virt.block_device [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Booting with volume 95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 at /dev/vdb
Nov 28 10:50:30 user nova-compute[74994]: DEBUG nova.network.neutron [req-cd5dba50-3c7b-4b55-baec-f95954a12fac req-18fcfbd6-d666-40b7-9f8e-a0de5d3a6a2b service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:50:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-cd5dba50-3c7b-4b55-baec-f95954a12fac req-18fcfbd6-d666-40b7-9f8e-a0de5d3a6a2b service nova] Releasing lock "refresh_cache-af9e5a26-f865-4563-aed9-34b8ed5b6697" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:50:30 user nova-compute[74994]: DEBUG nova.compute.manager [req-cd5dba50-3c7b-4b55-baec-f95954a12fac req-18fcfbd6-d666-40b7-9f8e-a0de5d3a6a2b service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received event network-changed-da486672-f1e9-4bbe-8d5a-e9f2f0ad5119 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:50:30 user nova-compute[74994]: DEBUG nova.compute.manager [req-cd5dba50-3c7b-4b55-baec-f95954a12fac req-18fcfbd6-d666-40b7-9f8e-a0de5d3a6a2b service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Refreshing instance network info cache due to event network-changed-da486672-f1e9-4bbe-8d5a-e9f2f0ad5119. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:50:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-cd5dba50-3c7b-4b55-baec-f95954a12fac req-18fcfbd6-d666-40b7-9f8e-a0de5d3a6a2b service nova] Acquiring lock "refresh_cache-af9e5a26-f865-4563-aed9-34b8ed5b6697" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:50:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-cd5dba50-3c7b-4b55-baec-f95954a12fac req-18fcfbd6-d666-40b7-9f8e-a0de5d3a6a2b service nova] Acquired lock "refresh_cache-af9e5a26-f865-4563-aed9-34b8ed5b6697" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:50:30 user nova-compute[74994]: DEBUG nova.network.neutron [req-cd5dba50-3c7b-4b55-baec-f95954a12fac req-18fcfbd6-d666-40b7-9f8e-a0de5d3a6a2b service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Refreshing network info cache for port da486672-f1e9-4bbe-8d5a-e9f2f0ad5119 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:50:30 user nova-compute[74994]: DEBUG os_brick.utils [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:50:30 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:30 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:30 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[210a2832-f46d-4939-ad0e-1eca01f5f510]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:30 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:30 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:30 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[718a1530-84a1-48cf-bcf5-4761b223514b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:30 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:30 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:30 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[89caccbb-5971-4965-a6d6-79dde2b7d8e1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:30 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4970c2-b3d7-4ed1-acd3-179e40d19005]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:30 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:30 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:50:30 user nova-compute[74994]: DEBUG nova.network.neutron [req-cd5dba50-3c7b-4b55-baec-f95954a12fac req-18fcfbd6-d666-40b7-9f8e-a0de5d3a6a2b service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 10:50:30 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 10:50:30 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:30 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:50:30 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 10:50:30 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09109a3-176c-41aa-a194-a402df788e72]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:30 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 10:50:30 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 10:50:30 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 10:50:30 user nova-compute[74994]: DEBUG os_brick.utils [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:50:30 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Updating existing volume attachment record: 11d17a0e-b62f-486d-b61f-94eea7c33125 {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 10:50:30 user nova-compute[74994]: DEBUG nova.network.neutron [req-cd5dba50-3c7b-4b55-baec-f95954a12fac req-18fcfbd6-d666-40b7-9f8e-a0de5d3a6a2b service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:50:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-cd5dba50-3c7b-4b55-baec-f95954a12fac req-18fcfbd6-d666-40b7-9f8e-a0de5d3a6a2b service nova] Releasing lock "refresh_cache-af9e5a26-f865-4563-aed9-34b8ed5b6697" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:50:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Acquired lock "refresh_cache-af9e5a26-f865-4563-aed9-34b8ed5b6697" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:50:30 user nova-compute[74994]: DEBUG nova.network.neutron [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 10:50:30 user nova-compute[74994]: DEBUG nova.network.neutron [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 10:50:31 user nova-compute[74994]: DEBUG nova.compute.manager [req-1969b468-5480-4439-8fc6-d281095c5e40 req-15260752-57e9-4b52-81b2-69ec2cb85baa service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received event network-changed-9330afbb-83bf-4674-8eda-d091eb2670e5 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:50:31 user nova-compute[74994]: DEBUG nova.compute.manager [req-1969b468-5480-4439-8fc6-d281095c5e40 req-15260752-57e9-4b52-81b2-69ec2cb85baa service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Refreshing instance network info cache due to event network-changed-9330afbb-83bf-4674-8eda-d091eb2670e5. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:50:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-1969b468-5480-4439-8fc6-d281095c5e40 req-15260752-57e9-4b52-81b2-69ec2cb85baa service nova] Acquiring lock "refresh_cache-af9e5a26-f865-4563-aed9-34b8ed5b6697" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:50:33 user nova-compute[74994]: DEBUG nova.network.neutron [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Updating instance_info_cache with network_info: [{"id": "7ca13785-4bcf-42f6-b804-36f3c3cd1b82", "address": "fa:16:3e:fa:03:33", "network": {"id": "0b2c7b2c-5fe7-4238-9675-285c43d2bdf4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-766551976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ca13785-4b", "ovs_interfaceid": "7ca13785-4bcf-42f6-b804-36f3c3cd1b82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f049d45c-915d-4517-8799-8d8200a45b49", "address": "fa:16:3e:b7:f0:54", "network": {"id": "55373264-0376-4835-a5b6-4dbe7fbc0423", "bridge": "br-int", "label": "tempest-device-tagging-net1-1542107900", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf049d45c-91", "ovs_interfaceid": "f049d45c-915d-4517-8799-8d8200a45b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d8d28630-5645-4f2e-b7d3-2b0ac060ea43", "address": "fa:16:3e:0e:35:01", "network": {"id": "55373264-0376-4835-a5b6-4dbe7fbc0423", "bridge": "br-int", "label": "tempest-device-tagging-net1-1542107900", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8d28630-56", "ovs_interfaceid": "d8d28630-5645-4f2e-b7d3-2b0ac060ea43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e6ce548a-c7d7-4f70-8411-7809489f0a91", "address": "fa:16:3e:4e:fc:91", "network": {"id": "55373264-0376-4835-a5b6-4dbe7fbc0423", "bridge": "br-int", "label": "tempest-device-tagging-net1-1542107900", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ce548a-c7", "ovs_interfaceid": "e6ce548a-c7d7-4f70-8411-7809489f0a91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6d482201-d7ff-4dcc-9a23-a399a27c69f3", "address": "fa:16:3e:b1:aa:d2", "network": {"id": "55373264-0376-4835-a5b6-4dbe7fbc0423", "bridge": "br-int", "label": "tempest-device-tagging-net1-1542107900", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d482201-d7", "ovs_interfaceid": "6d482201-d7ff-4dcc-9a23-a399a27c69f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da486672-f1e9-4bbe-8d5a-e9f2f0ad5119", "address": "fa:16:3e:56:1d:f4", "network": {"id": "e32d74f0-a6b2-4c07-b2b1-9c3bc9a6b4a5", "bridge": "br-int", "label": "tempest-device-tagging-net2-207234115", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda486672-f1", "ovs_interfaceid": "da486672-f1e9-4bbe-8d5a-e9f2f0ad5119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9330afbb-83bf-4674-8eda-d091eb2670e5", "address": "fa:16:3e:78:0e:99", "network": {"id": "e32d74f0-a6b2-4c07-b2b1-9c3bc9a6b4a5", "bridge": "br-int", "label": "tempest-device-tagging-net2-207234115", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9330afbb-83", "ovs_interfaceid": "9330afbb-83bf-4674-8eda-d091eb2670e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:50:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Releasing lock "refresh_cache-af9e5a26-f865-4563-aed9-34b8ed5b6697" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:50:33 user nova-compute[74994]: DEBUG nova.compute.manager [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Instance network_info: |[{"id": "7ca13785-4bcf-42f6-b804-36f3c3cd1b82", "address": "fa:16:3e:fa:03:33", "network": {"id": "0b2c7b2c-5fe7-4238-9675-285c43d2bdf4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-766551976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ca13785-4b", "ovs_interfaceid": "7ca13785-4bcf-42f6-b804-36f3c3cd1b82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f049d45c-915d-4517-8799-8d8200a45b49", "address": "fa:16:3e:b7:f0:54", "network": {"id": "55373264-0376-4835-a5b6-4dbe7fbc0423", "bridge": "br-int", "label": "tempest-device-tagging-net1-1542107900", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf049d45c-91", "ovs_interfaceid": "f049d45c-915d-4517-8799-8d8200a45b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d8d28630-5645-4f2e-b7d3-2b0ac060ea43", "address": "fa:16:3e:0e:35:01", "network": {"id": "55373264-0376-4835-a5b6-4dbe7fbc0423", "bridge": "br-int", "label": "tempest-device-tagging-net1-1542107900", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8d28630-56", "ovs_interfaceid": "d8d28630-5645-4f2e-b7d3-2b0ac060ea43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e6ce548a-c7d7-4f70-8411-7809489f0a91", "address": "fa:16:3e:4e:fc:91", "network": {"id": "55373264-0376-4835-a5b6-4dbe7fbc0423", "bridge": "br-int", "label": "tempest-device-tagging-net1-1542107900", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ce548a-c7", "ovs_interfaceid": "e6ce548a-c7d7-4f70-8411-7809489f0a91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6d482201-d7ff-4dcc-9a23-a399a27c69f3", "address": "fa:16:3e:b1:aa:d2", "network": {"id": "55373264-0376-4835-a5b6-4dbe7fbc0423", "bridge": "br-int", "label": "tempest-device-tagging-net1-1542107900", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d482201-d7", "ovs_interfaceid": "6d482201-d7ff-4dcc-9a23-a399a27c69f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da486672-f1e9-4bbe-8d5a-e9f2f0ad5119", "address": "fa:16:3e:56:1d:f4", "network": {"id": "e32d74f0-a6b2-4c07-b2b1-9c3bc9a6b4a5", "bridge": "br-int", "label": "tempest-device-tagging-net2-207234115", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda486672-f1", "ovs_interfaceid": "da486672-f1e9-4bbe-8d5a-e9f2f0ad5119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9330afbb-83bf-4674-8eda-d091eb2670e5", "address": "fa:16:3e:78:0e:99", "network": {"id": "e32d74f0-a6b2-4c07-b2b1-9c3bc9a6b4a5", "bridge": "br-int", "label": "tempest-device-tagging-net2-207234115", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9330afbb-83", "ovs_interfaceid": "9330afbb-83bf-4674-8eda-d091eb2670e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 10:50:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-1969b468-5480-4439-8fc6-d281095c5e40 req-15260752-57e9-4b52-81b2-69ec2cb85baa service nova] Acquired lock "refresh_cache-af9e5a26-f865-4563-aed9-34b8ed5b6697" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:50:33 user nova-compute[74994]: DEBUG nova.network.neutron [req-1969b468-5480-4439-8fc6-d281095c5e40 req-15260752-57e9-4b52-81b2-69ec2cb85baa service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Refreshing network info cache for port 9330afbb-83bf-4674-8eda-d091eb2670e5 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:50:33 user nova-compute[74994]: DEBUG nova.network.neutron [req-1969b468-5480-4439-8fc6-d281095c5e40 req-15260752-57e9-4b52-81b2-69ec2cb85baa service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Updated VIF entry in instance network info cache for port 9330afbb-83bf-4674-8eda-d091eb2670e5. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 10:50:33 user nova-compute[74994]: DEBUG nova.network.neutron [req-1969b468-5480-4439-8fc6-d281095c5e40 req-15260752-57e9-4b52-81b2-69ec2cb85baa service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Updating instance_info_cache with network_info: [{"id": "7ca13785-4bcf-42f6-b804-36f3c3cd1b82", "address": "fa:16:3e:fa:03:33", "network": {"id": "0b2c7b2c-5fe7-4238-9675-285c43d2bdf4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-766551976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ca13785-4b", "ovs_interfaceid": "7ca13785-4bcf-42f6-b804-36f3c3cd1b82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f049d45c-915d-4517-8799-8d8200a45b49", "address": "fa:16:3e:b7:f0:54", "network": {"id": "55373264-0376-4835-a5b6-4dbe7fbc0423", "bridge": "br-int", "label": "tempest-device-tagging-net1-1542107900", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf049d45c-91", "ovs_interfaceid": "f049d45c-915d-4517-8799-8d8200a45b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d8d28630-5645-4f2e-b7d3-2b0ac060ea43", "address": "fa:16:3e:0e:35:01", "network": {"id": "55373264-0376-4835-a5b6-4dbe7fbc0423", "bridge": "br-int", "label": "tempest-device-tagging-net1-1542107900", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8d28630-56", "ovs_interfaceid": "d8d28630-5645-4f2e-b7d3-2b0ac060ea43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e6ce548a-c7d7-4f70-8411-7809489f0a91", "address": "fa:16:3e:4e:fc:91", "network": {"id": "55373264-0376-4835-a5b6-4dbe7fbc0423", "bridge": "br-int", "label": "tempest-device-tagging-net1-1542107900", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ce548a-c7", "ovs_interfaceid": "e6ce548a-c7d7-4f70-8411-7809489f0a91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6d482201-d7ff-4dcc-9a23-a399a27c69f3", "address": "fa:16:3e:b1:aa:d2", "network": {"id": "55373264-0376-4835-a5b6-4dbe7fbc0423", "bridge": "br-int", "label": "tempest-device-tagging-net1-1542107900", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d482201-d7", "ovs_interfaceid": "6d482201-d7ff-4dcc-9a23-a399a27c69f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da486672-f1e9-4bbe-8d5a-e9f2f0ad5119", "address": "fa:16:3e:56:1d:f4", "network": {"id": "e32d74f0-a6b2-4c07-b2b1-9c3bc9a6b4a5", "bridge": "br-int", "label": "tempest-device-tagging-net2-207234115", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda486672-f1", "ovs_interfaceid": "da486672-f1e9-4bbe-8d5a-e9f2f0ad5119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9330afbb-83bf-4674-8eda-d091eb2670e5", "address": "fa:16:3e:78:0e:99", "network": {"id": "e32d74f0-a6b2-4c07-b2b1-9c3bc9a6b4a5", "bridge": "br-int", "label": "tempest-device-tagging-net2-207234115", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9330afbb-83", "ovs_interfaceid": "9330afbb-83bf-4674-8eda-d091eb2670e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:50:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-1969b468-5480-4439-8fc6-d281095c5e40 req-15260752-57e9-4b52-81b2-69ec2cb85baa service nova] Releasing lock "refresh_cache-af9e5a26-f865-4563-aed9-34b8ed5b6697" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:50:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:50:37 user nova-compute[74994]: INFO nova.virt.block_device [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Booting with volume 004b7b16-ae0c-4434-a11c-53390a43ceab at /dev/vdc
Nov 28 10:50:37 user nova-compute[74994]: DEBUG os_brick.utils [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:50:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:37 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a82c3aa-d461-40c7-b3ce-d84bc297bea7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:37 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3524e502-571b-48bf-830f-dd2a00ad8ba6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:37 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[807c9e6f-f0c2-4b92-b6a0-9e905e1c70ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:37 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff798ca2-0232-4ee3-acee-cccc052c5c7e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:50:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 10:50:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:50:37 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 10:50:37 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64d92ac-74a4-425b-a607-3114bb7bcb8d]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 10:50:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 10:50:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 10:50:37 user nova-compute[74994]: DEBUG os_brick.utils [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:50:37 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Updating existing volume attachment record: cad6878e-1175-453b-bb1b-71c38fba6072 {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 10:50:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG nova.compute.manager [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 10:50:44 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Creating image(s)
Nov 28 10:50:44 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Did not create local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Ensure instance console log exists: /opt/stack/data/nova/instances/af9e5a26-f865-4563-aed9-34b8ed5b6697/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Start _get_guest_xml network_info=[{"id": "7ca13785-4bcf-42f6-b804-36f3c3cd1b82", "address": "fa:16:3e:fa:03:33", "network": {"id": "0b2c7b2c-5fe7-4238-9675-285c43d2bdf4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-766551976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ca13785-4b", "ovs_interfaceid": "7ca13785-4bcf-42f6-b804-36f3c3cd1b82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f049d45c-915d-4517-8799-8d8200a45b49", "address": "fa:16:3e:b7:f0:54", "network": {"id": "55373264-0376-4835-a5b6-4dbe7fbc0423", "bridge": "br-int", "label": "tempest-device-tagging-net1-1542107900", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf049d45c-91", "ovs_interfaceid": "f049d45c-915d-4517-8799-8d8200a45b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d8d28630-5645-4f2e-b7d3-2b0ac060ea43", "address": "fa:16:3e:0e:35:01", "network": {"id": "55373264-0376-4835-a5b6-4dbe7fbc0423", "bridge": "br-int", "label": "tempest-device-tagging-net1-1542107900", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8d28630-56", "ovs_interfaceid": "d8d28630-5645-4f2e-b7d3-2b0ac060ea43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e6ce548a-c7d7-4f70-8411-7809489f0a91", "address": "fa:16:3e:4e:fc:91", "network": {"id": "55373264-0376-4835-a5b6-4dbe7fbc0423", "bridge": "br-int", "label": "tempest-device-tagging-net1-1542107900", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ce548a-c7", "ovs_interfaceid": "e6ce548a-c7d7-4f70-8411-7809489f0a91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6d482201-d7ff-4dcc-9a23-a399a27c69f3", "address": "fa:16:3e:b1:aa:d2", "network": {"id": "55373264-0376-4835-a5b6-4dbe7fbc0423", "bridge": "br-int", "label": "tempest-device-tagging-net1-1542107900", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d482201-d7", "ovs_interfaceid": "6d482201-d7ff-4dcc-9a23-a399a27c69f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da486672-f1e9-4bbe-8d5a-e9f2f0ad5119", "address": "fa:16:3e:56:1d:f4", "network": {"id": "e32d74f0-a6b2-4c07-b2b1-9c3bc9a6b4a5", "bridge": "br-int", "label": "tempest-device-tagging-net2-207234115", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda486672-f1", "ovs_interfaceid": "da486672-f1e9-4bbe-8d5a-e9f2f0ad5119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9330afbb-83bf-4674-8eda-d091eb2670e5", "address": "fa:16:3e:78:0e:99", "network": {"id": "e32d74f0-a6b2-4c07-b2b1-9c3bc9a6b4a5", "bridge": "br-int", "label": "tempest-device-tagging-net2-207234115", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9330afbb-83", "ovs_interfaceid": "9330afbb-83bf-4674-8eda-d091eb2670e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BYQEJHAv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'af9e5a26-f865-4563-aed9-34b8ed5b6697', 'attached_at': '', 'detached_at': '', 'volume_id': '670edcd3-e394-4ce9-8114-837cd58008b0', 'serial': '670edcd3-e394-4ce9-8114-837cd58008b0'}, 'attachment_id': '3566cb3c-4bf1-4dc9-865a-9379c2a4dc30', 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None}, {'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mBwyHkSC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'af9e5a26-f865-4563-aed9-34b8ed5b6697', 'attached_at': '', 'detached_at': '', 'volume_id': '95bbeedd-0974-4f79-ae9e-ac4ec0ed7148', 'serial': '95bbeedd-0974-4f79-ae9e-ac4ec0ed7148'}, 'attachment_id': '11d17a0e-b62f-486d-b61f-94eea7c33125', 'boot_index': 1, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'volume_type': None}, {'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HpWctMGu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'af9e5a26-f865-4563-aed9-34b8ed5b6697', 'attached_at': '', 'detached_at': '', 'volume_id': '004b7b16-ae0c-4434-a11c-53390a43ceab', 'serial': '004b7b16-ae0c-4434-a11c-53390a43ceab'}, 'attachment_id': 'cad6878e-1175-453b-bb1b-71c38fba6072', 'boot_index': 2, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 10:50:44 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:50:44 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:50:44 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG os_brick.initiator.connector [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Factory for ISCSI on None {{(pid=74994) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.008s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BYQEJHAv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:50:44 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:50:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:50:44 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:50:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:50:44 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 10:50:44 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7908cfa-e30a-4b93-ab3d-971b225f9f43]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 10:50:44 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0756ef-6113-496d-b4fb-03038163b956]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0] added
Nov 28 10:50:44 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e73d63-f2e5-4e04-ba74-3a717c690101]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[51551457-8934-4e4d-8774-d6ac400a0dd4]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BYQEJHAv {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BYQEJHAv" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[52039af7-ba79-4e2f-96c1-eb38c32d23b4]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BYQEJHAv'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86f2f08-d315-4126-b4be-825371f97cc9]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c46935e-9e3b-46f5-8d26-a550ffeeee0e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 10:50:44 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 10:50:44 user nova-compute[74994]:  {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:50:44 user nova-compute[74994]: WARNING os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 10:50:44 user nova-compute[74994]: 
Nov 28 10:50:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[15deeb05-4401-4e6d-94f6-dc645e1bb046]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0, portal: 172.16.0.220,3260]
Nov 28 10:50:44 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0, portal: 172.16.0.220,3260] successful.
Nov 28 10:50:44 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[902a9e62-bb06-4a92-8300-909b78217864]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1112f0-022e-4bda-aa0d-950b512e1a61]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:50:44 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:50:44 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.236s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[396da6af-048f-4e6d-a7e2-090fff7898e2]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:44 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: None {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 10:50:45 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 10:50:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BYQEJHAv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 10:50:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.267s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:50:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] <== connect_volume: return (1268ms) {'type': 'block', 'scsi_wwn': '26139336236303164', 'path': '/dev/sdb'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:50:45 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139336236303164', 'path': '/dev/sdb'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 10:50:45 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 10:50:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mBwyHkSC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:50:45 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:50:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:50:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:50:45 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:50:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:50:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:50:45 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 10:50:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:45 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f126036-ddfb-4821-b044-3441c6761b3f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 10:50:45 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:50:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:45 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be01eec-a36c-404d-8536-031478f837d6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148] added
Nov 28 10:50:45 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:50:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:45 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c689ed-1f8d-407a-8f25-830c4d3d7548]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:50:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:45 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a46bebd-db23-489d-9468-fcb6379001fa]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:50:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mBwyHkSC {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mBwyHkSC" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:45 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4663ec2-2445-4755-9899-6a69653a8d53]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mBwyHkSC'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:50:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:45 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b07893-511f-4ed4-8cb9-906273b9c3dc]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:50:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:45 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f439898-1d14-411b-b76a-5565d8116123]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:50:45 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:50:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:50:45 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:50:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:45 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[400edd66-1e25-401a-bc5c-c44946cfc60b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148, portal: 172.16.0.220,3260]
Nov 28 10:50:45 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148, portal: 172.16.0.220,3260] successful.
Nov 28 10:50:45 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:50:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.156s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d506ae4-bed5-4202-bf1c-694eacb40d05]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:50:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac657ae4-b28c-4dea-ac66-5f1c65d0a445]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:50:46 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:50:46 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:50:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:50:46 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:50:46 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:50:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.461s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:50:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 10:50:46 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 10:50:46 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 10:50:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ca1ab1-0e0c-424d-af20-7b390b4825a6]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:46 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: None {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mBwyHkSC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.486s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] <== connect_volume: return (1487ms) {'type': 'block', 'scsi_wwn': '26235396337353832', 'path': '/dev/sdc'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235396337353832', 'path': '/dev/sdc'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HpWctMGu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:50:47 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:50:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:50:47 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:50:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:50:47 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 10:50:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ae44e8-f1c5-46cb-8dd4-6e27e7931ae7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 10:50:47 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df6c751-6995-4af9-982d-3ac31c2ae885]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab] added
Nov 28 10:50:47 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[758b43bb-8aa2-4edf-b842-d049914b3fb2]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfdeed85-fe48-4f20-a354-71593bad669b]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HpWctMGu {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HpWctMGu" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b5679a-b804-47c0-b07c-fcea12c6249d]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HpWctMGu'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9dbbc2f-b2b4-442d-8ded-64906713fc33]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8c720e-1bbc-4ce5-8e37-c16a0d663971]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:50:47 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:50:47 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:50:47 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:50:47 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbff688-9cb6-443e-9fe6-2c78ab679030]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab, portal: 172.16.0.220,3260]
Nov 28 10:50:47 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab, portal: 172.16.0.220,3260] successful.
Nov 28 10:50:47 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[46914db2-311c-4654-bc8c-7e00689eb5f1]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75b3792-3ba1-4f74-994a-616818485f20]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:50:47 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:50:47 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:50:47 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:50:47 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:50:47 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:50:47 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.241s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a8024c-0d2b-46d1-85ab-b0c7d0e3c066]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 10:50:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HpWctMGu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.271s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] <== connect_volume: return (1272ms) {'type': 'block', 'scsi_wwn': '26363616365663263', 'path': '/dev/sdd'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363616365663263', 'path': '/dev/sdd'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:50:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1695169480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1695169480',id=12,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFN6MEwyUWk8GSmHy1bNd9rONr8OYvJnOKizV3jBEue+Dp6QzKo81hoNph+ojxxVeX39WSSYot1LYMhIoRx0iJpNwiKpZtbgjHAAjMlNS/SHmKZc2KEOeHCAZCZthW3ROw==',key_name='tempest-keypair-518302348',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d334446f1c65465885717aab3fb6c78b',ramdisk_id='',reservation_id='r-xgkc4yau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1196788905',owner_user_name='tempest-TaggedBootDevicesTest_v242-1196788905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:50:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9cf909ee96b249c98a98547cab18fcef',uuid=af9e5a26-f865-4563-aed9-34b8ed5b6697,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ca13785-4bcf-42f6-b804-36f3c3cd1b82", "address": "fa:16:3e:fa:03:33", "network": {"id": "0b2c7b2c-5fe7-4238-9675-285c43d2bdf4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-766551976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ca13785-4b", "ovs_interfaceid": "7ca13785-4bcf-42f6-b804-36f3c3cd1b82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Converting VIF {"id": "7ca13785-4bcf-42f6-b804-36f3c3cd1b82", "address": "fa:16:3e:fa:03:33", "network": {"id": "0b2c7b2c-5fe7-4238-9675-285c43d2bdf4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-766551976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ca13785-4b", "ovs_interfaceid": "7ca13785-4bcf-42f6-b804-36f3c3cd1b82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:03:33,bridge_name='br-int',has_traffic_filtering=True,id=7ca13785-4bcf-42f6-b804-36f3c3cd1b82,network=Network(0b2c7b2c-5fe7-4238-9675-285c43d2bdf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ca13785-4b') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:50:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1695169480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1695169480',id=12,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFN6MEwyUWk8GSmHy1bNd9rONr8OYvJnOKizV3jBEue+Dp6QzKo81hoNph+ojxxVeX39WSSYot1LYMhIoRx0iJpNwiKpZtbgjHAAjMlNS/SHmKZc2KEOeHCAZCZthW3ROw==',key_name='tempest-keypair-518302348',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d334446f1c65465885717aab3fb6c78b',ramdisk_id='',reservation_id='r-xgkc4yau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1196788905',owner_user_name='tempest-TaggedBootDevicesTest_v242-1196788905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:50:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9cf909ee96b249c98a98547cab18fcef',uuid=af9e5a26-f865-4563-aed9-34b8ed5b6697,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f049d45c-915d-4517-8799-8d8200a45b49", "address": "fa:16:3e:b7:f0:54", "network": {"id": "55373264-0376-4835-a5b6-4dbe7fbc0423", "bridge": "br-int", "label": "tempest-device-tagging-net1-1542107900", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf049d45c-91", "ovs_interfaceid": "f049d45c-915d-4517-8799-8d8200a45b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Converting VIF {"id": "f049d45c-915d-4517-8799-8d8200a45b49", "address": "fa:16:3e:b7:f0:54", "network": {"id": "55373264-0376-4835-a5b6-4dbe7fbc0423", "bridge": "br-int", "label": "tempest-device-tagging-net1-1542107900", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf049d45c-91", "ovs_interfaceid": "f049d45c-915d-4517-8799-8d8200a45b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:f0:54,bridge_name='br-int',has_traffic_filtering=True,id=f049d45c-915d-4517-8799-8d8200a45b49,network=Network(55373264-0376-4835-a5b6-4dbe7fbc0423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf049d45c-91') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:50:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1695169480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1695169480',id=12,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFN6MEwyUWk8GSmHy1bNd9rONr8OYvJnOKizV3jBEue+Dp6QzKo81hoNph+ojxxVeX39WSSYot1LYMhIoRx0iJpNwiKpZtbgjHAAjMlNS/SHmKZc2KEOeHCAZCZthW3ROw==',key_name='tempest-keypair-518302348',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d334446f1c65465885717aab3fb6c78b',ramdisk_id='',reservation_id='r-xgkc4yau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1196788905',owner_user_name='tempest-TaggedBootDevicesTest_v242-1196788905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:50:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9cf909ee96b249c98a98547cab18fcef',uuid=af9e5a26-f865-4563-aed9-34b8ed5b6697,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8d28630-5645-4f2e-b7d3-2b0ac060ea43", "address": "fa:16:3e:0e:35:01", "network": {"id": "55373264-0376-4835-a5b6-4dbe7fbc0423", "bridge": "br-int", "label": "tempest-device-tagging-net1-1542107900", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8d28630-56", "ovs_interfaceid": "d8d28630-5645-4f2e-b7d3-2b0ac060ea43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Converting VIF {"id": "d8d28630-5645-4f2e-b7d3-2b0ac060ea43", "address": "fa:16:3e:0e:35:01", "network": {"id": "55373264-0376-4835-a5b6-4dbe7fbc0423", "bridge": "br-int", "label": "tempest-device-tagging-net1-1542107900", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8d28630-56", "ovs_interfaceid": "d8d28630-5645-4f2e-b7d3-2b0ac060ea43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:35:01,bridge_name='br-int',has_traffic_filtering=True,id=d8d28630-5645-4f2e-b7d3-2b0ac060ea43,network=Network(55373264-0376-4835-a5b6-4dbe7fbc0423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd8d28630-56') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:50:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1695169480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1695169480',id=12,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFN6MEwyUWk8GSmHy1bNd9rONr8OYvJnOKizV3jBEue+Dp6QzKo81hoNph+ojxxVeX39WSSYot1LYMhIoRx0iJpNwiKpZtbgjHAAjMlNS/SHmKZc2KEOeHCAZCZthW3ROw==',key_name='tempest-keypair-518302348',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d334446f1c65465885717aab3fb6c78b',ramdisk_id='',reservation_id='r-xgkc4yau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1196788905',owner_user_name='tempest-TaggedBootDevicesTest_v242-1196788905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:50:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9cf909ee96b249c98a98547cab18fcef',uuid=af9e5a26-f865-4563-aed9-34b8ed5b6697,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6ce548a-c7d7-4f70-8411-7809489f0a91", "address": "fa:16:3e:4e:fc:91", "network": {"id": "55373264-0376-4835-a5b6-4dbe7fbc0423", "bridge": "br-int", "label": "tempest-device-tagging-net1-1542107900", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ce548a-c7", "ovs_interfaceid": "e6ce548a-c7d7-4f70-8411-7809489f0a91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Converting VIF {"id": "e6ce548a-c7d7-4f70-8411-7809489f0a91", "address": "fa:16:3e:4e:fc:91", "network": {"id": "55373264-0376-4835-a5b6-4dbe7fbc0423", "bridge": "br-int", "label": "tempest-device-tagging-net1-1542107900", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ce548a-c7", "ovs_interfaceid": "e6ce548a-c7d7-4f70-8411-7809489f0a91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:fc:91,bridge_name='br-int',has_traffic_filtering=True,id=e6ce548a-c7d7-4f70-8411-7809489f0a91,network=Network(55373264-0376-4835-a5b6-4dbe7fbc0423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6ce548a-c7') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:50:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1695169480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1695169480',id=12,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFN6MEwyUWk8GSmHy1bNd9rONr8OYvJnOKizV3jBEue+Dp6QzKo81hoNph+ojxxVeX39WSSYot1LYMhIoRx0iJpNwiKpZtbgjHAAjMlNS/SHmKZc2KEOeHCAZCZthW3ROw==',key_name='tempest-keypair-518302348',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d334446f1c65465885717aab3fb6c78b',ramdisk_id='',reservation_id='r-xgkc4yau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1196788905',owner_user_name='tempest-TaggedBootDevicesTest_v242-1196788905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:50:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9cf909ee96b249c98a98547cab18fcef',uuid=af9e5a26-f865-4563-aed9-34b8ed5b6697,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d482201-d7ff-4dcc-9a23-a399a27c69f3", "address": "fa:16:3e:b1:aa:d2", "network": {"id": "55373264-0376-4835-a5b6-4dbe7fbc0423", "bridge": "br-int", "label": "tempest-device-tagging-net1-1542107900", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d482201-d7", "ovs_interfaceid": "6d482201-d7ff-4dcc-9a23-a399a27c69f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Converting VIF {"id": "6d482201-d7ff-4dcc-9a23-a399a27c69f3", "address": "fa:16:3e:b1:aa:d2", "network": {"id": "55373264-0376-4835-a5b6-4dbe7fbc0423", "bridge": "br-int", "label": "tempest-device-tagging-net1-1542107900", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d482201-d7", "ovs_interfaceid": "6d482201-d7ff-4dcc-9a23-a399a27c69f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:aa:d2,bridge_name='br-int',has_traffic_filtering=True,id=6d482201-d7ff-4dcc-9a23-a399a27c69f3,network=Network(55373264-0376-4835-a5b6-4dbe7fbc0423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d482201-d7') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:50:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1695169480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1695169480',id=12,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFN6MEwyUWk8GSmHy1bNd9rONr8OYvJnOKizV3jBEue+Dp6QzKo81hoNph+ojxxVeX39WSSYot1LYMhIoRx0iJpNwiKpZtbgjHAAjMlNS/SHmKZc2KEOeHCAZCZthW3ROw==',key_name='tempest-keypair-518302348',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d334446f1c65465885717aab3fb6c78b',ramdisk_id='',reservation_id='r-xgkc4yau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1196788905',owner_user_name='tempest-TaggedBootDevicesTest_v242-1196788905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:50:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9cf909ee96b249c98a98547cab18fcef',uuid=af9e5a26-f865-4563-aed9-34b8ed5b6697,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da486672-f1e9-4bbe-8d5a-e9f2f0ad5119", "address": "fa:16:3e:56:1d:f4", "network": {"id": "e32d74f0-a6b2-4c07-b2b1-9c3bc9a6b4a5", "bridge": "br-int", "label": "tempest-device-tagging-net2-207234115", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda486672-f1", "ovs_interfaceid": "da486672-f1e9-4bbe-8d5a-e9f2f0ad5119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Converting VIF {"id": "da486672-f1e9-4bbe-8d5a-e9f2f0ad5119", "address": "fa:16:3e:56:1d:f4", "network": {"id": "e32d74f0-a6b2-4c07-b2b1-9c3bc9a6b4a5", "bridge": "br-int", "label": "tempest-device-tagging-net2-207234115", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda486672-f1", "ovs_interfaceid": "da486672-f1e9-4bbe-8d5a-e9f2f0ad5119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:1d:f4,bridge_name='br-int',has_traffic_filtering=True,id=da486672-f1e9-4bbe-8d5a-e9f2f0ad5119,network=Network(e32d74f0-a6b2-4c07-b2b1-9c3bc9a6b4a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda486672-f1') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:50:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1695169480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1695169480',id=12,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFN6MEwyUWk8GSmHy1bNd9rONr8OYvJnOKizV3jBEue+Dp6QzKo81hoNph+ojxxVeX39WSSYot1LYMhIoRx0iJpNwiKpZtbgjHAAjMlNS/SHmKZc2KEOeHCAZCZthW3ROw==',key_name='tempest-keypair-518302348',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d334446f1c65465885717aab3fb6c78b',ramdisk_id='',reservation_id='r-xgkc4yau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1196788905',owner_user_name='tempest-TaggedBootDevicesTest_v242-1196788905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:50:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9cf909ee96b249c98a98547cab18fcef',uuid=af9e5a26-f865-4563-aed9-34b8ed5b6697,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9330afbb-83bf-4674-8eda-d091eb2670e5", "address": "fa:16:3e:78:0e:99", "network": {"id": "e32d74f0-a6b2-4c07-b2b1-9c3bc9a6b4a5", "bridge": "br-int", "label": "tempest-device-tagging-net2-207234115", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9330afbb-83", "ovs_interfaceid": "9330afbb-83bf-4674-8eda-d091eb2670e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Converting VIF {"id": "9330afbb-83bf-4674-8eda-d091eb2670e5", "address": "fa:16:3e:78:0e:99", "network": {"id": "e32d74f0-a6b2-4c07-b2b1-9c3bc9a6b4a5", "bridge": "br-int", "label": "tempest-device-tagging-net2-207234115", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9330afbb-83", "ovs_interfaceid": "9330afbb-83bf-4674-8eda-d091eb2670e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:0e:99,bridge_name='br-int',has_traffic_filtering=True,id=9330afbb-83bf-4674-8eda-d091eb2670e5,network=Network(e32d74f0-a6b2-4c07-b2b1-9c3bc9a6b4a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9330afbb-83') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG nova.objects.instance [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Lazy-loading 'pci_devices' on Instance uuid af9e5a26-f865-4563-aed9-34b8ed5b6697 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] End _get_guest_xml xml=<domain type="kvm">
Nov 28 10:50:48 user nova-compute[74994]:   <uuid>af9e5a26-f865-4563-aed9-34b8ed5b6697</uuid>
Nov 28 10:50:48 user nova-compute[74994]:   <name>instance-0000000c</name>
Nov 28 10:50:48 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 10:50:48 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 10:50:48 user nova-compute[74994]:   <metadata>
Nov 28 10:50:48 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 10:50:48 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 10:50:48 user nova-compute[74994]:       <nova:name>tempest-device-tagging-server-1695169480</nova:name>
Nov 28 10:50:48 user nova-compute[74994]:       <nova:creationTime>2023-11-28 10:50:44</nova:creationTime>
Nov 28 10:50:48 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 10:50:48 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 10:50:48 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 10:50:48 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 10:50:48 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 10:50:48 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 10:50:48 user nova-compute[74994]:       </nova:flavor>
Nov 28 10:50:48 user nova-compute[74994]:       <nova:owner>
Nov 28 10:50:48 user nova-compute[74994]:         <nova:user uuid="9cf909ee96b249c98a98547cab18fcef">tempest-TaggedBootDevicesTest_v242-1196788905-project-member</nova:user>
Nov 28 10:50:48 user nova-compute[74994]:         <nova:project uuid="d334446f1c65465885717aab3fb6c78b">tempest-TaggedBootDevicesTest_v242-1196788905</nova:project>
Nov 28 10:50:48 user nova-compute[74994]:       </nova:owner>
Nov 28 10:50:48 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 10:50:48 user nova-compute[74994]:       <nova:ports>
Nov 28 10:50:48 user nova-compute[74994]:         <nova:port uuid="7ca13785-4bcf-42f6-b804-36f3c3cd1b82">
Nov 28 10:50:48 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 10:50:48 user nova-compute[74994]:         </nova:port>
Nov 28 10:50:48 user nova-compute[74994]:         <nova:port uuid="f049d45c-915d-4517-8799-8d8200a45b49">
Nov 28 10:50:48 user nova-compute[74994]:           <nova:ip type="fixed" address="10.1.1.122" ipVersion="4"/>
Nov 28 10:50:48 user nova-compute[74994]:         </nova:port>
Nov 28 10:50:48 user nova-compute[74994]:         <nova:port uuid="d8d28630-5645-4f2e-b7d3-2b0ac060ea43">
Nov 28 10:50:48 user nova-compute[74994]:           <nova:ip type="fixed" address="10.1.1.140" ipVersion="4"/>
Nov 28 10:50:48 user nova-compute[74994]:         </nova:port>
Nov 28 10:50:48 user nova-compute[74994]:         <nova:port uuid="e6ce548a-c7d7-4f70-8411-7809489f0a91">
Nov 28 10:50:48 user nova-compute[74994]:           <nova:ip type="fixed" address="10.1.1.187" ipVersion="4"/>
Nov 28 10:50:48 user nova-compute[74994]:         </nova:port>
Nov 28 10:50:48 user nova-compute[74994]:         <nova:port uuid="6d482201-d7ff-4dcc-9a23-a399a27c69f3">
Nov 28 10:50:48 user nova-compute[74994]:           <nova:ip type="fixed" address="10.1.1.85" ipVersion="4"/>
Nov 28 10:50:48 user nova-compute[74994]:         </nova:port>
Nov 28 10:50:48 user nova-compute[74994]:         <nova:port uuid="da486672-f1e9-4bbe-8d5a-e9f2f0ad5119">
Nov 28 10:50:48 user nova-compute[74994]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 28 10:50:48 user nova-compute[74994]:         </nova:port>
Nov 28 10:50:48 user nova-compute[74994]:         <nova:port uuid="9330afbb-83bf-4674-8eda-d091eb2670e5">
Nov 28 10:50:48 user nova-compute[74994]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 28 10:50:48 user nova-compute[74994]:         </nova:port>
Nov 28 10:50:48 user nova-compute[74994]:       </nova:ports>
Nov 28 10:50:48 user nova-compute[74994]:     </nova:instance>
Nov 28 10:50:48 user nova-compute[74994]:   </metadata>
Nov 28 10:50:48 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 10:50:48 user nova-compute[74994]:     <system>
Nov 28 10:50:48 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 10:50:48 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 10:50:48 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 10:50:48 user nova-compute[74994]:       <entry name="serial">af9e5a26-f865-4563-aed9-34b8ed5b6697</entry>
Nov 28 10:50:48 user nova-compute[74994]:       <entry name="uuid">af9e5a26-f865-4563-aed9-34b8ed5b6697</entry>
Nov 28 10:50:48 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 10:50:48 user nova-compute[74994]:     </system>
Nov 28 10:50:48 user nova-compute[74994]:   </sysinfo>
Nov 28 10:50:48 user nova-compute[74994]:   <os>
Nov 28 10:50:48 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 10:50:48 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 10:50:48 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 10:50:48 user nova-compute[74994]:   </os>
Nov 28 10:50:48 user nova-compute[74994]:   <features>
Nov 28 10:50:48 user nova-compute[74994]:     <acpi/>
Nov 28 10:50:48 user nova-compute[74994]:     <apic/>
Nov 28 10:50:48 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 10:50:48 user nova-compute[74994]:   </features>
Nov 28 10:50:48 user nova-compute[74994]:   <clock offset="utc">
Nov 28 10:50:48 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 10:50:48 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 10:50:48 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 10:50:48 user nova-compute[74994]:   </clock>
Nov 28 10:50:48 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 10:50:48 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 10:50:48 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 10:50:48 user nova-compute[74994]:   </cpu>
Nov 28 10:50:48 user nova-compute[74994]:   <devices>
Nov 28 10:50:48 user nova-compute[74994]:     <disk type="file" device="cdrom">
Nov 28 10:50:48 user nova-compute[74994]:       <driver name="qemu" type="raw" cache="none"/>
Nov 28 10:50:48 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/af9e5a26-f865-4563-aed9-34b8ed5b6697/disk.config"/>
Nov 28 10:50:48 user nova-compute[74994]:       <target dev="hda" bus="ide"/>
Nov 28 10:50:48 user nova-compute[74994]:     </disk>
Nov 28 10:50:48 user nova-compute[74994]:     <disk type="block" device="disk">
Nov 28 10:50:48 user nova-compute[74994]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 10:50:48 user nova-compute[74994]:       <source dev="/dev/sdb"/>
Nov 28 10:50:48 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 10:50:48 user nova-compute[74994]:       <serial>670edcd3-e394-4ce9-8114-837cd58008b0</serial>
Nov 28 10:50:48 user nova-compute[74994]:     </disk>
Nov 28 10:50:48 user nova-compute[74994]:     <disk type="block" device="disk">
Nov 28 10:50:48 user nova-compute[74994]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 10:50:48 user nova-compute[74994]:       <source dev="/dev/sdc"/>
Nov 28 10:50:48 user nova-compute[74994]:       <target dev="vdb" bus="virtio"/>
Nov 28 10:50:48 user nova-compute[74994]:       <serial>95bbeedd-0974-4f79-ae9e-ac4ec0ed7148</serial>
Nov 28 10:50:48 user nova-compute[74994]:     </disk>
Nov 28 10:50:48 user nova-compute[74994]:     <disk type="block" device="disk">
Nov 28 10:50:48 user nova-compute[74994]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 10:50:48 user nova-compute[74994]:       <source dev="/dev/sdd"/>
Nov 28 10:50:48 user nova-compute[74994]:       <target dev="vdc" bus="virtio"/>
Nov 28 10:50:48 user nova-compute[74994]:       <serial>004b7b16-ae0c-4434-a11c-53390a43ceab</serial>
Nov 28 10:50:48 user nova-compute[74994]:     </disk>
Nov 28 10:50:48 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 10:50:48 user nova-compute[74994]:       <mac address="fa:16:3e:fa:03:33"/>
Nov 28 10:50:48 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:50:48 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 10:50:48 user nova-compute[74994]:       <target dev="tap7ca13785-4b"/>
Nov 28 10:50:48 user nova-compute[74994]:     </interface>
Nov 28 10:50:48 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 10:50:48 user nova-compute[74994]:       <mac address="fa:16:3e:b7:f0:54"/>
Nov 28 10:50:48 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:50:48 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 10:50:48 user nova-compute[74994]:       <target dev="tapf049d45c-91"/>
Nov 28 10:50:48 user nova-compute[74994]:     </interface>
Nov 28 10:50:48 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 10:50:48 user nova-compute[74994]:       <mac address="fa:16:3e:0e:35:01"/>
Nov 28 10:50:48 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:50:48 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 10:50:48 user nova-compute[74994]:       <target dev="tapd8d28630-56"/>
Nov 28 10:50:48 user nova-compute[74994]:     </interface>
Nov 28 10:50:48 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 10:50:48 user nova-compute[74994]:       <mac address="fa:16:3e:4e:fc:91"/>
Nov 28 10:50:48 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:50:48 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 10:50:48 user nova-compute[74994]:       <target dev="tape6ce548a-c7"/>
Nov 28 10:50:48 user nova-compute[74994]:     </interface>
Nov 28 10:50:48 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 10:50:48 user nova-compute[74994]:       <mac address="fa:16:3e:b1:aa:d2"/>
Nov 28 10:50:48 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:50:48 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 10:50:48 user nova-compute[74994]:       <target dev="tap6d482201-d7"/>
Nov 28 10:50:48 user nova-compute[74994]:     </interface>
Nov 28 10:50:48 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 10:50:48 user nova-compute[74994]:       <mac address="fa:16:3e:56:1d:f4"/>
Nov 28 10:50:48 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:50:48 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 10:50:48 user nova-compute[74994]:       <target dev="tapda486672-f1"/>
Nov 28 10:50:48 user nova-compute[74994]:     </interface>
Nov 28 10:50:48 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 10:50:48 user nova-compute[74994]:       <mac address="fa:16:3e:78:0e:99"/>
Nov 28 10:50:48 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:50:48 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 10:50:48 user nova-compute[74994]:       <target dev="tap9330afbb-83"/>
Nov 28 10:50:48 user nova-compute[74994]:     </interface>
Nov 28 10:50:48 user nova-compute[74994]:     <serial type="pty">
Nov 28 10:50:48 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/af9e5a26-f865-4563-aed9-34b8ed5b6697/console.log" append="off"/>
Nov 28 10:50:48 user nova-compute[74994]:     </serial>
Nov 28 10:50:48 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 10:50:48 user nova-compute[74994]:     <video>
Nov 28 10:50:48 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:50:48 user nova-compute[74994]:     </video>
Nov 28 10:50:48 user nova-compute[74994]:     <rng model="virtio">
Nov 28 10:50:48 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 10:50:48 user nova-compute[74994]:     </rng>
Nov 28 10:50:48 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 10:50:48 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 10:50:48 user nova-compute[74994]:       <stats period="10"/>
Nov 28 10:50:48 user nova-compute[74994]:     </memballoon>
Nov 28 10:50:48 user nova-compute[74994]:   </devices>
Nov 28 10:50:48 user nova-compute[74994]: </domain>
Nov 28 10:50:48 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:50:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1695169480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1695169480',id=12,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFN6MEwyUWk8GSmHy1bNd9rONr8OYvJnOKizV3jBEue+Dp6QzKo81hoNph+ojxxVeX39WSSYot1LYMhIoRx0iJpNwiKpZtbgjHAAjMlNS/SHmKZc2KEOeHCAZCZthW3ROw==',key_name='tempest-keypair-518302348',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d334446f1c65465885717aab3fb6c78b',ramdisk_id='',reservation_id='r-xgkc4yau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1196788905',owner_user_name='tempest-TaggedBootDevicesTest_v242-1196788905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:50:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9cf909ee96b249c98a98547cab18fcef',uuid=af9e5a26-f865-4563-aed9-34b8ed5b6697,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ca13785-4bcf-42f6-b804-36f3c3cd1b82", "address": "fa:16:3e:fa:03:33", "network": {"id": "0b2c7b2c-5fe7-4238-9675-285c43d2bdf4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-766551976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ca13785-4b", "ovs_interfaceid": "7ca13785-4bcf-42f6-b804-36f3c3cd1b82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Converting VIF {"id": "7ca13785-4bcf-42f6-b804-36f3c3cd1b82", "address": "fa:16:3e:fa:03:33", "network": {"id": "0b2c7b2c-5fe7-4238-9675-285c43d2bdf4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-766551976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ca13785-4b", "ovs_interfaceid": "7ca13785-4bcf-42f6-b804-36f3c3cd1b82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:03:33,bridge_name='br-int',has_traffic_filtering=True,id=7ca13785-4bcf-42f6-b804-36f3c3cd1b82,network=Network(0b2c7b2c-5fe7-4238-9675-285c43d2bdf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ca13785-4b') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG os_vif [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:03:33,bridge_name='br-int',has_traffic_filtering=True,id=7ca13785-4bcf-42f6-b804-36f3c3cd1b82,network=Network(0b2c7b2c-5fe7-4238-9675-285c43d2bdf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ca13785-4b') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cc310f7f-684d-5e16-a3d4-83b68c99b8cf', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ca13785-4b, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7ca13785-4b, col_values=(('qos', UUID('0116a889-b1c4-4e2d-9615-bfa99194c650')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7ca13785-4b, col_values=(('external_ids', {'iface-id': '7ca13785-4bcf-42f6-b804-36f3c3cd1b82', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:03:33', 'vm-uuid': 'af9e5a26-f865-4563-aed9-34b8ed5b6697'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:48 user nova-compute[74994]: INFO os_vif [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:03:33,bridge_name='br-int',has_traffic_filtering=True,id=7ca13785-4bcf-42f6-b804-36f3c3cd1b82,network=Network(0b2c7b2c-5fe7-4238-9675-285c43d2bdf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ca13785-4b')
Nov 28 10:50:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:50:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1695169480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1695169480',id=12,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFN6MEwyUWk8GSmHy1bNd9rONr8OYvJnOKizV3jBEue+Dp6QzKo81hoNph+ojxxVeX39WSSYot1LYMhIoRx0iJpNwiKpZtbgjHAAjMlNS/SHmKZc2KEOeHCAZCZthW3ROw==',key_name='tempest-keypair-518302348',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d334446f1c65465885717aab3fb6c78b',ramdisk_id='',reservation_id='r-xgkc4yau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1196788905',owner_user_name='tempest-TaggedBootDevicesTest_v242-1196788905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:50:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9cf909ee96b249c98a98547cab18fcef',uuid=af9e5a26-f865-4563-aed9-34b8ed5b6697,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f049d45c-915d-4517-8799-8d8200a45b49", "address": "fa:16:3e:b7:f0:54", "network": {"id": "55373264-0376-4835-a5b6-4dbe7fbc0423", "bridge": "br-int", "label": "tempest-device-tagging-net1-1542107900", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf049d45c-91", "ovs_interfaceid": "f049d45c-915d-4517-8799-8d8200a45b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Converting VIF {"id": "f049d45c-915d-4517-8799-8d8200a45b49", "address": "fa:16:3e:b7:f0:54", "network": {"id": "55373264-0376-4835-a5b6-4dbe7fbc0423", "bridge": "br-int", "label": "tempest-device-tagging-net1-1542107900", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf049d45c-91", "ovs_interfaceid": "f049d45c-915d-4517-8799-8d8200a45b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:f0:54,bridge_name='br-int',has_traffic_filtering=True,id=f049d45c-915d-4517-8799-8d8200a45b49,network=Network(55373264-0376-4835-a5b6-4dbe7fbc0423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf049d45c-91') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG os_vif [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:f0:54,bridge_name='br-int',has_traffic_filtering=True,id=f049d45c-915d-4517-8799-8d8200a45b49,network=Network(55373264-0376-4835-a5b6-4dbe7fbc0423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf049d45c-91') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1bf0210f-41aa-5ca7-ad84-09a54fafd60e', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf049d45c-91, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf049d45c-91, col_values=(('qos', UUID('e8ab8223-035e-45d2-95b5-afe4eed6800e')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf049d45c-91, col_values=(('external_ids', {'iface-id': 'f049d45c-915d-4517-8799-8d8200a45b49', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:f0:54', 'vm-uuid': 'af9e5a26-f865-4563-aed9-34b8ed5b6697'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:48 user nova-compute[74994]: INFO os_vif [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:f0:54,bridge_name='br-int',has_traffic_filtering=True,id=f049d45c-915d-4517-8799-8d8200a45b49,network=Network(55373264-0376-4835-a5b6-4dbe7fbc0423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf049d45c-91')
Nov 28 10:50:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:50:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1695169480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1695169480',id=12,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFN6MEwyUWk8GSmHy1bNd9rONr8OYvJnOKizV3jBEue+Dp6QzKo81hoNph+ojxxVeX39WSSYot1LYMhIoRx0iJpNwiKpZtbgjHAAjMlNS/SHmKZc2KEOeHCAZCZthW3ROw==',key_name='tempest-keypair-518302348',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d334446f1c65465885717aab3fb6c78b',ramdisk_id='',reservation_id='r-xgkc4yau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1196788905',owner_user_name='tempest-TaggedBootDevicesTest_v242-1196788905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:50:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9cf909ee96b249c98a98547cab18fcef',uuid=af9e5a26-f865-4563-aed9-34b8ed5b6697,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8d28630-5645-4f2e-b7d3-2b0ac060ea43", "address": "fa:16:3e:0e:35:01", "network": {"id": "55373264-0376-4835-a5b6-4dbe7fbc0423", "bridge": "br-int", "label": "tempest-device-tagging-net1-1542107900", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8d28630-56", "ovs_interfaceid": "d8d28630-5645-4f2e-b7d3-2b0ac060ea43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Converting VIF {"id": "d8d28630-5645-4f2e-b7d3-2b0ac060ea43", "address": "fa:16:3e:0e:35:01", "network": {"id": "55373264-0376-4835-a5b6-4dbe7fbc0423", "bridge": "br-int", "label": "tempest-device-tagging-net1-1542107900", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8d28630-56", "ovs_interfaceid": "d8d28630-5645-4f2e-b7d3-2b0ac060ea43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:35:01,bridge_name='br-int',has_traffic_filtering=True,id=d8d28630-5645-4f2e-b7d3-2b0ac060ea43,network=Network(55373264-0376-4835-a5b6-4dbe7fbc0423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd8d28630-56') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG os_vif [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:35:01,bridge_name='br-int',has_traffic_filtering=True,id=d8d28630-5645-4f2e-b7d3-2b0ac060ea43,network=Network(55373264-0376-4835-a5b6-4dbe7fbc0423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd8d28630-56') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5cd04b6c-279f-517f-881d-bf6776ef5663', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd8d28630-56, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd8d28630-56, col_values=(('qos', UUID('667f5bf8-9684-4ba8-a335-e3d465050ff2')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd8d28630-56, col_values=(('external_ids', {'iface-id': 'd8d28630-5645-4f2e-b7d3-2b0ac060ea43', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:35:01', 'vm-uuid': 'af9e5a26-f865-4563-aed9-34b8ed5b6697'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:48 user nova-compute[74994]: INFO os_vif [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:35:01,bridge_name='br-int',has_traffic_filtering=True,id=d8d28630-5645-4f2e-b7d3-2b0ac060ea43,network=Network(55373264-0376-4835-a5b6-4dbe7fbc0423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd8d28630-56')
Nov 28 10:50:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:50:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1695169480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1695169480',id=12,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFN6MEwyUWk8GSmHy1bNd9rONr8OYvJnOKizV3jBEue+Dp6QzKo81hoNph+ojxxVeX39WSSYot1LYMhIoRx0iJpNwiKpZtbgjHAAjMlNS/SHmKZc2KEOeHCAZCZthW3ROw==',key_name='tempest-keypair-518302348',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d334446f1c65465885717aab3fb6c78b',ramdisk_id='',reservation_id='r-xgkc4yau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1196788905',owner_user_name='tempest-TaggedBootDevicesTest_v242-1196788905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:50:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9cf909ee96b249c98a98547cab18fcef',uuid=af9e5a26-f865-4563-aed9-34b8ed5b6697,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6ce548a-c7d7-4f70-8411-7809489f0a91", "address": "fa:16:3e:4e:fc:91", "network": {"id": "55373264-0376-4835-a5b6-4dbe7fbc0423", "bridge": "br-int", "label": "tempest-device-tagging-net1-1542107900", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ce548a-c7", "ovs_interfaceid": "e6ce548a-c7d7-4f70-8411-7809489f0a91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Converting VIF {"id": "e6ce548a-c7d7-4f70-8411-7809489f0a91", "address": "fa:16:3e:4e:fc:91", "network": {"id": "55373264-0376-4835-a5b6-4dbe7fbc0423", "bridge": "br-int", "label": "tempest-device-tagging-net1-1542107900", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ce548a-c7", "ovs_interfaceid": "e6ce548a-c7d7-4f70-8411-7809489f0a91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:fc:91,bridge_name='br-int',has_traffic_filtering=True,id=e6ce548a-c7d7-4f70-8411-7809489f0a91,network=Network(55373264-0376-4835-a5b6-4dbe7fbc0423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6ce548a-c7') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG os_vif [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:fc:91,bridge_name='br-int',has_traffic_filtering=True,id=e6ce548a-c7d7-4f70-8411-7809489f0a91,network=Network(55373264-0376-4835-a5b6-4dbe7fbc0423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6ce548a-c7') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9bb43346-7382-5fed-aec3-c47936567d63', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6ce548a-c7, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape6ce548a-c7, col_values=(('qos', UUID('0ad4f918-1118-403a-afd8-44aa884c664a')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape6ce548a-c7, col_values=(('external_ids', {'iface-id': 'e6ce548a-c7d7-4f70-8411-7809489f0a91', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:fc:91', 'vm-uuid': 'af9e5a26-f865-4563-aed9-34b8ed5b6697'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:48 user nova-compute[74994]: INFO os_vif [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:fc:91,bridge_name='br-int',has_traffic_filtering=True,id=e6ce548a-c7d7-4f70-8411-7809489f0a91,network=Network(55373264-0376-4835-a5b6-4dbe7fbc0423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6ce548a-c7')
Nov 28 10:50:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:50:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1695169480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1695169480',id=12,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFN6MEwyUWk8GSmHy1bNd9rONr8OYvJnOKizV3jBEue+Dp6QzKo81hoNph+ojxxVeX39WSSYot1LYMhIoRx0iJpNwiKpZtbgjHAAjMlNS/SHmKZc2KEOeHCAZCZthW3ROw==',key_name='tempest-keypair-518302348',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d334446f1c65465885717aab3fb6c78b',ramdisk_id='',reservation_id='r-xgkc4yau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1196788905',owner_user_name='tempest-TaggedBootDevicesTest_v242-1196788905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:50:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9cf909ee96b249c98a98547cab18fcef',uuid=af9e5a26-f865-4563-aed9-34b8ed5b6697,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d482201-d7ff-4dcc-9a23-a399a27c69f3", "address": "fa:16:3e:b1:aa:d2", "network": {"id": "55373264-0376-4835-a5b6-4dbe7fbc0423", "bridge": "br-int", "label": "tempest-device-tagging-net1-1542107900", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d482201-d7", "ovs_interfaceid": "6d482201-d7ff-4dcc-9a23-a399a27c69f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Converting VIF {"id": "6d482201-d7ff-4dcc-9a23-a399a27c69f3", "address": "fa:16:3e:b1:aa:d2", "network": {"id": "55373264-0376-4835-a5b6-4dbe7fbc0423", "bridge": "br-int", "label": "tempest-device-tagging-net1-1542107900", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d482201-d7", "ovs_interfaceid": "6d482201-d7ff-4dcc-9a23-a399a27c69f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:aa:d2,bridge_name='br-int',has_traffic_filtering=True,id=6d482201-d7ff-4dcc-9a23-a399a27c69f3,network=Network(55373264-0376-4835-a5b6-4dbe7fbc0423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d482201-d7') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG os_vif [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:aa:d2,bridge_name='br-int',has_traffic_filtering=True,id=6d482201-d7ff-4dcc-9a23-a399a27c69f3,network=Network(55373264-0376-4835-a5b6-4dbe7fbc0423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d482201-d7') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2a184695-722a-5d07-a8a7-7e0a30c9ef76', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d482201-d7, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6d482201-d7, col_values=(('qos', UUID('0ec379c3-e3da-4de7-a835-87654083d858')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6d482201-d7, col_values=(('external_ids', {'iface-id': '6d482201-d7ff-4dcc-9a23-a399a27c69f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:aa:d2', 'vm-uuid': 'af9e5a26-f865-4563-aed9-34b8ed5b6697'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:48 user nova-compute[74994]: INFO os_vif [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:aa:d2,bridge_name='br-int',has_traffic_filtering=True,id=6d482201-d7ff-4dcc-9a23-a399a27c69f3,network=Network(55373264-0376-4835-a5b6-4dbe7fbc0423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d482201-d7')
Nov 28 10:50:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:50:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1695169480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1695169480',id=12,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFN6MEwyUWk8GSmHy1bNd9rONr8OYvJnOKizV3jBEue+Dp6QzKo81hoNph+ojxxVeX39WSSYot1LYMhIoRx0iJpNwiKpZtbgjHAAjMlNS/SHmKZc2KEOeHCAZCZthW3ROw==',key_name='tempest-keypair-518302348',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d334446f1c65465885717aab3fb6c78b',ramdisk_id='',reservation_id='r-xgkc4yau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1196788905',owner_user_name='tempest-TaggedBootDevicesTest_v242-1196788905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:50:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9cf909ee96b249c98a98547cab18fcef',uuid=af9e5a26-f865-4563-aed9-34b8ed5b6697,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da486672-f1e9-4bbe-8d5a-e9f2f0ad5119", "address": "fa:16:3e:56:1d:f4", "network": {"id": "e32d74f0-a6b2-4c07-b2b1-9c3bc9a6b4a5", "bridge": "br-int", "label": "tempest-device-tagging-net2-207234115", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda486672-f1", "ovs_interfaceid": "da486672-f1e9-4bbe-8d5a-e9f2f0ad5119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Converting VIF {"id": "da486672-f1e9-4bbe-8d5a-e9f2f0ad5119", "address": "fa:16:3e:56:1d:f4", "network": {"id": "e32d74f0-a6b2-4c07-b2b1-9c3bc9a6b4a5", "bridge": "br-int", "label": "tempest-device-tagging-net2-207234115", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda486672-f1", "ovs_interfaceid": "da486672-f1e9-4bbe-8d5a-e9f2f0ad5119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:1d:f4,bridge_name='br-int',has_traffic_filtering=True,id=da486672-f1e9-4bbe-8d5a-e9f2f0ad5119,network=Network(e32d74f0-a6b2-4c07-b2b1-9c3bc9a6b4a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda486672-f1') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG os_vif [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:1d:f4,bridge_name='br-int',has_traffic_filtering=True,id=da486672-f1e9-4bbe-8d5a-e9f2f0ad5119,network=Network(e32d74f0-a6b2-4c07-b2b1-9c3bc9a6b4a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda486672-f1') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bbe272ae-5914-5a5b-8fb5-286d27012b18', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda486672-f1, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapda486672-f1, col_values=(('qos', UUID('2a502765-1ab6-4d63-8f8e-759d46f8e4fd')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapda486672-f1, col_values=(('external_ids', {'iface-id': 'da486672-f1e9-4bbe-8d5a-e9f2f0ad5119', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:1d:f4', 'vm-uuid': 'af9e5a26-f865-4563-aed9-34b8ed5b6697'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:50:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:49 user nova-compute[74994]: INFO os_vif [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:1d:f4,bridge_name='br-int',has_traffic_filtering=True,id=da486672-f1e9-4bbe-8d5a-e9f2f0ad5119,network=Network(e32d74f0-a6b2-4c07-b2b1-9c3bc9a6b4a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda486672-f1')
Nov 28 10:50:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:50:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1695169480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1695169480',id=12,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFN6MEwyUWk8GSmHy1bNd9rONr8OYvJnOKizV3jBEue+Dp6QzKo81hoNph+ojxxVeX39WSSYot1LYMhIoRx0iJpNwiKpZtbgjHAAjMlNS/SHmKZc2KEOeHCAZCZthW3ROw==',key_name='tempest-keypair-518302348',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d334446f1c65465885717aab3fb6c78b',ramdisk_id='',reservation_id='r-xgkc4yau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1196788905',owner_user_name='tempest-TaggedBootDevicesTest_v242-1196788905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:50:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9cf909ee96b249c98a98547cab18fcef',uuid=af9e5a26-f865-4563-aed9-34b8ed5b6697,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9330afbb-83bf-4674-8eda-d091eb2670e5", "address": "fa:16:3e:78:0e:99", "network": {"id": "e32d74f0-a6b2-4c07-b2b1-9c3bc9a6b4a5", "bridge": "br-int", "label": "tempest-device-tagging-net2-207234115", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9330afbb-83", "ovs_interfaceid": "9330afbb-83bf-4674-8eda-d091eb2670e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 10:50:49 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Converting VIF {"id": "9330afbb-83bf-4674-8eda-d091eb2670e5", "address": "fa:16:3e:78:0e:99", "network": {"id": "e32d74f0-a6b2-4c07-b2b1-9c3bc9a6b4a5", "bridge": "br-int", "label": "tempest-device-tagging-net2-207234115", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9330afbb-83", "ovs_interfaceid": "9330afbb-83bf-4674-8eda-d091eb2670e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:50:49 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:0e:99,bridge_name='br-int',has_traffic_filtering=True,id=9330afbb-83bf-4674-8eda-d091eb2670e5,network=Network(e32d74f0-a6b2-4c07-b2b1-9c3bc9a6b4a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9330afbb-83') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:50:49 user nova-compute[74994]: DEBUG os_vif [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:0e:99,bridge_name='br-int',has_traffic_filtering=True,id=9330afbb-83bf-4674-8eda-d091eb2670e5,network=Network(e32d74f0-a6b2-4c07-b2b1-9c3bc9a6b4a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9330afbb-83') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 10:50:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:50:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 10:50:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '71479552-5dda-5f91-9ac8-e6c2834f0f2b', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:50:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:50:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9330afbb-83, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:50:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9330afbb-83, col_values=(('qos', UUID('b630b4b3-57b5-4a93-9ae4-80f2ea6d1d65')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:50:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9330afbb-83, col_values=(('external_ids', {'iface-id': '9330afbb-83bf-4674-8eda-d091eb2670e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:0e:99', 'vm-uuid': 'af9e5a26-f865-4563-aed9-34b8ed5b6697'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:50:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:50:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:49 user nova-compute[74994]: INFO os_vif [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:0e:99,bridge_name='br-int',has_traffic_filtering=True,id=9330afbb-83bf-4674-8eda-d091eb2670e5,network=Network(e32d74f0-a6b2-4c07-b2b1-9c3bc9a6b4a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9330afbb-83')
Nov 28 10:50:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] No BDM found with device name hda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:50:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:50:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] No VIF found with MAC fa:16:3e:fa:03:33, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:50:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] No VIF found with MAC fa:16:3e:b1:aa:d2, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:50:49 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Using config drive
Nov 28 10:50:49 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Creating config drive at /opt/stack/data/nova/instances/af9e5a26-f865-4563-aed9-34b8ed5b6697/disk.config
Nov 28 10:50:49 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/af9e5a26-f865-4563-aed9-34b8ed5b6697/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprc7y_a6x {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:49 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/af9e5a26-f865-4563-aed9-34b8ed5b6697/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprc7y_a6x" returned: 0 in 0.052s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:51 user nova-compute[74994]: DEBUG nova.compute.manager [req-4b587fbb-da6c-41ea-84c1-a2ddc2fc92c9 req-a6eae0f2-a1b6-496c-b654-0cbf3a3121b7 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received event network-vif-plugged-7ca13785-4bcf-42f6-b804-36f3c3cd1b82 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:50:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4b587fbb-da6c-41ea-84c1-a2ddc2fc92c9 req-a6eae0f2-a1b6-496c-b654-0cbf3a3121b7 service nova] Acquiring lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:50:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4b587fbb-da6c-41ea-84c1-a2ddc2fc92c9 req-a6eae0f2-a1b6-496c-b654-0cbf3a3121b7 service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:50:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4b587fbb-da6c-41ea-84c1-a2ddc2fc92c9 req-a6eae0f2-a1b6-496c-b654-0cbf3a3121b7 service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:50:51 user nova-compute[74994]: DEBUG nova.compute.manager [req-4b587fbb-da6c-41ea-84c1-a2ddc2fc92c9 req-a6eae0f2-a1b6-496c-b654-0cbf3a3121b7 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] No waiting events found dispatching network-vif-plugged-7ca13785-4bcf-42f6-b804-36f3c3cd1b82 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:50:51 user nova-compute[74994]: WARNING nova.compute.manager [req-4b587fbb-da6c-41ea-84c1-a2ddc2fc92c9 req-a6eae0f2-a1b6-496c-b654-0cbf3a3121b7 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received unexpected event network-vif-plugged-7ca13785-4bcf-42f6-b804-36f3c3cd1b82 for instance with vm_state building and task_state spawning.
Nov 28 10:50:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:51 user nova-compute[74994]: DEBUG nova.compute.manager [req-adde8c2b-16d4-4949-89ba-25fb2666067a req-21ec11cc-6813-44a6-bd26-5685008f107e service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received event network-vif-plugged-f049d45c-915d-4517-8799-8d8200a45b49 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:50:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-adde8c2b-16d4-4949-89ba-25fb2666067a req-21ec11cc-6813-44a6-bd26-5685008f107e service nova] Acquiring lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:50:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-adde8c2b-16d4-4949-89ba-25fb2666067a req-21ec11cc-6813-44a6-bd26-5685008f107e service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:50:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-adde8c2b-16d4-4949-89ba-25fb2666067a req-21ec11cc-6813-44a6-bd26-5685008f107e service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:50:51 user nova-compute[74994]: DEBUG nova.compute.manager [req-adde8c2b-16d4-4949-89ba-25fb2666067a req-21ec11cc-6813-44a6-bd26-5685008f107e service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] No waiting events found dispatching network-vif-plugged-f049d45c-915d-4517-8799-8d8200a45b49 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:50:51 user nova-compute[74994]: WARNING nova.compute.manager [req-adde8c2b-16d4-4949-89ba-25fb2666067a req-21ec11cc-6813-44a6-bd26-5685008f107e service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received unexpected event network-vif-plugged-f049d45c-915d-4517-8799-8d8200a45b49 for instance with vm_state building and task_state spawning.
Nov 28 10:50:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG nova.compute.manager [req-4ea75c7f-fc7a-4ea6-992f-6b01aecce091 req-0c319919-642d-4f69-9781-d10e36d95e5d service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received event network-vif-plugged-7ca13785-4bcf-42f6-b804-36f3c3cd1b82 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4ea75c7f-fc7a-4ea6-992f-6b01aecce091 req-0c319919-642d-4f69-9781-d10e36d95e5d service nova] Acquiring lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4ea75c7f-fc7a-4ea6-992f-6b01aecce091 req-0c319919-642d-4f69-9781-d10e36d95e5d service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4ea75c7f-fc7a-4ea6-992f-6b01aecce091 req-0c319919-642d-4f69-9781-d10e36d95e5d service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG nova.compute.manager [req-4ea75c7f-fc7a-4ea6-992f-6b01aecce091 req-0c319919-642d-4f69-9781-d10e36d95e5d service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] No waiting events found dispatching network-vif-plugged-7ca13785-4bcf-42f6-b804-36f3c3cd1b82 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:50:53 user nova-compute[74994]: WARNING nova.compute.manager [req-4ea75c7f-fc7a-4ea6-992f-6b01aecce091 req-0c319919-642d-4f69-9781-d10e36d95e5d service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received unexpected event network-vif-plugged-7ca13785-4bcf-42f6-b804-36f3c3cd1b82 for instance with vm_state building and task_state spawning.
Nov 28 10:50:53 user nova-compute[74994]: DEBUG nova.compute.manager [req-4ea75c7f-fc7a-4ea6-992f-6b01aecce091 req-0c319919-642d-4f69-9781-d10e36d95e5d service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received event network-vif-plugged-9330afbb-83bf-4674-8eda-d091eb2670e5 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4ea75c7f-fc7a-4ea6-992f-6b01aecce091 req-0c319919-642d-4f69-9781-d10e36d95e5d service nova] Acquiring lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4ea75c7f-fc7a-4ea6-992f-6b01aecce091 req-0c319919-642d-4f69-9781-d10e36d95e5d service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4ea75c7f-fc7a-4ea6-992f-6b01aecce091 req-0c319919-642d-4f69-9781-d10e36d95e5d service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG nova.compute.manager [req-4ea75c7f-fc7a-4ea6-992f-6b01aecce091 req-0c319919-642d-4f69-9781-d10e36d95e5d service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] No waiting events found dispatching network-vif-plugged-9330afbb-83bf-4674-8eda-d091eb2670e5 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:50:53 user nova-compute[74994]: WARNING nova.compute.manager [req-4ea75c7f-fc7a-4ea6-992f-6b01aecce091 req-0c319919-642d-4f69-9781-d10e36d95e5d service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received unexpected event network-vif-plugged-9330afbb-83bf-4674-8eda-d091eb2670e5 for instance with vm_state building and task_state spawning.
Nov 28 10:50:53 user nova-compute[74994]: DEBUG nova.compute.manager [req-4ea75c7f-fc7a-4ea6-992f-6b01aecce091 req-0c319919-642d-4f69-9781-d10e36d95e5d service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received event network-vif-plugged-9330afbb-83bf-4674-8eda-d091eb2670e5 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4ea75c7f-fc7a-4ea6-992f-6b01aecce091 req-0c319919-642d-4f69-9781-d10e36d95e5d service nova] Acquiring lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4ea75c7f-fc7a-4ea6-992f-6b01aecce091 req-0c319919-642d-4f69-9781-d10e36d95e5d service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4ea75c7f-fc7a-4ea6-992f-6b01aecce091 req-0c319919-642d-4f69-9781-d10e36d95e5d service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG nova.compute.manager [req-4ea75c7f-fc7a-4ea6-992f-6b01aecce091 req-0c319919-642d-4f69-9781-d10e36d95e5d service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] No waiting events found dispatching network-vif-plugged-9330afbb-83bf-4674-8eda-d091eb2670e5 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:50:53 user nova-compute[74994]: WARNING nova.compute.manager [req-4ea75c7f-fc7a-4ea6-992f-6b01aecce091 req-0c319919-642d-4f69-9781-d10e36d95e5d service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received unexpected event network-vif-plugged-9330afbb-83bf-4674-8eda-d091eb2670e5 for instance with vm_state building and task_state spawning.
Nov 28 10:50:53 user nova-compute[74994]: DEBUG nova.compute.manager [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received event network-vif-plugged-f049d45c-915d-4517-8799-8d8200a45b49 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] Acquiring lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG nova.compute.manager [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] No waiting events found dispatching network-vif-plugged-f049d45c-915d-4517-8799-8d8200a45b49 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:50:53 user nova-compute[74994]: WARNING nova.compute.manager [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received unexpected event network-vif-plugged-f049d45c-915d-4517-8799-8d8200a45b49 for instance with vm_state building and task_state spawning.
Nov 28 10:50:53 user nova-compute[74994]: DEBUG nova.compute.manager [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received event network-vif-plugged-d8d28630-5645-4f2e-b7d3-2b0ac060ea43 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] Acquiring lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG nova.compute.manager [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] No waiting events found dispatching network-vif-plugged-d8d28630-5645-4f2e-b7d3-2b0ac060ea43 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:50:53 user nova-compute[74994]: WARNING nova.compute.manager [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received unexpected event network-vif-plugged-d8d28630-5645-4f2e-b7d3-2b0ac060ea43 for instance with vm_state building and task_state spawning.
Nov 28 10:50:53 user nova-compute[74994]: DEBUG nova.compute.manager [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received event network-vif-plugged-d8d28630-5645-4f2e-b7d3-2b0ac060ea43 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] Acquiring lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG nova.compute.manager [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] No waiting events found dispatching network-vif-plugged-d8d28630-5645-4f2e-b7d3-2b0ac060ea43 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:50:53 user nova-compute[74994]: WARNING nova.compute.manager [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received unexpected event network-vif-plugged-d8d28630-5645-4f2e-b7d3-2b0ac060ea43 for instance with vm_state building and task_state spawning.
Nov 28 10:50:53 user nova-compute[74994]: DEBUG nova.compute.manager [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received event network-vif-plugged-e6ce548a-c7d7-4f70-8411-7809489f0a91 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] Acquiring lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG nova.compute.manager [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] No waiting events found dispatching network-vif-plugged-e6ce548a-c7d7-4f70-8411-7809489f0a91 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:50:53 user nova-compute[74994]: WARNING nova.compute.manager [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received unexpected event network-vif-plugged-e6ce548a-c7d7-4f70-8411-7809489f0a91 for instance with vm_state building and task_state spawning.
Nov 28 10:50:53 user nova-compute[74994]: DEBUG nova.compute.manager [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received event network-vif-plugged-e6ce548a-c7d7-4f70-8411-7809489f0a91 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] Acquiring lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG nova.compute.manager [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] No waiting events found dispatching network-vif-plugged-e6ce548a-c7d7-4f70-8411-7809489f0a91 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:50:53 user nova-compute[74994]: WARNING nova.compute.manager [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received unexpected event network-vif-plugged-e6ce548a-c7d7-4f70-8411-7809489f0a91 for instance with vm_state building and task_state spawning.
Nov 28 10:50:53 user nova-compute[74994]: DEBUG nova.compute.manager [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received event network-vif-plugged-6d482201-d7ff-4dcc-9a23-a399a27c69f3 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] Acquiring lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG nova.compute.manager [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] No waiting events found dispatching network-vif-plugged-6d482201-d7ff-4dcc-9a23-a399a27c69f3 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:50:53 user nova-compute[74994]: WARNING nova.compute.manager [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received unexpected event network-vif-plugged-6d482201-d7ff-4dcc-9a23-a399a27c69f3 for instance with vm_state building and task_state spawning.
Nov 28 10:50:53 user nova-compute[74994]: DEBUG nova.compute.manager [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received event network-vif-plugged-6d482201-d7ff-4dcc-9a23-a399a27c69f3 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] Acquiring lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG nova.compute.manager [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] No waiting events found dispatching network-vif-plugged-6d482201-d7ff-4dcc-9a23-a399a27c69f3 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:50:53 user nova-compute[74994]: WARNING nova.compute.manager [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received unexpected event network-vif-plugged-6d482201-d7ff-4dcc-9a23-a399a27c69f3 for instance with vm_state building and task_state spawning.
Nov 28 10:50:53 user nova-compute[74994]: DEBUG nova.compute.manager [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received event network-vif-plugged-da486672-f1e9-4bbe-8d5a-e9f2f0ad5119 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] Acquiring lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG nova.compute.manager [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] No waiting events found dispatching network-vif-plugged-da486672-f1e9-4bbe-8d5a-e9f2f0ad5119 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:50:53 user nova-compute[74994]: WARNING nova.compute.manager [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received unexpected event network-vif-plugged-da486672-f1e9-4bbe-8d5a-e9f2f0ad5119 for instance with vm_state building and task_state spawning.
Nov 28 10:50:53 user nova-compute[74994]: DEBUG nova.compute.manager [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received event network-vif-plugged-da486672-f1e9-4bbe-8d5a-e9f2f0ad5119 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] Acquiring lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG nova.compute.manager [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] No waiting events found dispatching network-vif-plugged-da486672-f1e9-4bbe-8d5a-e9f2f0ad5119 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:50:53 user nova-compute[74994]: WARNING nova.compute.manager [req-66378f30-b5b8-4ad6-a701-707e713eaff3 req-9793f611-448c-4b03-8cb2-8c4544b89226 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received unexpected event network-vif-plugged-da486672-f1e9-4bbe-8d5a-e9f2f0ad5119 for instance with vm_state building and task_state spawning.
Nov 28 10:50:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:54 user nova-compute[74994]: DEBUG nova.compute.manager [None req-b74e91db-b9cf-4c98-bab4-d21c13982ba6 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 10:50:54 user nova-compute[74994]: INFO nova.compute.manager [None req-b74e91db-b9cf-4c98-bab4-d21c13982ba6 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] instance snapshotting
Nov 28 10:50:54 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-b74e91db-b9cf-4c98-bab4-d21c13982ba6 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Beginning live snapshot process
Nov 28 10:50:54 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-b74e91db-b9cf-4c98-bab4-d21c13982ba6 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json -f qcow2 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:54 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-b74e91db-b9cf-4c98-bab4-d21c13982ba6 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:54 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-b74e91db-b9cf-4c98-bab4-d21c13982ba6 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json -f qcow2 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:54 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-b74e91db-b9cf-4c98-bab4-d21c13982ba6 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json -f qcow2" returned: 0 in 0.170s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:54 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-b74e91db-b9cf-4c98-bab4-d21c13982ba6 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:54 user nova-compute[74994]: DEBUG nova.compute.manager [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 10:50:54 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 10:50:55 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Instance spawned successfully.
Nov 28 10:50:55 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 10:50:55 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:50:55 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:50:55 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:50:55 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:50:55 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:50:55 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:50:55 user nova-compute[74994]: INFO nova.compute.manager [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Took 10.80 seconds to spawn the instance on the hypervisor.
Nov 28 10:50:55 user nova-compute[74994]: DEBUG nova.compute.manager [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 10:50:55 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-b74e91db-b9cf-4c98-bab4-d21c13982ba6 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.193s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:55 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-b74e91db-b9cf-4c98-bab4-d21c13982ba6 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphjvdl2fm/5b19f84f5da940818ab1eba6edfd49d5.delta 1073741824 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:55 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-b74e91db-b9cf-4c98-bab4-d21c13982ba6 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphjvdl2fm/5b19f84f5da940818ab1eba6edfd49d5.delta 1073741824" returned: 0 in 0.053s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:55 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-b74e91db-b9cf-4c98-bab4-d21c13982ba6 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 28 10:50:55 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b74e91db-b9cf-4c98-bab4-d21c13982ba6 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74994) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1753}}
Nov 28 10:50:55 user nova-compute[74994]: INFO nova.virt.libvirt.host [None req-b74e91db-b9cf-4c98-bab4-d21c13982ba6 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] UEFI support detected
Nov 28 10:50:55 user nova-compute[74994]: INFO nova.compute.manager [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Took 34.47 seconds to build instance.
Nov 28 10:50:55 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-392a9eaa-3a30-4edb-9409-e7ac423a8e8e tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 34.578s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:50:55 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-b74e91db-b9cf-4c98-bab4-d21c13982ba6 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 10:50:56 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-b74e91db-b9cf-4c98-bab4-d21c13982ba6 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 10:50:56 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-b74e91db-b9cf-4c98-bab4-d21c13982ba6 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 28 10:50:56 user nova-compute[74994]: DEBUG nova.privsep.utils [None req-b74e91db-b9cf-4c98-bab4-d21c13982ba6 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74994) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 10:50:56 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-b74e91db-b9cf-4c98-bab4-d21c13982ba6 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphjvdl2fm/5b19f84f5da940818ab1eba6edfd49d5.delta /opt/stack/data/nova/instances/snapshots/tmphjvdl2fm/5b19f84f5da940818ab1eba6edfd49d5 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Acquiring lock "a8b4b5dc-0696-4a01-8318-7d3ec2014d6e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:50:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Lock "a8b4b5dc-0696-4a01-8318-7d3ec2014d6e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:50:57 user nova-compute[74994]: INFO nova.compute.manager [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Rescuing
Nov 28 10:50:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquiring lock "refresh_cache-279e1c4c-36f9-492f-ab3f-1b587347eadd" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:50:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquired lock "refresh_cache-279e1c4c-36f9-492f-ab3f-1b587347eadd" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:50:57 user nova-compute[74994]: DEBUG nova.network.neutron [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 10:50:57 user nova-compute[74994]: DEBUG nova.objects.instance [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Lazy-loading 'flavor' on Instance uuid a8b4b5dc-0696-4a01-8318-7d3ec2014d6e {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:50:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Lock "a8b4b5dc-0696-4a01-8318-7d3ec2014d6e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.088s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:50:57 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-b74e91db-b9cf-4c98-bab4-d21c13982ba6 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphjvdl2fm/5b19f84f5da940818ab1eba6edfd49d5.delta /opt/stack/data/nova/instances/snapshots/tmphjvdl2fm/5b19f84f5da940818ab1eba6edfd49d5" returned: 0 in 0.613s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:57 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-b74e91db-b9cf-4c98-bab4-d21c13982ba6 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Snapshot extracted, beginning image upload
Nov 28 10:50:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Acquiring lock "a8b4b5dc-0696-4a01-8318-7d3ec2014d6e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:50:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Lock "a8b4b5dc-0696-4a01-8318-7d3ec2014d6e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:50:57 user nova-compute[74994]: INFO nova.compute.manager [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Attaching volume c7b4d4f9-945c-40c4-b5ac-b2744973727a to /dev/vdb
Nov 28 10:50:57 user nova-compute[74994]: DEBUG os_brick.utils [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:50:57 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:57 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:57 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[16824460-dcf1-4df4-b5d3-7b9080d2aefe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:57 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:57 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:57 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb4e3c9-ff88-4728-ba21-6d42fbbcc159]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:57 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:57 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:57 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c47101-fece-4d6b-bf15-6841e42f45b1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:57 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc75521-9ebd-4340-a22e-6b0458c52fb6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:57 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:57 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:50:57 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 10:50:57 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:57 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:50:57 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 10:50:57 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d7a066-22f9-4ce1-8121-da47e7d773ad]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:50:57 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 10:50:57 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 10:50:57 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 10:50:57 user nova-compute[74994]: DEBUG os_brick.utils [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:50:57 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Updating existing volume attachment record: 740cc232-7ba5-4039-8689-1004f2b77d72 {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 10:50:57 user nova-compute[74994]: DEBUG nova.network.neutron [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Updating instance_info_cache with network_info: [{"id": "aeaddf62-0ca1-40d1-9228-897ee0015d4a", "address": "fa:16:3e:bc:02:82", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeaddf62-0c", "ovs_interfaceid": "aeaddf62-0ca1-40d1-9228-897ee0015d4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:50:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Releasing lock "refresh_cache-279e1c4c-36f9-492f-ab3f-1b587347eadd" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:50:57 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:58 user nova-compute[74994]: DEBUG nova.compute.manager [req-236729cb-3ef7-4a09-8c14-17d83af134cf req-934cfa23-f485-42de-a9e3-f393ef0efd6d service nova] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Received event network-vif-unplugged-aeaddf62-0ca1-40d1-9228-897ee0015d4a {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:50:58 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-236729cb-3ef7-4a09-8c14-17d83af134cf req-934cfa23-f485-42de-a9e3-f393ef0efd6d service nova] Acquiring lock "279e1c4c-36f9-492f-ab3f-1b587347eadd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:50:58 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-236729cb-3ef7-4a09-8c14-17d83af134cf req-934cfa23-f485-42de-a9e3-f393ef0efd6d service nova] Lock "279e1c4c-36f9-492f-ab3f-1b587347eadd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:50:58 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-236729cb-3ef7-4a09-8c14-17d83af134cf req-934cfa23-f485-42de-a9e3-f393ef0efd6d service nova] Lock "279e1c4c-36f9-492f-ab3f-1b587347eadd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:50:58 user nova-compute[74994]: DEBUG nova.compute.manager [req-236729cb-3ef7-4a09-8c14-17d83af134cf req-934cfa23-f485-42de-a9e3-f393ef0efd6d service nova] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] No waiting events found dispatching network-vif-unplugged-aeaddf62-0ca1-40d1-9228-897ee0015d4a {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:50:58 user nova-compute[74994]: WARNING nova.compute.manager [req-236729cb-3ef7-4a09-8c14-17d83af134cf req-934cfa23-f485-42de-a9e3-f393ef0efd6d service nova] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Received unexpected event network-vif-unplugged-aeaddf62-0ca1-40d1-9228-897ee0015d4a for instance with vm_state active and task_state rescuing.
Nov 28 10:50:58 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Instance destroyed successfully.
Nov 28 10:50:58 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Attempting rescue
Nov 28 10:50:58 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74994) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 10:50:58 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Instance directory exists: not creating {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 10:50:58 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Creating image(s)
Nov 28 10:50:58 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquiring lock "/opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:50:58 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "/opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:50:58 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "/opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:50:58 user nova-compute[74994]: DEBUG nova.objects.instance [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lazy-loading 'trusted_certs' on Instance uuid 279e1c4c-36f9-492f-ab3f-1b587347eadd {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:50:58 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Acquiring lock "bc114bed-8d7e-46e0-86a7-7eed7ce75b5c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:50:58 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Lock "bc114bed-8d7e-46e0-86a7-7eed7ce75b5c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:50:58 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquiring lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:50:58 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:50:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:58 user nova-compute[74994]: DEBUG nova.compute.manager [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 10:50:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:58 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:50:58 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:50:58 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 10:50:58 user nova-compute[74994]: INFO nova.compute.claims [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Claim successful on node user
Nov 28 10:50:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.196s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue" returned: 0 in 0.060s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG nova.objects.instance [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lazy-loading 'migration_context' on Instance uuid 279e1c4c-36f9-492f-ab3f-1b587347eadd {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG nova.objects.base [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Object Instance<279e1c4c-36f9-492f-ab3f-1b587347eadd> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Created local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Start _get_guest_xml network_info=[{"id": "aeaddf62-0ca1-40d1-9228-897ee0015d4a", "address": "fa:16:3e:bc:02:82", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "vif_mac": "fa:16:3e:bc:02:82"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeaddf62-0c", "ovs_interfaceid": "aeaddf62-0ca1-40d1-9228-897ee0015d4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'aa939d1b-b8a6-4391-935b-0191bf5ccd0a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG nova.objects.instance [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lazy-loading 'resources' on Instance uuid 279e1c4c-36f9-492f-ab3f-1b587347eadd {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG nova.objects.base [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Object Instance<279e1c4c-36f9-492f-ab3f-1b587347eadd> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG nova.objects.instance [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lazy-loading 'numa_topology' on Instance uuid 279e1c4c-36f9-492f-ab3f-1b587347eadd {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG nova.objects.base [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Object Instance<279e1c4c-36f9-492f-ab3f-1b587347eadd> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 10:50:59 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:50:59 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:50:59 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG nova.objects.instance [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lazy-loading 'vcpu_model' on Instance uuid 279e1c4c-36f9-492f-ab3f-1b587347eadd {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG nova.objects.base [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Object Instance<279e1c4c-36f9-492f-ab3f-1b587347eadd> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:49:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-262139967',display_name='tempest-ServerRescueNegativeTestJSON-server-262139967',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-262139967',id=4,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:49:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77126f6f39db4a628b74551ea7d0aa21',ramdisk_id='',reservation_id='r-xeb42ckc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1900175697',owner_user_name='tempest-ServerRescueNegativeTestJSON-1900175697-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:49:25Z,user_data=None,user_id='6b5c1a1f2efc4a2faf8b82d467681d45',uuid=279e1c4c-36f9-492f-ab3f-1b587347eadd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aeaddf62-0ca1-40d1-9228-897ee0015d4a", "address": "fa:16:3e:bc:02:82", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "vif_mac": "fa:16:3e:bc:02:82"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeaddf62-0c", "ovs_interfaceid": "aeaddf62-0ca1-40d1-9228-897ee0015d4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Converting VIF {"id": "aeaddf62-0ca1-40d1-9228-897ee0015d4a", "address": "fa:16:3e:bc:02:82", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "vif_mac": "fa:16:3e:bc:02:82"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeaddf62-0c", "ovs_interfaceid": "aeaddf62-0ca1-40d1-9228-897ee0015d4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:02:82,bridge_name='br-int',has_traffic_filtering=True,id=aeaddf62-0ca1-40d1-9228-897ee0015d4a,network=Network(77bc68aa-1654-4e4d-9c65-7515fe6f4b2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeaddf62-0c') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG nova.objects.instance [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lazy-loading 'pci_devices' on Instance uuid 279e1c4c-36f9-492f-ab3f-1b587347eadd {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG nova.objects.base [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Object Instance<279e1c4c-36f9-492f-ab3f-1b587347eadd> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] End _get_guest_xml xml=<domain type="kvm">
Nov 28 10:50:59 user nova-compute[74994]:   <uuid>279e1c4c-36f9-492f-ab3f-1b587347eadd</uuid>
Nov 28 10:50:59 user nova-compute[74994]:   <name>instance-00000004</name>
Nov 28 10:50:59 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 10:50:59 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 10:50:59 user nova-compute[74994]:   <metadata>
Nov 28 10:50:59 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 10:50:59 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 10:50:59 user nova-compute[74994]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-262139967</nova:name>
Nov 28 10:50:59 user nova-compute[74994]:       <nova:creationTime>2023-11-28 10:50:59</nova:creationTime>
Nov 28 10:50:59 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 10:50:59 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 10:50:59 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 10:50:59 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 10:50:59 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 10:50:59 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 10:50:59 user nova-compute[74994]:       </nova:flavor>
Nov 28 10:50:59 user nova-compute[74994]:       <nova:owner>
Nov 28 10:50:59 user nova-compute[74994]:         <nova:user uuid="6b5c1a1f2efc4a2faf8b82d467681d45">tempest-ServerRescueNegativeTestJSON-1900175697-project-member</nova:user>
Nov 28 10:50:59 user nova-compute[74994]:         <nova:project uuid="77126f6f39db4a628b74551ea7d0aa21">tempest-ServerRescueNegativeTestJSON-1900175697</nova:project>
Nov 28 10:50:59 user nova-compute[74994]:       </nova:owner>
Nov 28 10:50:59 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 10:50:59 user nova-compute[74994]:       <nova:ports>
Nov 28 10:50:59 user nova-compute[74994]:         <nova:port uuid="aeaddf62-0ca1-40d1-9228-897ee0015d4a">
Nov 28 10:50:59 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 10:50:59 user nova-compute[74994]:         </nova:port>
Nov 28 10:50:59 user nova-compute[74994]:       </nova:ports>
Nov 28 10:50:59 user nova-compute[74994]:     </nova:instance>
Nov 28 10:50:59 user nova-compute[74994]:   </metadata>
Nov 28 10:50:59 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 10:50:59 user nova-compute[74994]:     <system>
Nov 28 10:50:59 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 10:50:59 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 10:50:59 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 10:50:59 user nova-compute[74994]:       <entry name="serial">279e1c4c-36f9-492f-ab3f-1b587347eadd</entry>
Nov 28 10:50:59 user nova-compute[74994]:       <entry name="uuid">279e1c4c-36f9-492f-ab3f-1b587347eadd</entry>
Nov 28 10:50:59 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 10:50:59 user nova-compute[74994]:     </system>
Nov 28 10:50:59 user nova-compute[74994]:   </sysinfo>
Nov 28 10:50:59 user nova-compute[74994]:   <os>
Nov 28 10:50:59 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 10:50:59 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 10:50:59 user nova-compute[74994]:   </os>
Nov 28 10:50:59 user nova-compute[74994]:   <features>
Nov 28 10:50:59 user nova-compute[74994]:     <acpi/>
Nov 28 10:50:59 user nova-compute[74994]:     <apic/>
Nov 28 10:50:59 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 10:50:59 user nova-compute[74994]:   </features>
Nov 28 10:50:59 user nova-compute[74994]:   <clock offset="utc">
Nov 28 10:50:59 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 10:50:59 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 10:50:59 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 10:50:59 user nova-compute[74994]:   </clock>
Nov 28 10:50:59 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 10:50:59 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 10:50:59 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 10:50:59 user nova-compute[74994]:   </cpu>
Nov 28 10:50:59 user nova-compute[74994]:   <devices>
Nov 28 10:50:59 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 10:50:59 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 10:50:59 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue"/>
Nov 28 10:50:59 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 10:50:59 user nova-compute[74994]:     </disk>
Nov 28 10:50:59 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 10:50:59 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 10:50:59 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk"/>
Nov 28 10:50:59 user nova-compute[74994]:       <target dev="vdb" bus="virtio"/>
Nov 28 10:50:59 user nova-compute[74994]:     </disk>
Nov 28 10:50:59 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 10:50:59 user nova-compute[74994]:       <mac address="fa:16:3e:bc:02:82"/>
Nov 28 10:50:59 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:50:59 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 10:50:59 user nova-compute[74994]:       <target dev="tapaeaddf62-0c"/>
Nov 28 10:50:59 user nova-compute[74994]:     </interface>
Nov 28 10:50:59 user nova-compute[74994]:     <serial type="pty">
Nov 28 10:50:59 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/console.log" append="off"/>
Nov 28 10:50:59 user nova-compute[74994]:     </serial>
Nov 28 10:50:59 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 10:50:59 user nova-compute[74994]:     <video>
Nov 28 10:50:59 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:50:59 user nova-compute[74994]:     </video>
Nov 28 10:50:59 user nova-compute[74994]:     <rng model="virtio">
Nov 28 10:50:59 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 10:50:59 user nova-compute[74994]:     </rng>
Nov 28 10:50:59 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 10:50:59 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 10:50:59 user nova-compute[74994]:       <stats period="10"/>
Nov 28 10:50:59 user nova-compute[74994]:     </memballoon>
Nov 28 10:50:59 user nova-compute[74994]:   </devices>
Nov 28 10:50:59 user nova-compute[74994]: </domain>
Nov 28 10:50:59 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 10:50:59 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Instance destroyed successfully.
Nov 28 10:50:59 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] No VIF found with MAC fa:16:3e:bc:02:82, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.628s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG nova.compute.manager [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG nova.compute.manager [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG nova.network.neutron [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 10:50:59 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 10:50:59 user nova-compute[74994]: DEBUG nova.compute.manager [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG nova.policy [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3c29f1c4e20e4bfd80b1d565b58330aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c23e61575784c8baffda1deda7812fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG nova.compute.manager [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 10:50:59 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Creating image(s)
Nov 28 10:50:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Acquiring lock "/opt/stack/data/nova/instances/bc114bed-8d7e-46e0-86a7-7eed7ce75b5c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Lock "/opt/stack/data/nova/instances/bc114bed-8d7e-46e0-86a7-7eed7ce75b5c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Lock "/opt/stack/data/nova/instances/bc114bed-8d7e-46e0-86a7-7eed7ce75b5c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.209s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Acquiring lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:50:59 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:00 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.265s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:00 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/bc114bed-8d7e-46e0-86a7-7eed7ce75b5c/disk 1073741824 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:00 user nova-compute[74994]: DEBUG nova.compute.manager [req-a3e026b1-0809-4f29-bcbb-84970d6106ed req-8a818fe3-f885-47a6-be3e-4fe661b8833c service nova] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Received event network-vif-plugged-aeaddf62-0ca1-40d1-9228-897ee0015d4a {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:51:00 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a3e026b1-0809-4f29-bcbb-84970d6106ed req-8a818fe3-f885-47a6-be3e-4fe661b8833c service nova] Acquiring lock "279e1c4c-36f9-492f-ab3f-1b587347eadd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:51:00 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a3e026b1-0809-4f29-bcbb-84970d6106ed req-8a818fe3-f885-47a6-be3e-4fe661b8833c service nova] Lock "279e1c4c-36f9-492f-ab3f-1b587347eadd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:51:00 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a3e026b1-0809-4f29-bcbb-84970d6106ed req-8a818fe3-f885-47a6-be3e-4fe661b8833c service nova] Lock "279e1c4c-36f9-492f-ab3f-1b587347eadd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:51:00 user nova-compute[74994]: DEBUG nova.compute.manager [req-a3e026b1-0809-4f29-bcbb-84970d6106ed req-8a818fe3-f885-47a6-be3e-4fe661b8833c service nova] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] No waiting events found dispatching network-vif-plugged-aeaddf62-0ca1-40d1-9228-897ee0015d4a {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:51:00 user nova-compute[74994]: WARNING nova.compute.manager [req-a3e026b1-0809-4f29-bcbb-84970d6106ed req-8a818fe3-f885-47a6-be3e-4fe661b8833c service nova] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Received unexpected event network-vif-plugged-aeaddf62-0ca1-40d1-9228-897ee0015d4a for instance with vm_state active and task_state rescuing.
Nov 28 10:51:00 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/bc114bed-8d7e-46e0-86a7-7eed7ce75b5c/disk 1073741824" returned: 0 in 0.064s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:00 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.338s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:51:00 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:00 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:51:00 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.206s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:00 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bc114bed-8d7e-46e0-86a7-7eed7ce75b5c/disk. size=1073741824 {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 10:51:00 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc114bed-8d7e-46e0-86a7-7eed7ce75b5c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:00 user nova-compute[74994]: DEBUG nova.network.neutron [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Successfully created port: 4447defd-231f-48d4-aed4-b8459a768808 {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 10:51:00 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc114bed-8d7e-46e0-86a7-7eed7ce75b5c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:00 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Cannot resize image /opt/stack/data/nova/instances/bc114bed-8d7e-46e0-86a7-7eed7ce75b5c/disk to a smaller size. {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 10:51:00 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Created local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 10:51:00 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Ensure instance console log exists: /opt/stack/data/nova/instances/bc114bed-8d7e-46e0-86a7-7eed7ce75b5c/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 10:51:00 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:51:00 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:51:00 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:51:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:00 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-b74e91db-b9cf-4c98-bab4-d21c13982ba6 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Snapshot image upload complete
Nov 28 10:51:00 user nova-compute[74994]: INFO nova.compute.manager [None req-b74e91db-b9cf-4c98-bab4-d21c13982ba6 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Took 6.60 seconds to snapshot the instance on the hypervisor.
Nov 28 10:51:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:01 user nova-compute[74994]: DEBUG nova.network.neutron [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Successfully updated port: 4447defd-231f-48d4-aed4-b8459a768808 {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 10:51:01 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Acquiring lock "refresh_cache-bc114bed-8d7e-46e0-86a7-7eed7ce75b5c" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:51:01 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Acquired lock "refresh_cache-bc114bed-8d7e-46e0-86a7-7eed7ce75b5c" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:51:01 user nova-compute[74994]: DEBUG nova.network.neutron [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 10:51:01 user nova-compute[74994]: DEBUG nova.compute.manager [req-46d136c1-76d6-44a2-a076-89768adc49f5 req-fbed17c4-7ca9-4cc3-ad33-fb29522265e9 service nova] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Received event network-changed-4447defd-231f-48d4-aed4-b8459a768808 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:51:01 user nova-compute[74994]: DEBUG nova.compute.manager [req-46d136c1-76d6-44a2-a076-89768adc49f5 req-fbed17c4-7ca9-4cc3-ad33-fb29522265e9 service nova] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Refreshing instance network info cache due to event network-changed-4447defd-231f-48d4-aed4-b8459a768808. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:51:01 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-46d136c1-76d6-44a2-a076-89768adc49f5 req-fbed17c4-7ca9-4cc3-ad33-fb29522265e9 service nova] Acquiring lock "refresh_cache-bc114bed-8d7e-46e0-86a7-7eed7ce75b5c" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:51:01 user nova-compute[74994]: DEBUG nova.network.neutron [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 10:51:01 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:51:01 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 10:51:01 user nova-compute[74994]: DEBUG nova.network.neutron [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Updating instance_info_cache with network_info: [{"id": "4447defd-231f-48d4-aed4-b8459a768808", "address": "fa:16:3e:eb:89:30", "network": {"id": "434398a7-094f-4b01-ae77-ae83f21a8390", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1446659533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c23e61575784c8baffda1deda7812fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4447defd-23", "ovs_interfaceid": "4447defd-231f-48d4-aed4-b8459a768808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Releasing lock "refresh_cache-bc114bed-8d7e-46e0-86a7-7eed7ce75b5c" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG nova.compute.manager [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Instance network_info: |[{"id": "4447defd-231f-48d4-aed4-b8459a768808", "address": "fa:16:3e:eb:89:30", "network": {"id": "434398a7-094f-4b01-ae77-ae83f21a8390", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1446659533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c23e61575784c8baffda1deda7812fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4447defd-23", "ovs_interfaceid": "4447defd-231f-48d4-aed4-b8459a768808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-46d136c1-76d6-44a2-a076-89768adc49f5 req-fbed17c4-7ca9-4cc3-ad33-fb29522265e9 service nova] Acquired lock "refresh_cache-bc114bed-8d7e-46e0-86a7-7eed7ce75b5c" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG nova.network.neutron [req-46d136c1-76d6-44a2-a076-89768adc49f5 req-fbed17c4-7ca9-4cc3-ad33-fb29522265e9 service nova] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Refreshing network info cache for port 4447defd-231f-48d4-aed4-b8459a768808 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Start _get_guest_xml network_info=[{"id": "4447defd-231f-48d4-aed4-b8459a768808", "address": "fa:16:3e:eb:89:30", "network": {"id": "434398a7-094f-4b01-ae77-ae83f21a8390", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1446659533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c23e61575784c8baffda1deda7812fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4447defd-23", "ovs_interfaceid": "4447defd-231f-48d4-aed4-b8459a768808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'aa939d1b-b8a6-4391-935b-0191bf5ccd0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 10:51:02 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:51:02 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:51:02 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:50:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-129232436',display_name='tempest-ServersNegativeTestJSON-server-129232436',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-129232436',id=13,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c23e61575784c8baffda1deda7812fd',ramdisk_id='',reservation_id='r-wki39teo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1243683462',owner_user_name='tempest-ServersNegativeTestJSON-1243683462-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:51:00Z,user_data=None,user_id='3c29f1c4e20e4bfd80b1d565b58330aa',uuid=bc114bed-8d7e-46e0-86a7-7eed7ce75b5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4447defd-231f-48d4-aed4-b8459a768808", "address": "fa:16:3e:eb:89:30", "network": {"id": "434398a7-094f-4b01-ae77-ae83f21a8390", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1446659533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c23e61575784c8baffda1deda7812fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4447defd-23", "ovs_interfaceid": "4447defd-231f-48d4-aed4-b8459a768808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Converting VIF {"id": "4447defd-231f-48d4-aed4-b8459a768808", "address": "fa:16:3e:eb:89:30", "network": {"id": "434398a7-094f-4b01-ae77-ae83f21a8390", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1446659533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c23e61575784c8baffda1deda7812fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4447defd-23", "ovs_interfaceid": "4447defd-231f-48d4-aed4-b8459a768808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:89:30,bridge_name='br-int',has_traffic_filtering=True,id=4447defd-231f-48d4-aed4-b8459a768808,network=Network(434398a7-094f-4b01-ae77-ae83f21a8390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4447defd-23') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG nova.objects.instance [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Lazy-loading 'pci_devices' on Instance uuid bc114bed-8d7e-46e0-86a7-7eed7ce75b5c {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] End _get_guest_xml xml=<domain type="kvm">
Nov 28 10:51:02 user nova-compute[74994]:   <uuid>bc114bed-8d7e-46e0-86a7-7eed7ce75b5c</uuid>
Nov 28 10:51:02 user nova-compute[74994]:   <name>instance-0000000d</name>
Nov 28 10:51:02 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 10:51:02 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 10:51:02 user nova-compute[74994]:   <metadata>
Nov 28 10:51:02 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 10:51:02 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 10:51:02 user nova-compute[74994]:       <nova:name>tempest-ServersNegativeTestJSON-server-129232436</nova:name>
Nov 28 10:51:02 user nova-compute[74994]:       <nova:creationTime>2023-11-28 10:51:02</nova:creationTime>
Nov 28 10:51:02 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 10:51:02 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 10:51:02 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 10:51:02 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 10:51:02 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 10:51:02 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 10:51:02 user nova-compute[74994]:       </nova:flavor>
Nov 28 10:51:02 user nova-compute[74994]:       <nova:owner>
Nov 28 10:51:02 user nova-compute[74994]:         <nova:user uuid="3c29f1c4e20e4bfd80b1d565b58330aa">tempest-ServersNegativeTestJSON-1243683462-project-member</nova:user>
Nov 28 10:51:02 user nova-compute[74994]:         <nova:project uuid="1c23e61575784c8baffda1deda7812fd">tempest-ServersNegativeTestJSON-1243683462</nova:project>
Nov 28 10:51:02 user nova-compute[74994]:       </nova:owner>
Nov 28 10:51:02 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 10:51:02 user nova-compute[74994]:       <nova:ports>
Nov 28 10:51:02 user nova-compute[74994]:         <nova:port uuid="4447defd-231f-48d4-aed4-b8459a768808">
Nov 28 10:51:02 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 10:51:02 user nova-compute[74994]:         </nova:port>
Nov 28 10:51:02 user nova-compute[74994]:       </nova:ports>
Nov 28 10:51:02 user nova-compute[74994]:     </nova:instance>
Nov 28 10:51:02 user nova-compute[74994]:   </metadata>
Nov 28 10:51:02 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 10:51:02 user nova-compute[74994]:     <system>
Nov 28 10:51:02 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 10:51:02 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 10:51:02 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 10:51:02 user nova-compute[74994]:       <entry name="serial">bc114bed-8d7e-46e0-86a7-7eed7ce75b5c</entry>
Nov 28 10:51:02 user nova-compute[74994]:       <entry name="uuid">bc114bed-8d7e-46e0-86a7-7eed7ce75b5c</entry>
Nov 28 10:51:02 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 10:51:02 user nova-compute[74994]:     </system>
Nov 28 10:51:02 user nova-compute[74994]:   </sysinfo>
Nov 28 10:51:02 user nova-compute[74994]:   <os>
Nov 28 10:51:02 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 10:51:02 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 10:51:02 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 10:51:02 user nova-compute[74994]:   </os>
Nov 28 10:51:02 user nova-compute[74994]:   <features>
Nov 28 10:51:02 user nova-compute[74994]:     <acpi/>
Nov 28 10:51:02 user nova-compute[74994]:     <apic/>
Nov 28 10:51:02 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 10:51:02 user nova-compute[74994]:   </features>
Nov 28 10:51:02 user nova-compute[74994]:   <clock offset="utc">
Nov 28 10:51:02 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 10:51:02 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 10:51:02 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 10:51:02 user nova-compute[74994]:   </clock>
Nov 28 10:51:02 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 10:51:02 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 10:51:02 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 10:51:02 user nova-compute[74994]:   </cpu>
Nov 28 10:51:02 user nova-compute[74994]:   <devices>
Nov 28 10:51:02 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 10:51:02 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 10:51:02 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/bc114bed-8d7e-46e0-86a7-7eed7ce75b5c/disk"/>
Nov 28 10:51:02 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 10:51:02 user nova-compute[74994]:     </disk>
Nov 28 10:51:02 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 10:51:02 user nova-compute[74994]:       <mac address="fa:16:3e:eb:89:30"/>
Nov 28 10:51:02 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:51:02 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 10:51:02 user nova-compute[74994]:       <target dev="tap4447defd-23"/>
Nov 28 10:51:02 user nova-compute[74994]:     </interface>
Nov 28 10:51:02 user nova-compute[74994]:     <serial type="pty">
Nov 28 10:51:02 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/bc114bed-8d7e-46e0-86a7-7eed7ce75b5c/console.log" append="off"/>
Nov 28 10:51:02 user nova-compute[74994]:     </serial>
Nov 28 10:51:02 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 10:51:02 user nova-compute[74994]:     <video>
Nov 28 10:51:02 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:51:02 user nova-compute[74994]:     </video>
Nov 28 10:51:02 user nova-compute[74994]:     <rng model="virtio">
Nov 28 10:51:02 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 10:51:02 user nova-compute[74994]:     </rng>
Nov 28 10:51:02 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 10:51:02 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 10:51:02 user nova-compute[74994]:       <stats period="10"/>
Nov 28 10:51:02 user nova-compute[74994]:     </memballoon>
Nov 28 10:51:02 user nova-compute[74994]:   </devices>
Nov 28 10:51:02 user nova-compute[74994]: </domain>
Nov 28 10:51:02 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:50:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-129232436',display_name='tempest-ServersNegativeTestJSON-server-129232436',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-129232436',id=13,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c23e61575784c8baffda1deda7812fd',ramdisk_id='',reservation_id='r-wki39teo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1243683462',owner_user_name='tempest-ServersNegativeTestJSON-1243683462-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:51:00Z,user_data=None,user_id='3c29f1c4e20e4bfd80b1d565b58330aa',uuid=bc114bed-8d7e-46e0-86a7-7eed7ce75b5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4447defd-231f-48d4-aed4-b8459a768808", "address": "fa:16:3e:eb:89:30", "network": {"id": "434398a7-094f-4b01-ae77-ae83f21a8390", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1446659533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c23e61575784c8baffda1deda7812fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4447defd-23", "ovs_interfaceid": "4447defd-231f-48d4-aed4-b8459a768808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Converting VIF {"id": "4447defd-231f-48d4-aed4-b8459a768808", "address": "fa:16:3e:eb:89:30", "network": {"id": "434398a7-094f-4b01-ae77-ae83f21a8390", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1446659533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c23e61575784c8baffda1deda7812fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4447defd-23", "ovs_interfaceid": "4447defd-231f-48d4-aed4-b8459a768808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:89:30,bridge_name='br-int',has_traffic_filtering=True,id=4447defd-231f-48d4-aed4-b8459a768808,network=Network(434398a7-094f-4b01-ae77-ae83f21a8390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4447defd-23') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG os_vif [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:89:30,bridge_name='br-int',has_traffic_filtering=True,id=4447defd-231f-48d4-aed4-b8459a768808,network=Network(434398a7-094f-4b01-ae77-ae83f21a8390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4447defd-23') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '28024a69-4275-5731-a0bb-84f07803981f', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4447defd-23, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4447defd-23, col_values=(('qos', UUID('a93c8077-56b7-4e16-ae8e-b77b6369ef4c')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4447defd-23, col_values=(('external_ids', {'iface-id': '4447defd-231f-48d4-aed4-b8459a768808', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:89:30', 'vm-uuid': 'bc114bed-8d7e-46e0-86a7-7eed7ce75b5c'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:02 user nova-compute[74994]: INFO os_vif [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:89:30,bridge_name='br-int',has_traffic_filtering=True,id=4447defd-231f-48d4-aed4-b8459a768808,network=Network(434398a7-094f-4b01-ae77-ae83f21a8390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4447defd-23')
Nov 28 10:51:02 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] No VIF found with MAC fa:16:3e:eb:89:30, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG nova.compute.manager [req-cd316416-8ced-4e42-a2b0-7443a7350a37 req-b5bcee2f-02fb-48e4-8069-5df7e969df37 service nova] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Received event network-vif-plugged-aeaddf62-0ca1-40d1-9228-897ee0015d4a {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-cd316416-8ced-4e42-a2b0-7443a7350a37 req-b5bcee2f-02fb-48e4-8069-5df7e969df37 service nova] Acquiring lock "279e1c4c-36f9-492f-ab3f-1b587347eadd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-cd316416-8ced-4e42-a2b0-7443a7350a37 req-b5bcee2f-02fb-48e4-8069-5df7e969df37 service nova] Lock "279e1c4c-36f9-492f-ab3f-1b587347eadd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-cd316416-8ced-4e42-a2b0-7443a7350a37 req-b5bcee2f-02fb-48e4-8069-5df7e969df37 service nova] Lock "279e1c4c-36f9-492f-ab3f-1b587347eadd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG nova.compute.manager [req-cd316416-8ced-4e42-a2b0-7443a7350a37 req-b5bcee2f-02fb-48e4-8069-5df7e969df37 service nova] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] No waiting events found dispatching network-vif-plugged-aeaddf62-0ca1-40d1-9228-897ee0015d4a {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:51:02 user nova-compute[74994]: WARNING nova.compute.manager [req-cd316416-8ced-4e42-a2b0-7443a7350a37 req-b5bcee2f-02fb-48e4-8069-5df7e969df37 service nova] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Received unexpected event network-vif-plugged-aeaddf62-0ca1-40d1-9228-897ee0015d4a for instance with vm_state active and task_state rescuing.
Nov 28 10:51:02 user nova-compute[74994]: DEBUG nova.compute.manager [req-cd316416-8ced-4e42-a2b0-7443a7350a37 req-b5bcee2f-02fb-48e4-8069-5df7e969df37 service nova] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Received event network-vif-plugged-aeaddf62-0ca1-40d1-9228-897ee0015d4a {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-cd316416-8ced-4e42-a2b0-7443a7350a37 req-b5bcee2f-02fb-48e4-8069-5df7e969df37 service nova] Acquiring lock "279e1c4c-36f9-492f-ab3f-1b587347eadd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-cd316416-8ced-4e42-a2b0-7443a7350a37 req-b5bcee2f-02fb-48e4-8069-5df7e969df37 service nova] Lock "279e1c4c-36f9-492f-ab3f-1b587347eadd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-cd316416-8ced-4e42-a2b0-7443a7350a37 req-b5bcee2f-02fb-48e4-8069-5df7e969df37 service nova] Lock "279e1c4c-36f9-492f-ab3f-1b587347eadd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG nova.compute.manager [req-cd316416-8ced-4e42-a2b0-7443a7350a37 req-b5bcee2f-02fb-48e4-8069-5df7e969df37 service nova] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] No waiting events found dispatching network-vif-plugged-aeaddf62-0ca1-40d1-9228-897ee0015d4a {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:51:02 user nova-compute[74994]: WARNING nova.compute.manager [req-cd316416-8ced-4e42-a2b0-7443a7350a37 req-b5bcee2f-02fb-48e4-8069-5df7e969df37 service nova] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Received unexpected event network-vif-plugged-aeaddf62-0ca1-40d1-9228-897ee0015d4a for instance with vm_state active and task_state rescuing.
Nov 28 10:51:02 user nova-compute[74994]: DEBUG nova.network.neutron [req-46d136c1-76d6-44a2-a076-89768adc49f5 req-fbed17c4-7ca9-4cc3-ad33-fb29522265e9 service nova] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Updated VIF entry in instance network info cache for port 4447defd-231f-48d4-aed4-b8459a768808. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG nova.network.neutron [req-46d136c1-76d6-44a2-a076-89768adc49f5 req-fbed17c4-7ca9-4cc3-ad33-fb29522265e9 service nova] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Updating instance_info_cache with network_info: [{"id": "4447defd-231f-48d4-aed4-b8459a768808", "address": "fa:16:3e:eb:89:30", "network": {"id": "434398a7-094f-4b01-ae77-ae83f21a8390", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1446659533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c23e61575784c8baffda1deda7812fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4447defd-23", "ovs_interfaceid": "4447defd-231f-48d4-aed4-b8459a768808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-46d136c1-76d6-44a2-a076-89768adc49f5 req-fbed17c4-7ca9-4cc3-ad33-fb29522265e9 service nova] Releasing lock "refresh_cache-bc114bed-8d7e-46e0-86a7-7eed7ce75b5c" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:51:02 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:51:03 user nova-compute[74994]: DEBUG nova.compute.manager [None req-08daada6-1049-4200-aeb5-aefd3d07e504 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 10:51:03 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:51:03 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 10:51:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "refresh_cache-a8b4b5dc-0696-4a01-8318-7d3ec2014d6e" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:51:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquired lock "refresh_cache-a8b4b5dc-0696-4a01-8318-7d3ec2014d6e" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:51:03 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Forcefully refreshing network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 10:51:04 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Updating instance_info_cache with network_info: [{"id": "2f85c58c-a67a-435e-95bd-ae59a03c7a14", "address": "fa:16:3e:96:7b:84", "network": {"id": "99dc7b50-b4f4-4cdd-83fa-8efbdcdac028", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1822691421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00249c339d324b7990aac48ea640d770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f85c58c-a6", "ovs_interfaceid": "2f85c58c-a67a-435e-95bd-ae59a03c7a14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:51:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Releasing lock "refresh_cache-a8b4b5dc-0696-4a01-8318-7d3ec2014d6e" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:51:04 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Updated the network info_cache for instance {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 10:51:04 user nova-compute[74994]: DEBUG nova.compute.manager [req-ce75b5a1-ab43-43af-bf3c-218d84d57b30 req-a293c79e-91b1-4795-95b7-6392758afb43 service nova] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Received event network-vif-plugged-4447defd-231f-48d4-aed4-b8459a768808 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:51:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ce75b5a1-ab43-43af-bf3c-218d84d57b30 req-a293c79e-91b1-4795-95b7-6392758afb43 service nova] Acquiring lock "bc114bed-8d7e-46e0-86a7-7eed7ce75b5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:51:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ce75b5a1-ab43-43af-bf3c-218d84d57b30 req-a293c79e-91b1-4795-95b7-6392758afb43 service nova] Lock "bc114bed-8d7e-46e0-86a7-7eed7ce75b5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:51:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ce75b5a1-ab43-43af-bf3c-218d84d57b30 req-a293c79e-91b1-4795-95b7-6392758afb43 service nova] Lock "bc114bed-8d7e-46e0-86a7-7eed7ce75b5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:51:04 user nova-compute[74994]: DEBUG nova.compute.manager [req-ce75b5a1-ab43-43af-bf3c-218d84d57b30 req-a293c79e-91b1-4795-95b7-6392758afb43 service nova] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] No waiting events found dispatching network-vif-plugged-4447defd-231f-48d4-aed4-b8459a768808 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:51:04 user nova-compute[74994]: WARNING nova.compute.manager [req-ce75b5a1-ab43-43af-bf3c-218d84d57b30 req-a293c79e-91b1-4795-95b7-6392758afb43 service nova] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Received unexpected event network-vif-plugged-4447defd-231f-48d4-aed4-b8459a768808 for instance with vm_state building and task_state spawning.
Nov 28 10:51:04 user nova-compute[74994]: DEBUG nova.compute.manager [req-ce75b5a1-ab43-43af-bf3c-218d84d57b30 req-a293c79e-91b1-4795-95b7-6392758afb43 service nova] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Received event network-vif-plugged-4447defd-231f-48d4-aed4-b8459a768808 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:51:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ce75b5a1-ab43-43af-bf3c-218d84d57b30 req-a293c79e-91b1-4795-95b7-6392758afb43 service nova] Acquiring lock "bc114bed-8d7e-46e0-86a7-7eed7ce75b5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:51:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ce75b5a1-ab43-43af-bf3c-218d84d57b30 req-a293c79e-91b1-4795-95b7-6392758afb43 service nova] Lock "bc114bed-8d7e-46e0-86a7-7eed7ce75b5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:51:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ce75b5a1-ab43-43af-bf3c-218d84d57b30 req-a293c79e-91b1-4795-95b7-6392758afb43 service nova] Lock "bc114bed-8d7e-46e0-86a7-7eed7ce75b5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:51:04 user nova-compute[74994]: DEBUG nova.compute.manager [req-ce75b5a1-ab43-43af-bf3c-218d84d57b30 req-a293c79e-91b1-4795-95b7-6392758afb43 service nova] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] No waiting events found dispatching network-vif-plugged-4447defd-231f-48d4-aed4-b8459a768808 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:51:04 user nova-compute[74994]: WARNING nova.compute.manager [req-ce75b5a1-ab43-43af-bf3c-218d84d57b30 req-a293c79e-91b1-4795-95b7-6392758afb43 service nova] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Received unexpected event network-vif-plugged-4447defd-231f-48d4-aed4-b8459a768808 for instance with vm_state building and task_state spawning.
Nov 28 10:51:04 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:51:04 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:51:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:51:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:51:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:51:04 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c7b4d4f9-945c-40c4-b5ac-b2744973727a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zfFgasRr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:51:05 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:51:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:51:05 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:51:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7b4d4f9-945c-40c4-b5ac-b2744973727a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7b4d4f9-945c-40c4-b5ac-b2744973727a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:51:05 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 10:51:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b4d4f9-945c-40c4-b5ac-b2744973727a -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b4d4f9-945c-40c4-b5ac-b2744973727a -p 172.16.0.220:3260" returned: 21 in 0.036s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2a4cbb-b142-4874-bc72-1329f936e049]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 10:51:05 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b4d4f9-945c-40c4-b5ac-b2744973727a -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b4d4f9-945c-40c4-b5ac-b2744973727a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[42adfb43-9adb-4be5-a377-af2ba944e5c5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7b4d4f9-945c-40c4-b5ac-b2744973727a] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7b4d4f9-945c-40c4-b5ac-b2744973727a] added
Nov 28 10:51:05 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b4d4f9-945c-40c4-b5ac-b2744973727a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b4d4f9-945c-40c4-b5ac-b2744973727a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[150ad9a3-8376-40c1-b915-7d36f334a2a3]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b4d4f9-945c-40c4-b5ac-b2744973727a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b4d4f9-945c-40c4-b5ac-b2744973727a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[76191c1e-fd6b-4d97-a148-ba4456996725]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b4d4f9-945c-40c4-b5ac-b2744973727a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zfFgasRr {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b4d4f9-945c-40c4-b5ac-b2744973727a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zfFgasRr" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1befe1fb-7f0c-4d13-b1f2-8bfec2f1837d]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zfFgasRr'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b4d4f9-945c-40c4-b5ac-b2744973727a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b4d4f9-945c-40c4-b5ac-b2744973727a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0525ec20-9358-4697-bb82-dac64dd82a68]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc114bed-8d7e-46e0-86a7-7eed7ce75b5c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[acea294b-0a8e-4e54-852b-9467c66dbe18]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:51:05 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:51:05 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:51:05 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:51:05 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:51:05 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:51:05 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b4d4f9-945c-40c4-b5ac-b2744973727a -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b4d4f9-945c-40c4-b5ac-b2744973727a -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e112cf0b-be2b-4f99-8db7-a229bdfe80b4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7b4d4f9-945c-40c4-b5ac-b2744973727a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c7b4d4f9-945c-40c4-b5ac-b2744973727a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7b4d4f9-945c-40c4-b5ac-b2744973727a, portal: 172.16.0.220,3260]
Nov 28 10:51:05 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:c7b4d4f9-945c-40c4-b5ac-b2744973727a, portal: 172.16.0.220,3260] successful.
Nov 28 10:51:05 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b4d4f9-945c-40c4-b5ac-b2744973727a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b4d4f9-945c-40c4-b5ac-b2744973727a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb681a38-e3b0-4b9a-a002-409703b6fb52]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8ee2ef-5977-4fcc-8810-7b36581e5d12]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b4d4f9-945c-40c4-b5ac-b2744973727a (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:51:05 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:51:05 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:51:05 user nova-compute[74994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b4d4f9-945c-40c4-b5ac-b2744973727a (non-flash)
Nov 28 10:51:05 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:51:05 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:51:05 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:51:05 user nova-compute[74994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b4d4f9-945c-40c4-b5ac-b2744973727a (non-flash)
Nov 28 10:51:05 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7b4d4f9-945c-40c4-b5ac-b2744973727a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.376s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc114bed-8d7e-46e0-86a7-7eed7ce75b5c/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc114bed-8d7e-46e0-86a7-7eed7ce75b5c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[79dfc88e-4c32-446d-982f-be5f72eee0d6]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c7b4d4f9-945c-40c4-b5ac-b2744973727a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zfFgasRr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG nova.compute.manager [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 10:51:05 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Instance spawned successfully.
Nov 28 10:51:05 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:51:05 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:51:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc114bed-8d7e-46e0-86a7-7eed7ce75b5c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e6a974e-3626-453c-8662-0d160f6e57de/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:06 user nova-compute[74994]: INFO nova.compute.manager [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Took 6.36 seconds to spawn the instance on the hypervisor.
Nov 28 10:51:06 user nova-compute[74994]: DEBUG nova.compute.manager [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 10:51:06 user nova-compute[74994]: INFO nova.compute.manager [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Took 7.35 seconds to build instance.
Nov 28 10:51:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e6a974e-3626-453c-8662-0d160f6e57de/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e6a974e-3626-453c-8662-0d160f6e57de/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bfb09e6f-d19d-435f-83e8-e8ccec52c05e tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Lock "bc114bed-8d7e-46e0-86a7-7eed7ce75b5c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.530s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:51:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e6a974e-3626-453c-8662-0d160f6e57de/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:06 user nova-compute[74994]: DEBUG nova.compute.manager [req-2fad1982-4221-43a3-916a-7ac7c9727adf req-b310f4a8-e199-4ddb-a14d-0a07776d5cd7 service nova] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Received event network-changed-744c3452-d7cd-44a1-83d5-a60e6db5b8b5 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:51:06 user nova-compute[74994]: DEBUG nova.compute.manager [req-2fad1982-4221-43a3-916a-7ac7c9727adf req-b310f4a8-e199-4ddb-a14d-0a07776d5cd7 service nova] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Refreshing instance network info cache due to event network-changed-744c3452-d7cd-44a1-83d5-a60e6db5b8b5. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:51:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-2fad1982-4221-43a3-916a-7ac7c9727adf req-b310f4a8-e199-4ddb-a14d-0a07776d5cd7 service nova] Acquiring lock "refresh_cache-cce813fa-bf97-41f8-8aee-c7a73354e24c" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:51:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-2fad1982-4221-43a3-916a-7ac7c9727adf req-b310f4a8-e199-4ddb-a14d-0a07776d5cd7 service nova] Acquired lock "refresh_cache-cce813fa-bf97-41f8-8aee-c7a73354e24c" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:51:06 user nova-compute[74994]: DEBUG nova.network.neutron [req-2fad1982-4221-43a3-916a-7ac7c9727adf req-b310f4a8-e199-4ddb-a14d-0a07776d5cd7 service nova] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Refreshing network info cache for port 744c3452-d7cd-44a1-83d5-a60e6db5b8b5 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:51:06 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.454s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:51:06 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] <== connect_volume: return (1456ms) {'type': 'block', 'scsi_wwn': '23330623237306137', 'path': '/dev/sde'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:51:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23330623237306137', 'path': '/dev/sde'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 10:51:06 user nova-compute[74994]: DEBUG nova.objects.instance [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Lazy-loading 'flavor' on Instance uuid a8b4b5dc-0696-4a01-8318-7d3ec2014d6e {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:51:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e30565c-9f8e-4a87-8054-6c260dac4f48/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 10:51:06 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 10:51:06 user nova-compute[74994]:   <source dev="/dev/sde"/>
Nov 28 10:51:06 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 10:51:06 user nova-compute[74994]:   <serial>c7b4d4f9-945c-40c4-b5ac-b2744973727a</serial>
Nov 28 10:51:06 user nova-compute[74994]: </disk>
Nov 28 10:51:06 user nova-compute[74994]:  {{(pid=74994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 10:51:07 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e30565c-9f8e-4a87-8054-6c260dac4f48/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e30565c-9f8e-4a87-8054-6c260dac4f48/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:07 user nova-compute[74994]: DEBUG nova.network.neutron [req-2fad1982-4221-43a3-916a-7ac7c9727adf req-b310f4a8-e199-4ddb-a14d-0a07776d5cd7 service nova] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Updated VIF entry in instance network info cache for port 744c3452-d7cd-44a1-83d5-a60e6db5b8b5. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 10:51:07 user nova-compute[74994]: DEBUG nova.network.neutron [req-2fad1982-4221-43a3-916a-7ac7c9727adf req-b310f4a8-e199-4ddb-a14d-0a07776d5cd7 service nova] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Updating instance_info_cache with network_info: [{"id": "744c3452-d7cd-44a1-83d5-a60e6db5b8b5", "address": "fa:16:3e:a0:b1:ed", "network": {"id": "d9bcdec6-69e0-4e65-8a26-1af1f8232365", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1227861580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "636fa9a1f046425e9332cc3807f8fb46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744c3452-d7", "ovs_interfaceid": "744c3452-d7cd-44a1-83d5-a60e6db5b8b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:51:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e30565c-9f8e-4a87-8054-6c260dac4f48/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-2fad1982-4221-43a3-916a-7ac7c9727adf req-b310f4a8-e199-4ddb-a14d-0a07776d5cd7 service nova] Releasing lock "refresh_cache-cce813fa-bf97-41f8-8aee-c7a73354e24c" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:51:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b4b5dc-0696-4a01-8318-7d3ec2014d6e/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:07 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:51:07 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:51:07 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] No VIF found with MAC fa:16:3e:96:7b:84, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:51:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b4b5dc-0696-4a01-8318-7d3ec2014d6e/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b4b5dc-0696-4a01-8318-7d3ec2014d6e/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-747826f7-82af-4c96-8f4c-5990394772ad tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Lock "a8b4b5dc-0696-4a01-8318-7d3ec2014d6e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.419s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:51:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b4b5dc-0696-4a01-8318-7d3ec2014d6e/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b51d690-8198-4748-807d-1902e75564b9/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b51d690-8198-4748-807d-1902e75564b9/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b51d690-8198-4748-807d-1902e75564b9/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b51d690-8198-4748-807d-1902e75564b9/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce813fa-bf97-41f8-8aee-c7a73354e24c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce813fa-bf97-41f8-8aee-c7a73354e24c/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce813fa-bf97-41f8-8aee-c7a73354e24c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b9e0cc93-8212-495c-b71c-678701716cac tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Acquiring lock "a8b4b5dc-0696-4a01-8318-7d3ec2014d6e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:51:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b9e0cc93-8212-495c-b71c-678701716cac tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Lock "a8b4b5dc-0696-4a01-8318-7d3ec2014d6e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:51:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b9e0cc93-8212-495c-b71c-678701716cac tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Acquiring lock "a8b4b5dc-0696-4a01-8318-7d3ec2014d6e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:51:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b9e0cc93-8212-495c-b71c-678701716cac tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Lock "a8b4b5dc-0696-4a01-8318-7d3ec2014d6e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:51:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b9e0cc93-8212-495c-b71c-678701716cac tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Lock "a8b4b5dc-0696-4a01-8318-7d3ec2014d6e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:51:08 user nova-compute[74994]: INFO nova.compute.manager [None req-b9e0cc93-8212-495c-b71c-678701716cac tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Terminating instance
Nov 28 10:51:08 user nova-compute[74994]: DEBUG nova.compute.manager [None req-b9e0cc93-8212-495c-b71c-678701716cac tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 10:51:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce813fa-bf97-41f8-8aee-c7a73354e24c/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG nova.compute.manager [req-357b3646-a700-42a4-91f9-1b6a63252cd3 req-47dc32e5-6b3e-4b10-b598-4126770913ce service nova] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Received event network-vif-unplugged-2f85c58c-a67a-435e-95bd-ae59a03c7a14 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-357b3646-a700-42a4-91f9-1b6a63252cd3 req-47dc32e5-6b3e-4b10-b598-4126770913ce service nova] Acquiring lock "a8b4b5dc-0696-4a01-8318-7d3ec2014d6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-357b3646-a700-42a4-91f9-1b6a63252cd3 req-47dc32e5-6b3e-4b10-b598-4126770913ce service nova] Lock "a8b4b5dc-0696-4a01-8318-7d3ec2014d6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-357b3646-a700-42a4-91f9-1b6a63252cd3 req-47dc32e5-6b3e-4b10-b598-4126770913ce service nova] Lock "a8b4b5dc-0696-4a01-8318-7d3ec2014d6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG nova.compute.manager [req-357b3646-a700-42a4-91f9-1b6a63252cd3 req-47dc32e5-6b3e-4b10-b598-4126770913ce service nova] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] No waiting events found dispatching network-vif-unplugged-2f85c58c-a67a-435e-95bd-ae59a03c7a14 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG nova.compute.manager [req-357b3646-a700-42a4-91f9-1b6a63252cd3 req-47dc32e5-6b3e-4b10-b598-4126770913ce service nova] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Received event network-vif-unplugged-2f85c58c-a67a-435e-95bd-ae59a03c7a14 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json" returned: 0 in 0.229s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:09 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Instance destroyed successfully.
Nov 28 10:51:09 user nova-compute[74994]: DEBUG nova.objects.instance [None req-b9e0cc93-8212-495c-b71c-678701716cac tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Lazy-loading 'resources' on Instance uuid a8b4b5dc-0696-4a01-8318-7d3ec2014d6e {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-b9e0cc93-8212-495c-b71c-678701716cac tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:49:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-575516577',display_name='tempest-DeleteServersTestJSON-server-575516577',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-575516577',id=2,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:49:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='00249c339d324b7990aac48ea640d770',ramdisk_id='',reservation_id='r-wbt1ltyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-156220800',owner_user_name='tempest-DeleteServersTestJSON-156220800-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T10:49:25Z,user_data=None,user_id='cbb3e2a69e66423e8bfe8f60d1cfa3e3',uuid=a8b4b5dc-0696-4a01-8318-7d3ec2014d6e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f85c58c-a67a-435e-95bd-ae59a03c7a14", "address": "fa:16:3e:96:7b:84", "network": {"id": "99dc7b50-b4f4-4cdd-83fa-8efbdcdac028", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1822691421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00249c339d324b7990aac48ea640d770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f85c58c-a6", "ovs_interfaceid": "2f85c58c-a67a-435e-95bd-ae59a03c7a14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-b9e0cc93-8212-495c-b71c-678701716cac tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Converting VIF {"id": "2f85c58c-a67a-435e-95bd-ae59a03c7a14", "address": "fa:16:3e:96:7b:84", "network": {"id": "99dc7b50-b4f4-4cdd-83fa-8efbdcdac028", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1822691421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00249c339d324b7990aac48ea640d770", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f85c58c-a6", "ovs_interfaceid": "2f85c58c-a67a-435e-95bd-ae59a03c7a14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-b9e0cc93-8212-495c-b71c-678701716cac tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:7b:84,bridge_name='br-int',has_traffic_filtering=True,id=2f85c58c-a67a-435e-95bd-ae59a03c7a14,network=Network(99dc7b50-b4f4-4cdd-83fa-8efbdcdac028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f85c58c-a6') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG os_vif [None req-b9e0cc93-8212-495c-b71c-678701716cac tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:7b:84,bridge_name='br-int',has_traffic_filtering=True,id=2f85c58c-a67a-435e-95bd-ae59a03c7a14,network=Network(99dc7b50-b4f4-4cdd-83fa-8efbdcdac028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f85c58c-a6') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f85c58c-a6, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6148dad5-5701-4db4-9d59-f6afac3d5279) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:51:09 user nova-compute[74994]: INFO os_vif [None req-b9e0cc93-8212-495c-b71c-678701716cac tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:7b:84,bridge_name='br-int',has_traffic_filtering=True,id=2f85c58c-a67a-435e-95bd-ae59a03c7a14,network=Network(99dc7b50-b4f4-4cdd-83fa-8efbdcdac028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f85c58c-a6')
Nov 28 10:51:09 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9e0cc93-8212-495c-b71c-678701716cac tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e0cc93-8212-495c-b71c-678701716cac tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:c7b4d4f9-945c-40c4-b5ac-b2744973727a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zfFgasRr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:51:09 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-b9e0cc93-8212-495c-b71c-678701716cac tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:51:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-b9e0cc93-8212-495c-b71c-678701716cac tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-b9e0cc93-8212-495c-b71c-678701716cac tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d68c412-f44c-40da-a1cc-55256cceb377]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7b4d4f9-945c-40c4-b5ac-b2744973727a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e0cc93-8212-495c-b71c-678701716cac tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 10:51:09 user nova-compute[74994]: No targets found.
Nov 28 10:51:09 user nova-compute[74994]: iSNS:
Nov 28 10:51:09 user nova-compute[74994]: No targets found.
Nov 28 10:51:09 user nova-compute[74994]: STATIC:
Nov 28 10:51:09 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab
Nov 28 10:51:09 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:51:09 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:51:09 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148
Nov 28 10:51:09 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:51:09 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:51:09 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:c7b4d4f9-945c-40c4-b5ac-b2744973727a
Nov 28 10:51:09 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:51:09 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:51:09 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0
Nov 28 10:51:09 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:51:09 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:51:09 user nova-compute[74994]: FIRMWARE:
Nov 28 10:51:09 user nova-compute[74994]: No targets found.
Nov 28 10:51:09 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e0cc93-8212-495c-b71c-678701716cac tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 10:51:09 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 10:51:09 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e0cc93-8212-495c-b71c-678701716cac tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7b4d4f9-945c-40c4-b5ac-b2744973727a', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "cce813fa-bf97-41f8-8aee-c7a73354e24c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "cce813fa-bf97-41f8-8aee-c7a73354e24c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bde5f32-c11e-4790-a034-872f880ba8c2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7b4d4f9-945c-40c4-b5ac-b2744973727a\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG nova.objects.instance [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lazy-loading 'flavor' on Instance uuid cce813fa-bf97-41f8-8aee-c7a73354e24c {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9558203d-3ac1-40c3-8445-5103d93b2927]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b4d4f9-945c-40c4-b5ac-b2744973727a (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e0cc93-8212-495c-b71c-678701716cac tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:51:09 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:51:09 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:51:09 user nova-compute[74994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b4d4f9-945c-40c4-b5ac-b2744973727a (non-flash)
Nov 28 10:51:09 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e0cc93-8212-495c-b71c-678701716cac tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:51:09 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:51:09 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:51:09 user nova-compute[74994]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b4d4f9-945c-40c4-b5ac-b2744973727a (non-flash)
Nov 28 10:51:09 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e0cc93-8212-495c-b71c-678701716cac tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9445c0310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7b4d4f9-945c-40c4-b5ac-b2744973727a'): ({'sde'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-b9e0cc93-8212-495c-b71c-678701716cac tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Removing single pathed devices sde {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json" returned: 0 in 0.263s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6c5c88-8026-4a71-8686-ddfeaaf2a1c9]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "cce813fa-bf97-41f8-8aee-c7a73354e24c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.101s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0743b2-b685-4097-b502-9fe3d622d3d7]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-b9e0cc93-8212-495c-b71c-678701716cac tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Flushing IO for device /dev/sde {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecab0427-c416-40b4-8c1f-65204986354a]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-b9e0cc93-8212-495c-b71c-678701716cac tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac035897-32ca-481e-a667-6e8fdbc80f45]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-b9e0cc93-8212-495c-b71c-678701716cac tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-b9e0cc93-8212-495c-b71c-678701716cac tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] SCSI volumes sde have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e0cc93-8212-495c-b71c-678701716cac tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7b4d4f9-945c-40c4-b5ac-b2744973727a')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b4d4f9-945c-40c4-b5ac-b2744973727a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b4d4f9-945c-40c4-b5ac-b2744973727a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0564128e-79ff-4f04-88e0-bf4ffd814030]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e0cc93-8212-495c-b71c-678701716cac tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b4d4f9-945c-40c4-b5ac-b2744973727a -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b4d4f9-945c-40c4-b5ac-b2744973727a -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:10 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4ae4f6-daa4-4f9e-8e5d-e743065d4d03]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:c7b4d4f9-945c-40c4-b5ac-b2744973727a, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:c7b4d4f9-945c-40c4-b5ac-b2744973727a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e0cc93-8212-495c-b71c-678701716cac tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:c7b4d4f9-945c-40c4-b5ac-b2744973727a, portal: 172.16.0.220,3260]
Nov 28 10:51:10 user nova-compute[74994]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:c7b4d4f9-945c-40c4-b5ac-b2744973727a, portal: 172.16.0.220,3260] successful.
Nov 28 10:51:10 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b4d4f9-945c-40c4-b5ac-b2744973727a -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:10 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "cce813fa-bf97-41f8-8aee-c7a73354e24c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:51:10 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "cce813fa-bf97-41f8-8aee-c7a73354e24c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:51:10 user nova-compute[74994]: INFO nova.compute.manager [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Attaching volume 4b9fff2c-c9af-4563-8213-ebc7815d3d2f to /dev/vdb
Nov 28 10:51:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b4d4f9-945c-40c4-b5ac-b2744973727a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:10 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c666fe3-c194-405e-983b-b274edec9635]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e0cc93-8212-495c-b71c-678701716cac tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-b9e0cc93-8212-495c-b71c-678701716cac tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.430s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:51:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e0cc93-8212-495c-b71c-678701716cac tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] <== disconnect_volume: return (435ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:51:10 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9e0cc93-8212-495c-b71c-678701716cac tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 10:51:10 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-b9e0cc93-8212-495c-b71c-678701716cac tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Deleting instance files /opt/stack/data/nova/instances/a8b4b5dc-0696-4a01-8318-7d3ec2014d6e_del
Nov 28 10:51:10 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-b9e0cc93-8212-495c-b71c-678701716cac tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Deletion of /opt/stack/data/nova/instances/a8b4b5dc-0696-4a01-8318-7d3ec2014d6e_del complete
Nov 28 10:51:10 user nova-compute[74994]: DEBUG os_brick.utils [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:51:10 user nova-compute[74994]: INFO nova.compute.manager [None req-b9e0cc93-8212-495c-b71c-678701716cac tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Took 1.55 seconds to destroy the instance on the hypervisor.
Nov 28 10:51:10 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-b9e0cc93-8212-495c-b71c-678701716cac tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 10:51:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:10 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 10:51:10 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 10:51:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:10 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[926bd71c-1cd3-4561-a61e-e273631f97e6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:10 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[37172342-4815-43b5-bf2d-ef98cd0dbfb5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:10 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc465052-fc2d-4b64-b6ae-9949749a1d28]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:10 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da72ad5-5f86-4b34-9263-ef69a70aef07]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:51:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 10:51:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:51:10 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 10:51:10 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28fa57d-efe5-46d4-bd9d-7a3a2eb8f727]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 10:51:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 10:51:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 10:51:10 user nova-compute[74994]: DEBUG os_brick.utils [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] <== get_connector_properties: return (176ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:51:10 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Updating existing volume attachment record: 4d72ebf5-46a0-417b-84b5-e11793df11ff {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 10:51:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2925833-e88d-4aa7-a477-ff1bc1fcd724/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2925833-e88d-4aa7-a477-ff1bc1fcd724/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2925833-e88d-4aa7-a477-ff1bc1fcd724/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:10 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:51:11 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Took 0.85 seconds to deallocate network for instance.
Nov 28 10:51:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2925833-e88d-4aa7-a477-ff1bc1fcd724/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:11 user nova-compute[74994]: DEBUG nova.compute.manager [req-10eb6e85-79b4-437e-b634-5bced2ad9b8d req-ed8fd4c4-6ea7-483a-90ea-11d90a521a8b service nova] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Received event network-changed-7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:51:11 user nova-compute[74994]: DEBUG nova.compute.manager [req-10eb6e85-79b4-437e-b634-5bced2ad9b8d req-ed8fd4c4-6ea7-483a-90ea-11d90a521a8b service nova] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Refreshing instance network info cache due to event network-changed-7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:51:11 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-10eb6e85-79b4-437e-b634-5bced2ad9b8d req-ed8fd4c4-6ea7-483a-90ea-11d90a521a8b service nova] Acquiring lock "refresh_cache-2535b6f2-2a4b-4ce1-bd47-0f97d15700fb" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:51:11 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-10eb6e85-79b4-437e-b634-5bced2ad9b8d req-ed8fd4c4-6ea7-483a-90ea-11d90a521a8b service nova] Acquired lock "refresh_cache-2535b6f2-2a4b-4ce1-bd47-0f97d15700fb" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:51:11 user nova-compute[74994]: DEBUG nova.network.neutron [req-10eb6e85-79b4-437e-b634-5bced2ad9b8d req-ed8fd4c4-6ea7-483a-90ea-11d90a521a8b service nova] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Refreshing network info cache for port 7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:51:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:11 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 10:51:11 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 10:51:11 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 10:51:11 user nova-compute[74994]: INFO nova.compute.manager [None req-b9e0cc93-8212-495c-b71c-678701716cac tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Took 0.96 seconds to detach 1 volumes for instance.
Nov 28 10:51:12 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:51:12 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:51:12 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=6962MB free_disk=25.43768310546875GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 10:51:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:51:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:51:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b9e0cc93-8212-495c-b71c-678701716cac tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:51:12 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:51:12 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance bf357856-2d97-42e8-928d-71d0378f48c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:51:12 user nova-compute[74994]: WARNING nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance a8b4b5dc-0696-4a01-8318-7d3ec2014d6e is not being actively managed by this compute host but has allocations referencing this compute host: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocation because we do not know what to do.
Nov 28 10:51:12 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 279e1c4c-36f9-492f-ab3f-1b587347eadd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:51:12 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 5b51d690-8198-4748-807d-1902e75564b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:51:12 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance cce813fa-bf97-41f8-8aee-c7a73354e24c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:51:12 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:51:12 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 2e30565c-9f8e-4a87-8054-6c260dac4f48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:51:12 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:51:12 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance c2925833-e88d-4aa7-a477-ff1bc1fcd724 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:51:12 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 6e6a974e-3626-453c-8662-0d160f6e57de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:51:12 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance af9e5a26-f865-4563-aed9-34b8ed5b6697 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:51:12 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance bc114bed-8d7e-46e0-86a7-7eed7ce75b5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:51:12 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 10:51:12 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 10:51:12 user nova-compute[74994]: DEBUG nova.network.neutron [req-10eb6e85-79b4-437e-b634-5bced2ad9b8d req-ed8fd4c4-6ea7-483a-90ea-11d90a521a8b service nova] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Updated VIF entry in instance network info cache for port 7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 10:51:12 user nova-compute[74994]: DEBUG nova.network.neutron [req-10eb6e85-79b4-437e-b634-5bced2ad9b8d req-ed8fd4c4-6ea7-483a-90ea-11d90a521a8b service nova] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Updating instance_info_cache with network_info: [{"id": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "address": "fa:16:3e:5d:59:b1", "network": {"id": "670b5fe0-96f5-4414-9425-31ee24eda138", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1327797043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9bc007c45c84765bb2739844c7af055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcb29ac-ee", "ovs_interfaceid": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:51:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-10eb6e85-79b4-437e-b634-5bced2ad9b8d req-ed8fd4c4-6ea7-483a-90ea-11d90a521a8b service nova] Releasing lock "refresh_cache-2535b6f2-2a4b-4ce1-bd47-0f97d15700fb" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:51:12 user nova-compute[74994]: DEBUG nova.compute.manager [req-10eb6e85-79b4-437e-b634-5bced2ad9b8d req-ed8fd4c4-6ea7-483a-90ea-11d90a521a8b service nova] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Received event network-vif-plugged-2f85c58c-a67a-435e-95bd-ae59a03c7a14 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:51:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-10eb6e85-79b4-437e-b634-5bced2ad9b8d req-ed8fd4c4-6ea7-483a-90ea-11d90a521a8b service nova] Acquiring lock "a8b4b5dc-0696-4a01-8318-7d3ec2014d6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:51:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-10eb6e85-79b4-437e-b634-5bced2ad9b8d req-ed8fd4c4-6ea7-483a-90ea-11d90a521a8b service nova] Lock "a8b4b5dc-0696-4a01-8318-7d3ec2014d6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:51:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-10eb6e85-79b4-437e-b634-5bced2ad9b8d req-ed8fd4c4-6ea7-483a-90ea-11d90a521a8b service nova] Lock "a8b4b5dc-0696-4a01-8318-7d3ec2014d6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:51:12 user nova-compute[74994]: DEBUG nova.compute.manager [req-10eb6e85-79b4-437e-b634-5bced2ad9b8d req-ed8fd4c4-6ea7-483a-90ea-11d90a521a8b service nova] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] No waiting events found dispatching network-vif-plugged-2f85c58c-a67a-435e-95bd-ae59a03c7a14 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:51:12 user nova-compute[74994]: WARNING nova.compute.manager [req-10eb6e85-79b4-437e-b634-5bced2ad9b8d req-ed8fd4c4-6ea7-483a-90ea-11d90a521a8b service nova] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Received unexpected event network-vif-plugged-2f85c58c-a67a-435e-95bd-ae59a03c7a14 for instance with vm_state active and task_state deleting.
Nov 28 10:51:12 user nova-compute[74994]: DEBUG nova.compute.manager [req-10eb6e85-79b4-437e-b634-5bced2ad9b8d req-ed8fd4c4-6ea7-483a-90ea-11d90a521a8b service nova] [instance: a8b4b5dc-0696-4a01-8318-7d3ec2014d6e] Received event network-vif-deleted-2f85c58c-a67a-435e-95bd-ae59a03c7a14 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:51:12 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:51:12 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:51:12 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 10:51:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.879s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:51:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b9e0cc93-8212-495c-b71c-678701716cac tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.844s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:51:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b9e0cc93-8212-495c-b71c-678701716cac tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.004s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:51:12 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-b9e0cc93-8212-495c-b71c-678701716cac tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Deleted allocations for instance a8b4b5dc-0696-4a01-8318-7d3ec2014d6e
Nov 28 10:51:13 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b9e0cc93-8212-495c-b71c-678701716cac tempest-DeleteServersTestJSON-156220800 tempest-DeleteServersTestJSON-156220800-project-member] Lock "a8b4b5dc-0696-4a01-8318-7d3ec2014d6e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.459s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:51:13 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:51:13 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:51:13 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:51:13 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:51:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:18 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 10:51:18 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ezrovKLR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:51:18 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:51:18 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:51:18 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:51:18 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:51:18 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:51:18 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:51:18 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 10:51:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:18 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea54d31-39f9-41e5-88cb-6dac2f4a4b07]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:18 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 10:51:18 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:18 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ea830a-49b5-4e95-8f54-6f7b7cbedaa2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:18 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f] added
Nov 28 10:51:18 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:18 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[37860571-cf4e-4e78-a378-e14ceeae3671]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:18 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:18 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[838e5b69-9194-4987-a889-4112dcb55258]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:18 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ezrovKLR {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ezrovKLR" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:18 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[286e2392-3523-4765-b4fc-cdceefc46a30]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:18 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ezrovKLR'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:18 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d57cd0b-fae4-404d-9036-55061a9d9be3]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:18 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:18 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0de744-e2ec-489f-b0ec-12b450672854]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:18 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:51:18 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:51:18 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:51:18 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:51:18 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:51:18 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:51:18 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:51:18 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:51:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:19 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebfc33e8-1e9f-4f87-a283-72f3b5d59c46]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:19 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f, portal: 172.16.0.220,3260]
Nov 28 10:51:19 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f, portal: 172.16.0.220,3260] successful.
Nov 28 10:51:19 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:19 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2e1eab-dace-4947-92b5-8fee758d5ccf]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:19 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:19 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5948c47b-5faa-44c4-b293-7e26ab78073f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:19 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:51:19 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:51:19 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:51:19 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:51:19 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:51:19 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:51:19 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:51:19 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:51:19 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:51:19 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:51:19 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:51:19 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 10:51:19 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 10:51:19 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 10:51:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:19 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac93c2b1-515d-4167-8fb5-84a55a678eae]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:19 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 10:51:19 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ezrovKLR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 10:51:19 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:20 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:51:20 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '26261373136303166', 'path': '/dev/sde'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:51:20 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261373136303166', 'path': '/dev/sde'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 10:51:20 user nova-compute[74994]: DEBUG nova.objects.instance [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lazy-loading 'flavor' on Instance uuid cce813fa-bf97-41f8-8aee-c7a73354e24c {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:51:20 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 10:51:20 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 10:51:20 user nova-compute[74994]:   <source dev="/dev/sde"/>
Nov 28 10:51:20 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 10:51:20 user nova-compute[74994]:   <serial>4b9fff2c-c9af-4563-8213-ebc7815d3d2f</serial>
Nov 28 10:51:20 user nova-compute[74994]: </disk>
Nov 28 10:51:20 user nova-compute[74994]:  {{(pid=74994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 10:51:20 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:51:20 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:51:20 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] No VIF found with MAC fa:16:3e:a0:b1:ed, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:51:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-848dd24c-4abd-4ac1-adfb-1e49d4e23309 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "cce813fa-bf97-41f8-8aee-c7a73354e24c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.860s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:51:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "63b5b88a-f126-4e6c-926d-0a295830240d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:51:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "63b5b88a-f126-4e6c-926d-0a295830240d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:51:23 user nova-compute[74994]: DEBUG nova.compute.manager [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 10:51:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:51:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:51:23 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 10:51:23 user nova-compute[74994]: INFO nova.compute.claims [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Claim successful on node user
Nov 28 10:51:23 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:51:23 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:51:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.431s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:51:23 user nova-compute[74994]: DEBUG nova.compute.manager [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 10:51:24 user nova-compute[74994]: DEBUG nova.compute.manager [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 10:51:24 user nova-compute[74994]: DEBUG nova.network.neutron [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 10:51:24 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 10:51:24 user nova-compute[74994]: DEBUG nova.compute.manager [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 10:51:24 user nova-compute[74994]: DEBUG nova.policy [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa362c35530641a687a33182012c2332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636fa9a1f046425e9332cc3807f8fb46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 10:51:24 user nova-compute[74994]: DEBUG nova.compute.manager [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 10:51:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 10:51:24 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Creating image(s)
Nov 28 10:51:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "/opt/stack/data/nova/instances/63b5b88a-f126-4e6c-926d-0a295830240d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:51:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "/opt/stack/data/nova/instances/63b5b88a-f126-4e6c-926d-0a295830240d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:51:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "/opt/stack/data/nova/instances/63b5b88a-f126-4e6c-926d-0a295830240d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:51:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.224s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:51:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:51:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.174s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/63b5b88a-f126-4e6c-926d-0a295830240d/disk 1073741824 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/63b5b88a-f126-4e6c-926d-0a295830240d/disk 1073741824" returned: 0 in 0.064s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:51:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:24 user nova-compute[74994]: DEBUG nova.network.neutron [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Successfully created port: 59550f49-12c8-4ca1-b957-2c0a631dfa84 {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 10:51:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.175s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:24 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Checking if we can resize image /opt/stack/data/nova/instances/63b5b88a-f126-4e6c-926d-0a295830240d/disk. size=1073741824 {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 10:51:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63b5b88a-f126-4e6c-926d-0a295830240d/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63b5b88a-f126-4e6c-926d-0a295830240d/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Cannot resize image /opt/stack/data/nova/instances/63b5b88a-f126-4e6c-926d-0a295830240d/disk to a smaller size. {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Created local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Ensure instance console log exists: /opt/stack/data/nova/instances/63b5b88a-f126-4e6c-926d-0a295830240d/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG nova.network.neutron [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Successfully updated port: 59550f49-12c8-4ca1-b957-2c0a631dfa84 {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "refresh_cache-63b5b88a-f126-4e6c-926d-0a295830240d" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquired lock "refresh_cache-63b5b88a-f126-4e6c-926d-0a295830240d" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG nova.network.neutron [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG nova.compute.manager [req-953ad01f-4f57-4625-b78c-8b06ea24a5cf req-697058aa-a29e-456e-83f6-67cbd5f78bfc service nova] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Received event network-changed-59550f49-12c8-4ca1-b957-2c0a631dfa84 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG nova.compute.manager [req-953ad01f-4f57-4625-b78c-8b06ea24a5cf req-697058aa-a29e-456e-83f6-67cbd5f78bfc service nova] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Refreshing instance network info cache due to event network-changed-59550f49-12c8-4ca1-b957-2c0a631dfa84. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-953ad01f-4f57-4625-b78c-8b06ea24a5cf req-697058aa-a29e-456e-83f6-67cbd5f78bfc service nova] Acquiring lock "refresh_cache-63b5b88a-f126-4e6c-926d-0a295830240d" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG nova.network.neutron [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG nova.network.neutron [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Updating instance_info_cache with network_info: [{"id": "59550f49-12c8-4ca1-b957-2c0a631dfa84", "address": "fa:16:3e:1a:59:9b", "network": {"id": "d9bcdec6-69e0-4e65-8a26-1af1f8232365", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1227861580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "636fa9a1f046425e9332cc3807f8fb46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59550f49-12", "ovs_interfaceid": "59550f49-12c8-4ca1-b957-2c0a631dfa84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Releasing lock "refresh_cache-63b5b88a-f126-4e6c-926d-0a295830240d" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG nova.compute.manager [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Instance network_info: |[{"id": "59550f49-12c8-4ca1-b957-2c0a631dfa84", "address": "fa:16:3e:1a:59:9b", "network": {"id": "d9bcdec6-69e0-4e65-8a26-1af1f8232365", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1227861580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "636fa9a1f046425e9332cc3807f8fb46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59550f49-12", "ovs_interfaceid": "59550f49-12c8-4ca1-b957-2c0a631dfa84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-953ad01f-4f57-4625-b78c-8b06ea24a5cf req-697058aa-a29e-456e-83f6-67cbd5f78bfc service nova] Acquired lock "refresh_cache-63b5b88a-f126-4e6c-926d-0a295830240d" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG nova.network.neutron [req-953ad01f-4f57-4625-b78c-8b06ea24a5cf req-697058aa-a29e-456e-83f6-67cbd5f78bfc service nova] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Refreshing network info cache for port 59550f49-12c8-4ca1-b957-2c0a631dfa84 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Start _get_guest_xml network_info=[{"id": "59550f49-12c8-4ca1-b957-2c0a631dfa84", "address": "fa:16:3e:1a:59:9b", "network": {"id": "d9bcdec6-69e0-4e65-8a26-1af1f8232365", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1227861580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "636fa9a1f046425e9332cc3807f8fb46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59550f49-12", "ovs_interfaceid": "59550f49-12c8-4ca1-b957-2c0a631dfa84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'aa939d1b-b8a6-4391-935b-0191bf5ccd0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 10:51:25 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:51:25 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:51:25 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:51:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1117895133',display_name='tempest-AttachVolumeNegativeTest-server-1117895133',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1117895133',id=14,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEH1KcPGoGPtQOzn5rBVy1i6ItldzWcHpQ1PquDF1As9wYO1hdMQZPOQzKiishEgDMknfICbgGzofeNdERRvGofm+3hNx6j4nbVv9JgNI+3hFC4tqWd1XfqEEyvxAfrFg==',key_name='tempest-keypair-1873639358',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='636fa9a1f046425e9332cc3807f8fb46',ramdisk_id='',reservation_id='r-l8f9vy9a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-3431122',owner_user_name='tempest-AttachVolumeNegativeTest-3431122-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:51:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa362c35530641a687a33182012c2332',uuid=63b5b88a-f126-4e6c-926d-0a295830240d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59550f49-12c8-4ca1-b957-2c0a631dfa84", "address": "fa:16:3e:1a:59:9b", "network": {"id": "d9bcdec6-69e0-4e65-8a26-1af1f8232365", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1227861580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "636fa9a1f046425e9332cc3807f8fb46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59550f49-12", "ovs_interfaceid": "59550f49-12c8-4ca1-b957-2c0a631dfa84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Converting VIF {"id": "59550f49-12c8-4ca1-b957-2c0a631dfa84", "address": "fa:16:3e:1a:59:9b", "network": {"id": "d9bcdec6-69e0-4e65-8a26-1af1f8232365", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1227861580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "636fa9a1f046425e9332cc3807f8fb46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59550f49-12", "ovs_interfaceid": "59550f49-12c8-4ca1-b957-2c0a631dfa84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:59:9b,bridge_name='br-int',has_traffic_filtering=True,id=59550f49-12c8-4ca1-b957-2c0a631dfa84,network=Network(d9bcdec6-69e0-4e65-8a26-1af1f8232365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59550f49-12') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG nova.objects.instance [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lazy-loading 'pci_devices' on Instance uuid 63b5b88a-f126-4e6c-926d-0a295830240d {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] End _get_guest_xml xml=<domain type="kvm">
Nov 28 10:51:25 user nova-compute[74994]:   <uuid>63b5b88a-f126-4e6c-926d-0a295830240d</uuid>
Nov 28 10:51:25 user nova-compute[74994]:   <name>instance-0000000e</name>
Nov 28 10:51:25 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 10:51:25 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 10:51:25 user nova-compute[74994]:   <metadata>
Nov 28 10:51:25 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 10:51:25 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 10:51:25 user nova-compute[74994]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1117895133</nova:name>
Nov 28 10:51:25 user nova-compute[74994]:       <nova:creationTime>2023-11-28 10:51:25</nova:creationTime>
Nov 28 10:51:25 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 10:51:25 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 10:51:25 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 10:51:25 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 10:51:25 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 10:51:25 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 10:51:25 user nova-compute[74994]:       </nova:flavor>
Nov 28 10:51:25 user nova-compute[74994]:       <nova:owner>
Nov 28 10:51:25 user nova-compute[74994]:         <nova:user uuid="aa362c35530641a687a33182012c2332">tempest-AttachVolumeNegativeTest-3431122-project-member</nova:user>
Nov 28 10:51:25 user nova-compute[74994]:         <nova:project uuid="636fa9a1f046425e9332cc3807f8fb46">tempest-AttachVolumeNegativeTest-3431122</nova:project>
Nov 28 10:51:25 user nova-compute[74994]:       </nova:owner>
Nov 28 10:51:25 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 10:51:25 user nova-compute[74994]:       <nova:ports>
Nov 28 10:51:25 user nova-compute[74994]:         <nova:port uuid="59550f49-12c8-4ca1-b957-2c0a631dfa84">
Nov 28 10:51:25 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 28 10:51:25 user nova-compute[74994]:         </nova:port>
Nov 28 10:51:25 user nova-compute[74994]:       </nova:ports>
Nov 28 10:51:25 user nova-compute[74994]:     </nova:instance>
Nov 28 10:51:25 user nova-compute[74994]:   </metadata>
Nov 28 10:51:25 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 10:51:25 user nova-compute[74994]:     <system>
Nov 28 10:51:25 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 10:51:25 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 10:51:25 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 10:51:25 user nova-compute[74994]:       <entry name="serial">63b5b88a-f126-4e6c-926d-0a295830240d</entry>
Nov 28 10:51:25 user nova-compute[74994]:       <entry name="uuid">63b5b88a-f126-4e6c-926d-0a295830240d</entry>
Nov 28 10:51:25 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 10:51:25 user nova-compute[74994]:     </system>
Nov 28 10:51:25 user nova-compute[74994]:   </sysinfo>
Nov 28 10:51:25 user nova-compute[74994]:   <os>
Nov 28 10:51:25 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 10:51:25 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 10:51:25 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 10:51:25 user nova-compute[74994]:   </os>
Nov 28 10:51:25 user nova-compute[74994]:   <features>
Nov 28 10:51:25 user nova-compute[74994]:     <acpi/>
Nov 28 10:51:25 user nova-compute[74994]:     <apic/>
Nov 28 10:51:25 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 10:51:25 user nova-compute[74994]:   </features>
Nov 28 10:51:25 user nova-compute[74994]:   <clock offset="utc">
Nov 28 10:51:25 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 10:51:25 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 10:51:25 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 10:51:25 user nova-compute[74994]:   </clock>
Nov 28 10:51:25 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 10:51:25 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 10:51:25 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 10:51:25 user nova-compute[74994]:   </cpu>
Nov 28 10:51:25 user nova-compute[74994]:   <devices>
Nov 28 10:51:25 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 10:51:25 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 10:51:25 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/63b5b88a-f126-4e6c-926d-0a295830240d/disk"/>
Nov 28 10:51:25 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 10:51:25 user nova-compute[74994]:     </disk>
Nov 28 10:51:25 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 10:51:25 user nova-compute[74994]:       <mac address="fa:16:3e:1a:59:9b"/>
Nov 28 10:51:25 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:51:25 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 10:51:25 user nova-compute[74994]:       <target dev="tap59550f49-12"/>
Nov 28 10:51:25 user nova-compute[74994]:     </interface>
Nov 28 10:51:25 user nova-compute[74994]:     <serial type="pty">
Nov 28 10:51:25 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/63b5b88a-f126-4e6c-926d-0a295830240d/console.log" append="off"/>
Nov 28 10:51:25 user nova-compute[74994]:     </serial>
Nov 28 10:51:25 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 10:51:25 user nova-compute[74994]:     <video>
Nov 28 10:51:25 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:51:25 user nova-compute[74994]:     </video>
Nov 28 10:51:25 user nova-compute[74994]:     <rng model="virtio">
Nov 28 10:51:25 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 10:51:25 user nova-compute[74994]:     </rng>
Nov 28 10:51:25 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 10:51:25 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 10:51:25 user nova-compute[74994]:       <stats period="10"/>
Nov 28 10:51:25 user nova-compute[74994]:     </memballoon>
Nov 28 10:51:25 user nova-compute[74994]:   </devices>
Nov 28 10:51:25 user nova-compute[74994]: </domain>
Nov 28 10:51:25 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:51:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1117895133',display_name='tempest-AttachVolumeNegativeTest-server-1117895133',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1117895133',id=14,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEH1KcPGoGPtQOzn5rBVy1i6ItldzWcHpQ1PquDF1As9wYO1hdMQZPOQzKiishEgDMknfICbgGzofeNdERRvGofm+3hNx6j4nbVv9JgNI+3hFC4tqWd1XfqEEyvxAfrFg==',key_name='tempest-keypair-1873639358',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='636fa9a1f046425e9332cc3807f8fb46',ramdisk_id='',reservation_id='r-l8f9vy9a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-3431122',owner_user_name='tempest-AttachVolumeNegativeTest-3431122-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:51:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa362c35530641a687a33182012c2332',uuid=63b5b88a-f126-4e6c-926d-0a295830240d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59550f49-12c8-4ca1-b957-2c0a631dfa84", "address": "fa:16:3e:1a:59:9b", "network": {"id": "d9bcdec6-69e0-4e65-8a26-1af1f8232365", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1227861580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "636fa9a1f046425e9332cc3807f8fb46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59550f49-12", "ovs_interfaceid": "59550f49-12c8-4ca1-b957-2c0a631dfa84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Converting VIF {"id": "59550f49-12c8-4ca1-b957-2c0a631dfa84", "address": "fa:16:3e:1a:59:9b", "network": {"id": "d9bcdec6-69e0-4e65-8a26-1af1f8232365", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1227861580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "636fa9a1f046425e9332cc3807f8fb46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59550f49-12", "ovs_interfaceid": "59550f49-12c8-4ca1-b957-2c0a631dfa84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:59:9b,bridge_name='br-int',has_traffic_filtering=True,id=59550f49-12c8-4ca1-b957-2c0a631dfa84,network=Network(d9bcdec6-69e0-4e65-8a26-1af1f8232365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59550f49-12') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG os_vif [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:59:9b,bridge_name='br-int',has_traffic_filtering=True,id=59550f49-12c8-4ca1-b957-2c0a631dfa84,network=Network(d9bcdec6-69e0-4e65-8a26-1af1f8232365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59550f49-12') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c590f75a-7f46-5965-a650-cdbd9648703e', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap59550f49-12, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap59550f49-12, col_values=(('qos', UUID('c295f6d7-7ca0-467e-af38-1a7be16c4808')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap59550f49-12, col_values=(('external_ids', {'iface-id': '59550f49-12c8-4ca1-b957-2c0a631dfa84', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:59:9b', 'vm-uuid': '63b5b88a-f126-4e6c-926d-0a295830240d'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:25 user nova-compute[74994]: INFO os_vif [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:59:9b,bridge_name='br-int',has_traffic_filtering=True,id=59550f49-12c8-4ca1-b957-2c0a631dfa84,network=Network(d9bcdec6-69e0-4e65-8a26-1af1f8232365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59550f49-12')
Nov 28 10:51:25 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:51:25 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] No VIF found with MAC fa:16:3e:1a:59:9b, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:51:26 user nova-compute[74994]: DEBUG nova.network.neutron [req-953ad01f-4f57-4625-b78c-8b06ea24a5cf req-697058aa-a29e-456e-83f6-67cbd5f78bfc service nova] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Updated VIF entry in instance network info cache for port 59550f49-12c8-4ca1-b957-2c0a631dfa84. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 10:51:26 user nova-compute[74994]: DEBUG nova.network.neutron [req-953ad01f-4f57-4625-b78c-8b06ea24a5cf req-697058aa-a29e-456e-83f6-67cbd5f78bfc service nova] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Updating instance_info_cache with network_info: [{"id": "59550f49-12c8-4ca1-b957-2c0a631dfa84", "address": "fa:16:3e:1a:59:9b", "network": {"id": "d9bcdec6-69e0-4e65-8a26-1af1f8232365", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1227861580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "636fa9a1f046425e9332cc3807f8fb46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59550f49-12", "ovs_interfaceid": "59550f49-12c8-4ca1-b957-2c0a631dfa84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:51:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-953ad01f-4f57-4625-b78c-8b06ea24a5cf req-697058aa-a29e-456e-83f6-67cbd5f78bfc service nova] Releasing lock "refresh_cache-63b5b88a-f126-4e6c-926d-0a295830240d" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:51:26 user nova-compute[74994]: DEBUG nova.compute.manager [req-d9649f5e-9478-4385-a2a3-90dde39d812f req-1ef02a6c-a527-4eb1-b063-2d9b0c1ffdc9 service nova] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Received event network-changed-11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:51:26 user nova-compute[74994]: DEBUG nova.compute.manager [req-d9649f5e-9478-4385-a2a3-90dde39d812f req-1ef02a6c-a527-4eb1-b063-2d9b0c1ffdc9 service nova] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Refreshing instance network info cache due to event network-changed-11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:51:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d9649f5e-9478-4385-a2a3-90dde39d812f req-1ef02a6c-a527-4eb1-b063-2d9b0c1ffdc9 service nova] Acquiring lock "refresh_cache-2e30565c-9f8e-4a87-8054-6c260dac4f48" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:51:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d9649f5e-9478-4385-a2a3-90dde39d812f req-1ef02a6c-a527-4eb1-b063-2d9b0c1ffdc9 service nova] Acquired lock "refresh_cache-2e30565c-9f8e-4a87-8054-6c260dac4f48" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:51:26 user nova-compute[74994]: DEBUG nova.network.neutron [req-d9649f5e-9478-4385-a2a3-90dde39d812f req-1ef02a6c-a527-4eb1-b063-2d9b0c1ffdc9 service nova] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Refreshing network info cache for port 11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:51:26 user nova-compute[74994]: DEBUG nova.network.neutron [req-d9649f5e-9478-4385-a2a3-90dde39d812f req-1ef02a6c-a527-4eb1-b063-2d9b0c1ffdc9 service nova] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Updated VIF entry in instance network info cache for port 11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 10:51:26 user nova-compute[74994]: DEBUG nova.network.neutron [req-d9649f5e-9478-4385-a2a3-90dde39d812f req-1ef02a6c-a527-4eb1-b063-2d9b0c1ffdc9 service nova] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Updating instance_info_cache with network_info: [{"id": "11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3", "address": "fa:16:3e:f3:12:45", "network": {"id": "fcf8118a-9224-4f12-b8cc-2936753d9e61", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1394689629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf57a964f98428c95cf169927522860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a544cf-6a", "ovs_interfaceid": "11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:51:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d9649f5e-9478-4385-a2a3-90dde39d812f req-1ef02a6c-a527-4eb1-b063-2d9b0c1ffdc9 service nova] Releasing lock "refresh_cache-2e30565c-9f8e-4a87-8054-6c260dac4f48" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:51:27 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:27 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:27 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:27 user nova-compute[74994]: DEBUG nova.compute.manager [req-3d3dbef4-0997-400d-9f6f-f2bbf2a08148 req-302f6a62-17ed-4cd6-ae6e-31ab5dd0bff2 service nova] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Received event network-vif-plugged-59550f49-12c8-4ca1-b957-2c0a631dfa84 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:51:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-3d3dbef4-0997-400d-9f6f-f2bbf2a08148 req-302f6a62-17ed-4cd6-ae6e-31ab5dd0bff2 service nova] Acquiring lock "63b5b88a-f126-4e6c-926d-0a295830240d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:51:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-3d3dbef4-0997-400d-9f6f-f2bbf2a08148 req-302f6a62-17ed-4cd6-ae6e-31ab5dd0bff2 service nova] Lock "63b5b88a-f126-4e6c-926d-0a295830240d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:51:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-3d3dbef4-0997-400d-9f6f-f2bbf2a08148 req-302f6a62-17ed-4cd6-ae6e-31ab5dd0bff2 service nova] Lock "63b5b88a-f126-4e6c-926d-0a295830240d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:51:27 user nova-compute[74994]: DEBUG nova.compute.manager [req-3d3dbef4-0997-400d-9f6f-f2bbf2a08148 req-302f6a62-17ed-4cd6-ae6e-31ab5dd0bff2 service nova] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] No waiting events found dispatching network-vif-plugged-59550f49-12c8-4ca1-b957-2c0a631dfa84 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:51:27 user nova-compute[74994]: WARNING nova.compute.manager [req-3d3dbef4-0997-400d-9f6f-f2bbf2a08148 req-302f6a62-17ed-4cd6-ae6e-31ab5dd0bff2 service nova] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Received unexpected event network-vif-plugged-59550f49-12c8-4ca1-b957-2c0a631dfa84 for instance with vm_state building and task_state spawning.
Nov 28 10:51:27 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:27 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Acquiring lock "2e30565c-9f8e-4a87-8054-6c260dac4f48" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:51:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lock "2e30565c-9f8e-4a87-8054-6c260dac4f48" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:51:29 user nova-compute[74994]: DEBUG nova.objects.instance [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lazy-loading 'flavor' on Instance uuid 2e30565c-9f8e-4a87-8054-6c260dac4f48 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:51:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lock "2e30565c-9f8e-4a87-8054-6c260dac4f48" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:51:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Acquiring lock "2e30565c-9f8e-4a87-8054-6c260dac4f48" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:51:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lock "2e30565c-9f8e-4a87-8054-6c260dac4f48" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:51:29 user nova-compute[74994]: INFO nova.compute.manager [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Attaching volume d499c4cb-3f36-4ba5-a4a5-f09f0c50937b to /dev/vdb
Nov 28 10:51:29 user nova-compute[74994]: DEBUG os_brick.utils [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:51:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:29 user nova-compute[74994]: DEBUG nova.compute.manager [req-d76bc2b9-313a-42ab-b4b3-2d35c22d178a req-41b1d410-3a3f-4797-9505-62467a6605bb service nova] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Received event network-vif-plugged-59550f49-12c8-4ca1-b957-2c0a631dfa84 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:51:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d76bc2b9-313a-42ab-b4b3-2d35c22d178a req-41b1d410-3a3f-4797-9505-62467a6605bb service nova] Acquiring lock "63b5b88a-f126-4e6c-926d-0a295830240d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:51:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d76bc2b9-313a-42ab-b4b3-2d35c22d178a req-41b1d410-3a3f-4797-9505-62467a6605bb service nova] Lock "63b5b88a-f126-4e6c-926d-0a295830240d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:51:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d76bc2b9-313a-42ab-b4b3-2d35c22d178a req-41b1d410-3a3f-4797-9505-62467a6605bb service nova] Lock "63b5b88a-f126-4e6c-926d-0a295830240d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:51:29 user nova-compute[74994]: DEBUG nova.compute.manager [req-d76bc2b9-313a-42ab-b4b3-2d35c22d178a req-41b1d410-3a3f-4797-9505-62467a6605bb service nova] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] No waiting events found dispatching network-vif-plugged-59550f49-12c8-4ca1-b957-2c0a631dfa84 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:51:29 user nova-compute[74994]: WARNING nova.compute.manager [req-d76bc2b9-313a-42ab-b4b3-2d35c22d178a req-41b1d410-3a3f-4797-9505-62467a6605bb service nova] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Received unexpected event network-vif-plugged-59550f49-12c8-4ca1-b957-2c0a631dfa84 for instance with vm_state building and task_state spawning.
Nov 28 10:51:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:29 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1515c67-2f37-4f2e-b38b-b0755ae70b6d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:29 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ba60ff-3155-4601-8ea4-89bd575e0c61]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:29 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab30e19b-6fe3-48f3-a6da-c69fc7435b13]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:29 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1223db-4dd5-42bf-9bce-a0fb0e956700]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:51:29 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 10:51:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:29 user nova-compute[74994]: DEBUG nova.compute.manager [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 10:51:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 10:51:29 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Instance spawned successfully.
Nov 28 10:51:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 10:51:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:51:29 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 10:51:29 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f5c7a1-33d3-428f-b3b2-ffb407e8e12e]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:29 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 10:51:29 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 10:51:29 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 10:51:29 user nova-compute[74994]: DEBUG os_brick.utils [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:51:29 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Updating existing volume attachment record: c6c1faa4-109a-4921-a764-8ef5a52bccf5 {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 10:51:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:51:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:51:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:51:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:51:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:51:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:51:29 user nova-compute[74994]: INFO nova.compute.manager [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Took 5.60 seconds to spawn the instance on the hypervisor.
Nov 28 10:51:29 user nova-compute[74994]: DEBUG nova.compute.manager [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 10:51:29 user nova-compute[74994]: INFO nova.compute.manager [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Took 6.40 seconds to build instance.
Nov 28 10:51:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f0993a63-5d25-4953-a43d-52d2189f2790 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "63b5b88a-f126-4e6c-926d-0a295830240d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.498s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:51:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:32 user nova-compute[74994]: DEBUG nova.compute.manager [req-b3bad469-9a06-4e38-86f4-87de73a3814a req-c4970b9a-3e07-483c-b516-c09f13924d31 service nova] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Received event network-changed-068d74d7-23a6-42b8-8a3c-02ba7ce746a7 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:51:32 user nova-compute[74994]: DEBUG nova.compute.manager [req-b3bad469-9a06-4e38-86f4-87de73a3814a req-c4970b9a-3e07-483c-b516-c09f13924d31 service nova] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Refreshing instance network info cache due to event network-changed-068d74d7-23a6-42b8-8a3c-02ba7ce746a7. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:51:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-b3bad469-9a06-4e38-86f4-87de73a3814a req-c4970b9a-3e07-483c-b516-c09f13924d31 service nova] Acquiring lock "refresh_cache-7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:51:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-b3bad469-9a06-4e38-86f4-87de73a3814a req-c4970b9a-3e07-483c-b516-c09f13924d31 service nova] Acquired lock "refresh_cache-7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:51:32 user nova-compute[74994]: DEBUG nova.network.neutron [req-b3bad469-9a06-4e38-86f4-87de73a3814a req-c4970b9a-3e07-483c-b516-c09f13924d31 service nova] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Refreshing network info cache for port 068d74d7-23a6-42b8-8a3c-02ba7ce746a7 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:51:32 user nova-compute[74994]: DEBUG nova.compute.manager [req-f95fea6b-17c1-4a29-8ce0-9cc06da47eb4 req-2c51ba37-5771-477b-83a3-6ab601b7b3a0 service nova] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Received event network-changed-752a5c48-15a2-443c-911c-f1a0c33ca925 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:51:32 user nova-compute[74994]: DEBUG nova.compute.manager [req-f95fea6b-17c1-4a29-8ce0-9cc06da47eb4 req-2c51ba37-5771-477b-83a3-6ab601b7b3a0 service nova] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Refreshing instance network info cache due to event network-changed-752a5c48-15a2-443c-911c-f1a0c33ca925. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:51:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f95fea6b-17c1-4a29-8ce0-9cc06da47eb4 req-2c51ba37-5771-477b-83a3-6ab601b7b3a0 service nova] Acquiring lock "refresh_cache-c2925833-e88d-4aa7-a477-ff1bc1fcd724" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:51:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f95fea6b-17c1-4a29-8ce0-9cc06da47eb4 req-2c51ba37-5771-477b-83a3-6ab601b7b3a0 service nova] Acquired lock "refresh_cache-c2925833-e88d-4aa7-a477-ff1bc1fcd724" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:51:32 user nova-compute[74994]: DEBUG nova.network.neutron [req-f95fea6b-17c1-4a29-8ce0-9cc06da47eb4 req-2c51ba37-5771-477b-83a3-6ab601b7b3a0 service nova] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Refreshing network info cache for port 752a5c48-15a2-443c-911c-f1a0c33ca925 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:51:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Acquiring lock "7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:51:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Lock "7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:51:32 user nova-compute[74994]: DEBUG nova.objects.instance [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Lazy-loading 'flavor' on Instance uuid 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:51:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Lock "7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:51:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Acquiring lock "7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:51:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Lock "7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:51:32 user nova-compute[74994]: INFO nova.compute.manager [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Attaching volume 37a2129a-a661-403a-9a9f-29e54191e56b to /dev/vdb
Nov 28 10:51:32 user nova-compute[74994]: DEBUG os_brick.utils [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:51:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:32 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b668cc3-9edd-459d-9b52-38544e9fc00e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:32 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76bace7-ae52-4d7f-b224-6c1d00e1d53a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:32 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e42c0b-3120-4f5e-ba48-516d60e0e587]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:32 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e618586-bf6b-4778-9ee8-bb491837aaab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:51:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 10:51:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:51:33 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 10:51:33 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4afcca-b87a-400e-9077-fbb56862b849]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 10:51:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 10:51:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 10:51:33 user nova-compute[74994]: DEBUG os_brick.utils [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:51:33 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Updating existing volume attachment record: 2b20b13b-a45f-4b8d-8f1f-45cfde412c1c {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 10:51:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-85dc4856-aea1-48ea-aa9a-d4d0749a092e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Acquiring lock "interface-c2925833-e88d-4aa7-a477-ff1bc1fcd724-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:51:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-85dc4856-aea1-48ea-aa9a-d4d0749a092e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Lock "interface-c2925833-e88d-4aa7-a477-ff1bc1fcd724-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:51:33 user nova-compute[74994]: DEBUG nova.objects.instance [None req-85dc4856-aea1-48ea-aa9a-d4d0749a092e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Lazy-loading 'flavor' on Instance uuid c2925833-e88d-4aa7-a477-ff1bc1fcd724 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:51:33 user nova-compute[74994]: DEBUG nova.objects.instance [None req-85dc4856-aea1-48ea-aa9a-d4d0749a092e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Lazy-loading 'pci_requests' on Instance uuid c2925833-e88d-4aa7-a477-ff1bc1fcd724 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:51:33 user nova-compute[74994]: DEBUG nova.objects.base [None req-85dc4856-aea1-48ea-aa9a-d4d0749a092e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Object Instance<c2925833-e88d-4aa7-a477-ff1bc1fcd724> lazy-loaded attributes: flavor,pci_requests {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 10:51:33 user nova-compute[74994]: DEBUG nova.network.neutron [None req-85dc4856-aea1-48ea-aa9a-d4d0749a092e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 10:51:33 user nova-compute[74994]: DEBUG nova.policy [None req-85dc4856-aea1-48ea-aa9a-d4d0749a092e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '02983082e29345a491ecd8fe18268b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1413a02a3034130b4a4ec170ca2fc16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 10:51:33 user nova-compute[74994]: DEBUG nova.network.neutron [req-b3bad469-9a06-4e38-86f4-87de73a3814a req-c4970b9a-3e07-483c-b516-c09f13924d31 service nova] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Updated VIF entry in instance network info cache for port 068d74d7-23a6-42b8-8a3c-02ba7ce746a7. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 10:51:33 user nova-compute[74994]: DEBUG nova.network.neutron [req-b3bad469-9a06-4e38-86f4-87de73a3814a req-c4970b9a-3e07-483c-b516-c09f13924d31 service nova] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Updating instance_info_cache with network_info: [{"id": "068d74d7-23a6-42b8-8a3c-02ba7ce746a7", "address": "fa:16:3e:de:46:25", "network": {"id": "b7c1f696-fec6-41c2-a173-f6497212eb9d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-130325100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8add654139084d4da3e8f2c2586a9466", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068d74d7-23", "ovs_interfaceid": "068d74d7-23a6-42b8-8a3c-02ba7ce746a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:51:33 user nova-compute[74994]: DEBUG nova.network.neutron [req-f95fea6b-17c1-4a29-8ce0-9cc06da47eb4 req-2c51ba37-5771-477b-83a3-6ab601b7b3a0 service nova] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Updated VIF entry in instance network info cache for port 752a5c48-15a2-443c-911c-f1a0c33ca925. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 10:51:33 user nova-compute[74994]: DEBUG nova.network.neutron [req-f95fea6b-17c1-4a29-8ce0-9cc06da47eb4 req-2c51ba37-5771-477b-83a3-6ab601b7b3a0 service nova] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Updating instance_info_cache with network_info: [{"id": "752a5c48-15a2-443c-911c-f1a0c33ca925", "address": "fa:16:3e:a4:4b:1f", "network": {"id": "92ee00e3-fc9c-459d-9dac-4ef40e592023", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2069871364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1413a02a3034130b4a4ec170ca2fc16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap752a5c48-15", "ovs_interfaceid": "752a5c48-15a2-443c-911c-f1a0c33ca925", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:51:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-b3bad469-9a06-4e38-86f4-87de73a3814a req-c4970b9a-3e07-483c-b516-c09f13924d31 service nova] Releasing lock "refresh_cache-7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:51:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f95fea6b-17c1-4a29-8ce0-9cc06da47eb4 req-2c51ba37-5771-477b-83a3-6ab601b7b3a0 service nova] Releasing lock "refresh_cache-c2925833-e88d-4aa7-a477-ff1bc1fcd724" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:51:33 user nova-compute[74994]: DEBUG nova.network.neutron [None req-85dc4856-aea1-48ea-aa9a-d4d0749a092e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Successfully created port: 9ecf4395-d083-44c8-8cf4-d4987884c1aa {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 10:51:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:34 user nova-compute[74994]: DEBUG nova.network.neutron [None req-85dc4856-aea1-48ea-aa9a-d4d0749a092e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Successfully updated port: 9ecf4395-d083-44c8-8cf4-d4987884c1aa {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 10:51:34 user nova-compute[74994]: DEBUG nova.compute.manager [req-c168c476-dfa0-42e4-bb17-305b8d12f121 req-1e299188-46e2-444a-9769-fa443aa4ba17 service nova] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Received event network-changed-9ecf4395-d083-44c8-8cf4-d4987884c1aa {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:51:34 user nova-compute[74994]: DEBUG nova.compute.manager [req-c168c476-dfa0-42e4-bb17-305b8d12f121 req-1e299188-46e2-444a-9769-fa443aa4ba17 service nova] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Refreshing instance network info cache due to event network-changed-9ecf4395-d083-44c8-8cf4-d4987884c1aa. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:51:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c168c476-dfa0-42e4-bb17-305b8d12f121 req-1e299188-46e2-444a-9769-fa443aa4ba17 service nova] Acquiring lock "refresh_cache-c2925833-e88d-4aa7-a477-ff1bc1fcd724" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:51:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c168c476-dfa0-42e4-bb17-305b8d12f121 req-1e299188-46e2-444a-9769-fa443aa4ba17 service nova] Acquired lock "refresh_cache-c2925833-e88d-4aa7-a477-ff1bc1fcd724" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:51:34 user nova-compute[74994]: DEBUG nova.network.neutron [req-c168c476-dfa0-42e4-bb17-305b8d12f121 req-1e299188-46e2-444a-9769-fa443aa4ba17 service nova] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Refreshing network info cache for port 9ecf4395-d083-44c8-8cf4-d4987884c1aa {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:51:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-85dc4856-aea1-48ea-aa9a-d4d0749a092e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Acquiring lock "refresh_cache-c2925833-e88d-4aa7-a477-ff1bc1fcd724" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:51:34 user nova-compute[74994]: DEBUG nova.network.neutron [req-c168c476-dfa0-42e4-bb17-305b8d12f121 req-1e299188-46e2-444a-9769-fa443aa4ba17 service nova] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Added VIF to instance network info cache for port 9ecf4395-d083-44c8-8cf4-d4987884c1aa. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3488}}
Nov 28 10:51:34 user nova-compute[74994]: DEBUG nova.network.neutron [req-c168c476-dfa0-42e4-bb17-305b8d12f121 req-1e299188-46e2-444a-9769-fa443aa4ba17 service nova] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Updating instance_info_cache with network_info: [{"id": "752a5c48-15a2-443c-911c-f1a0c33ca925", "address": "fa:16:3e:a4:4b:1f", "network": {"id": "92ee00e3-fc9c-459d-9dac-4ef40e592023", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2069871364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1413a02a3034130b4a4ec170ca2fc16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap752a5c48-15", "ovs_interfaceid": "752a5c48-15a2-443c-911c-f1a0c33ca925", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9ecf4395-d083-44c8-8cf4-d4987884c1aa", "address": "fa:16:3e:e4:1f:d6", "network": {"id": "00554ee0-49a7-42fd-b0c6-7dc89c5a90a7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-321761758", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a1413a02a3034130b4a4ec170ca2fc16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ecf4395-d0", "ovs_interfaceid": "9ecf4395-d083-44c8-8cf4-d4987884c1aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:51:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c168c476-dfa0-42e4-bb17-305b8d12f121 req-1e299188-46e2-444a-9769-fa443aa4ba17 service nova] Releasing lock "refresh_cache-c2925833-e88d-4aa7-a477-ff1bc1fcd724" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:51:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-85dc4856-aea1-48ea-aa9a-d4d0749a092e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Acquired lock "refresh_cache-c2925833-e88d-4aa7-a477-ff1bc1fcd724" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:51:34 user nova-compute[74994]: DEBUG nova.network.neutron [None req-85dc4856-aea1-48ea-aa9a-d4d0749a092e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 10:51:34 user nova-compute[74994]: WARNING nova.network.neutron [None req-85dc4856-aea1-48ea-aa9a-d4d0749a092e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] 00554ee0-49a7-42fd-b0c6-7dc89c5a90a7 already exists in list: networks containing: ['00554ee0-49a7-42fd-b0c6-7dc89c5a90a7']. ignoring it
Nov 28 10:51:34 user nova-compute[74994]: WARNING nova.network.neutron [None req-85dc4856-aea1-48ea-aa9a-d4d0749a092e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] 9ecf4395-d083-44c8-8cf4-d4987884c1aa already exists in list: port_ids containing: ['9ecf4395-d083-44c8-8cf4-d4987884c1aa']. ignoring it
Nov 28 10:51:35 user nova-compute[74994]: DEBUG nova.network.neutron [None req-85dc4856-aea1-48ea-aa9a-d4d0749a092e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Updating instance_info_cache with network_info: [{"id": "752a5c48-15a2-443c-911c-f1a0c33ca925", "address": "fa:16:3e:a4:4b:1f", "network": {"id": "92ee00e3-fc9c-459d-9dac-4ef40e592023", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2069871364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1413a02a3034130b4a4ec170ca2fc16", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap752a5c48-15", "ovs_interfaceid": "752a5c48-15a2-443c-911c-f1a0c33ca925", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9ecf4395-d083-44c8-8cf4-d4987884c1aa", "address": "fa:16:3e:e4:1f:d6", "network": {"id": "00554ee0-49a7-42fd-b0c6-7dc89c5a90a7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-321761758", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a1413a02a3034130b4a4ec170ca2fc16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ecf4395-d0", "ovs_interfaceid": "9ecf4395-d083-44c8-8cf4-d4987884c1aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:51:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-85dc4856-aea1-48ea-aa9a-d4d0749a092e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Releasing lock "refresh_cache-c2925833-e88d-4aa7-a477-ff1bc1fcd724" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:51:35 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-85dc4856-aea1-48ea-aa9a-d4d0749a092e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:49:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-185346772',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-185346772',id=10,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKb7DfQBhl9KQjX/Jy4TL5O6PXWUKL+vLgAOjfX/Q0BbK/dfYX/kuDxa2AyyjG8Tr6w0nPvpMGRLCsCXhPfUwNG1BTBUaGDIyyYhGnKPl0/QavZSldUeJCV0yh5hnereZw==',key_name='tempest-keypair-433898378',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:49:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a1413a02a3034130b4a4ec170ca2fc16',ramdisk_id='',reservation_id='r-z554pke2',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1012374446',owner_user_name='tempest-TaggedAttachmentsTest-1012374446-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T10:49:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02983082e29345a491ecd8fe18268b84',uuid=c2925833-e88d-4aa7-a477-ff1bc1fcd724,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ecf4395-d083-44c8-8cf4-d4987884c1aa", "address": "fa:16:3e:e4:1f:d6", "network": {"id": "00554ee0-49a7-42fd-b0c6-7dc89c5a90a7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-321761758", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a1413a02a3034130b4a4ec170ca2fc16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ecf4395-d0", "ovs_interfaceid": "9ecf4395-d083-44c8-8cf4-d4987884c1aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 10:51:35 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-85dc4856-aea1-48ea-aa9a-d4d0749a092e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Converting VIF {"id": "9ecf4395-d083-44c8-8cf4-d4987884c1aa", "address": "fa:16:3e:e4:1f:d6", "network": {"id": "00554ee0-49a7-42fd-b0c6-7dc89c5a90a7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-321761758", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a1413a02a3034130b4a4ec170ca2fc16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ecf4395-d0", "ovs_interfaceid": "9ecf4395-d083-44c8-8cf4-d4987884c1aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:51:35 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-85dc4856-aea1-48ea-aa9a-d4d0749a092e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:1f:d6,bridge_name='br-int',has_traffic_filtering=True,id=9ecf4395-d083-44c8-8cf4-d4987884c1aa,network=Network(00554ee0-49a7-42fd-b0c6-7dc89c5a90a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ecf4395-d0') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:51:35 user nova-compute[74994]: DEBUG os_vif [None req-85dc4856-aea1-48ea-aa9a-d4d0749a092e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:1f:d6,bridge_name='br-int',has_traffic_filtering=True,id=9ecf4395-d083-44c8-8cf4-d4987884c1aa,network=Network(00554ee0-49a7-42fd-b0c6-7dc89c5a90a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ecf4395-d0') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 10:51:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:51:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 10:51:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '80c40f4b-4891-59ac-8377-d2a0f0f46df5', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:51:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:51:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9ecf4395-d0, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:51:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9ecf4395-d0, col_values=(('qos', UUID('6a4b8cbc-6445-4d20-95d4-dd085cb9b18c')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:51:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9ecf4395-d0, col_values=(('external_ids', {'iface-id': '9ecf4395-d083-44c8-8cf4-d4987884c1aa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:1f:d6', 'vm-uuid': 'c2925833-e88d-4aa7-a477-ff1bc1fcd724'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:51:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:51:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:35 user nova-compute[74994]: INFO os_vif [None req-85dc4856-aea1-48ea-aa9a-d4d0749a092e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:1f:d6,bridge_name='br-int',has_traffic_filtering=True,id=9ecf4395-d083-44c8-8cf4-d4987884c1aa,network=Network(00554ee0-49a7-42fd-b0c6-7dc89c5a90a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ecf4395-d0')
Nov 28 10:51:35 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-85dc4856-aea1-48ea-aa9a-d4d0749a092e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:49:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-185346772',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-185346772',id=10,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKb7DfQBhl9KQjX/Jy4TL5O6PXWUKL+vLgAOjfX/Q0BbK/dfYX/kuDxa2AyyjG8Tr6w0nPvpMGRLCsCXhPfUwNG1BTBUaGDIyyYhGnKPl0/QavZSldUeJCV0yh5hnereZw==',key_name='tempest-keypair-433898378',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:49:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a1413a02a3034130b4a4ec170ca2fc16',ramdisk_id='',reservation_id='r-z554pke2',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1012374446',owner_user_name='tempest-TaggedAttachmentsTest-1012374446-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T10:49:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02983082e29345a491ecd8fe18268b84',uuid=c2925833-e88d-4aa7-a477-ff1bc1fcd724,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ecf4395-d083-44c8-8cf4-d4987884c1aa", "address": "fa:16:3e:e4:1f:d6", "network": {"id": "00554ee0-49a7-42fd-b0c6-7dc89c5a90a7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-321761758", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a1413a02a3034130b4a4ec170ca2fc16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ecf4395-d0", "ovs_interfaceid": "9ecf4395-d083-44c8-8cf4-d4987884c1aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:51:35 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-85dc4856-aea1-48ea-aa9a-d4d0749a092e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Converting VIF {"id": "9ecf4395-d083-44c8-8cf4-d4987884c1aa", "address": "fa:16:3e:e4:1f:d6", "network": {"id": "00554ee0-49a7-42fd-b0c6-7dc89c5a90a7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-321761758", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a1413a02a3034130b4a4ec170ca2fc16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ecf4395-d0", "ovs_interfaceid": "9ecf4395-d083-44c8-8cf4-d4987884c1aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:51:35 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-85dc4856-aea1-48ea-aa9a-d4d0749a092e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:1f:d6,bridge_name='br-int',has_traffic_filtering=True,id=9ecf4395-d083-44c8-8cf4-d4987884c1aa,network=Network(00554ee0-49a7-42fd-b0c6-7dc89c5a90a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ecf4395-d0') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:51:35 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-85dc4856-aea1-48ea-aa9a-d4d0749a092e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] attach device xml: <interface type="ethernet">
Nov 28 10:51:35 user nova-compute[74994]:   <mac address="fa:16:3e:e4:1f:d6"/>
Nov 28 10:51:35 user nova-compute[74994]:   <model type="virtio"/>
Nov 28 10:51:35 user nova-compute[74994]:   <mtu size="1442"/>
Nov 28 10:51:35 user nova-compute[74994]:   <target dev="tap9ecf4395-d0"/>
Nov 28 10:51:35 user nova-compute[74994]: </interface>
Nov 28 10:51:35 user nova-compute[74994]:  {{(pid=74994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 10:51:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:36 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-85dc4856-aea1-48ea-aa9a-d4d0749a092e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:51:36 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-85dc4856-aea1-48ea-aa9a-d4d0749a092e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] No BDM found with device name hda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:51:36 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-85dc4856-aea1-48ea-aa9a-d4d0749a092e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] No VIF found with MAC fa:16:3e:a4:4b:1f, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:51:36 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-85dc4856-aea1-48ea-aa9a-d4d0749a092e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 10:51:36 user nova-compute[74994]:   <nova:package version="0.0.0"/>
Nov 28 10:51:36 user nova-compute[74994]:   <nova:name>tempest-device-tagging-server-185346772</nova:name>
Nov 28 10:51:36 user nova-compute[74994]:   <nova:creationTime>2023-11-28 10:51:36</nova:creationTime>
Nov 28 10:51:36 user nova-compute[74994]:   <nova:flavor name="m1.tiny">
Nov 28 10:51:36 user nova-compute[74994]:     <nova:memory>512</nova:memory>
Nov 28 10:51:36 user nova-compute[74994]:     <nova:disk>1</nova:disk>
Nov 28 10:51:36 user nova-compute[74994]:     <nova:swap>0</nova:swap>
Nov 28 10:51:36 user nova-compute[74994]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 10:51:36 user nova-compute[74994]:     <nova:vcpus>1</nova:vcpus>
Nov 28 10:51:36 user nova-compute[74994]:   </nova:flavor>
Nov 28 10:51:36 user nova-compute[74994]:   <nova:owner>
Nov 28 10:51:36 user nova-compute[74994]:     <nova:user uuid="02983082e29345a491ecd8fe18268b84">tempest-TaggedAttachmentsTest-1012374446-project-member</nova:user>
Nov 28 10:51:36 user nova-compute[74994]:     <nova:project uuid="a1413a02a3034130b4a4ec170ca2fc16">tempest-TaggedAttachmentsTest-1012374446</nova:project>
Nov 28 10:51:36 user nova-compute[74994]:   </nova:owner>
Nov 28 10:51:36 user nova-compute[74994]:   <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 10:51:36 user nova-compute[74994]:   <nova:ports>
Nov 28 10:51:36 user nova-compute[74994]:     <nova:port uuid="752a5c48-15a2-443c-911c-f1a0c33ca925">
Nov 28 10:51:36 user nova-compute[74994]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 10:51:36 user nova-compute[74994]:     </nova:port>
Nov 28 10:51:36 user nova-compute[74994]:     <nova:port uuid="9ecf4395-d083-44c8-8cf4-d4987884c1aa">
Nov 28 10:51:36 user nova-compute[74994]:       <nova:ip type="fixed" address="10.10.10.211" ipVersion="4"/>
Nov 28 10:51:36 user nova-compute[74994]:     </nova:port>
Nov 28 10:51:36 user nova-compute[74994]:   </nova:ports>
Nov 28 10:51:36 user nova-compute[74994]: </nova:instance>
Nov 28 10:51:36 user nova-compute[74994]:  {{(pid=74994) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 28 10:51:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-85dc4856-aea1-48ea-aa9a-d4d0749a092e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Lock "interface-c2925833-e88d-4aa7-a477-ff1bc1fcd724-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.183s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:51:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:36 user nova-compute[74994]: DEBUG nova.compute.manager [req-403a77f8-5d02-4fa9-8b20-73ae7602bd87 req-ef5c4ede-6a2a-4e02-9aa4-1901291fecc4 service nova] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Received event network-vif-plugged-9ecf4395-d083-44c8-8cf4-d4987884c1aa {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:51:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-403a77f8-5d02-4fa9-8b20-73ae7602bd87 req-ef5c4ede-6a2a-4e02-9aa4-1901291fecc4 service nova] Acquiring lock "c2925833-e88d-4aa7-a477-ff1bc1fcd724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:51:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-403a77f8-5d02-4fa9-8b20-73ae7602bd87 req-ef5c4ede-6a2a-4e02-9aa4-1901291fecc4 service nova] Lock "c2925833-e88d-4aa7-a477-ff1bc1fcd724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:51:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-403a77f8-5d02-4fa9-8b20-73ae7602bd87 req-ef5c4ede-6a2a-4e02-9aa4-1901291fecc4 service nova] Lock "c2925833-e88d-4aa7-a477-ff1bc1fcd724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:51:36 user nova-compute[74994]: DEBUG nova.compute.manager [req-403a77f8-5d02-4fa9-8b20-73ae7602bd87 req-ef5c4ede-6a2a-4e02-9aa4-1901291fecc4 service nova] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] No waiting events found dispatching network-vif-plugged-9ecf4395-d083-44c8-8cf4-d4987884c1aa {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:51:36 user nova-compute[74994]: WARNING nova.compute.manager [req-403a77f8-5d02-4fa9-8b20-73ae7602bd87 req-ef5c4ede-6a2a-4e02-9aa4-1901291fecc4 service nova] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Received unexpected event network-vif-plugged-9ecf4395-d083-44c8-8cf4-d4987884c1aa for instance with vm_state active and task_state None.
Nov 28 10:51:36 user nova-compute[74994]: DEBUG nova.compute.manager [req-403a77f8-5d02-4fa9-8b20-73ae7602bd87 req-ef5c4ede-6a2a-4e02-9aa4-1901291fecc4 service nova] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Received event network-vif-plugged-9ecf4395-d083-44c8-8cf4-d4987884c1aa {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:51:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-403a77f8-5d02-4fa9-8b20-73ae7602bd87 req-ef5c4ede-6a2a-4e02-9aa4-1901291fecc4 service nova] Acquiring lock "c2925833-e88d-4aa7-a477-ff1bc1fcd724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:51:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-403a77f8-5d02-4fa9-8b20-73ae7602bd87 req-ef5c4ede-6a2a-4e02-9aa4-1901291fecc4 service nova] Lock "c2925833-e88d-4aa7-a477-ff1bc1fcd724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:51:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-403a77f8-5d02-4fa9-8b20-73ae7602bd87 req-ef5c4ede-6a2a-4e02-9aa4-1901291fecc4 service nova] Lock "c2925833-e88d-4aa7-a477-ff1bc1fcd724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:51:36 user nova-compute[74994]: DEBUG nova.compute.manager [req-403a77f8-5d02-4fa9-8b20-73ae7602bd87 req-ef5c4ede-6a2a-4e02-9aa4-1901291fecc4 service nova] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] No waiting events found dispatching network-vif-plugged-9ecf4395-d083-44c8-8cf4-d4987884c1aa {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:51:36 user nova-compute[74994]: WARNING nova.compute.manager [req-403a77f8-5d02-4fa9-8b20-73ae7602bd87 req-ef5c4ede-6a2a-4e02-9aa4-1901291fecc4 service nova] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Received unexpected event network-vif-plugged-9ecf4395-d083-44c8-8cf4-d4987884c1aa for instance with vm_state active and task_state None.
Nov 28 10:51:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Acquiring lock "c2925833-e88d-4aa7-a477-ff1bc1fcd724" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:51:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Lock "c2925833-e88d-4aa7-a477-ff1bc1fcd724" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:51:36 user nova-compute[74994]: DEBUG nova.objects.instance [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Lazy-loading 'flavor' on Instance uuid c2925833-e88d-4aa7-a477-ff1bc1fcd724 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:51:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Lock "c2925833-e88d-4aa7-a477-ff1bc1fcd724" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:51:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Acquiring lock "c2925833-e88d-4aa7-a477-ff1bc1fcd724" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:51:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Lock "c2925833-e88d-4aa7-a477-ff1bc1fcd724" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:51:36 user nova-compute[74994]: INFO nova.compute.manager [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Attaching volume f2cccd27-a909-4729-90b3-e64e2c064c82 to /dev/vdb
Nov 28 10:51:37 user nova-compute[74994]: DEBUG os_brick.utils [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.027s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c06a29-e537-4752-a24d-125b3ac9abef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9ded7b-d42d-46e4-831e-675cd3e5f6a3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ac325e-4b64-4e74-bf1a-72f607434205]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[69179b57-1b31-4559-aded-02eb233f2b9f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:51:37 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 10:51:37 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d5226e-e225-4b96-bfb7-b6422a48cc50]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG os_brick.utils [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Updating existing volume attachment record: 303a9141-f382-414e-ad22-6a03dd8b8213 {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fVAuPkrL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:51:37 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:51:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:51:37 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:51:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:51:37 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 10:51:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aaa5358-44c2-4013-8ae4-fe4e5c1843e8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 10:51:37 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9abbac0c-cbf8-4b32-8e4e-6ca6a0ffbc35]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b] added
Nov 28 10:51:37 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9160e188-6b3b-4120-acee-d97f3de9a653]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[61060c10-21d1-43cb-9338-a3b0b255fb76]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fVAuPkrL {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fVAuPkrL" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba569025-3fb5-43e7-b912-92cfa2d608d0]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fVAuPkrL'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[00949f03-60ea-4845-8539-d6115037e1d2]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3405802-2b48-42ab-a1de-0f175badcc8b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:51:37 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:51:37 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:51:37 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:51:37 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:51:37 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:51:37 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:51:37 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:51:37 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[babd0d2e-65c7-4b7d-bfc3-eb2bcee35a70]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b, portal: 172.16.0.220,3260]
Nov 28 10:51:37 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b, portal: 172.16.0.220,3260] successful.
Nov 28 10:51:37 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[926f9c2e-c1a3-4000-a37c-2af7947bbb78]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[42995d9e-c545-44ad-8db7-de1ccf5b76ac]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:51:37 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:51:37 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:51:37 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:51:37 user nova-compute[74994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b (non-flash)
Nov 28 10:51:37 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:51:37 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:51:37 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:51:37 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:51:37 user nova-compute[74994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b (non-flash)
Nov 28 10:51:37 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ecc605-ec48-4bdb-a5a6-4a8e85a76648]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 10:51:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fVAuPkrL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 10:51:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:51:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26562356366623135', 'path': '/dev/sdf'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:51:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562356366623135', 'path': '/dev/sdf'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 10:51:38 user nova-compute[74994]: DEBUG nova.objects.instance [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lazy-loading 'flavor' on Instance uuid 2e30565c-9f8e-4a87-8054-6c260dac4f48 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:51:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 10:51:38 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 10:51:38 user nova-compute[74994]:   <source dev="/dev/sdf"/>
Nov 28 10:51:38 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 10:51:38 user nova-compute[74994]:   <serial>d499c4cb-3f36-4ba5-a4a5-f09f0c50937b</serial>
Nov 28 10:51:38 user nova-compute[74994]: </disk>
Nov 28 10:51:38 user nova-compute[74994]:  {{(pid=74994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 10:51:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:39 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:51:39 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:51:39 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] No VIF found with MAC fa:16:3e:f3:12:45, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:51:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-59aad479-de77-40a2-8fae-aab9ccdd50f0 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lock "2e30565c-9f8e-4a87-8054-6c260dac4f48" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.985s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:51:40 user nova-compute[74994]: DEBUG nova.compute.manager [req-4a941a90-29a0-4087-aa9c-0e9e506d4ca3 req-0ddf6c47-fb0b-4144-b77f-ff3457568b12 service nova] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Received event network-changed-9854edad-1d5f-4ea8-bced-f1ae510e224a {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:51:40 user nova-compute[74994]: DEBUG nova.compute.manager [req-4a941a90-29a0-4087-aa9c-0e9e506d4ca3 req-0ddf6c47-fb0b-4144-b77f-ff3457568b12 service nova] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Refreshing instance network info cache due to event network-changed-9854edad-1d5f-4ea8-bced-f1ae510e224a. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:51:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4a941a90-29a0-4087-aa9c-0e9e506d4ca3 req-0ddf6c47-fb0b-4144-b77f-ff3457568b12 service nova] Acquiring lock "refresh_cache-6e6a974e-3626-453c-8662-0d160f6e57de" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:51:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4a941a90-29a0-4087-aa9c-0e9e506d4ca3 req-0ddf6c47-fb0b-4144-b77f-ff3457568b12 service nova] Acquired lock "refresh_cache-6e6a974e-3626-453c-8662-0d160f6e57de" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:51:40 user nova-compute[74994]: DEBUG nova.network.neutron [req-4a941a90-29a0-4087-aa9c-0e9e506d4ca3 req-0ddf6c47-fb0b-4144-b77f-ff3457568b12 service nova] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Refreshing network info cache for port 9854edad-1d5f-4ea8-bced-f1ae510e224a {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:51:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] Acquiring lock "6e6a974e-3626-453c-8662-0d160f6e57de" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:51:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] Lock "6e6a974e-3626-453c-8662-0d160f6e57de" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:51:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 10:51:40 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KojpQYLe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:51:40 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:51:40 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:51:40 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:51:40 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:51:40 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:51:40 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:51:40 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 10:51:40 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:40 user nova-compute[74994]: DEBUG nova.objects.instance [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] Lazy-loading 'flavor' on Instance uuid 6e6a974e-3626-453c-8662-0d160f6e57de {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:51:40 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:40 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c7349c-5b75-4723-8ad7-3980f3ebd4bc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:40 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 10:51:40 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:40 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG nova.network.neutron [req-4a941a90-29a0-4087-aa9c-0e9e506d4ca3 req-0ddf6c47-fb0b-4144-b77f-ff3457568b12 service nova] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Updated VIF entry in instance network info cache for port 9854edad-1d5f-4ea8-bced-f1ae510e224a. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG nova.network.neutron [req-4a941a90-29a0-4087-aa9c-0e9e506d4ca3 req-0ddf6c47-fb0b-4144-b77f-ff3457568b12 service nova] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Updating instance_info_cache with network_info: [{"id": "9854edad-1d5f-4ea8-bced-f1ae510e224a", "address": "fa:16:3e:52:d1:90", "network": {"id": "d32e0d40-6adf-48ad-9316-b347b3ba6cf4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-883485495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e449ba25474e43973c86fedccea8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9854edad-1d", "ovs_interfaceid": "9854edad-1d5f-4ea8-bced-f1ae510e224a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.208s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d3d56f-9403-4824-a1b3-4103eebb5e34]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b] added
Nov 28 10:51:41 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4a941a90-29a0-4087-aa9c-0e9e506d4ca3 req-0ddf6c47-fb0b-4144-b77f-ff3457568b12 service nova] Releasing lock "refresh_cache-6e6a974e-3626-453c-8662-0d160f6e57de" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] Lock "6e6a974e-3626-453c-8662-0d160f6e57de" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.253s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe08b2a-a192-4dbc-aedb-0f3032e851a4]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-20c2f417-8016-46c8-9f83-eb2318369752 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Acquiring lock "2e30565c-9f8e-4a87-8054-6c260dac4f48" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-20c2f417-8016-46c8-9f83-eb2318369752 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lock "2e30565c-9f8e-4a87-8054-6c260dac4f48" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[85733add-3ac8-44aa-ab69-f03e5677788a]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KojpQYLe {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:41 user nova-compute[74994]: INFO nova.compute.manager [None req-20c2f417-8016-46c8-9f83-eb2318369752 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Detaching volume d499c4cb-3f36-4ba5-a4a5-f09f0c50937b
Nov 28 10:51:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KojpQYLe" returned: 0 in 0.029s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc718b0-8061-4b27-aba1-112f5a53dd09]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KojpQYLe'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6fb426b-9ef5-4548-8590-d9d0b07c87c6]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:41 user nova-compute[74994]: INFO nova.virt.block_device [None req-20c2f417-8016-46c8-9f83-eb2318369752 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Attempting to driver detach volume d499c4cb-3f36-4ba5-a4a5-f09f0c50937b from mountpoint /dev/vdb
Nov 28 10:51:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16637f3-6bfc-4856-88b6-ae4deed5adfb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:51:41 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:51:41 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:51:41 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:51:41 user nova-compute[74994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b (non-flash)
Nov 28 10:51:41 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:51:41 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:51:41 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:51:41 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:51:41 user nova-compute[74994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b (non-flash)
Nov 28 10:51:41 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-20c2f417-8016-46c8-9f83-eb2318369752 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Attempting to detach device vdb from instance 2e30565c-9f8e-4a87-8054-6c260dac4f48 from the persistent domain config. {{(pid=74994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-20c2f417-8016-46c8-9f83-eb2318369752 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 10:51:41 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 10:51:41 user nova-compute[74994]:   <source dev="/dev/sdf"/>
Nov 28 10:51:41 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 10:51:41 user nova-compute[74994]:   <serial>d499c4cb-3f36-4ba5-a4a5-f09f0c50937b</serial>
Nov 28 10:51:41 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 10:51:41 user nova-compute[74994]: </disk>
Nov 28 10:51:41 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] Acquiring lock "6e6a974e-3626-453c-8662-0d160f6e57de" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] Lock "6e6a974e-3626-453c-8662-0d160f6e57de" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:51:41 user nova-compute[74994]: INFO nova.compute.manager [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Attaching volume a789baf8-df65-4c89-bd72-88bf279d90e3 to /dev/vdb
Nov 28 10:51:41 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-20c2f417-8016-46c8-9f83-eb2318369752 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Successfully detached device vdb from instance 2e30565c-9f8e-4a87-8054-6c260dac4f48 from the persistent domain config.
Nov 28 10:51:41 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-20c2f417-8016-46c8-9f83-eb2318369752 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2e30565c-9f8e-4a87-8054-6c260dac4f48 from the live domain config. {{(pid=74994) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-20c2f417-8016-46c8-9f83-eb2318369752 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 10:51:41 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 10:51:41 user nova-compute[74994]:   <source dev="/dev/sdf"/>
Nov 28 10:51:41 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 10:51:41 user nova-compute[74994]:   <serial>d499c4cb-3f36-4ba5-a4a5-f09f0c50937b</serial>
Nov 28 10:51:41 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 10:51:41 user nova-compute[74994]: </disk>
Nov 28 10:51:41 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb29292-144b-40fe-b5d2-e53c9e41a9b6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b, portal: 172.16.0.220,3260]
Nov 28 10:51:41 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b, portal: 172.16.0.220,3260] successful.
Nov 28 10:51:41 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae3e742-a5b3-4e58-ae61-672ddb9194a1]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG os_brick.utils [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df12972-db89-4c33-9f19-16c8ec0e8328]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[117b123e-84b0-48ab-85df-fe24b60ab8b7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:51:41 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:51:41 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:51:41 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:51:41 user nova-compute[74994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b (non-flash)
Nov 28 10:51:41 user nova-compute[74994]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)
Nov 28 10:51:41 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:51:41 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:51:41 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:51:41 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:51:41 user nova-compute[74994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b (non-flash)
Nov 28 10:51:41 user nova-compute[74994]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)
Nov 28 10:51:41 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.567s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7909f04-7297-4cd8-a133-14b7142fb0a8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbc1b07-d6be-4bb0-ab3c-4817d370599d]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KojpQYLe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ce4ffb-4888-4f14-aa7b-6924814ee9b8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f521558-dc37-48e1-bade-869350899567]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:51:41 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 10:51:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32abe18-f44b-44ba-bf88-91ea277dc4e0]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG os_brick.utils [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Updating existing volume attachment record: 7b881e13-782a-4060-b7e1-3353375bd457 {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 10:51:41 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-20c2f417-8016-46c8-9f83-eb2318369752 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2e30565c-9f8e-4a87-8054-6c260dac4f48 {{(pid=74994) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 10:51:42 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.617s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:51:42 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] <== connect_volume: return (1618ms) {'type': 'block', 'scsi_wwn': '23738316237633761', 'path': '/dev/sdg'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:51:42 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23738316237633761', 'path': '/dev/sdg'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 10:51:42 user nova-compute[74994]: DEBUG nova.objects.instance [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Lazy-loading 'flavor' on Instance uuid 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:51:42 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 10:51:42 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 10:51:42 user nova-compute[74994]:   <source dev="/dev/sdg"/>
Nov 28 10:51:42 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 10:51:42 user nova-compute[74994]:   <serial>37a2129a-a661-403a-9a9f-29e54191e56b</serial>
Nov 28 10:51:42 user nova-compute[74994]: </disk>
Nov 28 10:51:42 user nova-compute[74994]:  {{(pid=74994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 10:51:42 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:51:42 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:51:42 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] No VIF found with MAC fa:16:3e:de:46:25, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:51:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-69d361cb-3525-47c3-ae6a-9901e1972df4 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Lock "7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.254s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:51:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Acquiring lock "7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Lock "7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG os_brick.utils [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[df52b3f4-960e-4f59-a1e4-0e52b2ebec4c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0f16ad-3221-46fd-9445-b578596fafef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[099bfcd6-870c-4e2f-a0a5-e070207ca2f5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[997ef756-5fe9-4be8-829e-a9509d660b54]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:51:44 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 10:51:44 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[54979b20-5116-4c5d-b08b-84d2ababf35e]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG os_brick.utils [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:51:44 user nova-compute[74994]: INFO nova.compute.manager [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Swapping volume 37a2129a-a661-403a-9a9f-29e54191e56b for 6d8d9b02-1a52-4141-bd39-95419cec5a1a
Nov 28 10:51:44 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yjFzuBZb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:51:44 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:51:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:51:44 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:51:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:51:44 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 10:51:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82 -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d163631f-539a-4118-828f-242ef52ba4e9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 10:51:44 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82 -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[725d3b8f-71c6-455f-9f57-35405a377d38]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82] added
Nov 28 10:51:44 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64ed95d-f9a8-4e92-8b04-7db8fb8c6772]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b43ce4-e6e5-4088-b991-10e3b86e0209]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yjFzuBZb {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yjFzuBZb" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22d0b42-2085-4484-99f0-674d1e422197]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yjFzuBZb'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f44276-c9b2-4b14-be32-8e446f0c6535]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6535b788-3e18-4532-853c-dce2e6ed3b5b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:51:44 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:51:44 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:51:44 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:51:44 user nova-compute[74994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b (non-flash)
Nov 28 10:51:44 user nova-compute[74994]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)
Nov 28 10:51:44 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:51:44 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:51:44 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:51:44 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:51:44 user nova-compute[74994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b (non-flash)
Nov 28 10:51:44 user nova-compute[74994]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)
Nov 28 10:51:44 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82 -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3dad42-622b-4ed9-8c96-6b954e15f939]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82, portal: 172.16.0.220,3260]
Nov 28 10:51:44 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82, portal: 172.16.0.220,3260] successful.
Nov 28 10:51:44 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[098c6672-64cb-4fdd-abf6-ca53d47b1ee2]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87a08a1-daf1-4e0b-82ec-d0cced36ddb3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:51:44 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:51:44 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:51:44 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:51:44 user nova-compute[74994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b (non-flash)
Nov 28 10:51:44 user nova-compute[74994]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)
Nov 28 10:51:44 user nova-compute[74994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82 (non-flash)
Nov 28 10:51:44 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:51:44 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:51:44 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:51:44 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:51:44 user nova-compute[74994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b (non-flash)
Nov 28 10:51:44 user nova-compute[74994]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)
Nov 28 10:51:44 user nova-compute[74994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82 (non-flash)
Nov 28 10:51:44 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dcdd5db-9a2f-4035-b2fd-cc2ccf11e151]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 10:51:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yjFzuBZb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 10:51:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:51:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23131623233336535', 'path': '/dev/sdh'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:51:45 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131623233336535', 'path': '/dev/sdh'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 10:51:45 user nova-compute[74994]: DEBUG nova.objects.instance [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Lazy-loading 'flavor' on Instance uuid c2925833-e88d-4aa7-a477-ff1bc1fcd724 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:51:45 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 10:51:45 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 10:51:45 user nova-compute[74994]:   <source dev="/dev/sdh"/>
Nov 28 10:51:45 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 10:51:45 user nova-compute[74994]:   <serial>f2cccd27-a909-4729-90b3-e64e2c064c82</serial>
Nov 28 10:51:45 user nova-compute[74994]: </disk>
Nov 28 10:51:45 user nova-compute[74994]:  {{(pid=74994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 10:51:46 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:51:46 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] No BDM found with device name hda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:51:46 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] No VIF found with MAC fa:16:3e:a4:4b:1f, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:51:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4838bacd-f215-4ec3-80ed-5cd6b9ce584e tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Lock "c2925833-e88d-4aa7-a477-ff1bc1fcd724" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.655s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:51:47 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ed603e6a-f03e-4e1d-aa5d-c6eee884a8b2 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Acquiring lock "c2925833-e88d-4aa7-a477-ff1bc1fcd724" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:51:47 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ed603e6a-f03e-4e1d-aa5d-c6eee884a8b2 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Lock "c2925833-e88d-4aa7-a477-ff1bc1fcd724" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:51:47 user nova-compute[74994]: INFO nova.compute.manager [None req-ed603e6a-f03e-4e1d-aa5d-c6eee884a8b2 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Detaching volume f2cccd27-a909-4729-90b3-e64e2c064c82
Nov 28 10:51:47 user nova-compute[74994]: INFO nova.virt.block_device [None req-ed603e6a-f03e-4e1d-aa5d-c6eee884a8b2 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Attempting to driver detach volume f2cccd27-a909-4729-90b3-e64e2c064c82 from mountpoint /dev/vdb
Nov 28 10:51:47 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ed603e6a-f03e-4e1d-aa5d-c6eee884a8b2 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Attempting to detach device vdb from instance c2925833-e88d-4aa7-a477-ff1bc1fcd724 from the persistent domain config. {{(pid=74994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 10:51:47 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-ed603e6a-f03e-4e1d-aa5d-c6eee884a8b2 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 10:51:47 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 10:51:47 user nova-compute[74994]:   <source dev="/dev/sdh"/>
Nov 28 10:51:47 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 10:51:47 user nova-compute[74994]:   <serial>f2cccd27-a909-4729-90b3-e64e2c064c82</serial>
Nov 28 10:51:47 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 28 10:51:47 user nova-compute[74994]: </disk>
Nov 28 10:51:47 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 10:51:47 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-ed603e6a-f03e-4e1d-aa5d-c6eee884a8b2 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Successfully detached device vdb from instance c2925833-e88d-4aa7-a477-ff1bc1fcd724 from the persistent domain config.
Nov 28 10:51:47 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ed603e6a-f03e-4e1d-aa5d-c6eee884a8b2 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c2925833-e88d-4aa7-a477-ff1bc1fcd724 from the live domain config. {{(pid=74994) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 10:51:47 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-ed603e6a-f03e-4e1d-aa5d-c6eee884a8b2 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 10:51:47 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 10:51:47 user nova-compute[74994]:   <source dev="/dev/sdh"/>
Nov 28 10:51:47 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 10:51:47 user nova-compute[74994]:   <serial>f2cccd27-a909-4729-90b3-e64e2c064c82</serial>
Nov 28 10:51:47 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 28 10:51:47 user nova-compute[74994]: </disk>
Nov 28 10:51:47 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 10:51:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ed603e6a-f03e-4e1d-aa5d-c6eee884a8b2 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c2925833-e88d-4aa7-a477-ff1bc1fcd724 {{(pid=74994) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 10:51:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 10:51:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tSTNnDau', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:51:48 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:51:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:51:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:51:48 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:51:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:51:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:51:48 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 10:51:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3 -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:48 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabb9d08-133b-479e-9904-b917102913e5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 10:51:48 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:48 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac7fd8a-32dd-4f38-b408-76f4f3559b12]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3] added
Nov 28 10:51:48 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:48 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32aef69-9817-4434-89a3-e338bd654fa4]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:48 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b24ca2-7e74-43bb-bff9-7d4b30a5155b]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tSTNnDau {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tSTNnDau" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:48 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a96589-fe09-47b8-b90b-f56fed3dacf4]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tSTNnDau'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:48 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[99447b4c-7bce-453e-bdeb-5103c1dd5e2f]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:49 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:49 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a3e89b-c8ee-4728-a73f-baae291874eb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:49 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:51:49 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:51:49 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:51:49 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:51:49 user nova-compute[74994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b (non-flash)
Nov 28 10:51:49 user nova-compute[74994]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)
Nov 28 10:51:49 user nova-compute[74994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82 (non-flash)
Nov 28 10:51:49 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:51:49 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:51:49 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:51:49 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:51:49 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:51:49 user nova-compute[74994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b (non-flash)
Nov 28 10:51:49 user nova-compute[74994]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)
Nov 28 10:51:49 user nova-compute[74994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82 (non-flash)
Nov 28 10:51:49 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:51:49 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3 -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:49 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:49 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[086fb644-0c7b-4830-988f-7e9d8acb145f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:49 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3, portal: 172.16.0.220,3260]
Nov 28 10:51:49 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3, portal: 172.16.0.220,3260] successful.
Nov 28 10:51:49 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:49 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:49 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:49 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[84094065-9ba0-4d51-8073-b26ace3c22d1]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:49 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:49 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:49 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:49 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f391662b-ea81-46dc-aaf1-5d5222d97685]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:49 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3 (non-flash)
Nov 28 10:51:49 user nova-compute[74994]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:51:49 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:51:49 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:51:49 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:51:49 user nova-compute[74994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b (non-flash)
Nov 28 10:51:49 user nova-compute[74994]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)
Nov 28 10:51:49 user nova-compute[74994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82 (non-flash)
Nov 28 10:51:49 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:51:49 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3 (non-flash)
Nov 28 10:51:49 user nova-compute[74994]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:51:49 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:51:49 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:51:49 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:51:49 user nova-compute[74994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b (non-flash)
Nov 28 10:51:49 user nova-compute[74994]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)
Nov 28 10:51:49 user nova-compute[74994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82 (non-flash)
Nov 28 10:51:49 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:51:49 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:51:49 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 10:51:49 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 10:51:49 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 10:51:49 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:49 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:49 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc952d83-2a16-483a-ba0b-30532abd5c56]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:49 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 10:51:49 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tSTNnDau', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 10:51:50 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:51:50 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23832636433326563', 'path': '/dev/sdi'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:51:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832636433326563', 'path': '/dev/sdi'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 10:51:50 user nova-compute[74994]: DEBUG nova.objects.instance [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] Lazy-loading 'flavor' on Instance uuid 6e6a974e-3626-453c-8662-0d160f6e57de {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:51:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] attach device xml: <disk type="block" device="disk">
Nov 28 10:51:50 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 10:51:50 user nova-compute[74994]:   <source dev="/dev/sdi"/>
Nov 28 10:51:50 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 10:51:50 user nova-compute[74994]:   <serial>a789baf8-df65-4c89-bd72-88bf279d90e3</serial>
Nov 28 10:51:50 user nova-compute[74994]: </disk>
Nov 28 10:51:50 user nova-compute[74994]:  {{(pid=74994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 10:51:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:51:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:51:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] No VIF found with MAC fa:16:3e:52:d1:90, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:51:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e779754-9547-43dc-8ad6-3af2d2092d80 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] Lock "6e6a974e-3626-453c-8662-0d160f6e57de" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.808s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:51:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-56f6f93c-8668-4b82-a4b9-93ee4d911deb tempest-VolumesAssistedSnapshotsTest-1327378574 tempest-VolumesAssistedSnapshotsTest-1327378574-project] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] volume_snapshot_create: create_info: {'snapshot_id': '29298993-3ec4-42f2-b163-9a237004c619', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74994) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 28 10:51:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-56f6f93c-8668-4b82-a4b9-93ee4d911deb tempest-VolumesAssistedSnapshotsTest-1327378574 tempest-VolumesAssistedSnapshotsTest-1327378574-project] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] snap xml: <domainsnapshot>
Nov 28 10:51:51 user nova-compute[74994]:   <disks>
Nov 28 10:51:51 user nova-compute[74994]:     <disk name="/dev/sdi" snapshot="external" type="file">
Nov 28 10:51:51 user nova-compute[74994]:       <source file="/dev/new_file"/>
Nov 28 10:51:51 user nova-compute[74994]:     </disk>
Nov 28 10:51:51 user nova-compute[74994]:     <disk name="vda" snapshot="no"/>
Nov 28 10:51:51 user nova-compute[74994]:   </disks>
Nov 28 10:51:51 user nova-compute[74994]: </domainsnapshot>
Nov 28 10:51:51 user nova-compute[74994]:  {{(pid=74994) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 28 10:51:51 user nova-compute[74994]: DEBUG nova.objects.instance [None req-56f6f93c-8668-4b82-a4b9-93ee4d911deb tempest-VolumesAssistedSnapshotsTest-1327378574 tempest-VolumesAssistedSnapshotsTest-1327378574-project] Lazy-loading 'system_metadata' on Instance uuid 6e6a974e-3626-453c-8662-0d160f6e57de {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:51:51 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-56f6f93c-8668-4b82-a4b9-93ee4d911deb tempest-VolumesAssistedSnapshotsTest-1327378574 tempest-VolumesAssistedSnapshotsTest-1327378574-project] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [None req-56f6f93c-8668-4b82-a4b9-93ee4d911deb tempest-VolumesAssistedSnapshotsTest-1327378574 tempest-VolumesAssistedSnapshotsTest-1327378574-project] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Traceback (most recent call last):
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [instance: 6e6a974e-3626-453c-8662-0d160f6e57de]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [instance: 6e6a974e-3626-453c-8662-0d160f6e57de]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [instance: 6e6a974e-3626-453c-8662-0d160f6e57de]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [instance: 6e6a974e-3626-453c-8662-0d160f6e57de]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [instance: 6e6a974e-3626-453c-8662-0d160f6e57de]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [instance: 6e6a974e-3626-453c-8662-0d160f6e57de]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [instance: 6e6a974e-3626-453c-8662-0d160f6e57de]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [instance: 6e6a974e-3626-453c-8662-0d160f6e57de]     rv = execute(f, *args, **kwargs)
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [instance: 6e6a974e-3626-453c-8662-0d160f6e57de]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [instance: 6e6a974e-3626-453c-8662-0d160f6e57de]     six.reraise(c, e, tb)
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [instance: 6e6a974e-3626-453c-8662-0d160f6e57de]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [instance: 6e6a974e-3626-453c-8662-0d160f6e57de]     raise value
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [instance: 6e6a974e-3626-453c-8662-0d160f6e57de]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [instance: 6e6a974e-3626-453c-8662-0d160f6e57de]     rv = meth(*args, **kwargs)
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [instance: 6e6a974e-3626-453c-8662-0d160f6e57de]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [instance: 6e6a974e-3626-453c-8662-0d160f6e57de]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] 
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [None req-56f6f93c-8668-4b82-a4b9-93ee4d911deb tempest-VolumesAssistedSnapshotsTest-1327378574 tempest-VolumesAssistedSnapshotsTest-1327378574-project] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Traceback (most recent call last):
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [instance: 6e6a974e-3626-453c-8662-0d160f6e57de]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [instance: 6e6a974e-3626-453c-8662-0d160f6e57de]     self._volume_snapshot_create(context, instance, guest,
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [instance: 6e6a974e-3626-453c-8662-0d160f6e57de]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [instance: 6e6a974e-3626-453c-8662-0d160f6e57de]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [instance: 6e6a974e-3626-453c-8662-0d160f6e57de]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [instance: 6e6a974e-3626-453c-8662-0d160f6e57de]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [instance: 6e6a974e-3626-453c-8662-0d160f6e57de]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [instance: 6e6a974e-3626-453c-8662-0d160f6e57de]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [instance: 6e6a974e-3626-453c-8662-0d160f6e57de]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [instance: 6e6a974e-3626-453c-8662-0d160f6e57de]     rv = execute(f, *args, **kwargs)
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [instance: 6e6a974e-3626-453c-8662-0d160f6e57de]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [instance: 6e6a974e-3626-453c-8662-0d160f6e57de]     six.reraise(c, e, tb)
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [instance: 6e6a974e-3626-453c-8662-0d160f6e57de]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [instance: 6e6a974e-3626-453c-8662-0d160f6e57de]     raise value
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [instance: 6e6a974e-3626-453c-8662-0d160f6e57de]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [instance: 6e6a974e-3626-453c-8662-0d160f6e57de]     rv = meth(*args, **kwargs)
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [instance: 6e6a974e-3626-453c-8662-0d160f6e57de]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [instance: 6e6a974e-3626-453c-8662-0d160f6e57de]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] 
Nov 28 10:51:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-71896b7d-29d0-41b8-88f5-5f41cf12f64b tempest-VolumesAssistedSnapshotsTest-1327378574 tempest-VolumesAssistedSnapshotsTest-1327378574-project] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] volume_snapshot_delete: delete_info: {'volume_id': 'a789baf8-df65-4c89-bd72-88bf279d90e3'} {{(pid=74994) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [None req-71896b7d-29d0-41b8-88f5-5f41cf12f64b tempest-VolumesAssistedSnapshotsTest-1327378574 tempest-VolumesAssistedSnapshotsTest-1327378574-project] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Traceback (most recent call last):
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [instance: 6e6a974e-3626-453c-8662-0d160f6e57de]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [instance: 6e6a974e-3626-453c-8662-0d160f6e57de]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [instance: 6e6a974e-3626-453c-8662-0d160f6e57de]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [instance: 6e6a974e-3626-453c-8662-0d160f6e57de]     if delete_info['type'] != 'qcow2':
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] KeyError: 'type'
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] 
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [None req-56f6f93c-8668-4b82-a4b9-93ee4d911deb tempest-VolumesAssistedSnapshotsTest-1327378574 tempest-VolumesAssistedSnapshotsTest-1327378574-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 29298993-3ec4-42f2-b163-9a237004c619 could not be found.
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver     raise value
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver 
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver 
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 29298993-3ec4-42f2-b163-9a237004c619 could not be found. (HTTP 404) (Request-ID: req-f3032963-3748-4378-9616-a63d1e895c6a)
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver 
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver 
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 29298993-3ec4-42f2-b163-9a237004c619 could not be found.
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver 
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver [None req-71896b7d-29d0-41b8-88f5-5f41cf12f64b tempest-VolumesAssistedSnapshotsTest-1327378574 tempest-VolumesAssistedSnapshotsTest-1327378574-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver 
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver 
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-46adad5c-d89c-4a18-bb13-9e951f0b130c)
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver 
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver 
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 28 10:51:51 user nova-compute[74994]: ERROR nova.virt.libvirt.driver 
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server [None req-56f6f93c-8668-4b82-a4b9-93ee4d911deb tempest-VolumesAssistedSnapshotsTest-1327378574 tempest-VolumesAssistedSnapshotsTest-1327378574-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server     raise value
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server 
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server [None req-71896b7d-29d0-41b8-88f5-5f41cf12f64b tempest-VolumesAssistedSnapshotsTest-1327378574 tempest-VolumesAssistedSnapshotsTest-1327378574-project] Exception during message handling: KeyError: 'type'
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 28 10:51:51 user nova-compute[74994]: ERROR oslo_messaging.rpc.server 
Nov 28 10:51:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-af81bd1a-8934-46e3-956a-43846ced68d1 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] Acquiring lock "6e6a974e-3626-453c-8662-0d160f6e57de" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:51:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-af81bd1a-8934-46e3-956a-43846ced68d1 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] Lock "6e6a974e-3626-453c-8662-0d160f6e57de" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:51:51 user nova-compute[74994]: INFO nova.compute.manager [None req-af81bd1a-8934-46e3-956a-43846ced68d1 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Detaching volume a789baf8-df65-4c89-bd72-88bf279d90e3
Nov 28 10:51:51 user nova-compute[74994]: INFO nova.virt.block_device [None req-af81bd1a-8934-46e3-956a-43846ced68d1 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Attempting to driver detach volume a789baf8-df65-4c89-bd72-88bf279d90e3 from mountpoint /dev/vdb
Nov 28 10:51:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-af81bd1a-8934-46e3-956a-43846ced68d1 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] Attempting to detach device vdb from instance 6e6a974e-3626-453c-8662-0d160f6e57de from the persistent domain config. {{(pid=74994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 10:51:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-af81bd1a-8934-46e3-956a-43846ced68d1 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] detach device xml: <disk type="block" device="disk">
Nov 28 10:51:51 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 10:51:51 user nova-compute[74994]:   <source dev="/dev/sdi"/>
Nov 28 10:51:51 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 10:51:51 user nova-compute[74994]:   <serial>a789baf8-df65-4c89-bd72-88bf279d90e3</serial>
Nov 28 10:51:51 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 10:51:51 user nova-compute[74994]: </disk>
Nov 28 10:51:51 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 10:51:51 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-af81bd1a-8934-46e3-956a-43846ced68d1 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] Successfully detached device vdb from instance 6e6a974e-3626-453c-8662-0d160f6e57de from the persistent domain config.
Nov 28 10:51:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-af81bd1a-8934-46e3-956a-43846ced68d1 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6e6a974e-3626-453c-8662-0d160f6e57de from the live domain config. {{(pid=74994) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 10:51:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-af81bd1a-8934-46e3-956a-43846ced68d1 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] detach device xml: <disk type="block" device="disk">
Nov 28 10:51:51 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 10:51:51 user nova-compute[74994]:   <source dev="/dev/sdi"/>
Nov 28 10:51:51 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 10:51:51 user nova-compute[74994]:   <serial>a789baf8-df65-4c89-bd72-88bf279d90e3</serial>
Nov 28 10:51:51 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 10:51:51 user nova-compute[74994]: </disk>
Nov 28 10:51:51 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG nova.compute.manager [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DHIliwdZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a', 'attached_at': '', 'detached_at': '', 'volume_id': '6d8d9b02-1a52-4141-bd39-95419cec5a1a', 'serial': '6d8d9b02-1a52-4141-bd39-95419cec5a1a'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KojpQYLe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a', 'attached_at': '', 'detached_at': '', 'volume_id': '37a2129a-a661-403a-9a9f-29e54191e56b', 'serial'} {{(pid=74994) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DHIliwdZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:51:52 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:51:52 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:51:52 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:51:52 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:51:52 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 10:51:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[974b8747-fbee-4b7a-abdc-1925f0a32c99]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 10:51:52 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d790c5-8249-4961-a932-7f7624d68b49]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a] added
Nov 28 10:51:52 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[95295acc-cdde-4514-969d-cae0531d1d23]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e112d604-e509-4463-abfb-7fb34186f2ea]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DHIliwdZ {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DHIliwdZ" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b51cdf-856e-40b9-bedc-723cb8d74fd9]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DHIliwdZ'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ac5ca1-cc24-4102-aaef-0857f4281e0a]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8c5664-528b-4fac-879b-973639a4ee2a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3 (non-flash)
Nov 28 10:51:52 user nova-compute[74994]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:51:52 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:51:52 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:51:52 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:51:52 user nova-compute[74994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b (non-flash)
Nov 28 10:51:52 user nova-compute[74994]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)
Nov 28 10:51:52 user nova-compute[74994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82 (non-flash)
Nov 28 10:51:52 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3 (non-flash)
Nov 28 10:51:52 user nova-compute[74994]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:51:52 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:51:52 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:51:52 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:51:52 user nova-compute[74994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b (non-flash)
Nov 28 10:51:52 user nova-compute[74994]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)
Nov 28 10:51:52 user nova-compute[74994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82 (non-flash)
Nov 28 10:51:52 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7368cb-450d-4c32-af2b-32aeeeba2fb3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a, portal: 172.16.0.220,3260]
Nov 28 10:51:52 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a, portal: 172.16.0.220,3260] successful.
Nov 28 10:51:52 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[955e6ce2-8926-4eab-8a28-2498ac39704b]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[40393500-998d-427a-8f24-2fd424382803]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3 (non-flash)
Nov 28 10:51:52 user nova-compute[74994]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a (non-flash)
Nov 28 10:51:52 user nova-compute[74994]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:51:52 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:51:52 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:51:52 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:51:52 user nova-compute[74994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b (non-flash)
Nov 28 10:51:52 user nova-compute[74994]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)
Nov 28 10:51:52 user nova-compute[74994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82 (non-flash)
Nov 28 10:51:52 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3 (non-flash)
Nov 28 10:51:52 user nova-compute[74994]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a (non-flash)
Nov 28 10:51:52 user nova-compute[74994]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:51:52 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:51:52 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:51:52 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:51:52 user nova-compute[74994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b (non-flash)
Nov 28 10:51:52 user nova-compute[74994]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)
Nov 28 10:51:52 user nova-compute[74994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82 (non-flash)
Nov 28 10:51:52 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac22debc-8b93-4fea-b838-ebef0c0f3eba]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DHIliwdZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 10:51:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-af81bd1a-8934-46e3-956a-43846ced68d1 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6e6a974e-3626-453c-8662-0d160f6e57de {{(pid=74994) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 10:51:53 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:51:53 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '26430656464346634', 'path': '/dev/sdj'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:51:53 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430656464346634', 'path': '/dev/sdj'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 10:51:53 user nova-compute[74994]: DEBUG nova.objects.instance [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Lazy-loading 'flavor' on Instance uuid 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:51:53 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] COPY block job progress, current cursor: 7340032 final cursor: 1073741824 {{(pid=74994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 10:51:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:54 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] COPY block job progress, current cursor: 192937984 final cursor: 1073741824 {{(pid=74994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 10:51:54 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] COPY block job progress, current cursor: 307232768 final cursor: 1073741824 {{(pid=74994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 10:51:55 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] COPY block job progress, current cursor: 433061888 final cursor: 1073741824 {{(pid=74994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 10:51:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:55 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] COPY block job progress, current cursor: 583008256 final cursor: 1073741824 {{(pid=74994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 10:51:56 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] COPY block job progress, current cursor: 720371712 final cursor: 1073741824 {{(pid=74994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 10:51:56 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] COPY block job progress, current cursor: 831520768 final cursor: 1073741824 {{(pid=74994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 10:51:57 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] COPY block job progress, current cursor: 1016070144 final cursor: 1073741824 {{(pid=74994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 10:51:57 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KojpQYLe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:51:58 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:51:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce3f6a1-2410-49c0-8b0d-5247bb4be2ba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 10:51:58 user nova-compute[74994]: No targets found.
Nov 28 10:51:58 user nova-compute[74994]: iSNS:
Nov 28 10:51:58 user nova-compute[74994]: No targets found.
Nov 28 10:51:58 user nova-compute[74994]: STATIC:
Nov 28 10:51:58 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3
Nov 28 10:51:58 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:51:58 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:51:58 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b
Nov 28 10:51:58 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:51:58 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:51:58 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab
Nov 28 10:51:58 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:51:58 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:51:58 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148
Nov 28 10:51:58 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:51:58 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:51:58 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f
Nov 28 10:51:58 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:51:58 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:51:58 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b
Nov 28 10:51:58 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:51:58 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:51:58 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a
Nov 28 10:51:58 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:51:58 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:51:58 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0
Nov 28 10:51:58 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:51:58 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:51:58 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82
Nov 28 10:51:58 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:51:58 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:51:58 user nova-compute[74994]: FIRMWARE:
Nov 28 10:51:58 user nova-compute[74994]: No targets found.
Nov 28 10:51:58 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 10:51:58 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 10:51:58 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[187b945c-79d3-4dfa-be39-1d9dd895c61a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[eefb131e-7925-4e0a-8960-2c2976f20fb8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3 (non-flash)
Nov 28 10:51:58 user nova-compute[74994]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a (non-flash)
Nov 28 10:51:58 user nova-compute[74994]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:51:58 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:51:58 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:51:58 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:51:58 user nova-compute[74994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b (non-flash)
Nov 28 10:51:58 user nova-compute[74994]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)
Nov 28 10:51:58 user nova-compute[74994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82 (non-flash)
Nov 28 10:51:58 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3 (non-flash)
Nov 28 10:51:58 user nova-compute[74994]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a (non-flash)
Nov 28 10:51:58 user nova-compute[74994]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:51:58 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:51:58 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:51:58 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:51:58 user nova-compute[74994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b (non-flash)
Nov 28 10:51:58 user nova-compute[74994]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)
Nov 28 10:51:58 user nova-compute[74994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82 (non-flash)
Nov 28 10:51:58 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb92069c670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b'): ({'sdg'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Removing single pathed devices sdg {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d04abd1-ab99-4400-a473-5d78b81af0b6]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c3025a-31c5-48c7-a557-8c9549e1df56]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Flushing IO for device /dev/sdg {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[792d621b-7a6a-4f75-af40-29ba142f4e85]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.039s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fddd79-2e7c-447b-a5d5-31bf7179ed5d]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] SCSI volumes sdg have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbd440c-1f6a-4351-82d0-5b84f30dea1f]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c762ea8-f1b2-4db5-a1b9-af10231ccbce]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b, portal: 172.16.0.220,3260]
Nov 28 10:51:58 user nova-compute[74994]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b, portal: 172.16.0.220,3260] successful.
Nov 28 10:51:58 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e48e92-d19d-457a-956c-c2e90bebe8bf]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] <== disconnect_volume: return (352ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG nova.compute.manager [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DHIliwdZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': '7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a', 'attached_at': '', 'detached_at': '', 'volume_id': '6d8d9b02-1a52-4141-bd39-95419cec5a1a', 'serial'} {{(pid=74994) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG nova.compute.manager [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] swap_volume: removing Cinder connection for volume 37a2129a-a661-403a-9a9f-29e54191e56b {{(pid=74994) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 28 10:51:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:51:59 user nova-compute[74994]: DEBUG nova.compute.manager [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] swap_volume: Updating volume 37a2129a-a661-403a-9a9f-29e54191e56b BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "DHIliwdZ", "auth_password": "XPDOm4di2VRZ7E", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdj", "volume_id": "6d8d9b02-1a52-4141-bd39-95419cec5a1a"}, "status": "reserved", "instance": "7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a", "attached_at": "", "detached_at": "", "volume_id": "6d8d9b02-1a52-4141-bd39-95419cec5a1a", "serial": "6d8d9b02-1a52-4141-bd39-95419cec5a1a"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '6d8d9b02-1a52-4141-bd39-95419cec5a1a', 'no_device': None, 'attachment_id': 'a31bd7e3-ba74-4f81-9b40-2d81d7d151c2'} {{(pid=74994) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 28 10:51:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-cd6ebe04-bf9f-4dc9-9d1f-ea8679b4a579 tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Lock "7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 15.206s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:52:00 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Acquiring lock "7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:52:00 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Lock "7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:52:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:00 user nova-compute[74994]: DEBUG os_brick.utils [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:52:00 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:00 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:00 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3ede57-cf63-4fae-864e-683fd77d9d50]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:00 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:00 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:00 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f298d4-902d-48f7-b566-cf23e405202d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:00 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:00 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:00 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a285b731-f99c-44a2-b60f-de32a2ea25e4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:00 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e3576d-afbb-46ee-875d-ae5b205bc5b1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:00 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:00 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:52:00 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 10:52:00 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:00 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:52:00 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 10:52:00 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b800fa5c-6304-4df9-b55f-9c0e49bd3e5d]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:00 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 10:52:00 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 10:52:00 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 10:52:00 user nova-compute[74994]: DEBUG os_brick.utils [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:52:00 user nova-compute[74994]: INFO nova.compute.manager [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Swapping volume 6d8d9b02-1a52-4141-bd39-95419cec5a1a for 37a2129a-a661-403a-9a9f-29e54191e56b
Nov 28 10:52:01 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:52:01 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:52:01 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 10:52:01 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-20c2f417-8016-46c8-9f83-eb2318369752 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2e30565c-9f8e-4a87-8054-6c260dac4f48 is timed out.
Nov 28 10:52:01 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-20c2f417-8016-46c8-9f83-eb2318369752 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Successfully detached device vdb from instance 2e30565c-9f8e-4a87-8054-6c260dac4f48 from the live domain config.
Nov 28 10:52:01 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20c2f417-8016-46c8-9f83-eb2318369752 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 10:52:01 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c2f417-8016-46c8-9f83-eb2318369752 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fVAuPkrL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:52:01 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-20c2f417-8016-46c8-9f83-eb2318369752 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:52:01 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-20c2f417-8016-46c8-9f83-eb2318369752 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:52:01 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-20c2f417-8016-46c8-9f83-eb2318369752 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:52:01 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:01 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:01 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0476ed-414f-4ef9-8128-f77fa3034f14]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:01 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c2f417-8016-46c8-9f83-eb2318369752 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 10:52:01 user nova-compute[74994]: No targets found.
Nov 28 10:52:01 user nova-compute[74994]: iSNS:
Nov 28 10:52:01 user nova-compute[74994]: No targets found.
Nov 28 10:52:01 user nova-compute[74994]: STATIC:
Nov 28 10:52:01 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3
Nov 28 10:52:01 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:52:01 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:52:01 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab
Nov 28 10:52:01 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:52:01 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:52:01 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148
Nov 28 10:52:01 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:52:01 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:52:01 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f
Nov 28 10:52:01 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:52:01 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:52:01 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b
Nov 28 10:52:01 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:52:01 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:52:01 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a
Nov 28 10:52:01 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:52:01 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:52:01 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0
Nov 28 10:52:01 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:52:01 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:52:01 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82
Nov 28 10:52:01 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:52:01 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:52:01 user nova-compute[74994]: FIRMWARE:
Nov 28 10:52:01 user nova-compute[74994]: No targets found.
Nov 28 10:52:01 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:52:01 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c2f417-8016-46c8-9f83-eb2318369752 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 10:52:01 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 10:52:01 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 10:52:01 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c2f417-8016-46c8-9f83-eb2318369752 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 10:52:01 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:01 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:01 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[17998e86-32c2-4c4d-8085-77882189fa17]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:01 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:01 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:01 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd100acb-8965-4022-a7f2-34d2bb18960a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:01 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c2f417-8016-46c8-9f83-eb2318369752 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3 (non-flash)
Nov 28 10:52:01 user nova-compute[74994]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a (non-flash)
Nov 28 10:52:01 user nova-compute[74994]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:52:01 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:52:01 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:52:01 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:52:01 user nova-compute[74994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b (non-flash)
Nov 28 10:52:01 user nova-compute[74994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82 (non-flash)
Nov 28 10:52:01 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:52:01 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c2f417-8016-46c8-9f83-eb2318369752 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3 (non-flash)
Nov 28 10:52:01 user nova-compute[74994]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a (non-flash)
Nov 28 10:52:01 user nova-compute[74994]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:52:01 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:52:01 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:52:01 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:52:01 user nova-compute[74994]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b (non-flash)
Nov 28 10:52:01 user nova-compute[74994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82 (non-flash)
Nov 28 10:52:01 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:52:01 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c2f417-8016-46c8-9f83-eb2318369752 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9206a0a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b'): ({'sdf'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 10:52:01 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-20c2f417-8016-46c8-9f83-eb2318369752 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Removing single pathed devices sdf {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 10:52:01 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:01 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:01 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6725627-1454-46c5-87c5-239f033f7c8e]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:01 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:01 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:01 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8541109d-14cb-43b9-b1d1-efac0189c3f5]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:01 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-20c2f417-8016-46c8-9f83-eb2318369752 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Flushing IO for device /dev/sdf {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 10:52:01 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:01 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:01 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa0e4c9-d8a3-4bb5-8a40-82fd6b98ea39]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:01 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-20c2f417-8016-46c8-9f83-eb2318369752 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 10:52:01 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:02 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.050s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:02 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c201300e-b774-4c4c-a4e6-4069c74ac1c8]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:02 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-20c2f417-8016-46c8-9f83-eb2318369752 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 10:52:02 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-20c2f417-8016-46c8-9f83-eb2318369752 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] SCSI volumes sdf have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 10:52:02 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c2f417-8016-46c8-9f83-eb2318369752 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 10:52:02 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:02 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:02 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce22fe2-7ffa-49d3-935c-1bb0b26e9a73]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:02 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c2f417-8016-46c8-9f83-eb2318369752 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:52:02 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:02 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:02 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca674e43-f826-4360-87fe-2dfdd0c74af6]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:02 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c2f417-8016-46c8-9f83-eb2318369752 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b, portal: 172.16.0.220,3260]
Nov 28 10:52:02 user nova-compute[74994]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b, portal: 172.16.0.220,3260] successful.
Nov 28 10:52:02 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:52:02 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:02 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d499c4cb-3f36-4ba5-a4a5-f09f0c50937b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:02 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc35c6b-539e-4f20-9a8b-2c23693dc2dc]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:02 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c2f417-8016-46c8-9f83-eb2318369752 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:52:02 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-20c2f417-8016-46c8-9f83-eb2318369752 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:52:02 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c2f417-8016-46c8-9f83-eb2318369752 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] <== disconnect_volume: return (353ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:52:02 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20c2f417-8016-46c8-9f83-eb2318369752 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 10:52:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "759fbcfd-ab13-438f-b860-6393a97d1205" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:52:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "759fbcfd-ab13-438f-b860-6393a97d1205" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:52:02 user nova-compute[74994]: DEBUG nova.compute.manager [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 10:52:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:52:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:52:02 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 10:52:02 user nova-compute[74994]: INFO nova.compute.claims [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Claim successful on node user
Nov 28 10:52:03 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:52:03 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:52:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.568s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:52:03 user nova-compute[74994]: DEBUG nova.compute.manager [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 10:52:03 user nova-compute[74994]: DEBUG nova.compute.manager [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 10:52:03 user nova-compute[74994]: DEBUG nova.network.neutron [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 10:52:03 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 10:52:03 user nova-compute[74994]: DEBUG nova.compute.manager [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 10:52:03 user nova-compute[74994]: INFO nova.virt.block_device [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Booting with blank volume at /dev/vda
Nov 28 10:52:03 user nova-compute[74994]: DEBUG nova.policy [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c49cba00cff4c4b80080c5f917b4176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612ae9ec21ad40a4b68e0926843874ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 10:52:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:04 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:52:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:04 user nova-compute[74994]: DEBUG nova.network.neutron [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Successfully created port: 7d4a82ba-d222-44bb-baac-6642f24b9528 {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 10:52:05 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:52:05 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 10:52:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "refresh_cache-bf357856-2d97-42e8-928d-71d0378f48c8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:52:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquired lock "refresh_cache-bf357856-2d97-42e8-928d-71d0378f48c8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:52:05 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Forcefully refreshing network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 10:52:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:05 user nova-compute[74994]: DEBUG nova.network.neutron [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Successfully updated port: 7d4a82ba-d222-44bb-baac-6642f24b9528 {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 10:52:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "refresh_cache-759fbcfd-ab13-438f-b860-6393a97d1205" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:52:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquired lock "refresh_cache-759fbcfd-ab13-438f-b860-6393a97d1205" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:52:05 user nova-compute[74994]: DEBUG nova.network.neutron [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 10:52:05 user nova-compute[74994]: DEBUG nova.compute.manager [req-ffbba894-313a-4c55-abe9-2d622922c932 req-4752eeee-d8dd-4012-9434-850030b9232d service nova] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Received event network-changed-7d4a82ba-d222-44bb-baac-6642f24b9528 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:52:05 user nova-compute[74994]: DEBUG nova.compute.manager [req-ffbba894-313a-4c55-abe9-2d622922c932 req-4752eeee-d8dd-4012-9434-850030b9232d service nova] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Refreshing instance network info cache due to event network-changed-7d4a82ba-d222-44bb-baac-6642f24b9528. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:52:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ffbba894-313a-4c55-abe9-2d622922c932 req-4752eeee-d8dd-4012-9434-850030b9232d service nova] Acquiring lock "refresh_cache-759fbcfd-ab13-438f-b860-6393a97d1205" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:52:05 user nova-compute[74994]: DEBUG nova.network.neutron [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 10:52:05 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Updating instance_info_cache with network_info: [{"id": "6a884296-8f6f-4647-b4c6-09d7f4e92887", "address": "fa:16:3e:a2:e1:5b", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a884296-8f", "ovs_interfaceid": "6a884296-8f6f-4647-b4c6-09d7f4e92887", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:52:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Releasing lock "refresh_cache-bf357856-2d97-42e8-928d-71d0378f48c8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:52:05 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Updated the network info_cache for instance {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 10:52:05 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:52:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:52:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:52:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:52:05 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 10:52:06 user nova-compute[74994]: DEBUG nova.network.neutron [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Updating instance_info_cache with network_info: [{"id": "7d4a82ba-d222-44bb-baac-6642f24b9528", "address": "fa:16:3e:4f:75:25", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d4a82ba-d2", "ovs_interfaceid": "7d4a82ba-d222-44bb-baac-6642f24b9528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:52:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Releasing lock "refresh_cache-759fbcfd-ab13-438f-b860-6393a97d1205" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:52:06 user nova-compute[74994]: DEBUG nova.compute.manager [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Instance network_info: |[{"id": "7d4a82ba-d222-44bb-baac-6642f24b9528", "address": "fa:16:3e:4f:75:25", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d4a82ba-d2", "ovs_interfaceid": "7d4a82ba-d222-44bb-baac-6642f24b9528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 10:52:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ffbba894-313a-4c55-abe9-2d622922c932 req-4752eeee-d8dd-4012-9434-850030b9232d service nova] Acquired lock "refresh_cache-759fbcfd-ab13-438f-b860-6393a97d1205" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:52:06 user nova-compute[74994]: DEBUG nova.network.neutron [req-ffbba894-313a-4c55-abe9-2d622922c932 req-4752eeee-d8dd-4012-9434-850030b9232d service nova] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Refreshing network info cache for port 7d4a82ba-d222-44bb-baac-6642f24b9528 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:52:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc114bed-8d7e-46e0-86a7-7eed7ce75b5c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc114bed-8d7e-46e0-86a7-7eed7ce75b5c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc114bed-8d7e-46e0-86a7-7eed7ce75b5c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc114bed-8d7e-46e0-86a7-7eed7ce75b5c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e6a974e-3626-453c-8662-0d160f6e57de/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:06 user nova-compute[74994]: DEBUG nova.network.neutron [req-ffbba894-313a-4c55-abe9-2d622922c932 req-4752eeee-d8dd-4012-9434-850030b9232d service nova] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Updated VIF entry in instance network info cache for port 7d4a82ba-d222-44bb-baac-6642f24b9528. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 10:52:06 user nova-compute[74994]: DEBUG nova.network.neutron [req-ffbba894-313a-4c55-abe9-2d622922c932 req-4752eeee-d8dd-4012-9434-850030b9232d service nova] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Updating instance_info_cache with network_info: [{"id": "7d4a82ba-d222-44bb-baac-6642f24b9528", "address": "fa:16:3e:4f:75:25", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d4a82ba-d2", "ovs_interfaceid": "7d4a82ba-d222-44bb-baac-6642f24b9528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:52:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ffbba894-313a-4c55-abe9-2d622922c932 req-4752eeee-d8dd-4012-9434-850030b9232d service nova] Releasing lock "refresh_cache-759fbcfd-ab13-438f-b860-6393a97d1205" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:52:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e6a974e-3626-453c-8662-0d160f6e57de/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e6a974e-3626-453c-8662-0d160f6e57de/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e6a974e-3626-453c-8662-0d160f6e57de/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e30565c-9f8e-4a87-8054-6c260dac4f48/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e30565c-9f8e-4a87-8054-6c260dac4f48/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e30565c-9f8e-4a87-8054-6c260dac4f48/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e30565c-9f8e-4a87-8054-6c260dac4f48/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63b5b88a-f126-4e6c-926d-0a295830240d/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63b5b88a-f126-4e6c-926d-0a295830240d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63b5b88a-f126-4e6c-926d-0a295830240d/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:08 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-ed603e6a-f03e-4e1d-aa5d-c6eee884a8b2 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c2925833-e88d-4aa7-a477-ff1bc1fcd724 is timed out.
Nov 28 10:52:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63b5b88a-f126-4e6c-926d-0a295830240d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:08 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-ed603e6a-f03e-4e1d-aa5d-c6eee884a8b2 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Successfully detached device vdb from instance c2925833-e88d-4aa7-a477-ff1bc1fcd724 from the live domain config.
Nov 28 10:52:08 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed603e6a-f03e-4e1d-aa5d-c6eee884a8b2 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed603e6a-f03e-4e1d-aa5d-c6eee884a8b2 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yjFzuBZb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:52:08 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-ed603e6a-f03e-4e1d-aa5d-c6eee884a8b2 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:52:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-ed603e6a-f03e-4e1d-aa5d-c6eee884a8b2 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-ed603e6a-f03e-4e1d-aa5d-c6eee884a8b2 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b51d690-8198-4748-807d-1902e75564b9/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ccbef5-76d2-471e-9633-150827a0a9cd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed603e6a-f03e-4e1d-aa5d-c6eee884a8b2 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 10:52:08 user nova-compute[74994]: No targets found.
Nov 28 10:52:08 user nova-compute[74994]: iSNS:
Nov 28 10:52:08 user nova-compute[74994]: No targets found.
Nov 28 10:52:08 user nova-compute[74994]: STATIC:
Nov 28 10:52:08 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3
Nov 28 10:52:08 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:52:08 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:52:08 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab
Nov 28 10:52:08 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:52:08 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:52:08 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148
Nov 28 10:52:08 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:52:08 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:52:08 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f
Nov 28 10:52:08 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:52:08 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:52:08 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a
Nov 28 10:52:08 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:52:08 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:52:08 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0
Nov 28 10:52:08 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:52:08 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:52:08 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82
Nov 28 10:52:08 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:52:08 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:52:08 user nova-compute[74994]: FIRMWARE:
Nov 28 10:52:08 user nova-compute[74994]: No targets found.
Nov 28 10:52:08 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed603e6a-f03e-4e1d-aa5d-c6eee884a8b2 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 10:52:08 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 10:52:08 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed603e6a-f03e-4e1d-aa5d-c6eee884a8b2 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[af87b47e-21f9-4334-9456-8af220294ce9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[530e9bdc-f3f4-497e-b881-aa49f22f6205]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed603e6a-f03e-4e1d-aa5d-c6eee884a8b2 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3 (non-flash)
Nov 28 10:52:08 user nova-compute[74994]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a (non-flash)
Nov 28 10:52:08 user nova-compute[74994]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:52:08 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:52:08 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:52:08 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:52:08 user nova-compute[74994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82 (non-flash)
Nov 28 10:52:08 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed603e6a-f03e-4e1d-aa5d-c6eee884a8b2 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3 (non-flash)
Nov 28 10:52:08 user nova-compute[74994]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a (non-flash)
Nov 28 10:52:08 user nova-compute[74994]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:52:08 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:52:08 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:52:08 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:52:08 user nova-compute[74994]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82 (non-flash)
Nov 28 10:52:08 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed603e6a-f03e-4e1d-aa5d-c6eee884a8b2 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb92071b7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82'): ({'sdh'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-ed603e6a-f03e-4e1d-aa5d-c6eee884a8b2 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Removing single pathed devices sdh {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbcd861a-0ca8-4f44-a448-366dfd5865ce]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4296c015-3e7d-4fd2-aa5c-2c75cba9c2da]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-ed603e6a-f03e-4e1d-aa5d-c6eee884a8b2 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Flushing IO for device /dev/sdh {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a75bb62-a432-46be-89a3-46bd0790b01d]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-ed603e6a-f03e-4e1d-aa5d-c6eee884a8b2 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b51d690-8198-4748-807d-1902e75564b9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b51d690-8198-4748-807d-1902e75564b9/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.039s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ad2524-8e81-4f18-aaa7-4a1c3cab09a6]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-ed603e6a-f03e-4e1d-aa5d-c6eee884a8b2 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-ed603e6a-f03e-4e1d-aa5d-c6eee884a8b2 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] SCSI volumes sdh have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed603e6a-f03e-4e1d-aa5d-c6eee884a8b2 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7de2193-83f5-4a36-8255-f53da66cb348]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed603e6a-f03e-4e1d-aa5d-c6eee884a8b2 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82 -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1588f48b-b1be-4f81-a1a3-e88a8e2fff91]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed603e6a-f03e-4e1d-aa5d-c6eee884a8b2 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82, portal: 172.16.0.220,3260]
Nov 28 10:52:08 user nova-compute[74994]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82, portal: 172.16.0.220,3260] successful.
Nov 28 10:52:08 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82 -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2cccd27-a909-4729-90b3-e64e2c064c82 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b21e6e-87ea-4a7c-9353-f63ff00215db]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed603e6a-f03e-4e1d-aa5d-c6eee884a8b2 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-ed603e6a-f03e-4e1d-aa5d-c6eee884a8b2 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed603e6a-f03e-4e1d-aa5d-c6eee884a8b2 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] <== disconnect_volume: return (369ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed603e6a-f03e-4e1d-aa5d-c6eee884a8b2 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b51d690-8198-4748-807d-1902e75564b9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce813fa-bf97-41f8-8aee-c7a73354e24c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce813fa-bf97-41f8-8aee-c7a73354e24c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce813fa-bf97-41f8-8aee-c7a73354e24c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce813fa-bf97-41f8-8aee-c7a73354e24c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 10:52:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:09 user nova-compute[74994]: DEBUG nova.objects.instance [None req-20c2f417-8016-46c8-9f83-eb2318369752 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lazy-loading 'flavor' on Instance uuid 2e30565c-9f8e-4a87-8054-6c260dac4f48 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:52:09 user nova-compute[74994]: DEBUG nova.objects.instance [None req-ed603e6a-f03e-4e1d-aa5d-c6eee884a8b2 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Lazy-loading 'flavor' on Instance uuid c2925833-e88d-4aa7-a477-ff1bc1fcd724 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:52:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-20c2f417-8016-46c8-9f83-eb2318369752 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lock "2e30565c-9f8e-4a87-8054-6c260dac4f48" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 28.584s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:52:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-62447626-40e3-484f-af67-4671c9140b74 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Acquiring lock "interface-c2925833-e88d-4aa7-a477-ff1bc1fcd724-9ecf4395-d083-44c8-8cf4-d4987884c1aa" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:52:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-62447626-40e3-484f-af67-4671c9140b74 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Lock "interface-c2925833-e88d-4aa7-a477-ff1bc1fcd724-9ecf4395-d083-44c8-8cf4-d4987884c1aa" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:52:09 user nova-compute[74994]: DEBUG nova.objects.instance [None req-62447626-40e3-484f-af67-4671c9140b74 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Lazy-loading 'flavor' on Instance uuid c2925833-e88d-4aa7-a477-ff1bc1fcd724 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:52:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ed603e6a-f03e-4e1d-aa5d-c6eee884a8b2 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Lock "c2925833-e88d-4aa7-a477-ff1bc1fcd724" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.217s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:52:09 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-62447626-40e3-484f-af67-4671c9140b74 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:49:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-185346772',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-185346772',id=10,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKb7DfQBhl9KQjX/Jy4TL5O6PXWUKL+vLgAOjfX/Q0BbK/dfYX/kuDxa2AyyjG8Tr6w0nPvpMGRLCsCXhPfUwNG1BTBUaGDIyyYhGnKPl0/QavZSldUeJCV0yh5hnereZw==',key_name='tempest-keypair-433898378',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:49:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a1413a02a3034130b4a4ec170ca2fc16',ramdisk_id='',reservation_id='r-z554pke2',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1012374446',owner_user_name='tempest-TaggedAttachmentsTest-1012374446-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T10:49:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02983082e29345a491ecd8fe18268b84',uuid=c2925833-e88d-4aa7-a477-ff1bc1fcd724,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ecf4395-d083-44c8-8cf4-d4987884c1aa", "address": "fa:16:3e:e4:1f:d6", "network": {"id": "00554ee0-49a7-42fd-b0c6-7dc89c5a90a7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-321761758", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a1413a02a3034130b4a4ec170ca2fc16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ecf4395-d0", "ovs_interfaceid": "9ecf4395-d083-44c8-8cf4-d4987884c1aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:52:09 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-62447626-40e3-484f-af67-4671c9140b74 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Converting VIF {"id": "9ecf4395-d083-44c8-8cf4-d4987884c1aa", "address": "fa:16:3e:e4:1f:d6", "network": {"id": "00554ee0-49a7-42fd-b0c6-7dc89c5a90a7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-321761758", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a1413a02a3034130b4a4ec170ca2fc16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ecf4395-d0", "ovs_interfaceid": "9ecf4395-d083-44c8-8cf4-d4987884c1aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:52:09 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-62447626-40e3-484f-af67-4671c9140b74 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:1f:d6,bridge_name='br-int',has_traffic_filtering=True,id=9ecf4395-d083-44c8-8cf4-d4987884c1aa,network=Network(00554ee0-49a7-42fd-b0c6-7dc89c5a90a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ecf4395-d0') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:52:09 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-62447626-40e3-484f-af67-4671c9140b74 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e4:1f:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tap9ecf4395-d0"/></interface> {{(pid=74994) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 28 10:52:09 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-62447626-40e3-484f-af67-4671c9140b74 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e4:1f:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tap9ecf4395-d0"/></interface> {{(pid=74994) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 28 10:52:09 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-62447626-40e3-484f-af67-4671c9140b74 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Attempting to detach device tap9ecf4395-d0 from instance c2925833-e88d-4aa7-a477-ff1bc1fcd724 from the persistent domain config. {{(pid=74994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 10:52:09 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-62447626-40e3-484f-af67-4671c9140b74 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] detach device xml: <interface type="ethernet">
Nov 28 10:52:09 user nova-compute[74994]:   <mac address="fa:16:3e:e4:1f:d6"/>
Nov 28 10:52:09 user nova-compute[74994]:   <model type="virtio"/>
Nov 28 10:52:09 user nova-compute[74994]:   <mtu size="1442"/>
Nov 28 10:52:09 user nova-compute[74994]:   <target dev="tap9ecf4395-d0"/>
Nov 28 10:52:09 user nova-compute[74994]: </interface>
Nov 28 10:52:09 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 10:52:09 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-62447626-40e3-484f-af67-4671c9140b74 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e4:1f:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tap9ecf4395-d0"/></interface> {{(pid=74994) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 28 10:52:09 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-62447626-40e3-484f-af67-4671c9140b74 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e4:1f:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tap9ecf4395-d0"/></interface>not found in domain: <domain type='kvm' id='10'>
Nov 28 10:52:09 user nova-compute[74994]:   <name>instance-0000000a</name>
Nov 28 10:52:09 user nova-compute[74994]:   <uuid>c2925833-e88d-4aa7-a477-ff1bc1fcd724</uuid>
Nov 28 10:52:09 user nova-compute[74994]:   <metadata>
Nov 28 10:52:09 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 10:52:09 user nova-compute[74994]:   <nova:package version="0.0.0"/>
Nov 28 10:52:09 user nova-compute[74994]:   <nova:name>tempest-device-tagging-server-185346772</nova:name>
Nov 28 10:52:09 user nova-compute[74994]:   <nova:creationTime>2023-11-28 10:51:36</nova:creationTime>
Nov 28 10:52:09 user nova-compute[74994]:   <nova:flavor name="m1.tiny">
Nov 28 10:52:09 user nova-compute[74994]:     <nova:memory>512</nova:memory>
Nov 28 10:52:09 user nova-compute[74994]:     <nova:disk>1</nova:disk>
Nov 28 10:52:09 user nova-compute[74994]:     <nova:swap>0</nova:swap>
Nov 28 10:52:09 user nova-compute[74994]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 10:52:09 user nova-compute[74994]:     <nova:vcpus>1</nova:vcpus>
Nov 28 10:52:09 user nova-compute[74994]:   </nova:flavor>
Nov 28 10:52:09 user nova-compute[74994]:   <nova:owner>
Nov 28 10:52:09 user nova-compute[74994]:     <nova:user uuid="02983082e29345a491ecd8fe18268b84">tempest-TaggedAttachmentsTest-1012374446-project-member</nova:user>
Nov 28 10:52:09 user nova-compute[74994]:     <nova:project uuid="a1413a02a3034130b4a4ec170ca2fc16">tempest-TaggedAttachmentsTest-1012374446</nova:project>
Nov 28 10:52:09 user nova-compute[74994]:   </nova:owner>
Nov 28 10:52:09 user nova-compute[74994]:   <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 10:52:09 user nova-compute[74994]:   <nova:ports>
Nov 28 10:52:09 user nova-compute[74994]:     <nova:port uuid="752a5c48-15a2-443c-911c-f1a0c33ca925">
Nov 28 10:52:09 user nova-compute[74994]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 10:52:09 user nova-compute[74994]:     </nova:port>
Nov 28 10:52:09 user nova-compute[74994]:     <nova:port uuid="9ecf4395-d083-44c8-8cf4-d4987884c1aa">
Nov 28 10:52:09 user nova-compute[74994]:       <nova:ip type="fixed" address="10.10.10.211" ipVersion="4"/>
Nov 28 10:52:09 user nova-compute[74994]:     </nova:port>
Nov 28 10:52:09 user nova-compute[74994]:   </nova:ports>
Nov 28 10:52:09 user nova-compute[74994]: </nova:instance>
Nov 28 10:52:09 user nova-compute[74994]:   </metadata>
Nov 28 10:52:09 user nova-compute[74994]:   <memory unit='KiB'>524288</memory>
Nov 28 10:52:09 user nova-compute[74994]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 28 10:52:09 user nova-compute[74994]:   <vcpu placement='static'>1</vcpu>
Nov 28 10:52:09 user nova-compute[74994]:   <resource>
Nov 28 10:52:09 user nova-compute[74994]:     <partition>/machine</partition>
Nov 28 10:52:09 user nova-compute[74994]:   </resource>
Nov 28 10:52:09 user nova-compute[74994]:   <sysinfo type='smbios'>
Nov 28 10:52:09 user nova-compute[74994]:     <system>
Nov 28 10:52:09 user nova-compute[74994]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 28 10:52:09 user nova-compute[74994]:       <entry name='product'>OpenStack Nova</entry>
Nov 28 10:52:09 user nova-compute[74994]:       <entry name='version'>0.0.0</entry>
Nov 28 10:52:09 user nova-compute[74994]:       <entry name='serial'>c2925833-e88d-4aa7-a477-ff1bc1fcd724</entry>
Nov 28 10:52:09 user nova-compute[74994]:       <entry name='uuid'>c2925833-e88d-4aa7-a477-ff1bc1fcd724</entry>
Nov 28 10:52:09 user nova-compute[74994]:       <entry name='family'>Virtual Machine</entry>
Nov 28 10:52:09 user nova-compute[74994]:     </system>
Nov 28 10:52:09 user nova-compute[74994]:   </sysinfo>
Nov 28 10:52:09 user nova-compute[74994]:   <os>
Nov 28 10:52:09 user nova-compute[74994]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 28 10:52:09 user nova-compute[74994]:     <boot dev='hd'/>
Nov 28 10:52:09 user nova-compute[74994]:     <smbios mode='sysinfo'/>
Nov 28 10:52:09 user nova-compute[74994]:   </os>
Nov 28 10:52:09 user nova-compute[74994]:   <features>
Nov 28 10:52:09 user nova-compute[74994]:     <acpi/>
Nov 28 10:52:09 user nova-compute[74994]:     <apic/>
Nov 28 10:52:09 user nova-compute[74994]:     <vmcoreinfo state='on'/>
Nov 28 10:52:09 user nova-compute[74994]:   </features>
Nov 28 10:52:09 user nova-compute[74994]:   <cpu mode='custom' match='exact' check='full'>
Nov 28 10:52:09 user nova-compute[74994]:     <model fallback='forbid'>Nehalem</model>
Nov 28 10:52:09 user nova-compute[74994]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 28 10:52:09 user nova-compute[74994]:     <feature policy='require' name='vme'/>
Nov 28 10:52:09 user nova-compute[74994]:     <feature policy='require' name='x2apic'/>
Nov 28 10:52:09 user nova-compute[74994]:     <feature policy='require' name='hypervisor'/>
Nov 28 10:52:09 user nova-compute[74994]:   </cpu>
Nov 28 10:52:09 user nova-compute[74994]:   <clock offset='utc'>
Nov 28 10:52:09 user nova-compute[74994]:     <timer name='pit' tickpolicy='delay'/>
Nov 28 10:52:09 user nova-compute[74994]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 28 10:52:09 user nova-compute[74994]:     <timer name='hpet' present='no'/>
Nov 28 10:52:09 user nova-compute[74994]:   </clock>
Nov 28 10:52:09 user nova-compute[74994]:   <on_poweroff>destroy</on_poweroff>
Nov 28 10:52:09 user nova-compute[74994]:   <on_reboot>restart</on_reboot>
Nov 28 10:52:09 user nova-compute[74994]:   <on_crash>destroy</on_crash>
Nov 28 10:52:09 user nova-compute[74994]:   <devices>
Nov 28 10:52:09 user nova-compute[74994]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 28 10:52:09 user nova-compute[74994]:     <disk type='file' device='disk'>
Nov 28 10:52:09 user nova-compute[74994]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 28 10:52:09 user nova-compute[74994]:       <source file='/opt/stack/data/nova/instances/c2925833-e88d-4aa7-a477-ff1bc1fcd724/disk' index='2'/>
Nov 28 10:52:09 user nova-compute[74994]:       <backingStore type='file' index='3'>
Nov 28 10:52:09 user nova-compute[74994]:         <format type='raw'/>
Nov 28 10:52:09 user nova-compute[74994]:         <source file='/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188'/>
Nov 28 10:52:09 user nova-compute[74994]:         <backingStore/>
Nov 28 10:52:09 user nova-compute[74994]:       </backingStore>
Nov 28 10:52:09 user nova-compute[74994]:       <target dev='vda' bus='virtio'/>
Nov 28 10:52:09 user nova-compute[74994]:       <alias name='virtio-disk0'/>
Nov 28 10:52:09 user nova-compute[74994]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 28 10:52:09 user nova-compute[74994]:     </disk>
Nov 28 10:52:09 user nova-compute[74994]:     <disk type='file' device='cdrom'>
Nov 28 10:52:09 user nova-compute[74994]:       <driver name='qemu' type='raw' cache='none'/>
Nov 28 10:52:09 user nova-compute[74994]:       <source file='/opt/stack/data/nova/instances/c2925833-e88d-4aa7-a477-ff1bc1fcd724/disk.config' index='1'/>
Nov 28 10:52:09 user nova-compute[74994]:       <backingStore/>
Nov 28 10:52:09 user nova-compute[74994]:       <target dev='hda' bus='ide'/>
Nov 28 10:52:09 user nova-compute[74994]:       <readonly/>
Nov 28 10:52:09 user nova-compute[74994]:       <alias name='ide0-0-0'/>
Nov 28 10:52:09 user nova-compute[74994]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 28 10:52:09 user nova-compute[74994]:     </disk>
Nov 28 10:52:09 user nova-compute[74994]:     <controller type='usb' index='0' model='none'>
Nov 28 10:52:09 user nova-compute[74994]:       <alias name='usb'/>
Nov 28 10:52:09 user nova-compute[74994]:     </controller>
Nov 28 10:52:09 user nova-compute[74994]:     <controller type='pci' index='0' model='pci-root'>
Nov 28 10:52:09 user nova-compute[74994]:       <alias name='pci.0'/>
Nov 28 10:52:09 user nova-compute[74994]:     </controller>
Nov 28 10:52:09 user nova-compute[74994]:     <controller type='ide' index='0'>
Nov 28 10:52:09 user nova-compute[74994]:       <alias name='ide'/>
Nov 28 10:52:09 user nova-compute[74994]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 28 10:52:09 user nova-compute[74994]:     </controller>
Nov 28 10:52:09 user nova-compute[74994]:     <interface type='ethernet'>
Nov 28 10:52:09 user nova-compute[74994]:       <mac address='fa:16:3e:a4:4b:1f'/>
Nov 28 10:52:09 user nova-compute[74994]:       <target dev='tap752a5c48-15'/>
Nov 28 10:52:09 user nova-compute[74994]:       <model type='virtio'/>
Nov 28 10:52:09 user nova-compute[74994]:       <mtu size='1442'/>
Nov 28 10:52:09 user nova-compute[74994]:       <alias name='net0'/>
Nov 28 10:52:09 user nova-compute[74994]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 28 10:52:09 user nova-compute[74994]:     </interface>
Nov 28 10:52:09 user nova-compute[74994]:     <interface type='ethernet'>
Nov 28 10:52:09 user nova-compute[74994]:       <mac address='fa:16:3e:e4:1f:d6'/>
Nov 28 10:52:09 user nova-compute[74994]:       <target dev='tap9ecf4395-d0'/>
Nov 28 10:52:09 user nova-compute[74994]:       <model type='virtio'/>
Nov 28 10:52:09 user nova-compute[74994]:       <mtu size='1442'/>
Nov 28 10:52:09 user nova-compute[74994]:       <alias name='net1'/>
Nov 28 10:52:09 user nova-compute[74994]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 28 10:52:09 user nova-compute[74994]:     </interface>
Nov 28 10:52:09 user nova-compute[74994]:     <serial type='pty'>
Nov 28 10:52:09 user nova-compute[74994]:       <source path='/dev/pts/9'/>
Nov 28 10:52:09 user nova-compute[74994]:       <log file='/opt/stack/data/nova/instances/c2925833-e88d-4aa7-a477-ff1bc1fcd724/console.log' append='off'/>
Nov 28 10:52:09 user nova-compute[74994]:       <target type='isa-serial' port='0'>
Nov 28 10:52:09 user nova-compute[74994]:         <model name='isa-serial'/>
Nov 28 10:52:09 user nova-compute[74994]:       </target>
Nov 28 10:52:09 user nova-compute[74994]:       <alias name='serial0'/>
Nov 28 10:52:09 user nova-compute[74994]:     </serial>
Nov 28 10:52:09 user nova-compute[74994]:     <console type='pty' tty='/dev/pts/9'>
Nov 28 10:52:09 user nova-compute[74994]:       <source path='/dev/pts/9'/>
Nov 28 10:52:09 user nova-compute[74994]:       <log file='/opt/stack/data/nova/instances/c2925833-e88d-4aa7-a477-ff1bc1fcd724/console.log' append='off'/>
Nov 28 10:52:09 user nova-compute[74994]:       <target type='serial' port='0'/>
Nov 28 10:52:09 user nova-compute[74994]:       <alias name='serial0'/>
Nov 28 10:52:09 user nova-compute[74994]:     </console>
Nov 28 10:52:09 user nova-compute[74994]:     <input type='mouse' bus='ps2'>
Nov 28 10:52:09 user nova-compute[74994]:       <alias name='input0'/>
Nov 28 10:52:09 user nova-compute[74994]:     </input>
Nov 28 10:52:09 user nova-compute[74994]:     <input type='keyboard' bus='ps2'>
Nov 28 10:52:09 user nova-compute[74994]:       <alias name='input1'/>
Nov 28 10:52:09 user nova-compute[74994]:     </input>
Nov 28 10:52:09 user nova-compute[74994]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Nov 28 10:52:09 user nova-compute[74994]:       <listen type='address' address='0.0.0.0'/>
Nov 28 10:52:09 user nova-compute[74994]:     </graphics>
Nov 28 10:52:09 user nova-compute[74994]:     <audio id='1' type='none'/>
Nov 28 10:52:09 user nova-compute[74994]:     <video>
Nov 28 10:52:09 user nova-compute[74994]:       <model type='virtio' heads='1' primary='yes'/>
Nov 28 10:52:09 user nova-compute[74994]:       <alias name='video0'/>
Nov 28 10:52:09 user nova-compute[74994]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 28 10:52:09 user nova-compute[74994]:     </video>
Nov 28 10:52:09 user nova-compute[74994]:     <memballoon model='virtio'>
Nov 28 10:52:09 user nova-compute[74994]:       <stats period='10'/>
Nov 28 10:52:09 user nova-compute[74994]:       <alias name='balloon0'/>
Nov 28 10:52:09 user nova-compute[74994]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 28 10:52:09 user nova-compute[74994]:     </memballoon>
Nov 28 10:52:09 user nova-compute[74994]:     <rng model='virtio'>
Nov 28 10:52:09 user nova-compute[74994]:       <backend model='random'>/dev/urandom</backend>
Nov 28 10:52:09 user nova-compute[74994]:       <alias name='rng0'/>
Nov 28 10:52:09 user nova-compute[74994]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 28 10:52:09 user nova-compute[74994]:     </rng>
Nov 28 10:52:09 user nova-compute[74994]:   </devices>
Nov 28 10:52:09 user nova-compute[74994]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 28 10:52:09 user nova-compute[74994]:     <label>libvirt-c2925833-e88d-4aa7-a477-ff1bc1fcd724</label>
Nov 28 10:52:09 user nova-compute[74994]:     <imagelabel>libvirt-c2925833-e88d-4aa7-a477-ff1bc1fcd724</imagelabel>
Nov 28 10:52:09 user nova-compute[74994]:   </seclabel>
Nov 28 10:52:09 user nova-compute[74994]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 28 10:52:09 user nova-compute[74994]:     <label>+64055:+108</label>
Nov 28 10:52:09 user nova-compute[74994]:     <imagelabel>+64055:+108</imagelabel>
Nov 28 10:52:09 user nova-compute[74994]:   </seclabel>
Nov 28 10:52:09 user nova-compute[74994]: </domain>
Nov 28 10:52:09 user nova-compute[74994]:  {{(pid=74994) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 28 10:52:09 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-62447626-40e3-484f-af67-4671c9140b74 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Successfully detached device tap9ecf4395-d0 from instance c2925833-e88d-4aa7-a477-ff1bc1fcd724 from the persistent domain config.
Nov 28 10:52:09 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-62447626-40e3-484f-af67-4671c9140b74 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] (1/8): Attempting to detach device tap9ecf4395-d0 with device alias net1 from instance c2925833-e88d-4aa7-a477-ff1bc1fcd724 from the live domain config. {{(pid=74994) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 10:52:09 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-62447626-40e3-484f-af67-4671c9140b74 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] detach device xml: <interface type="ethernet">
Nov 28 10:52:09 user nova-compute[74994]:   <mac address="fa:16:3e:e4:1f:d6"/>
Nov 28 10:52:09 user nova-compute[74994]:   <model type="virtio"/>
Nov 28 10:52:09 user nova-compute[74994]:   <mtu size="1442"/>
Nov 28 10:52:09 user nova-compute[74994]:   <target dev="tap9ecf4395-d0"/>
Nov 28 10:52:09 user nova-compute[74994]: </interface>
Nov 28 10:52:09 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 10:52:09 user nova-compute[74994]: DEBUG nova.compute.manager [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KojpQYLe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a', 'attached_at': '', 'detached_at': '', 'volume_id': '37a2129a-a661-403a-9a9f-29e54191e56b', 'serial': '37a2129a-a661-403a-9a9f-29e54191e56b'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DHIliwdZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': '6d8d9b02-1a52-4141-bd39-95419cec5a1a'}, 'status': 'reserved', 'instance': '7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a', 'attached_at': '', 'detached_at': '', 'volume_id': '6d8d9b02-1a52-4141-bd39-95419cec5a1a', 'serial'} {{(pid=74994) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 28 10:52:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:09 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 10:52:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KojpQYLe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:52:09 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:52:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:52:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:52:09 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:52:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:52:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:52:09 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 10:52:09 user nova-compute[74994]: DEBUG os_brick.utils [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:52:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:09 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e81e4d-3db8-4b35-b272-d7dde42b2f90]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 10:52:09 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:52:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:09 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb00da3-b893-4a6d-b4de-35d1b703abf1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a42bc7-bd81-41fb-9a1f-1c7616440d67]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b] added
Nov 28 10:52:10 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[945c5ee4-e0ad-4b4c-aa7b-bc0476586b2e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[df257f5c-3d14-4943-878b-6300f92e5461]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b3bceb-597a-482d-b9d3-21e044bd5fa9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d42ed5-1516-4b6c-95cc-cdd508c7f5bb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea49156-33ed-47dd-a4cc-05a1e25d1231]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KojpQYLe {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:52:10 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aca758c-fd58-487c-a625-3f21343d7621]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG os_brick.utils [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] <== get_connector_properties: return (177ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Updating existing volume attachment record: 890f2169-c3bd-43db-af23-286ea1c0fdcb {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-62447626-40e3-484f-af67-4671c9140b74 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Start waiting for the detach event from libvirt for device tap9ecf4395-d0 with device alias net1 for instance c2925833-e88d-4aa7-a477-ff1bc1fcd724 {{(pid=74994) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KojpQYLe" returned: 0 in 0.025s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89891ef-6845-40ea-a3ba-051c2f4b1677]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KojpQYLe'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68d27c0-4411-4b4b-a976-363ead83514b]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[69de5e38-b7f7-4e0e-8ab5-ae59cc9d9d92]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3 (non-flash)
Nov 28 10:52:10 user nova-compute[74994]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a (non-flash)
Nov 28 10:52:10 user nova-compute[74994]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:52:10 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:52:10 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:52:10 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:52:10 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3 (non-flash)
Nov 28 10:52:10 user nova-compute[74994]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a (non-flash)
Nov 28 10:52:10 user nova-compute[74994]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:52:10 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:52:10 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:52:10 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:52:10 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[63197803-bee8-4d63-a93b-4c802c73772a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b, portal: 172.16.0.220,3260]
Nov 28 10:52:10 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b, portal: 172.16.0.220,3260] successful.
Nov 28 10:52:10 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.076s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17d1351-15b3-45c1-b0ec-c5ade56050a8]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c644c8a-332c-43fa-8b03-9c2453ce3633]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3 (non-flash)
Nov 28 10:52:10 user nova-compute[74994]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a (non-flash)
Nov 28 10:52:10 user nova-compute[74994]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)
Nov 28 10:52:10 user nova-compute[74994]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:52:10 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:52:10 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:52:10 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:52:10 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3 (non-flash)
Nov 28 10:52:10 user nova-compute[74994]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a (non-flash)
Nov 28 10:52:10 user nova-compute[74994]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)
Nov 28 10:52:10 user nova-compute[74994]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:52:10 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:52:10 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:52:10 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:52:10 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.516s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] HCTL ('37', '-', '-', 0) found on session 12 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG nova.compute.manager [req-8418cde3-5864-4121-9599-f3862fa4254c req-3202d91b-6b14-47f8-837a-e09eef4646e4 service nova] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Received event network-vif-unplugged-9ecf4395-d083-44c8-8cf4-d4987884c1aa {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8418cde3-5864-4121-9599-f3862fa4254c req-3202d91b-6b14-47f8-837a-e09eef4646e4 service nova] Acquiring lock "c2925833-e88d-4aa7-a477-ff1bc1fcd724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8418cde3-5864-4121-9599-f3862fa4254c req-3202d91b-6b14-47f8-837a-e09eef4646e4 service nova] Lock "c2925833-e88d-4aa7-a477-ff1bc1fcd724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8418cde3-5864-4121-9599-f3862fa4254c req-3202d91b-6b14-47f8-837a-e09eef4646e4 service nova] Lock "c2925833-e88d-4aa7-a477-ff1bc1fcd724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG nova.compute.manager [req-8418cde3-5864-4121-9599-f3862fa4254c req-3202d91b-6b14-47f8-837a-e09eef4646e4 service nova] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] No waiting events found dispatching network-vif-unplugged-9ecf4395-d083-44c8-8cf4-d4987884c1aa {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:52:10 user nova-compute[74994]: WARNING nova.compute.manager [req-8418cde3-5864-4121-9599-f3862fa4254c req-3202d91b-6b14-47f8-837a-e09eef4646e4 service nova] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Received unexpected event network-vif-unplugged-9ecf4395-d083-44c8-8cf4-d4987884c1aa for instance with vm_state active and task_state None.
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc1e665-105f-4be4-8e7f-9ca405e5b188]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Searching for a device in session 12 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KojpQYLe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2925833-e88d-4aa7-a477-ff1bc1fcd724/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2925833-e88d-4aa7-a477-ff1bc1fcd724/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2925833-e88d-4aa7-a477-ff1bc1fcd724/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2925833-e88d-4aa7-a477-ff1bc1fcd724/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:11 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 10:52:11 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 10:52:11 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 10:52:11 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 10:52:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.933s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:52:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] <== connect_volume: return (1936ms) {'type': 'block', 'scsi_wwn': '23738316237633761', 'path': '/dev/sdf'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:52:11 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23738316237633761', 'path': '/dev/sdf'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 10:52:11 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:52:11 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:52:11 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=6673MB free_disk=25.39571762084961GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 10:52:11 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:52:11 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:52:11 user nova-compute[74994]: DEBUG nova.objects.instance [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Lazy-loading 'flavor' on Instance uuid 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 5b51d690-8198-4748-807d-1902e75564b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance bc114bed-8d7e-46e0-86a7-7eed7ce75b5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 6e6a974e-3626-453c-8662-0d160f6e57de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 2e30565c-9f8e-4a87-8054-6c260dac4f48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 759fbcfd-ab13-438f-b860-6393a97d1205 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 63b5b88a-f126-4e6c-926d-0a295830240d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance cce813fa-bf97-41f8-8aee-c7a73354e24c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 279e1c4c-36f9-492f-ab3f-1b587347eadd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance bf357856-2d97-42e8-928d-71d0378f48c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance c2925833-e88d-4aa7-a477-ff1bc1fcd724 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance af9e5a26-f865-4563-aed9-34b8ed5b6697 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 10:52:12 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-af81bd1a-8934-46e3-956a-43846ced68d1 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6e6a974e-3626-453c-8662-0d160f6e57de is timed out.
Nov 28 10:52:12 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-af81bd1a-8934-46e3-956a-43846ced68d1 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] Successfully detached device vdb from instance 6e6a974e-3626-453c-8662-0d160f6e57de from the live domain config.
Nov 28 10:52:12 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af81bd1a-8934-46e3-956a-43846ced68d1 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af81bd1a-8934-46e3-956a-43846ced68d1 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tSTNnDau', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:52:12 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-af81bd1a-8934-46e3-956a-43846ced68d1 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:52:12 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-af81bd1a-8934-46e3-956a-43846ced68d1 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-af81bd1a-8934-46e3-956a-43846ced68d1 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.034s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ca282e-6383-4d1b-8f6f-26bb38e57da3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af81bd1a-8934-46e3-956a-43846ced68d1 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 10:52:12 user nova-compute[74994]: No targets found.
Nov 28 10:52:12 user nova-compute[74994]: iSNS:
Nov 28 10:52:12 user nova-compute[74994]: No targets found.
Nov 28 10:52:12 user nova-compute[74994]: STATIC:
Nov 28 10:52:12 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3
Nov 28 10:52:12 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:52:12 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:52:12 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b
Nov 28 10:52:12 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:52:12 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:52:12 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab
Nov 28 10:52:12 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:52:12 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:52:12 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148
Nov 28 10:52:12 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:52:12 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:52:12 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f
Nov 28 10:52:12 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:52:12 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:52:12 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a
Nov 28 10:52:12 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:52:12 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:52:12 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0
Nov 28 10:52:12 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:52:12 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:52:12 user nova-compute[74994]: FIRMWARE:
Nov 28 10:52:12 user nova-compute[74994]: No targets found.
Nov 28 10:52:12 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af81bd1a-8934-46e3-956a-43846ced68d1 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 10:52:12 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 10:52:12 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af81bd1a-8934-46e3-956a-43846ced68d1 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG nova.compute.manager [req-2a0b90ea-adb6-43f3-a0d1-bf830ff749a4 req-252d3eb7-eb7a-43d9-bb9d-fec7453a0199 service nova] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Received event network-vif-plugged-9ecf4395-d083-44c8-8cf4-d4987884c1aa {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-2a0b90ea-adb6-43f3-a0d1-bf830ff749a4 req-252d3eb7-eb7a-43d9-bb9d-fec7453a0199 service nova] Acquiring lock "c2925833-e88d-4aa7-a477-ff1bc1fcd724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-2a0b90ea-adb6-43f3-a0d1-bf830ff749a4 req-252d3eb7-eb7a-43d9-bb9d-fec7453a0199 service nova] Lock "c2925833-e88d-4aa7-a477-ff1bc1fcd724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-2a0b90ea-adb6-43f3-a0d1-bf830ff749a4 req-252d3eb7-eb7a-43d9-bb9d-fec7453a0199 service nova] Lock "c2925833-e88d-4aa7-a477-ff1bc1fcd724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG nova.compute.manager [req-2a0b90ea-adb6-43f3-a0d1-bf830ff749a4 req-252d3eb7-eb7a-43d9-bb9d-fec7453a0199 service nova] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] No waiting events found dispatching network-vif-plugged-9ecf4395-d083-44c8-8cf4-d4987884c1aa {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:52:12 user nova-compute[74994]: WARNING nova.compute.manager [req-2a0b90ea-adb6-43f3-a0d1-bf830ff749a4 req-252d3eb7-eb7a-43d9-bb9d-fec7453a0199 service nova] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Received unexpected event network-vif-plugged-9ecf4395-d083-44c8-8cf4-d4987884c1aa for instance with vm_state active and task_state None.
Nov 28 10:52:12 user nova-compute[74994]: DEBUG nova.compute.manager [req-2a0b90ea-adb6-43f3-a0d1-bf830ff749a4 req-252d3eb7-eb7a-43d9-bb9d-fec7453a0199 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received event network-changed-7ca13785-4bcf-42f6-b804-36f3c3cd1b82 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG nova.compute.manager [req-2a0b90ea-adb6-43f3-a0d1-bf830ff749a4 req-252d3eb7-eb7a-43d9-bb9d-fec7453a0199 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Refreshing instance network info cache due to event network-changed-7ca13785-4bcf-42f6-b804-36f3c3cd1b82. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-2a0b90ea-adb6-43f3-a0d1-bf830ff749a4 req-252d3eb7-eb7a-43d9-bb9d-fec7453a0199 service nova] Acquiring lock "refresh_cache-af9e5a26-f865-4563-aed9-34b8ed5b6697" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-2a0b90ea-adb6-43f3-a0d1-bf830ff749a4 req-252d3eb7-eb7a-43d9-bb9d-fec7453a0199 service nova] Acquired lock "refresh_cache-af9e5a26-f865-4563-aed9-34b8ed5b6697" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG nova.network.neutron [req-2a0b90ea-adb6-43f3-a0d1-bf830ff749a4 req-252d3eb7-eb7a-43d9-bb9d-fec7453a0199 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Refreshing network info cache for port 7ca13785-4bcf-42f6-b804-36f3c3cd1b82 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.040s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3bb4bdf-8091-4b40-9f3d-f5728595a06c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[062e70fb-ac78-43c0-a8d9-31ff644b4307]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af81bd1a-8934-46e3-956a-43846ced68d1 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3 (non-flash)
Nov 28 10:52:12 user nova-compute[74994]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a (non-flash)
Nov 28 10:52:12 user nova-compute[74994]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)
Nov 28 10:52:12 user nova-compute[74994]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:52:12 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:52:12 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:52:12 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:52:12 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af81bd1a-8934-46e3-956a-43846ced68d1 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3 (non-flash)
Nov 28 10:52:12 user nova-compute[74994]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a (non-flash)
Nov 28 10:52:12 user nova-compute[74994]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)
Nov 28 10:52:12 user nova-compute[74994]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:52:12 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:52:12 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:52:12 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:52:12 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af81bd1a-8934-46e3-956a-43846ced68d1 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9207463b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3'): ({'sdi'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-af81bd1a-8934-46e3-956a-43846ced68d1 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] Removing single pathed devices sdi {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae635efd-8e86-4fd0-89c0-a93f1ff61b4c]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.025s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf956b46-871f-4595-91d7-04ca46e5dadc]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-af81bd1a-8934-46e3-956a-43846ced68d1 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] Flushing IO for device /dev/sdi {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e3b4a2-6555-4c81-a69b-d8e04a1b7bd0]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-af81bd1a-8934-46e3-956a-43846ced68d1 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.852s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.047s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[61494070-76b4-4dcc-9c5b-064d6a8afe4c]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-af81bd1a-8934-46e3-956a-43846ced68d1 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-af81bd1a-8934-46e3-956a-43846ced68d1 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] SCSI volumes sdi have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af81bd1a-8934-46e3-956a-43846ced68d1 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e1793d-9bc3-446c-a752-be0586b064a0]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af81bd1a-8934-46e3-956a-43846ced68d1 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3 -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4737df72-3d63-436a-9dca-7a9e9740174e]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af81bd1a-8934-46e3-956a-43846ced68d1 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3, portal: 172.16.0.220,3260]
Nov 28 10:52:12 user nova-compute[74994]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3, portal: 172.16.0.220,3260] successful.
Nov 28 10:52:12 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3 -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] COPY block job progress, current cursor: 159383552 final cursor: 1073741824 {{(pid=74994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a789baf8-df65-4c89-bd72-88bf279d90e3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.050s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc3d31b-b984-4ae8-a0d4-99179cc58c17]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af81bd1a-8934-46e3-956a-43846ced68d1 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-af81bd1a-8934-46e3-956a-43846ced68d1 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.503s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-af81bd1a-8934-46e3-956a-43846ced68d1 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] <== disconnect_volume: return (506ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:52:12 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af81bd1a-8934-46e3-956a-43846ced68d1 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 10:52:13 user nova-compute[74994]: DEBUG nova.network.neutron [req-2a0b90ea-adb6-43f3-a0d1-bf830ff749a4 req-252d3eb7-eb7a-43d9-bb9d-fec7453a0199 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Updated VIF entry in instance network info cache for port 7ca13785-4bcf-42f6-b804-36f3c3cd1b82. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 10:52:13 user nova-compute[74994]: DEBUG nova.network.neutron [req-2a0b90ea-adb6-43f3-a0d1-bf830ff749a4 req-252d3eb7-eb7a-43d9-bb9d-fec7453a0199 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Updating instance_info_cache with network_info: [{"id": "7ca13785-4bcf-42f6-b804-36f3c3cd1b82", "address": "fa:16:3e:fa:03:33", "network": {"id": "0b2c7b2c-5fe7-4238-9675-285c43d2bdf4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-766551976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ca13785-4b", "ovs_interfaceid": "7ca13785-4bcf-42f6-b804-36f3c3cd1b82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f049d45c-915d-4517-8799-8d8200a45b49", "address": "fa:16:3e:b7:f0:54", "network": {"id": "55373264-0376-4835-a5b6-4dbe7fbc0423", "bridge": "br-int", "label": "tempest-device-tagging-net1-1542107900", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf049d45c-91", "ovs_interfaceid": "f049d45c-915d-4517-8799-8d8200a45b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d8d28630-5645-4f2e-b7d3-2b0ac060ea43", "address": "fa:16:3e:0e:35:01", "network": {"id": "55373264-0376-4835-a5b6-4dbe7fbc0423", "bridge": "br-int", "label": "tempest-device-tagging-net1-1542107900", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8d28630-56", "ovs_interfaceid": "d8d28630-5645-4f2e-b7d3-2b0ac060ea43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e6ce548a-c7d7-4f70-8411-7809489f0a91", "address": "fa:16:3e:4e:fc:91", "network": {"id": "55373264-0376-4835-a5b6-4dbe7fbc0423", "bridge": "br-int", "label": "tempest-device-tagging-net1-1542107900", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ce548a-c7", "ovs_interfaceid": "e6ce548a-c7d7-4f70-8411-7809489f0a91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6d482201-d7ff-4dcc-9a23-a399a27c69f3", "address": "fa:16:3e:b1:aa:d2", "network": {"id": "55373264-0376-4835-a5b6-4dbe7fbc0423", "bridge": "br-int", "label": "tempest-device-tagging-net1-1542107900", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d482201-d7", "ovs_interfaceid": "6d482201-d7ff-4dcc-9a23-a399a27c69f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da486672-f1e9-4bbe-8d5a-e9f2f0ad5119", "address": "fa:16:3e:56:1d:f4", "network": {"id": "e32d74f0-a6b2-4c07-b2b1-9c3bc9a6b4a5", "bridge": "br-int", "label": "tempest-device-tagging-net2-207234115", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda486672-f1", "ovs_interfaceid": "da486672-f1e9-4bbe-8d5a-e9f2f0ad5119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9330afbb-83bf-4674-8eda-d091eb2670e5", "address": "fa:16:3e:78:0e:99", "network": {"id": "e32d74f0-a6b2-4c07-b2b1-9c3bc9a6b4a5", "bridge": "br-int", "label": "tempest-device-tagging-net2-207234115", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9330afbb-83", "ovs_interfaceid": "9330afbb-83bf-4674-8eda-d091eb2670e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:52:13 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-2a0b90ea-adb6-43f3-a0d1-bf830ff749a4 req-252d3eb7-eb7a-43d9-bb9d-fec7453a0199 service nova] Releasing lock "refresh_cache-af9e5a26-f865-4563-aed9-34b8ed5b6697" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:52:13 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:52:13 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:52:13 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:52:13 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:52:13 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] COPY block job progress, current cursor: 269484032 final cursor: 1073741824 {{(pid=74994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 10:52:13 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] COPY block job progress, current cursor: 401604608 final cursor: 1073741824 {{(pid=74994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 10:52:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:14 user nova-compute[74994]: DEBUG nova.objects.instance [None req-af81bd1a-8934-46e3-956a-43846ced68d1 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] Lazy-loading 'flavor' on Instance uuid 6e6a974e-3626-453c-8662-0d160f6e57de {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:52:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-af81bd1a-8934-46e3-956a-43846ced68d1 tempest-VolumesAssistedSnapshotsTest-1463402316 tempest-VolumesAssistedSnapshotsTest-1463402316-project-admin] Lock "6e6a974e-3626-453c-8662-0d160f6e57de" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.485s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:52:14 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] COPY block job progress, current cursor: 541065216 final cursor: 1073741824 {{(pid=74994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 10:52:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Acquiring lock "af9e5a26-f865-4563-aed9-34b8ed5b6697" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:52:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:52:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Acquiring lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:52:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:52:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:52:14 user nova-compute[74994]: INFO nova.compute.manager [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Terminating instance
Nov 28 10:52:14 user nova-compute[74994]: DEBUG nova.compute.manager [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 10:52:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:14 user nova-compute[74994]: DEBUG nova.compute.manager [req-46dbff6d-bddf-4b43-9f73-d45512d7be71 req-081a9841-c71f-4c94-b270-aec8b7d9ac0d service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received event network-vif-unplugged-7ca13785-4bcf-42f6-b804-36f3c3cd1b82 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:52:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-46dbff6d-bddf-4b43-9f73-d45512d7be71 req-081a9841-c71f-4c94-b270-aec8b7d9ac0d service nova] Acquiring lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:52:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-46dbff6d-bddf-4b43-9f73-d45512d7be71 req-081a9841-c71f-4c94-b270-aec8b7d9ac0d service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:52:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-46dbff6d-bddf-4b43-9f73-d45512d7be71 req-081a9841-c71f-4c94-b270-aec8b7d9ac0d service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:52:14 user nova-compute[74994]: DEBUG nova.compute.manager [req-46dbff6d-bddf-4b43-9f73-d45512d7be71 req-081a9841-c71f-4c94-b270-aec8b7d9ac0d service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] No waiting events found dispatching network-vif-unplugged-7ca13785-4bcf-42f6-b804-36f3c3cd1b82 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:52:14 user nova-compute[74994]: DEBUG nova.compute.manager [req-46dbff6d-bddf-4b43-9f73-d45512d7be71 req-081a9841-c71f-4c94-b270-aec8b7d9ac0d service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received event network-vif-unplugged-7ca13785-4bcf-42f6-b804-36f3c3cd1b82 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 10:52:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:14 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] COPY block job progress, current cursor: 654311424 final cursor: 1073741824 {{(pid=74994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 10:52:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:15 user nova-compute[74994]: DEBUG nova.compute.manager [req-1a298ca6-ba00-4070-8be3-f70ed4352f61 req-03713e96-30c8-4d77-aea0-64de176b72f4 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received event network-vif-unplugged-f049d45c-915d-4517-8799-8d8200a45b49 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:52:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-1a298ca6-ba00-4070-8be3-f70ed4352f61 req-03713e96-30c8-4d77-aea0-64de176b72f4 service nova] Acquiring lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:52:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-1a298ca6-ba00-4070-8be3-f70ed4352f61 req-03713e96-30c8-4d77-aea0-64de176b72f4 service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:52:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-1a298ca6-ba00-4070-8be3-f70ed4352f61 req-03713e96-30c8-4d77-aea0-64de176b72f4 service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:52:15 user nova-compute[74994]: DEBUG nova.compute.manager [req-1a298ca6-ba00-4070-8be3-f70ed4352f61 req-03713e96-30c8-4d77-aea0-64de176b72f4 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] No waiting events found dispatching network-vif-unplugged-f049d45c-915d-4517-8799-8d8200a45b49 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:52:15 user nova-compute[74994]: DEBUG nova.compute.manager [req-1a298ca6-ba00-4070-8be3-f70ed4352f61 req-03713e96-30c8-4d77-aea0-64de176b72f4 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received event network-vif-unplugged-f049d45c-915d-4517-8799-8d8200a45b49 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 10:52:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:15 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] COPY block job progress, current cursor: 781189120 final cursor: 1073741824 {{(pid=74994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 10:52:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:16 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] COPY block job progress, current cursor: 912261120 final cursor: 1073741824 {{(pid=74994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 10:52:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:16 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Instance destroyed successfully.
Nov 28 10:52:16 user nova-compute[74994]: DEBUG nova.objects.instance [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Lazy-loading 'resources' on Instance uuid af9e5a26-f865-4563-aed9-34b8ed5b6697 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:52:16 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:50:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1695169480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1695169480',id=12,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFN6MEwyUWk8GSmHy1bNd9rONr8OYvJnOKizV3jBEue+Dp6QzKo81hoNph+ojxxVeX39WSSYot1LYMhIoRx0iJpNwiKpZtbgjHAAjMlNS/SHmKZc2KEOeHCAZCZthW3ROw==',key_name='tempest-keypair-518302348',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:50:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d334446f1c65465885717aab3fb6c78b',ramdisk_id='',reservation_id='r-xgkc4yau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1196788905',owner_user_name='tempest-TaggedBootDevicesTest_v242-1196788905-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T10:50:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9cf909ee96b249c98a98547cab18fcef',uuid=af9e5a26-f865-4563-aed9-34b8ed5b6697,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ca13785-4bcf-42f6-b804-36f3c3cd1b82", "address": "fa:16:3e:fa:03:33", "network": {"id": "0b2c7b2c-5fe7-4238-9675-285c43d2bdf4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-766551976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ca13785-4b", "ovs_interfaceid": "7ca13785-4bcf-42f6-b804-36f3c3cd1b82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 10:52:16 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Converting VIF {"id": "7ca13785-4bcf-42f6-b804-36f3c3cd1b82", "address": "fa:16:3e:fa:03:33", "network": {"id": "0b2c7b2c-5fe7-4238-9675-285c43d2bdf4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-766551976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ca13785-4b", "ovs_interfaceid": "7ca13785-4bcf-42f6-b804-36f3c3cd1b82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:52:16 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fa:03:33,bridge_name='br-int',has_traffic_filtering=True,id=7ca13785-4bcf-42f6-b804-36f3c3cd1b82,network=Network(0b2c7b2c-5fe7-4238-9675-285c43d2bdf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ca13785-4b') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:52:16 user nova-compute[74994]: DEBUG os_vif [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:03:33,bridge_name='br-int',has_traffic_filtering=True,id=7ca13785-4bcf-42f6-b804-36f3c3cd1b82,network=Network(0b2c7b2c-5fe7-4238-9675-285c43d2bdf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ca13785-4b') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 10:52:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ca13785-4b, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:52:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:52:16 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] COPY block job progress, current cursor: 1061158912 final cursor: 1073741824 {{(pid=74994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 10:52:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0116a889-b1c4-4e2d-9615-bfa99194c650) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:52:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:52:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:16 user nova-compute[74994]: INFO os_vif [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:03:33,bridge_name='br-int',has_traffic_filtering=True,id=7ca13785-4bcf-42f6-b804-36f3c3cd1b82,network=Network(0b2c7b2c-5fe7-4238-9675-285c43d2bdf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ca13785-4b')
Nov 28 10:52:16 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:50:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1695169480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1695169480',id=12,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFN6MEwyUWk8GSmHy1bNd9rONr8OYvJnOKizV3jBEue+Dp6QzKo81hoNph+ojxxVeX39WSSYot1LYMhIoRx0iJpNwiKpZtbgjHAAjMlNS/SHmKZc2KEOeHCAZCZthW3ROw==',key_name='tempest-keypair-518302348',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:50:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d334446f1c65465885717aab3fb6c78b',ramdisk_id='',reservation_id='r-xgkc4yau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1196788905',owner_user_name='tempest-TaggedBootDevicesTest_v242-1196788905-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T10:50:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9cf909ee96b249c98a98547cab18fcef',uuid=af9e5a26-f865-4563-aed9-34b8ed5b6697,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f049d45c-915d-4517-8799-8d8200a45b49", "address": "fa:16:3e:b7:f0:54", "network": {"id": "55373264-0376-4835-a5b6-4dbe7fbc0423", "bridge": "br-int", "label": "tempest-device-tagging-net1-1542107900", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf049d45c-91", "ovs_interfaceid": "f049d45c-915d-4517-8799-8d8200a45b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 10:52:16 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Converting VIF {"id": "f049d45c-915d-4517-8799-8d8200a45b49", "address": "fa:16:3e:b7:f0:54", "network": {"id": "55373264-0376-4835-a5b6-4dbe7fbc0423", "bridge": "br-int", "label": "tempest-device-tagging-net1-1542107900", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf049d45c-91", "ovs_interfaceid": "f049d45c-915d-4517-8799-8d8200a45b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:52:16 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:f0:54,bridge_name='br-int',has_traffic_filtering=True,id=f049d45c-915d-4517-8799-8d8200a45b49,network=Network(55373264-0376-4835-a5b6-4dbe7fbc0423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf049d45c-91') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:52:16 user nova-compute[74994]: DEBUG os_vif [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:f0:54,bridge_name='br-int',has_traffic_filtering=True,id=f049d45c-915d-4517-8799-8d8200a45b49,network=Network(55373264-0376-4835-a5b6-4dbe7fbc0423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf049d45c-91') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 10:52:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf049d45c-91, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:52:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:52:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e8ab8223-035e-45d2-95b5-afe4eed6800e) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:52:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:52:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:16 user nova-compute[74994]: INFO os_vif [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:f0:54,bridge_name='br-int',has_traffic_filtering=True,id=f049d45c-915d-4517-8799-8d8200a45b49,network=Network(55373264-0376-4835-a5b6-4dbe7fbc0423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf049d45c-91')
Nov 28 10:52:16 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:50:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1695169480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1695169480',id=12,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFN6MEwyUWk8GSmHy1bNd9rONr8OYvJnOKizV3jBEue+Dp6QzKo81hoNph+ojxxVeX39WSSYot1LYMhIoRx0iJpNwiKpZtbgjHAAjMlNS/SHmKZc2KEOeHCAZCZthW3ROw==',key_name='tempest-keypair-518302348',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:50:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d334446f1c65465885717aab3fb6c78b',ramdisk_id='',reservation_id='r-xgkc4yau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1196788905',owner_user_name='tempest-TaggedBootDevicesTest_v242-1196788905-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T10:50:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9cf909ee96b249c98a98547cab18fcef',uuid=af9e5a26-f865-4563-aed9-34b8ed5b6697,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8d28630-5645-4f2e-b7d3-2b0ac060ea43", "address": "fa:16:3e:0e:35:01", "network": {"id": "55373264-0376-4835-a5b6-4dbe7fbc0423", "bridge": "br-int", "label": "tempest-device-tagging-net1-1542107900", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8d28630-56", "ovs_interfaceid": "d8d28630-5645-4f2e-b7d3-2b0ac060ea43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 10:52:16 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Converting VIF {"id": "d8d28630-5645-4f2e-b7d3-2b0ac060ea43", "address": "fa:16:3e:0e:35:01", "network": {"id": "55373264-0376-4835-a5b6-4dbe7fbc0423", "bridge": "br-int", "label": "tempest-device-tagging-net1-1542107900", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8d28630-56", "ovs_interfaceid": "d8d28630-5645-4f2e-b7d3-2b0ac060ea43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:52:16 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:35:01,bridge_name='br-int',has_traffic_filtering=True,id=d8d28630-5645-4f2e-b7d3-2b0ac060ea43,network=Network(55373264-0376-4835-a5b6-4dbe7fbc0423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd8d28630-56') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:52:16 user nova-compute[74994]: DEBUG os_vif [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:35:01,bridge_name='br-int',has_traffic_filtering=True,id=d8d28630-5645-4f2e-b7d3-2b0ac060ea43,network=Network(55373264-0376-4835-a5b6-4dbe7fbc0423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd8d28630-56') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 10:52:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd8d28630-56, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:52:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:52:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=667f5bf8-9684-4ba8-a335-e3d465050ff2) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:52:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:52:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:16 user nova-compute[74994]: INFO os_vif [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:35:01,bridge_name='br-int',has_traffic_filtering=True,id=d8d28630-5645-4f2e-b7d3-2b0ac060ea43,network=Network(55373264-0376-4835-a5b6-4dbe7fbc0423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd8d28630-56')
Nov 28 10:52:16 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:50:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1695169480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1695169480',id=12,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFN6MEwyUWk8GSmHy1bNd9rONr8OYvJnOKizV3jBEue+Dp6QzKo81hoNph+ojxxVeX39WSSYot1LYMhIoRx0iJpNwiKpZtbgjHAAjMlNS/SHmKZc2KEOeHCAZCZthW3ROw==',key_name='tempest-keypair-518302348',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:50:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d334446f1c65465885717aab3fb6c78b',ramdisk_id='',reservation_id='r-xgkc4yau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1196788905',owner_user_name='tempest-TaggedBootDevicesTest_v242-1196788905-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T10:50:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9cf909ee96b249c98a98547cab18fcef',uuid=af9e5a26-f865-4563-aed9-34b8ed5b6697,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6ce548a-c7d7-4f70-8411-7809489f0a91", "address": "fa:16:3e:4e:fc:91", "network": {"id": "55373264-0376-4835-a5b6-4dbe7fbc0423", "bridge": "br-int", "label": "tempest-device-tagging-net1-1542107900", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ce548a-c7", "ovs_interfaceid": "e6ce548a-c7d7-4f70-8411-7809489f0a91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 10:52:16 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Converting VIF {"id": "e6ce548a-c7d7-4f70-8411-7809489f0a91", "address": "fa:16:3e:4e:fc:91", "network": {"id": "55373264-0376-4835-a5b6-4dbe7fbc0423", "bridge": "br-int", "label": "tempest-device-tagging-net1-1542107900", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ce548a-c7", "ovs_interfaceid": "e6ce548a-c7d7-4f70-8411-7809489f0a91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:52:16 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:fc:91,bridge_name='br-int',has_traffic_filtering=True,id=e6ce548a-c7d7-4f70-8411-7809489f0a91,network=Network(55373264-0376-4835-a5b6-4dbe7fbc0423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6ce548a-c7') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:52:16 user nova-compute[74994]: DEBUG os_vif [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:fc:91,bridge_name='br-int',has_traffic_filtering=True,id=e6ce548a-c7d7-4f70-8411-7809489f0a91,network=Network(55373264-0376-4835-a5b6-4dbe7fbc0423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6ce548a-c7') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 10:52:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6ce548a-c7, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:52:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG nova.compute.manager [req-4e99fe24-e67f-4cfa-929c-254719a84a0a req-537ff07a-4a69-4462-aa39-9bdf0471930e service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received event network-vif-plugged-7ca13785-4bcf-42f6-b804-36f3c3cd1b82 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4e99fe24-e67f-4cfa-929c-254719a84a0a req-537ff07a-4a69-4462-aa39-9bdf0471930e service nova] Acquiring lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4e99fe24-e67f-4cfa-929c-254719a84a0a req-537ff07a-4a69-4462-aa39-9bdf0471930e service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4e99fe24-e67f-4cfa-929c-254719a84a0a req-537ff07a-4a69-4462-aa39-9bdf0471930e service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG nova.compute.manager [req-4e99fe24-e67f-4cfa-929c-254719a84a0a req-537ff07a-4a69-4462-aa39-9bdf0471930e service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] No waiting events found dispatching network-vif-plugged-7ca13785-4bcf-42f6-b804-36f3c3cd1b82 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:52:17 user nova-compute[74994]: WARNING nova.compute.manager [req-4e99fe24-e67f-4cfa-929c-254719a84a0a req-537ff07a-4a69-4462-aa39-9bdf0471930e service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received unexpected event network-vif-plugged-7ca13785-4bcf-42f6-b804-36f3c3cd1b82 for instance with vm_state active and task_state deleting.
Nov 28 10:52:17 user nova-compute[74994]: DEBUG nova.compute.manager [req-4e99fe24-e67f-4cfa-929c-254719a84a0a req-537ff07a-4a69-4462-aa39-9bdf0471930e service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received event network-vif-unplugged-9330afbb-83bf-4674-8eda-d091eb2670e5 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4e99fe24-e67f-4cfa-929c-254719a84a0a req-537ff07a-4a69-4462-aa39-9bdf0471930e service nova] Acquiring lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4e99fe24-e67f-4cfa-929c-254719a84a0a req-537ff07a-4a69-4462-aa39-9bdf0471930e service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4e99fe24-e67f-4cfa-929c-254719a84a0a req-537ff07a-4a69-4462-aa39-9bdf0471930e service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG nova.compute.manager [req-4e99fe24-e67f-4cfa-929c-254719a84a0a req-537ff07a-4a69-4462-aa39-9bdf0471930e service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] No waiting events found dispatching network-vif-unplugged-9330afbb-83bf-4674-8eda-d091eb2670e5 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG nova.compute.manager [req-4e99fe24-e67f-4cfa-929c-254719a84a0a req-537ff07a-4a69-4462-aa39-9bdf0471930e service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received event network-vif-unplugged-9330afbb-83bf-4674-8eda-d091eb2670e5 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG nova.compute.manager [req-4e99fe24-e67f-4cfa-929c-254719a84a0a req-537ff07a-4a69-4462-aa39-9bdf0471930e service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received event network-vif-plugged-9330afbb-83bf-4674-8eda-d091eb2670e5 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4e99fe24-e67f-4cfa-929c-254719a84a0a req-537ff07a-4a69-4462-aa39-9bdf0471930e service nova] Acquiring lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4e99fe24-e67f-4cfa-929c-254719a84a0a req-537ff07a-4a69-4462-aa39-9bdf0471930e service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4e99fe24-e67f-4cfa-929c-254719a84a0a req-537ff07a-4a69-4462-aa39-9bdf0471930e service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG nova.compute.manager [req-4e99fe24-e67f-4cfa-929c-254719a84a0a req-537ff07a-4a69-4462-aa39-9bdf0471930e service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] No waiting events found dispatching network-vif-plugged-9330afbb-83bf-4674-8eda-d091eb2670e5 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:52:17 user nova-compute[74994]: WARNING nova.compute.manager [req-4e99fe24-e67f-4cfa-929c-254719a84a0a req-537ff07a-4a69-4462-aa39-9bdf0471930e service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received unexpected event network-vif-plugged-9330afbb-83bf-4674-8eda-d091eb2670e5 for instance with vm_state active and task_state deleting.
Nov 28 10:52:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0ad4f918-1118-403a-afd8-44aa884c664a) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:17 user nova-compute[74994]: INFO os_vif [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:fc:91,bridge_name='br-int',has_traffic_filtering=True,id=e6ce548a-c7d7-4f70-8411-7809489f0a91,network=Network(55373264-0376-4835-a5b6-4dbe7fbc0423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6ce548a-c7')
Nov 28 10:52:17 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:50:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1695169480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1695169480',id=12,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFN6MEwyUWk8GSmHy1bNd9rONr8OYvJnOKizV3jBEue+Dp6QzKo81hoNph+ojxxVeX39WSSYot1LYMhIoRx0iJpNwiKpZtbgjHAAjMlNS/SHmKZc2KEOeHCAZCZthW3ROw==',key_name='tempest-keypair-518302348',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:50:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d334446f1c65465885717aab3fb6c78b',ramdisk_id='',reservation_id='r-xgkc4yau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1196788905',owner_user_name='tempest-TaggedBootDevicesTest_v242-1196788905-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T10:50:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9cf909ee96b249c98a98547cab18fcef',uuid=af9e5a26-f865-4563-aed9-34b8ed5b6697,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d482201-d7ff-4dcc-9a23-a399a27c69f3", "address": "fa:16:3e:b1:aa:d2", "network": {"id": "55373264-0376-4835-a5b6-4dbe7fbc0423", "bridge": "br-int", "label": "tempest-device-tagging-net1-1542107900", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d482201-d7", "ovs_interfaceid": "6d482201-d7ff-4dcc-9a23-a399a27c69f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Converting VIF {"id": "6d482201-d7ff-4dcc-9a23-a399a27c69f3", "address": "fa:16:3e:b1:aa:d2", "network": {"id": "55373264-0376-4835-a5b6-4dbe7fbc0423", "bridge": "br-int", "label": "tempest-device-tagging-net1-1542107900", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d482201-d7", "ovs_interfaceid": "6d482201-d7ff-4dcc-9a23-a399a27c69f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:aa:d2,bridge_name='br-int',has_traffic_filtering=True,id=6d482201-d7ff-4dcc-9a23-a399a27c69f3,network=Network(55373264-0376-4835-a5b6-4dbe7fbc0423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d482201-d7') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_vif [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:aa:d2,bridge_name='br-int',has_traffic_filtering=True,id=6d482201-d7ff-4dcc-9a23-a399a27c69f3,network=Network(55373264-0376-4835-a5b6-4dbe7fbc0423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d482201-d7') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d482201-d7, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0ec379c3-e3da-4de7-a835-87654083d858) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG nova.compute.manager [req-ae90c84d-5d58-4069-93d7-eb9087821c63 req-384a4d9c-4e01-4f3a-afa9-afd10835fc13 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received event network-vif-plugged-f049d45c-915d-4517-8799-8d8200a45b49 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ae90c84d-5d58-4069-93d7-eb9087821c63 req-384a4d9c-4e01-4f3a-afa9-afd10835fc13 service nova] Acquiring lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ae90c84d-5d58-4069-93d7-eb9087821c63 req-384a4d9c-4e01-4f3a-afa9-afd10835fc13 service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ae90c84d-5d58-4069-93d7-eb9087821c63 req-384a4d9c-4e01-4f3a-afa9-afd10835fc13 service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG nova.compute.manager [req-ae90c84d-5d58-4069-93d7-eb9087821c63 req-384a4d9c-4e01-4f3a-afa9-afd10835fc13 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] No waiting events found dispatching network-vif-plugged-f049d45c-915d-4517-8799-8d8200a45b49 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:52:17 user nova-compute[74994]: WARNING nova.compute.manager [req-ae90c84d-5d58-4069-93d7-eb9087821c63 req-384a4d9c-4e01-4f3a-afa9-afd10835fc13 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received unexpected event network-vif-plugged-f049d45c-915d-4517-8799-8d8200a45b49 for instance with vm_state active and task_state deleting.
Nov 28 10:52:17 user nova-compute[74994]: DEBUG nova.compute.manager [req-ae90c84d-5d58-4069-93d7-eb9087821c63 req-384a4d9c-4e01-4f3a-afa9-afd10835fc13 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received event network-vif-unplugged-d8d28630-5645-4f2e-b7d3-2b0ac060ea43 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ae90c84d-5d58-4069-93d7-eb9087821c63 req-384a4d9c-4e01-4f3a-afa9-afd10835fc13 service nova] Acquiring lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ae90c84d-5d58-4069-93d7-eb9087821c63 req-384a4d9c-4e01-4f3a-afa9-afd10835fc13 service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ae90c84d-5d58-4069-93d7-eb9087821c63 req-384a4d9c-4e01-4f3a-afa9-afd10835fc13 service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG nova.compute.manager [req-ae90c84d-5d58-4069-93d7-eb9087821c63 req-384a4d9c-4e01-4f3a-afa9-afd10835fc13 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] No waiting events found dispatching network-vif-unplugged-d8d28630-5645-4f2e-b7d3-2b0ac060ea43 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG nova.compute.manager [req-ae90c84d-5d58-4069-93d7-eb9087821c63 req-384a4d9c-4e01-4f3a-afa9-afd10835fc13 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received event network-vif-unplugged-d8d28630-5645-4f2e-b7d3-2b0ac060ea43 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG nova.compute.manager [req-ae90c84d-5d58-4069-93d7-eb9087821c63 req-384a4d9c-4e01-4f3a-afa9-afd10835fc13 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received event network-vif-plugged-d8d28630-5645-4f2e-b7d3-2b0ac060ea43 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ae90c84d-5d58-4069-93d7-eb9087821c63 req-384a4d9c-4e01-4f3a-afa9-afd10835fc13 service nova] Acquiring lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ae90c84d-5d58-4069-93d7-eb9087821c63 req-384a4d9c-4e01-4f3a-afa9-afd10835fc13 service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ae90c84d-5d58-4069-93d7-eb9087821c63 req-384a4d9c-4e01-4f3a-afa9-afd10835fc13 service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG nova.compute.manager [req-ae90c84d-5d58-4069-93d7-eb9087821c63 req-384a4d9c-4e01-4f3a-afa9-afd10835fc13 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] No waiting events found dispatching network-vif-plugged-d8d28630-5645-4f2e-b7d3-2b0ac060ea43 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:52:17 user nova-compute[74994]: WARNING nova.compute.manager [req-ae90c84d-5d58-4069-93d7-eb9087821c63 req-384a4d9c-4e01-4f3a-afa9-afd10835fc13 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received unexpected event network-vif-plugged-d8d28630-5645-4f2e-b7d3-2b0ac060ea43 for instance with vm_state active and task_state deleting.
Nov 28 10:52:17 user nova-compute[74994]: DEBUG nova.compute.manager [req-ae90c84d-5d58-4069-93d7-eb9087821c63 req-384a4d9c-4e01-4f3a-afa9-afd10835fc13 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received event network-vif-unplugged-e6ce548a-c7d7-4f70-8411-7809489f0a91 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ae90c84d-5d58-4069-93d7-eb9087821c63 req-384a4d9c-4e01-4f3a-afa9-afd10835fc13 service nova] Acquiring lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ae90c84d-5d58-4069-93d7-eb9087821c63 req-384a4d9c-4e01-4f3a-afa9-afd10835fc13 service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ae90c84d-5d58-4069-93d7-eb9087821c63 req-384a4d9c-4e01-4f3a-afa9-afd10835fc13 service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG nova.compute.manager [req-ae90c84d-5d58-4069-93d7-eb9087821c63 req-384a4d9c-4e01-4f3a-afa9-afd10835fc13 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] No waiting events found dispatching network-vif-unplugged-e6ce548a-c7d7-4f70-8411-7809489f0a91 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG nova.compute.manager [req-ae90c84d-5d58-4069-93d7-eb9087821c63 req-384a4d9c-4e01-4f3a-afa9-afd10835fc13 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received event network-vif-unplugged-e6ce548a-c7d7-4f70-8411-7809489f0a91 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG nova.compute.manager [req-ae90c84d-5d58-4069-93d7-eb9087821c63 req-384a4d9c-4e01-4f3a-afa9-afd10835fc13 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received event network-vif-plugged-e6ce548a-c7d7-4f70-8411-7809489f0a91 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ae90c84d-5d58-4069-93d7-eb9087821c63 req-384a4d9c-4e01-4f3a-afa9-afd10835fc13 service nova] Acquiring lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ae90c84d-5d58-4069-93d7-eb9087821c63 req-384a4d9c-4e01-4f3a-afa9-afd10835fc13 service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ae90c84d-5d58-4069-93d7-eb9087821c63 req-384a4d9c-4e01-4f3a-afa9-afd10835fc13 service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG nova.compute.manager [req-ae90c84d-5d58-4069-93d7-eb9087821c63 req-384a4d9c-4e01-4f3a-afa9-afd10835fc13 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] No waiting events found dispatching network-vif-plugged-e6ce548a-c7d7-4f70-8411-7809489f0a91 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:52:17 user nova-compute[74994]: WARNING nova.compute.manager [req-ae90c84d-5d58-4069-93d7-eb9087821c63 req-384a4d9c-4e01-4f3a-afa9-afd10835fc13 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received unexpected event network-vif-plugged-e6ce548a-c7d7-4f70-8411-7809489f0a91 for instance with vm_state active and task_state deleting.
Nov 28 10:52:17 user nova-compute[74994]: DEBUG nova.compute.manager [req-ae90c84d-5d58-4069-93d7-eb9087821c63 req-384a4d9c-4e01-4f3a-afa9-afd10835fc13 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received event network-vif-unplugged-6d482201-d7ff-4dcc-9a23-a399a27c69f3 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ae90c84d-5d58-4069-93d7-eb9087821c63 req-384a4d9c-4e01-4f3a-afa9-afd10835fc13 service nova] Acquiring lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ae90c84d-5d58-4069-93d7-eb9087821c63 req-384a4d9c-4e01-4f3a-afa9-afd10835fc13 service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ae90c84d-5d58-4069-93d7-eb9087821c63 req-384a4d9c-4e01-4f3a-afa9-afd10835fc13 service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG nova.compute.manager [req-ae90c84d-5d58-4069-93d7-eb9087821c63 req-384a4d9c-4e01-4f3a-afa9-afd10835fc13 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] No waiting events found dispatching network-vif-unplugged-6d482201-d7ff-4dcc-9a23-a399a27c69f3 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG nova.compute.manager [req-ae90c84d-5d58-4069-93d7-eb9087821c63 req-384a4d9c-4e01-4f3a-afa9-afd10835fc13 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received event network-vif-unplugged-6d482201-d7ff-4dcc-9a23-a399a27c69f3 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG nova.compute.manager [req-ae90c84d-5d58-4069-93d7-eb9087821c63 req-384a4d9c-4e01-4f3a-afa9-afd10835fc13 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received event network-vif-plugged-6d482201-d7ff-4dcc-9a23-a399a27c69f3 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ae90c84d-5d58-4069-93d7-eb9087821c63 req-384a4d9c-4e01-4f3a-afa9-afd10835fc13 service nova] Acquiring lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ae90c84d-5d58-4069-93d7-eb9087821c63 req-384a4d9c-4e01-4f3a-afa9-afd10835fc13 service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ae90c84d-5d58-4069-93d7-eb9087821c63 req-384a4d9c-4e01-4f3a-afa9-afd10835fc13 service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG nova.compute.manager [req-ae90c84d-5d58-4069-93d7-eb9087821c63 req-384a4d9c-4e01-4f3a-afa9-afd10835fc13 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] No waiting events found dispatching network-vif-plugged-6d482201-d7ff-4dcc-9a23-a399a27c69f3 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:52:17 user nova-compute[74994]: WARNING nova.compute.manager [req-ae90c84d-5d58-4069-93d7-eb9087821c63 req-384a4d9c-4e01-4f3a-afa9-afd10835fc13 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received unexpected event network-vif-plugged-6d482201-d7ff-4dcc-9a23-a399a27c69f3 for instance with vm_state active and task_state deleting.
Nov 28 10:52:17 user nova-compute[74994]: DEBUG nova.compute.manager [req-ae90c84d-5d58-4069-93d7-eb9087821c63 req-384a4d9c-4e01-4f3a-afa9-afd10835fc13 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received event network-vif-unplugged-da486672-f1e9-4bbe-8d5a-e9f2f0ad5119 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ae90c84d-5d58-4069-93d7-eb9087821c63 req-384a4d9c-4e01-4f3a-afa9-afd10835fc13 service nova] Acquiring lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ae90c84d-5d58-4069-93d7-eb9087821c63 req-384a4d9c-4e01-4f3a-afa9-afd10835fc13 service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ae90c84d-5d58-4069-93d7-eb9087821c63 req-384a4d9c-4e01-4f3a-afa9-afd10835fc13 service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG nova.compute.manager [req-ae90c84d-5d58-4069-93d7-eb9087821c63 req-384a4d9c-4e01-4f3a-afa9-afd10835fc13 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] No waiting events found dispatching network-vif-unplugged-da486672-f1e9-4bbe-8d5a-e9f2f0ad5119 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG nova.compute.manager [req-ae90c84d-5d58-4069-93d7-eb9087821c63 req-384a4d9c-4e01-4f3a-afa9-afd10835fc13 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received event network-vif-unplugged-da486672-f1e9-4bbe-8d5a-e9f2f0ad5119 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DHIliwdZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': '6d8d9b02-1a52-4141-bd39-95419cec5a1a'}, None), 'kwargs': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:52:17 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:52:17 user nova-compute[74994]: INFO os_vif [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:aa:d2,bridge_name='br-int',has_traffic_filtering=True,id=6d482201-d7ff-4dcc-9a23-a399a27c69f3,network=Network(55373264-0376-4835-a5b6-4dbe7fbc0423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d482201-d7')
Nov 28 10:52:17 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:50:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1695169480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1695169480',id=12,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFN6MEwyUWk8GSmHy1bNd9rONr8OYvJnOKizV3jBEue+Dp6QzKo81hoNph+ojxxVeX39WSSYot1LYMhIoRx0iJpNwiKpZtbgjHAAjMlNS/SHmKZc2KEOeHCAZCZthW3ROw==',key_name='tempest-keypair-518302348',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:50:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d334446f1c65465885717aab3fb6c78b',ramdisk_id='',reservation_id='r-xgkc4yau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1196788905',owner_user_name='tempest-TaggedBootDevicesTest_v242-1196788905-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T10:50:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9cf909ee96b249c98a98547cab18fcef',uuid=af9e5a26-f865-4563-aed9-34b8ed5b6697,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da486672-f1e9-4bbe-8d5a-e9f2f0ad5119", "address": "fa:16:3e:56:1d:f4", "network": {"id": "e32d74f0-a6b2-4c07-b2b1-9c3bc9a6b4a5", "bridge": "br-int", "label": "tempest-device-tagging-net2-207234115", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda486672-f1", "ovs_interfaceid": "da486672-f1e9-4bbe-8d5a-e9f2f0ad5119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Converting VIF {"id": "da486672-f1e9-4bbe-8d5a-e9f2f0ad5119", "address": "fa:16:3e:56:1d:f4", "network": {"id": "e32d74f0-a6b2-4c07-b2b1-9c3bc9a6b4a5", "bridge": "br-int", "label": "tempest-device-tagging-net2-207234115", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda486672-f1", "ovs_interfaceid": "da486672-f1e9-4bbe-8d5a-e9f2f0ad5119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:1d:f4,bridge_name='br-int',has_traffic_filtering=True,id=da486672-f1e9-4bbe-8d5a-e9f2f0ad5119,network=Network(e32d74f0-a6b2-4c07-b2b1-9c3bc9a6b4a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda486672-f1') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_vif [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:1d:f4,bridge_name='br-int',has_traffic_filtering=True,id=da486672-f1e9-4bbe-8d5a-e9f2f0ad5119,network=Network(e32d74f0-a6b2-4c07-b2b1-9c3bc9a6b4a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda486672-f1') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda486672-f1, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd82986-2089-4ac3-9167-209417716652]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 10:52:17 user nova-compute[74994]: No targets found.
Nov 28 10:52:17 user nova-compute[74994]: iSNS:
Nov 28 10:52:17 user nova-compute[74994]: No targets found.
Nov 28 10:52:17 user nova-compute[74994]: STATIC:
Nov 28 10:52:17 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b
Nov 28 10:52:17 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:52:17 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:52:17 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab
Nov 28 10:52:17 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:52:17 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:52:17 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148
Nov 28 10:52:17 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:52:17 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:52:17 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f
Nov 28 10:52:17 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:52:17 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:52:17 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a
Nov 28 10:52:17 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:52:17 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:52:17 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0
Nov 28 10:52:17 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:52:17 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:52:17 user nova-compute[74994]: FIRMWARE:
Nov 28 10:52:17 user nova-compute[74994]: No targets found.
Nov 28 10:52:17 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 10:52:17 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 10:52:17 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2a502765-1ab6-4d63-8f8e-759d46f8e4fd) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[472dd208-12d4-4d7a-abad-d80de6d98a4e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[268ce71b-e902-4f1e-b90c-baba83bc8e65]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a (non-flash)
Nov 28 10:52:17 user nova-compute[74994]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)
Nov 28 10:52:17 user nova-compute[74994]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:52:17 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:52:17 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:52:17 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:52:17 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a (non-flash)
Nov 28 10:52:17 user nova-compute[74994]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)
Nov 28 10:52:17 user nova-compute[74994]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:52:17 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:52:17 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:52:17 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:52:17 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9445c3010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a'): ({'sdj'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Removing single pathed devices sdj {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:17 user nova-compute[74994]: INFO os_vif [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:1d:f4,bridge_name='br-int',has_traffic_filtering=True,id=da486672-f1e9-4bbe-8d5a-e9f2f0ad5119,network=Network(e32d74f0-a6b2-4c07-b2b1-9c3bc9a6b4a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda486672-f1')
Nov 28 10:52:17 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:50:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1695169480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1695169480',id=12,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFN6MEwyUWk8GSmHy1bNd9rONr8OYvJnOKizV3jBEue+Dp6QzKo81hoNph+ojxxVeX39WSSYot1LYMhIoRx0iJpNwiKpZtbgjHAAjMlNS/SHmKZc2KEOeHCAZCZthW3ROw==',key_name='tempest-keypair-518302348',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:50:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d334446f1c65465885717aab3fb6c78b',ramdisk_id='',reservation_id='r-xgkc4yau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1196788905',owner_user_name='tempest-TaggedBootDevicesTest_v242-1196788905-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T10:50:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9cf909ee96b249c98a98547cab18fcef',uuid=af9e5a26-f865-4563-aed9-34b8ed5b6697,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9330afbb-83bf-4674-8eda-d091eb2670e5", "address": "fa:16:3e:78:0e:99", "network": {"id": "e32d74f0-a6b2-4c07-b2b1-9c3bc9a6b4a5", "bridge": "br-int", "label": "tempest-device-tagging-net2-207234115", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9330afbb-83", "ovs_interfaceid": "9330afbb-83bf-4674-8eda-d091eb2670e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Converting VIF {"id": "9330afbb-83bf-4674-8eda-d091eb2670e5", "address": "fa:16:3e:78:0e:99", "network": {"id": "e32d74f0-a6b2-4c07-b2b1-9c3bc9a6b4a5", "bridge": "br-int", "label": "tempest-device-tagging-net2-207234115", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9330afbb-83", "ovs_interfaceid": "9330afbb-83bf-4674-8eda-d091eb2670e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:0e:99,bridge_name='br-int',has_traffic_filtering=True,id=9330afbb-83bf-4674-8eda-d091eb2670e5,network=Network(e32d74f0-a6b2-4c07-b2b1-9c3bc9a6b4a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9330afbb-83') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_vif [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:0e:99,bridge_name='br-int',has_traffic_filtering=True,id=9330afbb-83bf-4674-8eda-d091eb2670e5,network=Network(e32d74f0-a6b2-4c07-b2b1-9c3bc9a6b4a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9330afbb-83') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9330afbb-83, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3782b89f-6a4f-4a81-9021-2c0c67fef6a2]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b630b4b3-57b5-4a93-9ae4-80f2ea6d1d65) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fa3113-2fd3-4b57-a87d-fbd206dec317]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Flushing IO for device /dev/sdj {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 10:52:17 user nova-compute[74994]: INFO os_vif [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:0e:99,bridge_name='br-int',has_traffic_filtering=True,id=9330afbb-83bf-4674-8eda-d091eb2670e5,network=Network(e32d74f0-a6b2-4c07-b2b1-9c3bc9a6b4a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9330afbb-83')
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BYQEJHAv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:52:17 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.012s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3986190-d3ad-4a20-a662-8a79134eb40f]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.039s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbdb5e1-aeed-4952-9e4b-70a1ccb154a0]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] SCSI volumes sdj have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0655d2-86ea-4765-a03c-d6385c770aa2]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[23297f10-3c9a-43ee-9df6-3cf69d5ca33f]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a, portal: 172.16.0.220,3260]
Nov 28 10:52:17 user nova-compute[74994]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a, portal: 172.16.0.220,3260] successful.
Nov 28 10:52:17 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d8d9b02-1a52-4141-bd39-95419cec5a1a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9a9ae6-b114-4a01-91e1-50f1010f089c]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] <== disconnect_volume: return (305ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.180s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b8caf1-d2e1-4a3b-a696-b910ade2904b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 10:52:17 user nova-compute[74994]: No targets found.
Nov 28 10:52:17 user nova-compute[74994]: iSNS:
Nov 28 10:52:17 user nova-compute[74994]: No targets found.
Nov 28 10:52:17 user nova-compute[74994]: STATIC:
Nov 28 10:52:17 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b
Nov 28 10:52:17 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:52:17 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:52:17 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab
Nov 28 10:52:17 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:52:17 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:52:17 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148
Nov 28 10:52:17 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:52:17 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:52:17 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f
Nov 28 10:52:17 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:52:17 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:52:17 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0
Nov 28 10:52:17 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:52:17 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:52:17 user nova-compute[74994]: FIRMWARE:
Nov 28 10:52:17 user nova-compute[74994]: No targets found.
Nov 28 10:52:17 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 10:52:17 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 10:52:17 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3bb0dc3-9b59-4246-a287-744776e4449e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG nova.compute.manager [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KojpQYLe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a', 'attached_at': '', 'detached_at': '', 'volume_id': '37a2129a-a661-403a-9a9f-29e54191e56b', 'serial'} {{(pid=74994) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG nova.compute.manager [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] swap_volume: removing Cinder connection for volume 6d8d9b02-1a52-4141-bd39-95419cec5a1a {{(pid=74994) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e1662b-dad3-4d57-b7c5-7ad05bdce403]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)
Nov 28 10:52:17 user nova-compute[74994]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:52:17 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:52:17 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:52:17 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:52:17 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)
Nov 28 10:52:17 user nova-compute[74994]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 (non-flash)
Nov 28 10:52:17 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:52:17 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:52:17 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:52:17 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9206ba050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0'): ({'sdb'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Removing single pathed devices sdb {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[70696b40-7f2c-4754-aeec-4caa74469546]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47ae115-f4ac-45d0-8f97-dd20a828f5b9]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Flushing IO for device /dev/sdb {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbaeeb08-8f75-4350-af5f-5265c3bc4787]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a4edc7-bed1-4f5d-9823-25a0026c529f]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] SCSI volumes sdb have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab16419f-cd17-4022-9898-aa05619500a9]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ae0d49-5e7b-429d-89a4-2e48fd736254]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0, portal: 172.16.0.220,3260]
Nov 28 10:52:17 user nova-compute[74994]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0, portal: 172.16.0.220,3260] successful.
Nov 28 10:52:17 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670edcd3-e394-4ce9-8114-837cd58008b0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6333ffd9-7217-4b99-921d-561e68055296]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] <== disconnect_volume: return (494ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mBwyHkSC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:52:17 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2386f5-044c-42a5-baa9-c0ef6b0ec956]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 10:52:17 user nova-compute[74994]: No targets found.
Nov 28 10:52:17 user nova-compute[74994]: iSNS:
Nov 28 10:52:17 user nova-compute[74994]: No targets found.
Nov 28 10:52:17 user nova-compute[74994]: STATIC:
Nov 28 10:52:17 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b
Nov 28 10:52:17 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:52:17 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:52:17 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab
Nov 28 10:52:17 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:52:17 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:52:17 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148
Nov 28 10:52:17 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:52:17 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:52:17 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f
Nov 28 10:52:17 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:52:17 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:52:17 user nova-compute[74994]: FIRMWARE:
Nov 28 10:52:17 user nova-compute[74994]: No targets found.
Nov 28 10:52:17 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 10:52:17 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 10:52:17 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f84cb7e-d502-4d82-8dc6-195b81485e7b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[da140d61-04ea-45d4-9825-9911d9908afe]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)
Nov 28 10:52:17 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:52:17 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:52:17 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:52:17 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)
Nov 28 10:52:17 user nova-compute[74994]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 (non-flash)
Nov 28 10:52:17 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:52:17 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:52:17 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9206ba8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148'): ({'sdc'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Removing single pathed devices sdc {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e85dc5-0cc6-479d-9a72-1e81c91950a7]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[051ddace-3aa4-490b-b2b3-6d21db9f983e]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Flushing IO for device /dev/sdc {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ba014a-5440-45a1-983b-77e80657468b]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7ae70b-cd65-4a35-a7bd-eaecd49e31cb]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] SCSI volumes sdc have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 10:52:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59c5108-934e-4f67-aad6-10b98f597cad]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[54900bf6-e97e-43ce-a211-a5c61275d458]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148, portal: 172.16.0.220,3260]
Nov 28 10:52:18 user nova-compute[74994]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148, portal: 172.16.0.220,3260] successful.
Nov 28 10:52:18 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95bbeedd-0974-4f79-ae9e-ac4ec0ed7148 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e4b06c-86cd-4f11-95a2-b187416776a4]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] <== disconnect_volume: return (296ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HpWctMGu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:52:18 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:52:18 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[69354e01-93df-45a3-b979-3d5daa56dec6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 10:52:18 user nova-compute[74994]: No targets found.
Nov 28 10:52:18 user nova-compute[74994]: iSNS:
Nov 28 10:52:18 user nova-compute[74994]: No targets found.
Nov 28 10:52:18 user nova-compute[74994]: STATIC:
Nov 28 10:52:18 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b
Nov 28 10:52:18 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:52:18 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:52:18 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab
Nov 28 10:52:18 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:52:18 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:52:18 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f
Nov 28 10:52:18 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:52:18 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:52:18 user nova-compute[74994]: FIRMWARE:
Nov 28 10:52:18 user nova-compute[74994]: No targets found.
Nov 28 10:52:18 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 10:52:18 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 10:52:18 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6dfedc-70dd-4dc4-b170-1e8a8ac3c71b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1b5715-5a7b-499e-baef-b6776a84c7ee]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)
Nov 28 10:52:18 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:52:18 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:52:18 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)
Nov 28 10:52:18 user nova-compute[74994]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab (non-flash)
Nov 28 10:52:18 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:52:18 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9206b9870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab'): ({'sdd'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Removing single pathed devices sdd {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85f7886-fc1f-457b-b7ee-60b1eb9e8cf3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[760f5d80-922b-41ed-9572-37fe0e2529d5]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Flushing IO for device /dev/sdd {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ff1e7e-d5f0-4a6b-afc9-6246e7ca04ea]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[435410db-c50a-432a-9bd3-8f918766e431]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] SCSI volumes sdd have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG nova.compute.manager [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] swap_volume: Updating volume 6d8d9b02-1a52-4141-bd39-95419cec5a1a BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "KojpQYLe", "auth_password": "rFOMGg6HzdwE1J", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "37a2129a-a661-403a-9a9f-29e54191e56b"}, "status": "reserved", "instance": "7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a", "attached_at": "", "detached_at": "", "volume_id": "37a2129a-a661-403a-9a9f-29e54191e56b", "serial": "37a2129a-a661-403a-9a9f-29e54191e56b"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '37a2129a-a661-403a-9a9f-29e54191e56b', 'no_device': None, 'attachment_id': '7c30d738-377d-43bd-9cd1-be8e3213676f'} {{(pid=74994) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[44bad02f-13fa-4b53-a583-6a8338dcaefb]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ecce37fa-7ee3-4cd6-8b7c-f6b3cf9fc3df tempest-TestVolumeSwap-344420942 tempest-TestVolumeSwap-344420942-project-admin] Lock "7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 17.777s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9604de9-9d85-420e-8b64-6a3775ccb26f]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab, portal: 172.16.0.220,3260]
Nov 28 10:52:18 user nova-compute[74994]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab, portal: 172.16.0.220,3260] successful.
Nov 28 10:52:18 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:004b7b16-ae0c-4434-a11c-53390a43ceab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[194f7238-1000-4871-950e-3bcf8b0aabef]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] <== disconnect_volume: return (288ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 10:52:18 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Deleting instance files /opt/stack/data/nova/instances/af9e5a26-f865-4563-aed9-34b8ed5b6697_del
Nov 28 10:52:18 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Deletion of /opt/stack/data/nova/instances/af9e5a26-f865-4563-aed9-34b8ed5b6697_del complete
Nov 28 10:52:18 user nova-compute[74994]: INFO nova.compute.manager [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Took 3.98 seconds to destroy the instance on the hypervisor.
Nov 28 10:52:18 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2974d6c5-7cf8-42a9-8c2a-55bcd0e21f14 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Acquiring lock "7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2974d6c5-7cf8-42a9-8c2a-55bcd0e21f14 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Lock "7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:52:18 user nova-compute[74994]: INFO nova.compute.manager [None req-2974d6c5-7cf8-42a9-8c2a-55bcd0e21f14 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Detaching volume 37a2129a-a661-403a-9a9f-29e54191e56b
Nov 28 10:52:18 user nova-compute[74994]: INFO nova.virt.block_device [None req-2974d6c5-7cf8-42a9-8c2a-55bcd0e21f14 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Attempting to driver detach volume 37a2129a-a661-403a-9a9f-29e54191e56b from mountpoint /dev/vdb
Nov 28 10:52:18 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2974d6c5-7cf8-42a9-8c2a-55bcd0e21f14 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Attempting to detach device vdb from instance 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a from the persistent domain config. {{(pid=74994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-2974d6c5-7cf8-42a9-8c2a-55bcd0e21f14 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 10:52:18 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 10:52:18 user nova-compute[74994]:   <source dev="/dev/sdf"/>
Nov 28 10:52:18 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 10:52:18 user nova-compute[74994]:   <serial>37a2129a-a661-403a-9a9f-29e54191e56b</serial>
Nov 28 10:52:18 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 10:52:18 user nova-compute[74994]: </disk>
Nov 28 10:52:18 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 10:52:18 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-2974d6c5-7cf8-42a9-8c2a-55bcd0e21f14 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Successfully detached device vdb from instance 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a from the persistent domain config.
Nov 28 10:52:18 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2974d6c5-7cf8-42a9-8c2a-55bcd0e21f14 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a from the live domain config. {{(pid=74994) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 10:52:18 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-2974d6c5-7cf8-42a9-8c2a-55bcd0e21f14 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 10:52:18 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 10:52:18 user nova-compute[74994]:   <source dev="/dev/sdf"/>
Nov 28 10:52:18 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 10:52:18 user nova-compute[74994]:   <serial>37a2129a-a661-403a-9a9f-29e54191e56b</serial>
Nov 28 10:52:18 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 10:52:18 user nova-compute[74994]: </disk>
Nov 28 10:52:18 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 10:52:19 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:19 user nova-compute[74994]: DEBUG nova.compute.manager [req-0c6f6df4-d231-4a42-8a3b-e5df7d502ae3 req-c574cbd2-ebfb-42a2-b9f9-4171fae0d732 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received event network-vif-plugged-da486672-f1e9-4bbe-8d5a-e9f2f0ad5119 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:52:19 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-0c6f6df4-d231-4a42-8a3b-e5df7d502ae3 req-c574cbd2-ebfb-42a2-b9f9-4171fae0d732 service nova] Acquiring lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:52:19 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-0c6f6df4-d231-4a42-8a3b-e5df7d502ae3 req-c574cbd2-ebfb-42a2-b9f9-4171fae0d732 service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:52:19 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-0c6f6df4-d231-4a42-8a3b-e5df7d502ae3 req-c574cbd2-ebfb-42a2-b9f9-4171fae0d732 service nova] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:52:19 user nova-compute[74994]: DEBUG nova.compute.manager [req-0c6f6df4-d231-4a42-8a3b-e5df7d502ae3 req-c574cbd2-ebfb-42a2-b9f9-4171fae0d732 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] No waiting events found dispatching network-vif-plugged-da486672-f1e9-4bbe-8d5a-e9f2f0ad5119 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:52:19 user nova-compute[74994]: WARNING nova.compute.manager [req-0c6f6df4-d231-4a42-8a3b-e5df7d502ae3 req-c574cbd2-ebfb-42a2-b9f9-4171fae0d732 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received unexpected event network-vif-plugged-da486672-f1e9-4bbe-8d5a-e9f2f0ad5119 for instance with vm_state active and task_state deleting.
Nov 28 10:52:19 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2974d6c5-7cf8-42a9-8c2a-55bcd0e21f14 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a {{(pid=74994) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 10:52:20 user nova-compute[74994]: DEBUG nova.compute.manager [req-9b0364e4-5e18-474b-8066-8b3be8f4bc9b req-d4dd7ac7-8c31-4c5d-b0ac-af7a1cf9a43e service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received event network-vif-deleted-da486672-f1e9-4bbe-8d5a-e9f2f0ad5119 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:52:20 user nova-compute[74994]: INFO nova.compute.manager [req-9b0364e4-5e18-474b-8066-8b3be8f4bc9b req-d4dd7ac7-8c31-4c5d-b0ac-af7a1cf9a43e service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Neutron deleted interface da486672-f1e9-4bbe-8d5a-e9f2f0ad5119; detaching it from the instance and deleting it from the info cache
Nov 28 10:52:20 user nova-compute[74994]: DEBUG nova.network.neutron [req-9b0364e4-5e18-474b-8066-8b3be8f4bc9b req-d4dd7ac7-8c31-4c5d-b0ac-af7a1cf9a43e service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Updating instance_info_cache with network_info: [{"id": "7ca13785-4bcf-42f6-b804-36f3c3cd1b82", "address": "fa:16:3e:fa:03:33", "network": {"id": "0b2c7b2c-5fe7-4238-9675-285c43d2bdf4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-766551976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ca13785-4b", "ovs_interfaceid": "7ca13785-4bcf-42f6-b804-36f3c3cd1b82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f049d45c-915d-4517-8799-8d8200a45b49", "address": "fa:16:3e:b7:f0:54", "network": {"id": "55373264-0376-4835-a5b6-4dbe7fbc0423", "bridge": "br-int", "label": "tempest-device-tagging-net1-1542107900", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf049d45c-91", "ovs_interfaceid": "f049d45c-915d-4517-8799-8d8200a45b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d8d28630-5645-4f2e-b7d3-2b0ac060ea43", "address": "fa:16:3e:0e:35:01", "network": {"id": "55373264-0376-4835-a5b6-4dbe7fbc0423", "bridge": "br-int", "label": "tempest-device-tagging-net1-1542107900", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8d28630-56", "ovs_interfaceid": "d8d28630-5645-4f2e-b7d3-2b0ac060ea43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e6ce548a-c7d7-4f70-8411-7809489f0a91", "address": "fa:16:3e:4e:fc:91", "network": {"id": "55373264-0376-4835-a5b6-4dbe7fbc0423", "bridge": "br-int", "label": "tempest-device-tagging-net1-1542107900", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ce548a-c7", "ovs_interfaceid": "e6ce548a-c7d7-4f70-8411-7809489f0a91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6d482201-d7ff-4dcc-9a23-a399a27c69f3", "address": "fa:16:3e:b1:aa:d2", "network": {"id": "55373264-0376-4835-a5b6-4dbe7fbc0423", "bridge": "br-int", "label": "tempest-device-tagging-net1-1542107900", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d482201-d7", "ovs_interfaceid": "6d482201-d7ff-4dcc-9a23-a399a27c69f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9330afbb-83bf-4674-8eda-d091eb2670e5", "address": "fa:16:3e:78:0e:99", "network": {"id": "e32d74f0-a6b2-4c07-b2b1-9c3bc9a6b4a5", "bridge": "br-int", "label": "tempest-device-tagging-net2-207234115", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d334446f1c65465885717aab3fb6c78b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9330afbb-83", "ovs_interfaceid": "9330afbb-83bf-4674-8eda-d091eb2670e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:52:20 user nova-compute[74994]: DEBUG nova.compute.manager [req-9b0364e4-5e18-474b-8066-8b3be8f4bc9b req-d4dd7ac7-8c31-4c5d-b0ac-af7a1cf9a43e service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Detach interface failed, port_id=da486672-f1e9-4bbe-8d5a-e9f2f0ad5119, reason: Instance af9e5a26-f865-4563-aed9-34b8ed5b6697 could not be found. {{(pid=74994) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 10:52:22 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:52:22 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Took 3.57 seconds to deallocate network for instance.
Nov 28 10:52:22 user nova-compute[74994]: DEBUG nova.compute.manager [req-385264b2-7445-404a-8308-a9e1c5b2781e req-f84c919f-ab5a-4e0d-8973-938d45bd1726 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received event network-vif-deleted-6d482201-d7ff-4dcc-9a23-a399a27c69f3 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:52:22 user nova-compute[74994]: DEBUG nova.compute.manager [req-385264b2-7445-404a-8308-a9e1c5b2781e req-f84c919f-ab5a-4e0d-8973-938d45bd1726 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received event network-vif-deleted-e6ce548a-c7d7-4f70-8411-7809489f0a91 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:52:22 user nova-compute[74994]: DEBUG nova.compute.manager [req-385264b2-7445-404a-8308-a9e1c5b2781e req-f84c919f-ab5a-4e0d-8973-938d45bd1726 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received event network-vif-deleted-7ca13785-4bcf-42f6-b804-36f3c3cd1b82 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:52:22 user nova-compute[74994]: DEBUG nova.compute.manager [req-385264b2-7445-404a-8308-a9e1c5b2781e req-f84c919f-ab5a-4e0d-8973-938d45bd1726 service nova] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Received event network-vif-deleted-9330afbb-83bf-4674-8eda-d091eb2670e5 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:52:22 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:23 user nova-compute[74994]: DEBUG nova.compute.manager [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 10:52:23 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 10:52:23 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Creating image(s)
Nov 28 10:52:23 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Did not create local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 10:52:23 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Ensure instance console log exists: /opt/stack/data/nova/instances/759fbcfd-ab13-438f-b860-6393a97d1205/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 10:52:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:52:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:52:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:52:23 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Start _get_guest_xml network_info=[{"id": "7d4a82ba-d222-44bb-baac-6642f24b9528", "address": "fa:16:3e:4f:75:25", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d4a82ba-d2", "ovs_interfaceid": "7d4a82ba-d222-44bb-baac-6642f24b9528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'npJsWGzr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '759fbcfd-ab13-438f-b860-6393a97d1205', 'attached_at': '', 'detached_at': '', 'volume_id': '6b722d69-93d3-49c4-ab46-38ce89b057de', 'serial': '6b722d69-93d3-49c4-ab46-38ce89b057de'}, 'attachment_id': '890f2169-c3bd-43db-af23-286ea1c0fdcb', 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 10:52:23 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:52:23 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:52:23 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 10:52:23 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 10:52:23 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 10:52:23 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 10:52:23 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 10:52:23 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 10:52:23 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 10:52:23 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 10:52:23 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 10:52:23 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 10:52:23 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 10:52:23 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 10:52:23 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 10:52:23 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 10:52:23 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 10:52:23 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 10:52:23 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 10:52:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'npJsWGzr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:52:23 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:52:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:52:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:52:23 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:52:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:52:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:52:23 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 10:52:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62fafa6-bd06-4667-87c9-5eff63679e71]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 10:52:23 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:52:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:24 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[540148fb-d478-4177-8eff-b73ec45aeb00]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de] added
Nov 28 10:52:24 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:52:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:24 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8b2740-8c78-4192-bbaf-fb81558675e3]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:52:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:24 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9723577-926f-41ea-b9be-d6a42f0a4ae8]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:52:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v npJsWGzr {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v npJsWGzr" returned: 0 in 0.027s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:24 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdab2cd2-de1b-4286-9876-32ef7fc72fdd]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'npJsWGzr'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:52:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:24 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6263cf-d45a-499c-8a97-02ac90ee1c1a]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:52:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:24 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37b7148-d44b-4886-99b1-a682df3a6b2e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)
Nov 28 10:52:24 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:52:24 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:52:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)
Nov 28 10:52:24 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:52:24 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:52:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:24 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[614dd564-f9ba-4529-a4ba-d13f4d2b50c6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de, portal: 172.16.0.220,3260]
Nov 28 10:52:24 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de, portal: 172.16.0.220,3260] successful.
Nov 28 10:52:24 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:52:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:24 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[65250922-d4b5-43e7-b4ab-00b8e9036825]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:52:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:24 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[522f9f30-8e8b-4520-ac45-1be721b2c8ad]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)
Nov 28 10:52:24 user nova-compute[74994]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:52:24 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:52:24 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:52:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)
Nov 28 10:52:24 user nova-compute[74994]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:52:24 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:52:24 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:52:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:52:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 10:52:24 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 10:52:24 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 10:52:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:24 user nova-compute[74994]: INFO nova.compute.manager [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] [instance: af9e5a26-f865-4563-aed9-34b8ed5b6697] Took 2.19 seconds to detach 3 volumes for instance.
Nov 28 10:52:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:24 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[815d714e-5bb7-4845-b678-ea7f92f16774]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:24 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 10:52:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'npJsWGzr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 10:52:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:52:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:52:24 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:52:24 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:52:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.400s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:52:24 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Deleted allocations for instance af9e5a26-f865-4563-aed9-34b8ed5b6697
Nov 28 10:52:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-28476ba6-893e-4b3f-9cc3-c6db315081e0 tempest-TaggedBootDevicesTest_v242-1196788905 tempest-TaggedBootDevicesTest_v242-1196788905-project-member] Lock "af9e5a26-f865-4563-aed9-34b8ed5b6697" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.346s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:52:25 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:52:25 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '26338343861366666', 'path': '/dev/sdb'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:52:25 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338343861366666', 'path': '/dev/sdb'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 10:52:25 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:52:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-478607448',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-478607448',id=15,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='612ae9ec21ad40a4b68e0926843874ae',ramdisk_id='',reservation_id='r-51gyvey2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-332508527',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:52:04Z,user_data=None,user_id='6c49cba00cff4c4b80080c5f917b4176',uuid=759fbcfd-ab13-438f-b860-6393a97d1205,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d4a82ba-d222-44bb-baac-6642f24b9528", "address": "fa:16:3e:4f:75:25", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d4a82ba-d2", "ovs_interfaceid": "7d4a82ba-d222-44bb-baac-6642f24b9528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:52:25 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Converting VIF {"id": "7d4a82ba-d222-44bb-baac-6642f24b9528", "address": "fa:16:3e:4f:75:25", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d4a82ba-d2", "ovs_interfaceid": "7d4a82ba-d222-44bb-baac-6642f24b9528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:52:25 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:75:25,bridge_name='br-int',has_traffic_filtering=True,id=7d4a82ba-d222-44bb-baac-6642f24b9528,network=Network(a1692a13-d1d7-4df6-bfc0-54f231846889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d4a82ba-d2') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:52:25 user nova-compute[74994]: DEBUG nova.objects.instance [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lazy-loading 'pci_devices' on Instance uuid 759fbcfd-ab13-438f-b860-6393a97d1205 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:52:25 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] End _get_guest_xml xml=<domain type="kvm">
Nov 28 10:52:25 user nova-compute[74994]:   <uuid>759fbcfd-ab13-438f-b860-6393a97d1205</uuid>
Nov 28 10:52:25 user nova-compute[74994]:   <name>instance-0000000f</name>
Nov 28 10:52:25 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 10:52:25 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 10:52:25 user nova-compute[74994]:   <metadata>
Nov 28 10:52:25 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 10:52:25 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 10:52:25 user nova-compute[74994]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-478607448</nova:name>
Nov 28 10:52:25 user nova-compute[74994]:       <nova:creationTime>2023-11-28 10:52:23</nova:creationTime>
Nov 28 10:52:25 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 10:52:25 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 10:52:25 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 10:52:25 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 10:52:25 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 10:52:25 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 10:52:25 user nova-compute[74994]:       </nova:flavor>
Nov 28 10:52:25 user nova-compute[74994]:       <nova:owner>
Nov 28 10:52:25 user nova-compute[74994]:         <nova:user uuid="6c49cba00cff4c4b80080c5f917b4176">tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member</nova:user>
Nov 28 10:52:25 user nova-compute[74994]:         <nova:project uuid="612ae9ec21ad40a4b68e0926843874ae">tempest-ServerBootFromVolumeStableRescueTest-332508527</nova:project>
Nov 28 10:52:25 user nova-compute[74994]:       </nova:owner>
Nov 28 10:52:25 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 10:52:25 user nova-compute[74994]:       <nova:ports>
Nov 28 10:52:25 user nova-compute[74994]:         <nova:port uuid="7d4a82ba-d222-44bb-baac-6642f24b9528">
Nov 28 10:52:25 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 10:52:25 user nova-compute[74994]:         </nova:port>
Nov 28 10:52:25 user nova-compute[74994]:       </nova:ports>
Nov 28 10:52:25 user nova-compute[74994]:     </nova:instance>
Nov 28 10:52:25 user nova-compute[74994]:   </metadata>
Nov 28 10:52:25 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 10:52:25 user nova-compute[74994]:     <system>
Nov 28 10:52:25 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 10:52:25 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 10:52:25 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 10:52:25 user nova-compute[74994]:       <entry name="serial">759fbcfd-ab13-438f-b860-6393a97d1205</entry>
Nov 28 10:52:25 user nova-compute[74994]:       <entry name="uuid">759fbcfd-ab13-438f-b860-6393a97d1205</entry>
Nov 28 10:52:25 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 10:52:25 user nova-compute[74994]:     </system>
Nov 28 10:52:25 user nova-compute[74994]:   </sysinfo>
Nov 28 10:52:25 user nova-compute[74994]:   <os>
Nov 28 10:52:25 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 10:52:25 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 10:52:25 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 10:52:25 user nova-compute[74994]:   </os>
Nov 28 10:52:25 user nova-compute[74994]:   <features>
Nov 28 10:52:25 user nova-compute[74994]:     <acpi/>
Nov 28 10:52:25 user nova-compute[74994]:     <apic/>
Nov 28 10:52:25 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 10:52:25 user nova-compute[74994]:   </features>
Nov 28 10:52:25 user nova-compute[74994]:   <clock offset="utc">
Nov 28 10:52:25 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 10:52:25 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 10:52:25 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 10:52:25 user nova-compute[74994]:   </clock>
Nov 28 10:52:25 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 10:52:25 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 10:52:25 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 10:52:25 user nova-compute[74994]:   </cpu>
Nov 28 10:52:25 user nova-compute[74994]:   <devices>
Nov 28 10:52:25 user nova-compute[74994]:     <disk type="block" device="disk">
Nov 28 10:52:25 user nova-compute[74994]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 10:52:25 user nova-compute[74994]:       <source dev="/dev/sdb"/>
Nov 28 10:52:25 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 10:52:25 user nova-compute[74994]:       <serial>6b722d69-93d3-49c4-ab46-38ce89b057de</serial>
Nov 28 10:52:25 user nova-compute[74994]:     </disk>
Nov 28 10:52:25 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 10:52:25 user nova-compute[74994]:       <mac address="fa:16:3e:4f:75:25"/>
Nov 28 10:52:25 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:52:25 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 10:52:25 user nova-compute[74994]:       <target dev="tap7d4a82ba-d2"/>
Nov 28 10:52:25 user nova-compute[74994]:     </interface>
Nov 28 10:52:25 user nova-compute[74994]:     <serial type="pty">
Nov 28 10:52:25 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/759fbcfd-ab13-438f-b860-6393a97d1205/console.log" append="off"/>
Nov 28 10:52:25 user nova-compute[74994]:     </serial>
Nov 28 10:52:25 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 10:52:25 user nova-compute[74994]:     <video>
Nov 28 10:52:25 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:52:25 user nova-compute[74994]:     </video>
Nov 28 10:52:25 user nova-compute[74994]:     <rng model="virtio">
Nov 28 10:52:25 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 10:52:25 user nova-compute[74994]:     </rng>
Nov 28 10:52:25 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 10:52:25 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 10:52:25 user nova-compute[74994]:       <stats period="10"/>
Nov 28 10:52:25 user nova-compute[74994]:     </memballoon>
Nov 28 10:52:25 user nova-compute[74994]:   </devices>
Nov 28 10:52:25 user nova-compute[74994]: </domain>
Nov 28 10:52:25 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 10:52:25 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:52:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-478607448',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-478607448',id=15,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='612ae9ec21ad40a4b68e0926843874ae',ramdisk_id='',reservation_id='r-51gyvey2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-332508527',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:52:04Z,user_data=None,user_id='6c49cba00cff4c4b80080c5f917b4176',uuid=759fbcfd-ab13-438f-b860-6393a97d1205,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d4a82ba-d222-44bb-baac-6642f24b9528", "address": "fa:16:3e:4f:75:25", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d4a82ba-d2", "ovs_interfaceid": "7d4a82ba-d222-44bb-baac-6642f24b9528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 10:52:25 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Converting VIF {"id": "7d4a82ba-d222-44bb-baac-6642f24b9528", "address": "fa:16:3e:4f:75:25", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d4a82ba-d2", "ovs_interfaceid": "7d4a82ba-d222-44bb-baac-6642f24b9528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:52:25 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:75:25,bridge_name='br-int',has_traffic_filtering=True,id=7d4a82ba-d222-44bb-baac-6642f24b9528,network=Network(a1692a13-d1d7-4df6-bfc0-54f231846889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d4a82ba-d2') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:52:25 user nova-compute[74994]: DEBUG os_vif [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:75:25,bridge_name='br-int',has_traffic_filtering=True,id=7d4a82ba-d222-44bb-baac-6642f24b9528,network=Network(a1692a13-d1d7-4df6-bfc0-54f231846889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d4a82ba-d2') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 10:52:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:52:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 10:52:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5fb0ad18-54b4-5f7e-bdc0-68200a91e2d6', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:52:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:52:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7d4a82ba-d2, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:52:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7d4a82ba-d2, col_values=(('qos', UUID('a7423e1c-4be4-4fef-a066-7164192cdf23')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:52:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7d4a82ba-d2, col_values=(('external_ids', {'iface-id': '7d4a82ba-d222-44bb-baac-6642f24b9528', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:75:25', 'vm-uuid': '759fbcfd-ab13-438f-b860-6393a97d1205'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:52:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:52:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:25 user nova-compute[74994]: INFO os_vif [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:75:25,bridge_name='br-int',has_traffic_filtering=True,id=7d4a82ba-d222-44bb-baac-6642f24b9528,network=Network(a1692a13-d1d7-4df6-bfc0-54f231846889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d4a82ba-d2')
Nov 28 10:52:25 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:52:25 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] No VIF found with MAC fa:16:3e:4f:75:25, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:52:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:26 user nova-compute[74994]: DEBUG nova.compute.manager [req-a763f8b3-035e-4477-93d1-9cfb28416610 req-fcf36931-770c-42b0-b818-c634be9b2aa4 service nova] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Received event network-vif-plugged-7d4a82ba-d222-44bb-baac-6642f24b9528 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:52:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a763f8b3-035e-4477-93d1-9cfb28416610 req-fcf36931-770c-42b0-b818-c634be9b2aa4 service nova] Acquiring lock "759fbcfd-ab13-438f-b860-6393a97d1205-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:52:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a763f8b3-035e-4477-93d1-9cfb28416610 req-fcf36931-770c-42b0-b818-c634be9b2aa4 service nova] Lock "759fbcfd-ab13-438f-b860-6393a97d1205-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:52:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a763f8b3-035e-4477-93d1-9cfb28416610 req-fcf36931-770c-42b0-b818-c634be9b2aa4 service nova] Lock "759fbcfd-ab13-438f-b860-6393a97d1205-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:52:26 user nova-compute[74994]: DEBUG nova.compute.manager [req-a763f8b3-035e-4477-93d1-9cfb28416610 req-fcf36931-770c-42b0-b818-c634be9b2aa4 service nova] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] No waiting events found dispatching network-vif-plugged-7d4a82ba-d222-44bb-baac-6642f24b9528 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:52:26 user nova-compute[74994]: WARNING nova.compute.manager [req-a763f8b3-035e-4477-93d1-9cfb28416610 req-fcf36931-770c-42b0-b818-c634be9b2aa4 service nova] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Received unexpected event network-vif-plugged-7d4a82ba-d222-44bb-baac-6642f24b9528 for instance with vm_state building and task_state spawning.
Nov 28 10:52:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:28 user nova-compute[74994]: DEBUG nova.compute.manager [req-9d50d774-5ef3-4c0a-b259-d07a6b035da9 req-77539128-5455-40d1-92ce-981831dcda68 service nova] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Received event network-vif-plugged-7d4a82ba-d222-44bb-baac-6642f24b9528 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:52:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9d50d774-5ef3-4c0a-b259-d07a6b035da9 req-77539128-5455-40d1-92ce-981831dcda68 service nova] Acquiring lock "759fbcfd-ab13-438f-b860-6393a97d1205-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:52:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9d50d774-5ef3-4c0a-b259-d07a6b035da9 req-77539128-5455-40d1-92ce-981831dcda68 service nova] Lock "759fbcfd-ab13-438f-b860-6393a97d1205-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:52:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9d50d774-5ef3-4c0a-b259-d07a6b035da9 req-77539128-5455-40d1-92ce-981831dcda68 service nova] Lock "759fbcfd-ab13-438f-b860-6393a97d1205-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:52:28 user nova-compute[74994]: DEBUG nova.compute.manager [req-9d50d774-5ef3-4c0a-b259-d07a6b035da9 req-77539128-5455-40d1-92ce-981831dcda68 service nova] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] No waiting events found dispatching network-vif-plugged-7d4a82ba-d222-44bb-baac-6642f24b9528 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:52:28 user nova-compute[74994]: WARNING nova.compute.manager [req-9d50d774-5ef3-4c0a-b259-d07a6b035da9 req-77539128-5455-40d1-92ce-981831dcda68 service nova] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Received unexpected event network-vif-plugged-7d4a82ba-d222-44bb-baac-6642f24b9528 for instance with vm_state building and task_state spawning.
Nov 28 10:52:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:29 user nova-compute[74994]: DEBUG nova.compute.manager [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 10:52:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 10:52:29 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Instance spawned successfully.
Nov 28 10:52:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 10:52:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:52:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:52:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:52:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:52:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:52:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:52:29 user nova-compute[74994]: INFO nova.compute.manager [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Took 5.56 seconds to spawn the instance on the hypervisor.
Nov 28 10:52:29 user nova-compute[74994]: DEBUG nova.compute.manager [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 10:52:29 user nova-compute[74994]: INFO nova.compute.manager [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Took 26.72 seconds to build instance.
Nov 28 10:52:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-7b9afd9f-9cc5-40bf-8058-0e9e77336206 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "759fbcfd-ab13-438f-b860-6393a97d1205" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.814s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:52:30 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-62447626-40e3-484f-af67-4671c9140b74 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Waiting for libvirt event about the detach of device tap9ecf4395-d0 with device alias net1 from instance c2925833-e88d-4aa7-a477-ff1bc1fcd724 is timed out.
Nov 28 10:52:30 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-62447626-40e3-484f-af67-4671c9140b74 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e4:1f:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tap9ecf4395-d0"/></interface> {{(pid=74994) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 28 10:52:30 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-62447626-40e3-484f-af67-4671c9140b74 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e4:1f:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tap9ecf4395-d0"/></interface>not found in domain: <domain type='kvm' id='10'>
Nov 28 10:52:30 user nova-compute[74994]:   <name>instance-0000000a</name>
Nov 28 10:52:30 user nova-compute[74994]:   <uuid>c2925833-e88d-4aa7-a477-ff1bc1fcd724</uuid>
Nov 28 10:52:30 user nova-compute[74994]:   <metadata>
Nov 28 10:52:30 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 10:52:30 user nova-compute[74994]:   <nova:package version="0.0.0"/>
Nov 28 10:52:30 user nova-compute[74994]:   <nova:name>tempest-device-tagging-server-185346772</nova:name>
Nov 28 10:52:30 user nova-compute[74994]:   <nova:creationTime>2023-11-28 10:51:36</nova:creationTime>
Nov 28 10:52:30 user nova-compute[74994]:   <nova:flavor name="m1.tiny">
Nov 28 10:52:30 user nova-compute[74994]:     <nova:memory>512</nova:memory>
Nov 28 10:52:30 user nova-compute[74994]:     <nova:disk>1</nova:disk>
Nov 28 10:52:30 user nova-compute[74994]:     <nova:swap>0</nova:swap>
Nov 28 10:52:30 user nova-compute[74994]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 10:52:30 user nova-compute[74994]:     <nova:vcpus>1</nova:vcpus>
Nov 28 10:52:30 user nova-compute[74994]:   </nova:flavor>
Nov 28 10:52:30 user nova-compute[74994]:   <nova:owner>
Nov 28 10:52:30 user nova-compute[74994]:     <nova:user uuid="02983082e29345a491ecd8fe18268b84">tempest-TaggedAttachmentsTest-1012374446-project-member</nova:user>
Nov 28 10:52:30 user nova-compute[74994]:     <nova:project uuid="a1413a02a3034130b4a4ec170ca2fc16">tempest-TaggedAttachmentsTest-1012374446</nova:project>
Nov 28 10:52:30 user nova-compute[74994]:   </nova:owner>
Nov 28 10:52:30 user nova-compute[74994]:   <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 10:52:30 user nova-compute[74994]:   <nova:ports>
Nov 28 10:52:30 user nova-compute[74994]:     <nova:port uuid="752a5c48-15a2-443c-911c-f1a0c33ca925">
Nov 28 10:52:30 user nova-compute[74994]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 10:52:30 user nova-compute[74994]:     </nova:port>
Nov 28 10:52:30 user nova-compute[74994]:     <nova:port uuid="9ecf4395-d083-44c8-8cf4-d4987884c1aa">
Nov 28 10:52:30 user nova-compute[74994]:       <nova:ip type="fixed" address="10.10.10.211" ipVersion="4"/>
Nov 28 10:52:30 user nova-compute[74994]:     </nova:port>
Nov 28 10:52:30 user nova-compute[74994]:   </nova:ports>
Nov 28 10:52:30 user nova-compute[74994]: </nova:instance>
Nov 28 10:52:30 user nova-compute[74994]:   </metadata>
Nov 28 10:52:30 user nova-compute[74994]:   <memory unit='KiB'>524288</memory>
Nov 28 10:52:30 user nova-compute[74994]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 28 10:52:30 user nova-compute[74994]:   <vcpu placement='static'>1</vcpu>
Nov 28 10:52:30 user nova-compute[74994]:   <resource>
Nov 28 10:52:30 user nova-compute[74994]:     <partition>/machine</partition>
Nov 28 10:52:30 user nova-compute[74994]:   </resource>
Nov 28 10:52:30 user nova-compute[74994]:   <sysinfo type='smbios'>
Nov 28 10:52:30 user nova-compute[74994]:     <system>
Nov 28 10:52:30 user nova-compute[74994]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 28 10:52:30 user nova-compute[74994]:       <entry name='product'>OpenStack Nova</entry>
Nov 28 10:52:30 user nova-compute[74994]:       <entry name='version'>0.0.0</entry>
Nov 28 10:52:30 user nova-compute[74994]:       <entry name='serial'>c2925833-e88d-4aa7-a477-ff1bc1fcd724</entry>
Nov 28 10:52:30 user nova-compute[74994]:       <entry name='uuid'>c2925833-e88d-4aa7-a477-ff1bc1fcd724</entry>
Nov 28 10:52:30 user nova-compute[74994]:       <entry name='family'>Virtual Machine</entry>
Nov 28 10:52:30 user nova-compute[74994]:     </system>
Nov 28 10:52:30 user nova-compute[74994]:   </sysinfo>
Nov 28 10:52:30 user nova-compute[74994]:   <os>
Nov 28 10:52:30 user nova-compute[74994]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 28 10:52:30 user nova-compute[74994]:     <boot dev='hd'/>
Nov 28 10:52:30 user nova-compute[74994]:     <smbios mode='sysinfo'/>
Nov 28 10:52:30 user nova-compute[74994]:   </os>
Nov 28 10:52:30 user nova-compute[74994]:   <features>
Nov 28 10:52:30 user nova-compute[74994]:     <acpi/>
Nov 28 10:52:30 user nova-compute[74994]:     <apic/>
Nov 28 10:52:30 user nova-compute[74994]:     <vmcoreinfo state='on'/>
Nov 28 10:52:30 user nova-compute[74994]:   </features>
Nov 28 10:52:30 user nova-compute[74994]:   <cpu mode='custom' match='exact' check='full'>
Nov 28 10:52:30 user nova-compute[74994]:     <model fallback='forbid'>Nehalem</model>
Nov 28 10:52:30 user nova-compute[74994]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 28 10:52:30 user nova-compute[74994]:     <feature policy='require' name='vme'/>
Nov 28 10:52:30 user nova-compute[74994]:     <feature policy='require' name='x2apic'/>
Nov 28 10:52:30 user nova-compute[74994]:     <feature policy='require' name='hypervisor'/>
Nov 28 10:52:30 user nova-compute[74994]:   </cpu>
Nov 28 10:52:30 user nova-compute[74994]:   <clock offset='utc'>
Nov 28 10:52:30 user nova-compute[74994]:     <timer name='pit' tickpolicy='delay'/>
Nov 28 10:52:30 user nova-compute[74994]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 28 10:52:30 user nova-compute[74994]:     <timer name='hpet' present='no'/>
Nov 28 10:52:30 user nova-compute[74994]:   </clock>
Nov 28 10:52:30 user nova-compute[74994]:   <on_poweroff>destroy</on_poweroff>
Nov 28 10:52:30 user nova-compute[74994]:   <on_reboot>restart</on_reboot>
Nov 28 10:52:30 user nova-compute[74994]:   <on_crash>destroy</on_crash>
Nov 28 10:52:30 user nova-compute[74994]:   <devices>
Nov 28 10:52:30 user nova-compute[74994]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 28 10:52:30 user nova-compute[74994]:     <disk type='file' device='disk'>
Nov 28 10:52:30 user nova-compute[74994]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 28 10:52:30 user nova-compute[74994]:       <source file='/opt/stack/data/nova/instances/c2925833-e88d-4aa7-a477-ff1bc1fcd724/disk' index='2'/>
Nov 28 10:52:30 user nova-compute[74994]:       <backingStore type='file' index='3'>
Nov 28 10:52:30 user nova-compute[74994]:         <format type='raw'/>
Nov 28 10:52:30 user nova-compute[74994]:         <source file='/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188'/>
Nov 28 10:52:30 user nova-compute[74994]:         <backingStore/>
Nov 28 10:52:30 user nova-compute[74994]:       </backingStore>
Nov 28 10:52:30 user nova-compute[74994]:       <target dev='vda' bus='virtio'/>
Nov 28 10:52:30 user nova-compute[74994]:       <alias name='virtio-disk0'/>
Nov 28 10:52:30 user nova-compute[74994]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 28 10:52:30 user nova-compute[74994]:     </disk>
Nov 28 10:52:30 user nova-compute[74994]:     <disk type='file' device='cdrom'>
Nov 28 10:52:30 user nova-compute[74994]:       <driver name='qemu' type='raw' cache='none'/>
Nov 28 10:52:30 user nova-compute[74994]:       <source file='/opt/stack/data/nova/instances/c2925833-e88d-4aa7-a477-ff1bc1fcd724/disk.config' index='1'/>
Nov 28 10:52:30 user nova-compute[74994]:       <backingStore/>
Nov 28 10:52:30 user nova-compute[74994]:       <target dev='hda' bus='ide'/>
Nov 28 10:52:30 user nova-compute[74994]:       <readonly/>
Nov 28 10:52:30 user nova-compute[74994]:       <alias name='ide0-0-0'/>
Nov 28 10:52:30 user nova-compute[74994]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 28 10:52:30 user nova-compute[74994]:     </disk>
Nov 28 10:52:30 user nova-compute[74994]:     <controller type='usb' index='0' model='none'>
Nov 28 10:52:30 user nova-compute[74994]:       <alias name='usb'/>
Nov 28 10:52:30 user nova-compute[74994]:     </controller>
Nov 28 10:52:30 user nova-compute[74994]:     <controller type='pci' index='0' model='pci-root'>
Nov 28 10:52:30 user nova-compute[74994]:       <alias name='pci.0'/>
Nov 28 10:52:30 user nova-compute[74994]:     </controller>
Nov 28 10:52:30 user nova-compute[74994]:     <controller type='ide' index='0'>
Nov 28 10:52:30 user nova-compute[74994]:       <alias name='ide'/>
Nov 28 10:52:30 user nova-compute[74994]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 28 10:52:30 user nova-compute[74994]:     </controller>
Nov 28 10:52:30 user nova-compute[74994]:     <interface type='ethernet'>
Nov 28 10:52:30 user nova-compute[74994]:       <mac address='fa:16:3e:a4:4b:1f'/>
Nov 28 10:52:30 user nova-compute[74994]:       <target dev='tap752a5c48-15'/>
Nov 28 10:52:30 user nova-compute[74994]:       <model type='virtio'/>
Nov 28 10:52:30 user nova-compute[74994]:       <mtu size='1442'/>
Nov 28 10:52:30 user nova-compute[74994]:       <alias name='net0'/>
Nov 28 10:52:30 user nova-compute[74994]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 28 10:52:30 user nova-compute[74994]:     </interface>
Nov 28 10:52:30 user nova-compute[74994]:     <serial type='pty'>
Nov 28 10:52:30 user nova-compute[74994]:       <source path='/dev/pts/9'/>
Nov 28 10:52:30 user nova-compute[74994]:       <log file='/opt/stack/data/nova/instances/c2925833-e88d-4aa7-a477-ff1bc1fcd724/console.log' append='off'/>
Nov 28 10:52:30 user nova-compute[74994]:       <target type='isa-serial' port='0'>
Nov 28 10:52:30 user nova-compute[74994]:         <model name='isa-serial'/>
Nov 28 10:52:30 user nova-compute[74994]:       </target>
Nov 28 10:52:30 user nova-compute[74994]:       <alias name='serial0'/>
Nov 28 10:52:30 user nova-compute[74994]:     </serial>
Nov 28 10:52:30 user nova-compute[74994]:     <console type='pty' tty='/dev/pts/9'>
Nov 28 10:52:30 user nova-compute[74994]:       <source path='/dev/pts/9'/>
Nov 28 10:52:30 user nova-compute[74994]:       <log file='/opt/stack/data/nova/instances/c2925833-e88d-4aa7-a477-ff1bc1fcd724/console.log' append='off'/>
Nov 28 10:52:30 user nova-compute[74994]:       <target type='serial' port='0'/>
Nov 28 10:52:30 user nova-compute[74994]:       <alias name='serial0'/>
Nov 28 10:52:30 user nova-compute[74994]:     </console>
Nov 28 10:52:30 user nova-compute[74994]:     <input type='mouse' bus='ps2'>
Nov 28 10:52:30 user nova-compute[74994]:       <alias name='input0'/>
Nov 28 10:52:30 user nova-compute[74994]:     </input>
Nov 28 10:52:30 user nova-compute[74994]:     <input type='keyboard' bus='ps2'>
Nov 28 10:52:30 user nova-compute[74994]:       <alias name='input1'/>
Nov 28 10:52:30 user nova-compute[74994]:     </input>
Nov 28 10:52:30 user nova-compute[74994]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Nov 28 10:52:30 user nova-compute[74994]:       <listen type='address' address='0.0.0.0'/>
Nov 28 10:52:30 user nova-compute[74994]:     </graphics>
Nov 28 10:52:30 user nova-compute[74994]:     <audio id='1' type='none'/>
Nov 28 10:52:30 user nova-compute[74994]:     <video>
Nov 28 10:52:30 user nova-compute[74994]:       <model type='virtio' heads='1' primary='yes'/>
Nov 28 10:52:30 user nova-compute[74994]:       <alias name='video0'/>
Nov 28 10:52:30 user nova-compute[74994]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 28 10:52:30 user nova-compute[74994]:     </video>
Nov 28 10:52:30 user nova-compute[74994]:     <memballoon model='virtio'>
Nov 28 10:52:30 user nova-compute[74994]:       <stats period='10'/>
Nov 28 10:52:30 user nova-compute[74994]:       <alias name='balloon0'/>
Nov 28 10:52:30 user nova-compute[74994]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 28 10:52:30 user nova-compute[74994]:     </memballoon>
Nov 28 10:52:30 user nova-compute[74994]:     <rng model='virtio'>
Nov 28 10:52:30 user nova-compute[74994]:       <backend model='random'>/dev/urandom</backend>
Nov 28 10:52:30 user nova-compute[74994]:       <alias name='rng0'/>
Nov 28 10:52:30 user nova-compute[74994]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 28 10:52:30 user nova-compute[74994]:     </rng>
Nov 28 10:52:30 user nova-compute[74994]:   </devices>
Nov 28 10:52:30 user nova-compute[74994]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 28 10:52:30 user nova-compute[74994]:     <label>libvirt-c2925833-e88d-4aa7-a477-ff1bc1fcd724</label>
Nov 28 10:52:30 user nova-compute[74994]:     <imagelabel>libvirt-c2925833-e88d-4aa7-a477-ff1bc1fcd724</imagelabel>
Nov 28 10:52:30 user nova-compute[74994]:   </seclabel>
Nov 28 10:52:30 user nova-compute[74994]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 28 10:52:30 user nova-compute[74994]:     <label>+64055:+108</label>
Nov 28 10:52:30 user nova-compute[74994]:     <imagelabel>+64055:+108</imagelabel>
Nov 28 10:52:30 user nova-compute[74994]:   </seclabel>
Nov 28 10:52:30 user nova-compute[74994]: </domain>
Nov 28 10:52:30 user nova-compute[74994]:  {{(pid=74994) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 28 10:52:30 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-62447626-40e3-484f-af67-4671c9140b74 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Successfully detached device tap9ecf4395-d0 from instance c2925833-e88d-4aa7-a477-ff1bc1fcd724 from the live domain config.
Nov 28 10:52:30 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-62447626-40e3-484f-af67-4671c9140b74 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:49:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-185346772',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-185346772',id=10,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKb7DfQBhl9KQjX/Jy4TL5O6PXWUKL+vLgAOjfX/Q0BbK/dfYX/kuDxa2AyyjG8Tr6w0nPvpMGRLCsCXhPfUwNG1BTBUaGDIyyYhGnKPl0/QavZSldUeJCV0yh5hnereZw==',key_name='tempest-keypair-433898378',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:49:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a1413a02a3034130b4a4ec170ca2fc16',ramdisk_id='',reservation_id='r-z554pke2',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1012374446',owner_user_name='tempest-TaggedAttachmentsTest-1012374446-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T10:49:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02983082e29345a491ecd8fe18268b84',uuid=c2925833-e88d-4aa7-a477-ff1bc1fcd724,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ecf4395-d083-44c8-8cf4-d4987884c1aa", "address": "fa:16:3e:e4:1f:d6", "network": {"id": "00554ee0-49a7-42fd-b0c6-7dc89c5a90a7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-321761758", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a1413a02a3034130b4a4ec170ca2fc16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ecf4395-d0", "ovs_interfaceid": "9ecf4395-d083-44c8-8cf4-d4987884c1aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 10:52:30 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-62447626-40e3-484f-af67-4671c9140b74 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Converting VIF {"id": "9ecf4395-d083-44c8-8cf4-d4987884c1aa", "address": "fa:16:3e:e4:1f:d6", "network": {"id": "00554ee0-49a7-42fd-b0c6-7dc89c5a90a7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-321761758", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a1413a02a3034130b4a4ec170ca2fc16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ecf4395-d0", "ovs_interfaceid": "9ecf4395-d083-44c8-8cf4-d4987884c1aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:52:30 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-62447626-40e3-484f-af67-4671c9140b74 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:1f:d6,bridge_name='br-int',has_traffic_filtering=True,id=9ecf4395-d083-44c8-8cf4-d4987884c1aa,network=Network(00554ee0-49a7-42fd-b0c6-7dc89c5a90a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ecf4395-d0') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:52:30 user nova-compute[74994]: DEBUG os_vif [None req-62447626-40e3-484f-af67-4671c9140b74 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:1f:d6,bridge_name='br-int',has_traffic_filtering=True,id=9ecf4395-d083-44c8-8cf4-d4987884c1aa,network=Network(00554ee0-49a7-42fd-b0c6-7dc89c5a90a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ecf4395-d0') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 10:52:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9ecf4395-d0, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:52:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6a4b8cbc-6445-4d20-95d4-dd085cb9b18c) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:52:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:30 user nova-compute[74994]: INFO os_vif [None req-62447626-40e3-484f-af67-4671c9140b74 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:1f:d6,bridge_name='br-int',has_traffic_filtering=True,id=9ecf4395-d083-44c8-8cf4-d4987884c1aa,network=Network(00554ee0-49a7-42fd-b0c6-7dc89c5a90a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ecf4395-d0')
Nov 28 10:52:30 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-62447626-40e3-484f-af67-4671c9140b74 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 10:52:30 user nova-compute[74994]:   <nova:package version="0.0.0"/>
Nov 28 10:52:30 user nova-compute[74994]:   <nova:name>tempest-device-tagging-server-185346772</nova:name>
Nov 28 10:52:30 user nova-compute[74994]:   <nova:creationTime>2023-11-28 10:52:30</nova:creationTime>
Nov 28 10:52:30 user nova-compute[74994]:   <nova:flavor name="m1.tiny">
Nov 28 10:52:30 user nova-compute[74994]:     <nova:memory>512</nova:memory>
Nov 28 10:52:30 user nova-compute[74994]:     <nova:disk>1</nova:disk>
Nov 28 10:52:30 user nova-compute[74994]:     <nova:swap>0</nova:swap>
Nov 28 10:52:30 user nova-compute[74994]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 10:52:30 user nova-compute[74994]:     <nova:vcpus>1</nova:vcpus>
Nov 28 10:52:30 user nova-compute[74994]:   </nova:flavor>
Nov 28 10:52:30 user nova-compute[74994]:   <nova:owner>
Nov 28 10:52:30 user nova-compute[74994]:     <nova:user uuid="02983082e29345a491ecd8fe18268b84">tempest-TaggedAttachmentsTest-1012374446-project-member</nova:user>
Nov 28 10:52:30 user nova-compute[74994]:     <nova:project uuid="a1413a02a3034130b4a4ec170ca2fc16">tempest-TaggedAttachmentsTest-1012374446</nova:project>
Nov 28 10:52:30 user nova-compute[74994]:   </nova:owner>
Nov 28 10:52:30 user nova-compute[74994]:   <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 10:52:30 user nova-compute[74994]:   <nova:ports>
Nov 28 10:52:30 user nova-compute[74994]:     <nova:port uuid="752a5c48-15a2-443c-911c-f1a0c33ca925">
Nov 28 10:52:30 user nova-compute[74994]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 10:52:30 user nova-compute[74994]:     </nova:port>
Nov 28 10:52:30 user nova-compute[74994]:   </nova:ports>
Nov 28 10:52:30 user nova-compute[74994]: </nova:instance>
Nov 28 10:52:30 user nova-compute[74994]:  {{(pid=74994) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 28 10:52:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-62447626-40e3-484f-af67-4671c9140b74 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Acquiring lock "refresh_cache-c2925833-e88d-4aa7-a477-ff1bc1fcd724" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:52:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-62447626-40e3-484f-af67-4671c9140b74 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Acquired lock "refresh_cache-c2925833-e88d-4aa7-a477-ff1bc1fcd724" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:52:30 user nova-compute[74994]: DEBUG nova.network.neutron [None req-62447626-40e3-484f-af67-4671c9140b74 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 10:52:31 user nova-compute[74994]: DEBUG nova.compute.manager [req-6a103b7e-8aa8-4528-bccd-74b5c07d5b95 req-441759e5-5e32-4a36-b33c-26105115a3c0 service nova] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Received event network-vif-deleted-9ecf4395-d083-44c8-8cf4-d4987884c1aa {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:52:31 user nova-compute[74994]: INFO nova.compute.manager [req-6a103b7e-8aa8-4528-bccd-74b5c07d5b95 req-441759e5-5e32-4a36-b33c-26105115a3c0 service nova] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Neutron deleted interface 9ecf4395-d083-44c8-8cf4-d4987884c1aa; detaching it from the instance and deleting it from the info cache
Nov 28 10:52:31 user nova-compute[74994]: DEBUG nova.network.neutron [req-6a103b7e-8aa8-4528-bccd-74b5c07d5b95 req-441759e5-5e32-4a36-b33c-26105115a3c0 service nova] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Updating instance_info_cache with network_info: [{"id": "752a5c48-15a2-443c-911c-f1a0c33ca925", "address": "fa:16:3e:a4:4b:1f", "network": {"id": "92ee00e3-fc9c-459d-9dac-4ef40e592023", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2069871364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1413a02a3034130b4a4ec170ca2fc16", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap752a5c48-15", "ovs_interfaceid": "752a5c48-15a2-443c-911c-f1a0c33ca925", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:52:31 user nova-compute[74994]: DEBUG nova.objects.instance [req-6a103b7e-8aa8-4528-bccd-74b5c07d5b95 req-441759e5-5e32-4a36-b33c-26105115a3c0 service nova] Lazy-loading 'system_metadata' on Instance uuid c2925833-e88d-4aa7-a477-ff1bc1fcd724 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:52:31 user nova-compute[74994]: DEBUG nova.objects.instance [req-6a103b7e-8aa8-4528-bccd-74b5c07d5b95 req-441759e5-5e32-4a36-b33c-26105115a3c0 service nova] Lazy-loading 'flavor' on Instance uuid c2925833-e88d-4aa7-a477-ff1bc1fcd724 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:52:31 user nova-compute[74994]: DEBUG nova.objects.base [req-6a103b7e-8aa8-4528-bccd-74b5c07d5b95 req-441759e5-5e32-4a36-b33c-26105115a3c0 service nova] Object Instance<c2925833-e88d-4aa7-a477-ff1bc1fcd724> lazy-loaded attributes: system_metadata,flavor {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 10:52:31 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [req-6a103b7e-8aa8-4528-bccd-74b5c07d5b95 req-441759e5-5e32-4a36-b33c-26105115a3c0 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:49:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-185346772',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-185346772',id=10,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKb7DfQBhl9KQjX/Jy4TL5O6PXWUKL+vLgAOjfX/Q0BbK/dfYX/kuDxa2AyyjG8Tr6w0nPvpMGRLCsCXhPfUwNG1BTBUaGDIyyYhGnKPl0/QavZSldUeJCV0yh5hnereZw==',key_name='tempest-keypair-433898378',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:49:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a1413a02a3034130b4a4ec170ca2fc16',ramdisk_id='',reservation_id='r-z554pke2',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1012374446',owner_user_name='tempest-TaggedAttachmentsTest-1012374446-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T10:49:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02983082e29345a491ecd8fe18268b84',uuid=c2925833-e88d-4aa7-a477-ff1bc1fcd724,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ecf4395-d083-44c8-8cf4-d4987884c1aa", "address": "fa:16:3e:e4:1f:d6", "network": {"id": "00554ee0-49a7-42fd-b0c6-7dc89c5a90a7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-321761758", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a1413a02a3034130b4a4ec170ca2fc16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ecf4395-d0", "ovs_interfaceid": "9ecf4395-d083-44c8-8cf4-d4987884c1aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:52:31 user nova-compute[74994]: DEBUG nova.network.os_vif_util [req-6a103b7e-8aa8-4528-bccd-74b5c07d5b95 req-441759e5-5e32-4a36-b33c-26105115a3c0 service nova] Converting VIF {"id": "9ecf4395-d083-44c8-8cf4-d4987884c1aa", "address": "fa:16:3e:e4:1f:d6", "network": {"id": "00554ee0-49a7-42fd-b0c6-7dc89c5a90a7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-321761758", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a1413a02a3034130b4a4ec170ca2fc16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ecf4395-d0", "ovs_interfaceid": "9ecf4395-d083-44c8-8cf4-d4987884c1aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:52:31 user nova-compute[74994]: DEBUG nova.network.os_vif_util [req-6a103b7e-8aa8-4528-bccd-74b5c07d5b95 req-441759e5-5e32-4a36-b33c-26105115a3c0 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:1f:d6,bridge_name='br-int',has_traffic_filtering=True,id=9ecf4395-d083-44c8-8cf4-d4987884c1aa,network=Network(00554ee0-49a7-42fd-b0c6-7dc89c5a90a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ecf4395-d0') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:52:31 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [req-6a103b7e-8aa8-4528-bccd-74b5c07d5b95 req-441759e5-5e32-4a36-b33c-26105115a3c0 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e4:1f:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tap9ecf4395-d0"/></interface> {{(pid=74994) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 28 10:52:31 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [req-6a103b7e-8aa8-4528-bccd-74b5c07d5b95 req-441759e5-5e32-4a36-b33c-26105115a3c0 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e4:1f:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tap9ecf4395-d0"/></interface>not found in domain: <domain type='kvm' id='10'>
Nov 28 10:52:31 user nova-compute[74994]:   <name>instance-0000000a</name>
Nov 28 10:52:31 user nova-compute[74994]:   <uuid>c2925833-e88d-4aa7-a477-ff1bc1fcd724</uuid>
Nov 28 10:52:31 user nova-compute[74994]:   <metadata>
Nov 28 10:52:31 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 10:52:31 user nova-compute[74994]:   <nova:package version="0.0.0"/>
Nov 28 10:52:31 user nova-compute[74994]:   <nova:name>tempest-device-tagging-server-185346772</nova:name>
Nov 28 10:52:31 user nova-compute[74994]:   <nova:creationTime>2023-11-28 10:52:30</nova:creationTime>
Nov 28 10:52:31 user nova-compute[74994]:   <nova:flavor name="m1.tiny">
Nov 28 10:52:31 user nova-compute[74994]:     <nova:memory>512</nova:memory>
Nov 28 10:52:31 user nova-compute[74994]:     <nova:disk>1</nova:disk>
Nov 28 10:52:31 user nova-compute[74994]:     <nova:swap>0</nova:swap>
Nov 28 10:52:31 user nova-compute[74994]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 10:52:31 user nova-compute[74994]:     <nova:vcpus>1</nova:vcpus>
Nov 28 10:52:31 user nova-compute[74994]:   </nova:flavor>
Nov 28 10:52:31 user nova-compute[74994]:   <nova:owner>
Nov 28 10:52:31 user nova-compute[74994]:     <nova:user uuid="02983082e29345a491ecd8fe18268b84">tempest-TaggedAttachmentsTest-1012374446-project-member</nova:user>
Nov 28 10:52:31 user nova-compute[74994]:     <nova:project uuid="a1413a02a3034130b4a4ec170ca2fc16">tempest-TaggedAttachmentsTest-1012374446</nova:project>
Nov 28 10:52:31 user nova-compute[74994]:   </nova:owner>
Nov 28 10:52:31 user nova-compute[74994]:   <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 10:52:31 user nova-compute[74994]:   <nova:ports>
Nov 28 10:52:31 user nova-compute[74994]:     <nova:port uuid="752a5c48-15a2-443c-911c-f1a0c33ca925">
Nov 28 10:52:31 user nova-compute[74994]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 10:52:31 user nova-compute[74994]:     </nova:port>
Nov 28 10:52:31 user nova-compute[74994]:   </nova:ports>
Nov 28 10:52:31 user nova-compute[74994]: </nova:instance>
Nov 28 10:52:31 user nova-compute[74994]:   </metadata>
Nov 28 10:52:31 user nova-compute[74994]:   <memory unit='KiB'>524288</memory>
Nov 28 10:52:31 user nova-compute[74994]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 28 10:52:31 user nova-compute[74994]:   <vcpu placement='static'>1</vcpu>
Nov 28 10:52:31 user nova-compute[74994]:   <resource>
Nov 28 10:52:31 user nova-compute[74994]:     <partition>/machine</partition>
Nov 28 10:52:31 user nova-compute[74994]:   </resource>
Nov 28 10:52:31 user nova-compute[74994]:   <sysinfo type='smbios'>
Nov 28 10:52:31 user nova-compute[74994]:     <system>
Nov 28 10:52:31 user nova-compute[74994]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 28 10:52:31 user nova-compute[74994]:       <entry name='product'>OpenStack Nova</entry>
Nov 28 10:52:31 user nova-compute[74994]:       <entry name='version'>0.0.0</entry>
Nov 28 10:52:31 user nova-compute[74994]:       <entry name='serial'>c2925833-e88d-4aa7-a477-ff1bc1fcd724</entry>
Nov 28 10:52:31 user nova-compute[74994]:       <entry name='uuid'>c2925833-e88d-4aa7-a477-ff1bc1fcd724</entry>
Nov 28 10:52:31 user nova-compute[74994]:       <entry name='family'>Virtual Machine</entry>
Nov 28 10:52:31 user nova-compute[74994]:     </system>
Nov 28 10:52:31 user nova-compute[74994]:   </sysinfo>
Nov 28 10:52:31 user nova-compute[74994]:   <os>
Nov 28 10:52:31 user nova-compute[74994]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 28 10:52:31 user nova-compute[74994]:     <boot dev='hd'/>
Nov 28 10:52:31 user nova-compute[74994]:     <smbios mode='sysinfo'/>
Nov 28 10:52:31 user nova-compute[74994]:   </os>
Nov 28 10:52:31 user nova-compute[74994]:   <features>
Nov 28 10:52:31 user nova-compute[74994]:     <acpi/>
Nov 28 10:52:31 user nova-compute[74994]:     <apic/>
Nov 28 10:52:31 user nova-compute[74994]:     <vmcoreinfo state='on'/>
Nov 28 10:52:31 user nova-compute[74994]:   </features>
Nov 28 10:52:31 user nova-compute[74994]:   <cpu mode='custom' match='exact' check='full'>
Nov 28 10:52:31 user nova-compute[74994]:     <model fallback='forbid'>Nehalem</model>
Nov 28 10:52:31 user nova-compute[74994]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 28 10:52:31 user nova-compute[74994]:     <feature policy='require' name='vme'/>
Nov 28 10:52:31 user nova-compute[74994]:     <feature policy='require' name='x2apic'/>
Nov 28 10:52:31 user nova-compute[74994]:     <feature policy='require' name='hypervisor'/>
Nov 28 10:52:31 user nova-compute[74994]:   </cpu>
Nov 28 10:52:31 user nova-compute[74994]:   <clock offset='utc'>
Nov 28 10:52:31 user nova-compute[74994]:     <timer name='pit' tickpolicy='delay'/>
Nov 28 10:52:31 user nova-compute[74994]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 28 10:52:31 user nova-compute[74994]:     <timer name='hpet' present='no'/>
Nov 28 10:52:31 user nova-compute[74994]:   </clock>
Nov 28 10:52:31 user nova-compute[74994]:   <on_poweroff>destroy</on_poweroff>
Nov 28 10:52:31 user nova-compute[74994]:   <on_reboot>restart</on_reboot>
Nov 28 10:52:31 user nova-compute[74994]:   <on_crash>destroy</on_crash>
Nov 28 10:52:31 user nova-compute[74994]:   <devices>
Nov 28 10:52:31 user nova-compute[74994]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 28 10:52:31 user nova-compute[74994]:     <disk type='file' device='disk'>
Nov 28 10:52:31 user nova-compute[74994]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 28 10:52:31 user nova-compute[74994]:       <source file='/opt/stack/data/nova/instances/c2925833-e88d-4aa7-a477-ff1bc1fcd724/disk' index='2'/>
Nov 28 10:52:31 user nova-compute[74994]:       <backingStore type='file' index='3'>
Nov 28 10:52:31 user nova-compute[74994]:         <format type='raw'/>
Nov 28 10:52:31 user nova-compute[74994]:         <source file='/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188'/>
Nov 28 10:52:31 user nova-compute[74994]:         <backingStore/>
Nov 28 10:52:31 user nova-compute[74994]:       </backingStore>
Nov 28 10:52:31 user nova-compute[74994]:       <target dev='vda' bus='virtio'/>
Nov 28 10:52:31 user nova-compute[74994]:       <alias name='virtio-disk0'/>
Nov 28 10:52:31 user nova-compute[74994]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 28 10:52:31 user nova-compute[74994]:     </disk>
Nov 28 10:52:31 user nova-compute[74994]:     <disk type='file' device='cdrom'>
Nov 28 10:52:31 user nova-compute[74994]:       <driver name='qemu' type='raw' cache='none'/>
Nov 28 10:52:31 user nova-compute[74994]:       <source file='/opt/stack/data/nova/instances/c2925833-e88d-4aa7-a477-ff1bc1fcd724/disk.config' index='1'/>
Nov 28 10:52:31 user nova-compute[74994]:       <backingStore/>
Nov 28 10:52:31 user nova-compute[74994]:       <target dev='hda' bus='ide'/>
Nov 28 10:52:31 user nova-compute[74994]:       <readonly/>
Nov 28 10:52:31 user nova-compute[74994]:       <alias name='ide0-0-0'/>
Nov 28 10:52:31 user nova-compute[74994]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 28 10:52:31 user nova-compute[74994]:     </disk>
Nov 28 10:52:31 user nova-compute[74994]:     <controller type='usb' index='0' model='none'>
Nov 28 10:52:31 user nova-compute[74994]:       <alias name='usb'/>
Nov 28 10:52:31 user nova-compute[74994]:     </controller>
Nov 28 10:52:31 user nova-compute[74994]:     <controller type='pci' index='0' model='pci-root'>
Nov 28 10:52:31 user nova-compute[74994]:       <alias name='pci.0'/>
Nov 28 10:52:31 user nova-compute[74994]:     </controller>
Nov 28 10:52:31 user nova-compute[74994]:     <controller type='ide' index='0'>
Nov 28 10:52:31 user nova-compute[74994]:       <alias name='ide'/>
Nov 28 10:52:31 user nova-compute[74994]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 28 10:52:31 user nova-compute[74994]:     </controller>
Nov 28 10:52:31 user nova-compute[74994]:     <interface type='ethernet'>
Nov 28 10:52:31 user nova-compute[74994]:       <mac address='fa:16:3e:a4:4b:1f'/>
Nov 28 10:52:31 user nova-compute[74994]:       <target dev='tap752a5c48-15'/>
Nov 28 10:52:31 user nova-compute[74994]:       <model type='virtio'/>
Nov 28 10:52:31 user nova-compute[74994]:       <mtu size='1442'/>
Nov 28 10:52:31 user nova-compute[74994]:       <alias name='net0'/>
Nov 28 10:52:31 user nova-compute[74994]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 28 10:52:31 user nova-compute[74994]:     </interface>
Nov 28 10:52:31 user nova-compute[74994]:     <serial type='pty'>
Nov 28 10:52:31 user nova-compute[74994]:       <source path='/dev/pts/9'/>
Nov 28 10:52:31 user nova-compute[74994]:       <log file='/opt/stack/data/nova/instances/c2925833-e88d-4aa7-a477-ff1bc1fcd724/console.log' append='off'/>
Nov 28 10:52:31 user nova-compute[74994]:       <target type='isa-serial' port='0'>
Nov 28 10:52:31 user nova-compute[74994]:         <model name='isa-serial'/>
Nov 28 10:52:31 user nova-compute[74994]:       </target>
Nov 28 10:52:31 user nova-compute[74994]:       <alias name='serial0'/>
Nov 28 10:52:31 user nova-compute[74994]:     </serial>
Nov 28 10:52:31 user nova-compute[74994]:     <console type='pty' tty='/dev/pts/9'>
Nov 28 10:52:31 user nova-compute[74994]:       <source path='/dev/pts/9'/>
Nov 28 10:52:31 user nova-compute[74994]:       <log file='/opt/stack/data/nova/instances/c2925833-e88d-4aa7-a477-ff1bc1fcd724/console.log' append='off'/>
Nov 28 10:52:31 user nova-compute[74994]:       <target type='serial' port='0'/>
Nov 28 10:52:31 user nova-compute[74994]:       <alias name='serial0'/>
Nov 28 10:52:31 user nova-compute[74994]:     </console>
Nov 28 10:52:31 user nova-compute[74994]:     <input type='mouse' bus='ps2'>
Nov 28 10:52:31 user nova-compute[74994]:       <alias name='input0'/>
Nov 28 10:52:31 user nova-compute[74994]:     </input>
Nov 28 10:52:31 user nova-compute[74994]:     <input type='keyboard' bus='ps2'>
Nov 28 10:52:31 user nova-compute[74994]:       <alias name='input1'/>
Nov 28 10:52:31 user nova-compute[74994]:     </input>
Nov 28 10:52:31 user nova-compute[74994]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Nov 28 10:52:31 user nova-compute[74994]:       <listen type='address' address='0.0.0.0'/>
Nov 28 10:52:31 user nova-compute[74994]:     </graphics>
Nov 28 10:52:31 user nova-compute[74994]:     <audio id='1' type='none'/>
Nov 28 10:52:31 user nova-compute[74994]:     <video>
Nov 28 10:52:31 user nova-compute[74994]:       <model type='virtio' heads='1' primary='yes'/>
Nov 28 10:52:31 user nova-compute[74994]:       <alias name='video0'/>
Nov 28 10:52:31 user nova-compute[74994]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 28 10:52:31 user nova-compute[74994]:     </video>
Nov 28 10:52:31 user nova-compute[74994]:     <memballoon model='virtio'>
Nov 28 10:52:31 user nova-compute[74994]:       <stats period='10'/>
Nov 28 10:52:31 user nova-compute[74994]:       <alias name='balloon0'/>
Nov 28 10:52:31 user nova-compute[74994]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 28 10:52:31 user nova-compute[74994]:     </memballoon>
Nov 28 10:52:31 user nova-compute[74994]:     <rng model='virtio'>
Nov 28 10:52:31 user nova-compute[74994]:       <backend model='random'>/dev/urandom</backend>
Nov 28 10:52:31 user nova-compute[74994]:       <alias name='rng0'/>
Nov 28 10:52:31 user nova-compute[74994]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 28 10:52:31 user nova-compute[74994]:     </rng>
Nov 28 10:52:31 user nova-compute[74994]:   </devices>
Nov 28 10:52:31 user nova-compute[74994]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 28 10:52:31 user nova-compute[74994]:     <label>libvirt-c2925833-e88d-4aa7-a477-ff1bc1fcd724</label>
Nov 28 10:52:31 user nova-compute[74994]:     <imagelabel>libvirt-c2925833-e88d-4aa7-a477-ff1bc1fcd724</imagelabel>
Nov 28 10:52:31 user nova-compute[74994]:   </seclabel>
Nov 28 10:52:31 user nova-compute[74994]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 28 10:52:31 user nova-compute[74994]:     <label>+64055:+108</label>
Nov 28 10:52:31 user nova-compute[74994]:     <imagelabel>+64055:+108</imagelabel>
Nov 28 10:52:31 user nova-compute[74994]:   </seclabel>
Nov 28 10:52:31 user nova-compute[74994]: </domain>
Nov 28 10:52:31 user nova-compute[74994]:  {{(pid=74994) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 28 10:52:31 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [req-6a103b7e-8aa8-4528-bccd-74b5c07d5b95 req-441759e5-5e32-4a36-b33c-26105115a3c0 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e4:1f:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tap9ecf4395-d0"/></interface> {{(pid=74994) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 28 10:52:31 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [req-6a103b7e-8aa8-4528-bccd-74b5c07d5b95 req-441759e5-5e32-4a36-b33c-26105115a3c0 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e4:1f:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tap9ecf4395-d0"/></interface>not found in domain: <domain type='kvm' id='10'>
Nov 28 10:52:31 user nova-compute[74994]:   <name>instance-0000000a</name>
Nov 28 10:52:31 user nova-compute[74994]:   <uuid>c2925833-e88d-4aa7-a477-ff1bc1fcd724</uuid>
Nov 28 10:52:31 user nova-compute[74994]:   <metadata>
Nov 28 10:52:31 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 10:52:31 user nova-compute[74994]:   <nova:package version="0.0.0"/>
Nov 28 10:52:31 user nova-compute[74994]:   <nova:name>tempest-device-tagging-server-185346772</nova:name>
Nov 28 10:52:31 user nova-compute[74994]:   <nova:creationTime>2023-11-28 10:52:30</nova:creationTime>
Nov 28 10:52:31 user nova-compute[74994]:   <nova:flavor name="m1.tiny">
Nov 28 10:52:31 user nova-compute[74994]:     <nova:memory>512</nova:memory>
Nov 28 10:52:31 user nova-compute[74994]:     <nova:disk>1</nova:disk>
Nov 28 10:52:31 user nova-compute[74994]:     <nova:swap>0</nova:swap>
Nov 28 10:52:31 user nova-compute[74994]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 10:52:31 user nova-compute[74994]:     <nova:vcpus>1</nova:vcpus>
Nov 28 10:52:31 user nova-compute[74994]:   </nova:flavor>
Nov 28 10:52:31 user nova-compute[74994]:   <nova:owner>
Nov 28 10:52:31 user nova-compute[74994]:     <nova:user uuid="02983082e29345a491ecd8fe18268b84">tempest-TaggedAttachmentsTest-1012374446-project-member</nova:user>
Nov 28 10:52:31 user nova-compute[74994]:     <nova:project uuid="a1413a02a3034130b4a4ec170ca2fc16">tempest-TaggedAttachmentsTest-1012374446</nova:project>
Nov 28 10:52:31 user nova-compute[74994]:   </nova:owner>
Nov 28 10:52:31 user nova-compute[74994]:   <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 10:52:31 user nova-compute[74994]:   <nova:ports>
Nov 28 10:52:31 user nova-compute[74994]:     <nova:port uuid="752a5c48-15a2-443c-911c-f1a0c33ca925">
Nov 28 10:52:31 user nova-compute[74994]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 10:52:31 user nova-compute[74994]:     </nova:port>
Nov 28 10:52:31 user nova-compute[74994]:   </nova:ports>
Nov 28 10:52:31 user nova-compute[74994]: </nova:instance>
Nov 28 10:52:31 user nova-compute[74994]:   </metadata>
Nov 28 10:52:31 user nova-compute[74994]:   <memory unit='KiB'>524288</memory>
Nov 28 10:52:31 user nova-compute[74994]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 28 10:52:31 user nova-compute[74994]:   <vcpu placement='static'>1</vcpu>
Nov 28 10:52:31 user nova-compute[74994]:   <resource>
Nov 28 10:52:31 user nova-compute[74994]:     <partition>/machine</partition>
Nov 28 10:52:31 user nova-compute[74994]:   </resource>
Nov 28 10:52:31 user nova-compute[74994]:   <sysinfo type='smbios'>
Nov 28 10:52:31 user nova-compute[74994]:     <system>
Nov 28 10:52:31 user nova-compute[74994]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 28 10:52:31 user nova-compute[74994]:       <entry name='product'>OpenStack Nova</entry>
Nov 28 10:52:31 user nova-compute[74994]:       <entry name='version'>0.0.0</entry>
Nov 28 10:52:31 user nova-compute[74994]:       <entry name='serial'>c2925833-e88d-4aa7-a477-ff1bc1fcd724</entry>
Nov 28 10:52:31 user nova-compute[74994]:       <entry name='uuid'>c2925833-e88d-4aa7-a477-ff1bc1fcd724</entry>
Nov 28 10:52:31 user nova-compute[74994]:       <entry name='family'>Virtual Machine</entry>
Nov 28 10:52:31 user nova-compute[74994]:     </system>
Nov 28 10:52:31 user nova-compute[74994]:   </sysinfo>
Nov 28 10:52:31 user nova-compute[74994]:   <os>
Nov 28 10:52:31 user nova-compute[74994]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 28 10:52:31 user nova-compute[74994]:     <boot dev='hd'/>
Nov 28 10:52:31 user nova-compute[74994]:     <smbios mode='sysinfo'/>
Nov 28 10:52:31 user nova-compute[74994]:   </os>
Nov 28 10:52:31 user nova-compute[74994]:   <features>
Nov 28 10:52:31 user nova-compute[74994]:     <acpi/>
Nov 28 10:52:31 user nova-compute[74994]:     <apic/>
Nov 28 10:52:31 user nova-compute[74994]:     <vmcoreinfo state='on'/>
Nov 28 10:52:31 user nova-compute[74994]:   </features>
Nov 28 10:52:31 user nova-compute[74994]:   <cpu mode='custom' match='exact' check='full'>
Nov 28 10:52:31 user nova-compute[74994]:     <model fallback='forbid'>Nehalem</model>
Nov 28 10:52:31 user nova-compute[74994]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 28 10:52:31 user nova-compute[74994]:     <feature policy='require' name='vme'/>
Nov 28 10:52:31 user nova-compute[74994]:     <feature policy='require' name='x2apic'/>
Nov 28 10:52:31 user nova-compute[74994]:     <feature policy='require' name='hypervisor'/>
Nov 28 10:52:31 user nova-compute[74994]:   </cpu>
Nov 28 10:52:31 user nova-compute[74994]:   <clock offset='utc'>
Nov 28 10:52:31 user nova-compute[74994]:     <timer name='pit' tickpolicy='delay'/>
Nov 28 10:52:31 user nova-compute[74994]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 28 10:52:31 user nova-compute[74994]:     <timer name='hpet' present='no'/>
Nov 28 10:52:31 user nova-compute[74994]:   </clock>
Nov 28 10:52:31 user nova-compute[74994]:   <on_poweroff>destroy</on_poweroff>
Nov 28 10:52:31 user nova-compute[74994]:   <on_reboot>restart</on_reboot>
Nov 28 10:52:31 user nova-compute[74994]:   <on_crash>destroy</on_crash>
Nov 28 10:52:31 user nova-compute[74994]:   <devices>
Nov 28 10:52:31 user nova-compute[74994]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 28 10:52:31 user nova-compute[74994]:     <disk type='file' device='disk'>
Nov 28 10:52:31 user nova-compute[74994]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 28 10:52:31 user nova-compute[74994]:       <source file='/opt/stack/data/nova/instances/c2925833-e88d-4aa7-a477-ff1bc1fcd724/disk' index='2'/>
Nov 28 10:52:31 user nova-compute[74994]:       <backingStore type='file' index='3'>
Nov 28 10:52:31 user nova-compute[74994]:         <format type='raw'/>
Nov 28 10:52:31 user nova-compute[74994]:         <source file='/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188'/>
Nov 28 10:52:31 user nova-compute[74994]:         <backingStore/>
Nov 28 10:52:31 user nova-compute[74994]:       </backingStore>
Nov 28 10:52:31 user nova-compute[74994]:       <target dev='vda' bus='virtio'/>
Nov 28 10:52:31 user nova-compute[74994]:       <alias name='virtio-disk0'/>
Nov 28 10:52:31 user nova-compute[74994]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 28 10:52:31 user nova-compute[74994]:     </disk>
Nov 28 10:52:31 user nova-compute[74994]:     <disk type='file' device='cdrom'>
Nov 28 10:52:31 user nova-compute[74994]:       <driver name='qemu' type='raw' cache='none'/>
Nov 28 10:52:31 user nova-compute[74994]:       <source file='/opt/stack/data/nova/instances/c2925833-e88d-4aa7-a477-ff1bc1fcd724/disk.config' index='1'/>
Nov 28 10:52:31 user nova-compute[74994]:       <backingStore/>
Nov 28 10:52:31 user nova-compute[74994]:       <target dev='hda' bus='ide'/>
Nov 28 10:52:31 user nova-compute[74994]:       <readonly/>
Nov 28 10:52:31 user nova-compute[74994]:       <alias name='ide0-0-0'/>
Nov 28 10:52:31 user nova-compute[74994]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 28 10:52:31 user nova-compute[74994]:     </disk>
Nov 28 10:52:31 user nova-compute[74994]:     <controller type='usb' index='0' model='none'>
Nov 28 10:52:31 user nova-compute[74994]:       <alias name='usb'/>
Nov 28 10:52:31 user nova-compute[74994]:     </controller>
Nov 28 10:52:31 user nova-compute[74994]:     <controller type='pci' index='0' model='pci-root'>
Nov 28 10:52:31 user nova-compute[74994]:       <alias name='pci.0'/>
Nov 28 10:52:31 user nova-compute[74994]:     </controller>
Nov 28 10:52:31 user nova-compute[74994]:     <controller type='ide' index='0'>
Nov 28 10:52:31 user nova-compute[74994]:       <alias name='ide'/>
Nov 28 10:52:31 user nova-compute[74994]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 28 10:52:31 user nova-compute[74994]:     </controller>
Nov 28 10:52:31 user nova-compute[74994]:     <interface type='ethernet'>
Nov 28 10:52:31 user nova-compute[74994]:       <mac address='fa:16:3e:a4:4b:1f'/>
Nov 28 10:52:31 user nova-compute[74994]:       <target dev='tap752a5c48-15'/>
Nov 28 10:52:31 user nova-compute[74994]:       <model type='virtio'/>
Nov 28 10:52:31 user nova-compute[74994]:       <mtu size='1442'/>
Nov 28 10:52:31 user nova-compute[74994]:       <alias name='net0'/>
Nov 28 10:52:31 user nova-compute[74994]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 28 10:52:31 user nova-compute[74994]:     </interface>
Nov 28 10:52:31 user nova-compute[74994]:     <serial type='pty'>
Nov 28 10:52:31 user nova-compute[74994]:       <source path='/dev/pts/9'/>
Nov 28 10:52:31 user nova-compute[74994]:       <log file='/opt/stack/data/nova/instances/c2925833-e88d-4aa7-a477-ff1bc1fcd724/console.log' append='off'/>
Nov 28 10:52:31 user nova-compute[74994]:       <target type='isa-serial' port='0'>
Nov 28 10:52:31 user nova-compute[74994]:         <model name='isa-serial'/>
Nov 28 10:52:31 user nova-compute[74994]:       </target>
Nov 28 10:52:31 user nova-compute[74994]:       <alias name='serial0'/>
Nov 28 10:52:31 user nova-compute[74994]:     </serial>
Nov 28 10:52:31 user nova-compute[74994]:     <console type='pty' tty='/dev/pts/9'>
Nov 28 10:52:31 user nova-compute[74994]:       <source path='/dev/pts/9'/>
Nov 28 10:52:31 user nova-compute[74994]:       <log file='/opt/stack/data/nova/instances/c2925833-e88d-4aa7-a477-ff1bc1fcd724/console.log' append='off'/>
Nov 28 10:52:31 user nova-compute[74994]:       <target type='serial' port='0'/>
Nov 28 10:52:31 user nova-compute[74994]:       <alias name='serial0'/>
Nov 28 10:52:31 user nova-compute[74994]:     </console>
Nov 28 10:52:31 user nova-compute[74994]:     <input type='mouse' bus='ps2'>
Nov 28 10:52:31 user nova-compute[74994]:       <alias name='input0'/>
Nov 28 10:52:31 user nova-compute[74994]:     </input>
Nov 28 10:52:31 user nova-compute[74994]:     <input type='keyboard' bus='ps2'>
Nov 28 10:52:31 user nova-compute[74994]:       <alias name='input1'/>
Nov 28 10:52:31 user nova-compute[74994]:     </input>
Nov 28 10:52:31 user nova-compute[74994]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Nov 28 10:52:31 user nova-compute[74994]:       <listen type='address' address='0.0.0.0'/>
Nov 28 10:52:31 user nova-compute[74994]:     </graphics>
Nov 28 10:52:31 user nova-compute[74994]:     <audio id='1' type='none'/>
Nov 28 10:52:31 user nova-compute[74994]:     <video>
Nov 28 10:52:31 user nova-compute[74994]:       <model type='virtio' heads='1' primary='yes'/>
Nov 28 10:52:31 user nova-compute[74994]:       <alias name='video0'/>
Nov 28 10:52:31 user nova-compute[74994]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 28 10:52:31 user nova-compute[74994]:     </video>
Nov 28 10:52:31 user nova-compute[74994]:     <memballoon model='virtio'>
Nov 28 10:52:31 user nova-compute[74994]:       <stats period='10'/>
Nov 28 10:52:31 user nova-compute[74994]:       <alias name='balloon0'/>
Nov 28 10:52:31 user nova-compute[74994]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 28 10:52:31 user nova-compute[74994]:     </memballoon>
Nov 28 10:52:31 user nova-compute[74994]:     <rng model='virtio'>
Nov 28 10:52:31 user nova-compute[74994]:       <backend model='random'>/dev/urandom</backend>
Nov 28 10:52:31 user nova-compute[74994]:       <alias name='rng0'/>
Nov 28 10:52:31 user nova-compute[74994]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 28 10:52:31 user nova-compute[74994]:     </rng>
Nov 28 10:52:31 user nova-compute[74994]:   </devices>
Nov 28 10:52:31 user nova-compute[74994]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 28 10:52:31 user nova-compute[74994]:     <label>libvirt-c2925833-e88d-4aa7-a477-ff1bc1fcd724</label>
Nov 28 10:52:31 user nova-compute[74994]:     <imagelabel>libvirt-c2925833-e88d-4aa7-a477-ff1bc1fcd724</imagelabel>
Nov 28 10:52:31 user nova-compute[74994]:   </seclabel>
Nov 28 10:52:31 user nova-compute[74994]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 28 10:52:31 user nova-compute[74994]:     <label>+64055:+108</label>
Nov 28 10:52:31 user nova-compute[74994]:     <imagelabel>+64055:+108</imagelabel>
Nov 28 10:52:31 user nova-compute[74994]:   </seclabel>
Nov 28 10:52:31 user nova-compute[74994]: </domain>
Nov 28 10:52:31 user nova-compute[74994]:  {{(pid=74994) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 28 10:52:31 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [req-6a103b7e-8aa8-4528-bccd-74b5c07d5b95 req-441759e5-5e32-4a36-b33c-26105115a3c0 service nova] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Detaching interface fa:16:3e:e4:1f:d6 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap9ecf4395-d0' not found.
Nov 28 10:52:31 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [req-6a103b7e-8aa8-4528-bccd-74b5c07d5b95 req-441759e5-5e32-4a36-b33c-26105115a3c0 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:49:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-185346772',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-185346772',id=10,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKb7DfQBhl9KQjX/Jy4TL5O6PXWUKL+vLgAOjfX/Q0BbK/dfYX/kuDxa2AyyjG8Tr6w0nPvpMGRLCsCXhPfUwNG1BTBUaGDIyyYhGnKPl0/QavZSldUeJCV0yh5hnereZw==',key_name='tempest-keypair-433898378',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:49:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a1413a02a3034130b4a4ec170ca2fc16',ramdisk_id='',reservation_id='r-z554pke2',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1012374446',owner_user_name='tempest-TaggedAttachmentsTest-1012374446-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T10:49:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02983082e29345a491ecd8fe18268b84',uuid=c2925833-e88d-4aa7-a477-ff1bc1fcd724,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ecf4395-d083-44c8-8cf4-d4987884c1aa", "address": "fa:16:3e:e4:1f:d6", "network": {"id": "00554ee0-49a7-42fd-b0c6-7dc89c5a90a7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-321761758", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a1413a02a3034130b4a4ec170ca2fc16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ecf4395-d0", "ovs_interfaceid": "9ecf4395-d083-44c8-8cf4-d4987884c1aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 10:52:31 user nova-compute[74994]: DEBUG nova.network.os_vif_util [req-6a103b7e-8aa8-4528-bccd-74b5c07d5b95 req-441759e5-5e32-4a36-b33c-26105115a3c0 service nova] Converting VIF {"id": "9ecf4395-d083-44c8-8cf4-d4987884c1aa", "address": "fa:16:3e:e4:1f:d6", "network": {"id": "00554ee0-49a7-42fd-b0c6-7dc89c5a90a7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-321761758", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a1413a02a3034130b4a4ec170ca2fc16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ecf4395-d0", "ovs_interfaceid": "9ecf4395-d083-44c8-8cf4-d4987884c1aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:52:31 user nova-compute[74994]: DEBUG nova.network.os_vif_util [req-6a103b7e-8aa8-4528-bccd-74b5c07d5b95 req-441759e5-5e32-4a36-b33c-26105115a3c0 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:1f:d6,bridge_name='br-int',has_traffic_filtering=True,id=9ecf4395-d083-44c8-8cf4-d4987884c1aa,network=Network(00554ee0-49a7-42fd-b0c6-7dc89c5a90a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ecf4395-d0') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:52:31 user nova-compute[74994]: DEBUG os_vif [req-6a103b7e-8aa8-4528-bccd-74b5c07d5b95 req-441759e5-5e32-4a36-b33c-26105115a3c0 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:1f:d6,bridge_name='br-int',has_traffic_filtering=True,id=9ecf4395-d083-44c8-8cf4-d4987884c1aa,network=Network(00554ee0-49a7-42fd-b0c6-7dc89c5a90a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ecf4395-d0') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 10:52:31 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:31 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9ecf4395-d0, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:52:31 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 10:52:31 user nova-compute[74994]: INFO os_vif [req-6a103b7e-8aa8-4528-bccd-74b5c07d5b95 req-441759e5-5e32-4a36-b33c-26105115a3c0 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:1f:d6,bridge_name='br-int',has_traffic_filtering=True,id=9ecf4395-d083-44c8-8cf4-d4987884c1aa,network=Network(00554ee0-49a7-42fd-b0c6-7dc89c5a90a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ecf4395-d0')
Nov 28 10:52:31 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [req-6a103b7e-8aa8-4528-bccd-74b5c07d5b95 req-441759e5-5e32-4a36-b33c-26105115a3c0 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 10:52:31 user nova-compute[74994]:   <nova:package version="0.0.0"/>
Nov 28 10:52:31 user nova-compute[74994]:   <nova:name>tempest-device-tagging-server-185346772</nova:name>
Nov 28 10:52:31 user nova-compute[74994]:   <nova:creationTime>2023-11-28 10:52:31</nova:creationTime>
Nov 28 10:52:31 user nova-compute[74994]:   <nova:flavor name="m1.tiny">
Nov 28 10:52:31 user nova-compute[74994]:     <nova:memory>512</nova:memory>
Nov 28 10:52:31 user nova-compute[74994]:     <nova:disk>1</nova:disk>
Nov 28 10:52:31 user nova-compute[74994]:     <nova:swap>0</nova:swap>
Nov 28 10:52:31 user nova-compute[74994]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 10:52:31 user nova-compute[74994]:     <nova:vcpus>1</nova:vcpus>
Nov 28 10:52:31 user nova-compute[74994]:   </nova:flavor>
Nov 28 10:52:31 user nova-compute[74994]:   <nova:owner>
Nov 28 10:52:31 user nova-compute[74994]:     <nova:user uuid="02983082e29345a491ecd8fe18268b84">tempest-TaggedAttachmentsTest-1012374446-project-member</nova:user>
Nov 28 10:52:31 user nova-compute[74994]:     <nova:project uuid="a1413a02a3034130b4a4ec170ca2fc16">tempest-TaggedAttachmentsTest-1012374446</nova:project>
Nov 28 10:52:31 user nova-compute[74994]:   </nova:owner>
Nov 28 10:52:31 user nova-compute[74994]:   <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 10:52:31 user nova-compute[74994]:   <nova:ports>
Nov 28 10:52:31 user nova-compute[74994]:     <nova:port uuid="752a5c48-15a2-443c-911c-f1a0c33ca925">
Nov 28 10:52:31 user nova-compute[74994]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 10:52:31 user nova-compute[74994]:     </nova:port>
Nov 28 10:52:31 user nova-compute[74994]:   </nova:ports>
Nov 28 10:52:31 user nova-compute[74994]: </nova:instance>
Nov 28 10:52:31 user nova-compute[74994]:  {{(pid=74994) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 28 10:52:31 user nova-compute[74994]: INFO nova.network.neutron [None req-62447626-40e3-484f-af67-4671c9140b74 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Port 9ecf4395-d083-44c8-8cf4-d4987884c1aa from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Nov 28 10:52:31 user nova-compute[74994]: DEBUG nova.network.neutron [None req-62447626-40e3-484f-af67-4671c9140b74 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Updating instance_info_cache with network_info: [{"id": "752a5c48-15a2-443c-911c-f1a0c33ca925", "address": "fa:16:3e:a4:4b:1f", "network": {"id": "92ee00e3-fc9c-459d-9dac-4ef40e592023", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2069871364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1413a02a3034130b4a4ec170ca2fc16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap752a5c48-15", "ovs_interfaceid": "752a5c48-15a2-443c-911c-f1a0c33ca925", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:52:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-62447626-40e3-484f-af67-4671c9140b74 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Releasing lock "refresh_cache-c2925833-e88d-4aa7-a477-ff1bc1fcd724" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:52:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-62447626-40e3-484f-af67-4671c9140b74 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Lock "interface-c2925833-e88d-4aa7-a477-ff1bc1fcd724-9ecf4395-d083-44c8-8cf4-d4987884c1aa" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.544s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:52:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Acquiring lock "034bca55-d0dc-4d62-b95e-38bf26fee4a0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:52:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lock "034bca55-d0dc-4d62-b95e-38bf26fee4a0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:52:32 user nova-compute[74994]: DEBUG nova.compute.manager [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 10:52:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:52:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:52:32 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 10:52:32 user nova-compute[74994]: INFO nova.compute.claims [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Claim successful on node user
Nov 28 10:52:33 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:52:33 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:52:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.801s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:52:33 user nova-compute[74994]: DEBUG nova.compute.manager [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 10:52:33 user nova-compute[74994]: DEBUG nova.compute.manager [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 10:52:33 user nova-compute[74994]: DEBUG nova.network.neutron [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 10:52:33 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 10:52:33 user nova-compute[74994]: DEBUG nova.compute.manager [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 10:52:33 user nova-compute[74994]: DEBUG nova.policy [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5bb3c1cbcd954e789f4a462aca3cf25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf57a964f98428c95cf169927522860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 10:52:33 user nova-compute[74994]: DEBUG nova.compute.manager [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 10:52:33 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 10:52:33 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Creating image(s)
Nov 28 10:52:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Acquiring lock "/opt/stack/data/nova/instances/034bca55-d0dc-4d62-b95e-38bf26fee4a0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:52:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lock "/opt/stack/data/nova/instances/034bca55-d0dc-4d62-b95e-38bf26fee4a0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:52:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lock "/opt/stack/data/nova/instances/034bca55-d0dc-4d62-b95e-38bf26fee4a0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:52:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.174s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Acquiring lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:52:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:52:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:34 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.179s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:34 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/034bca55-d0dc-4d62-b95e-38bf26fee4a0/disk 1073741824 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:34 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/034bca55-d0dc-4d62-b95e-38bf26fee4a0/disk 1073741824" returned: 0 in 0.051s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:52:34 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:34 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.189s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:34 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Checking if we can resize image /opt/stack/data/nova/instances/034bca55-d0dc-4d62-b95e-38bf26fee4a0/disk. size=1073741824 {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 10:52:34 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034bca55-d0dc-4d62-b95e-38bf26fee4a0/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:34 user nova-compute[74994]: DEBUG nova.network.neutron [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Successfully created port: 4630452f-98fd-475e-aac8-fc2a6fb6d82f {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 10:52:34 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034bca55-d0dc-4d62-b95e-38bf26fee4a0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:34 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Cannot resize image /opt/stack/data/nova/instances/034bca55-d0dc-4d62-b95e-38bf26fee4a0/disk to a smaller size. {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 10:52:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Created local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 10:52:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Ensure instance console log exists: /opt/stack/data/nova/instances/034bca55-d0dc-4d62-b95e-38bf26fee4a0/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 10:52:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:52:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:52:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG nova.network.neutron [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Successfully updated port: 4630452f-98fd-475e-aac8-fc2a6fb6d82f {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Acquiring lock "refresh_cache-034bca55-d0dc-4d62-b95e-38bf26fee4a0" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Acquired lock "refresh_cache-034bca55-d0dc-4d62-b95e-38bf26fee4a0" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG nova.network.neutron [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG nova.compute.manager [req-0dcb73ef-8465-4db5-bfb5-09ae041a99ee req-72c7d1b4-041f-43d1-8946-e110378f7eea service nova] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Received event network-changed-4630452f-98fd-475e-aac8-fc2a6fb6d82f {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG nova.compute.manager [req-0dcb73ef-8465-4db5-bfb5-09ae041a99ee req-72c7d1b4-041f-43d1-8946-e110378f7eea service nova] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Refreshing instance network info cache due to event network-changed-4630452f-98fd-475e-aac8-fc2a6fb6d82f. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-0dcb73ef-8465-4db5-bfb5-09ae041a99ee req-72c7d1b4-041f-43d1-8946-e110378f7eea service nova] Acquiring lock "refresh_cache-034bca55-d0dc-4d62-b95e-38bf26fee4a0" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG nova.network.neutron [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG nova.network.neutron [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Updating instance_info_cache with network_info: [{"id": "4630452f-98fd-475e-aac8-fc2a6fb6d82f", "address": "fa:16:3e:f3:0e:26", "network": {"id": "fcf8118a-9224-4f12-b8cc-2936753d9e61", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1394689629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf57a964f98428c95cf169927522860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4630452f-98", "ovs_interfaceid": "4630452f-98fd-475e-aac8-fc2a6fb6d82f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Releasing lock "refresh_cache-034bca55-d0dc-4d62-b95e-38bf26fee4a0" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG nova.compute.manager [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Instance network_info: |[{"id": "4630452f-98fd-475e-aac8-fc2a6fb6d82f", "address": "fa:16:3e:f3:0e:26", "network": {"id": "fcf8118a-9224-4f12-b8cc-2936753d9e61", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1394689629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf57a964f98428c95cf169927522860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4630452f-98", "ovs_interfaceid": "4630452f-98fd-475e-aac8-fc2a6fb6d82f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-0dcb73ef-8465-4db5-bfb5-09ae041a99ee req-72c7d1b4-041f-43d1-8946-e110378f7eea service nova] Acquired lock "refresh_cache-034bca55-d0dc-4d62-b95e-38bf26fee4a0" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG nova.network.neutron [req-0dcb73ef-8465-4db5-bfb5-09ae041a99ee req-72c7d1b4-041f-43d1-8946-e110378f7eea service nova] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Refreshing network info cache for port 4630452f-98fd-475e-aac8-fc2a6fb6d82f {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Start _get_guest_xml network_info=[{"id": "4630452f-98fd-475e-aac8-fc2a6fb6d82f", "address": "fa:16:3e:f3:0e:26", "network": {"id": "fcf8118a-9224-4f12-b8cc-2936753d9e61", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1394689629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf57a964f98428c95cf169927522860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4630452f-98", "ovs_interfaceid": "4630452f-98fd-475e-aac8-fc2a6fb6d82f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'aa939d1b-b8a6-4391-935b-0191bf5ccd0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 10:52:35 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:52:35 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:52:35 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:52:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1788532294',display_name='tempest-VolumesAdminNegativeTest-server-1788532294',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1788532294',id=16,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5cf57a964f98428c95cf169927522860',ramdisk_id='',reservation_id='r-1l0ru058',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-230929412',owner_user_name='tempest-VolumesAdminNegativeTest-230929412-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:52:34Z,user_data=None,user_id='5bb3c1cbcd954e789f4a462aca3cf25d',uuid=034bca55-d0dc-4d62-b95e-38bf26fee4a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4630452f-98fd-475e-aac8-fc2a6fb6d82f", "address": "fa:16:3e:f3:0e:26", "network": {"id": "fcf8118a-9224-4f12-b8cc-2936753d9e61", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1394689629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf57a964f98428c95cf169927522860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4630452f-98", "ovs_interfaceid": "4630452f-98fd-475e-aac8-fc2a6fb6d82f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Converting VIF {"id": "4630452f-98fd-475e-aac8-fc2a6fb6d82f", "address": "fa:16:3e:f3:0e:26", "network": {"id": "fcf8118a-9224-4f12-b8cc-2936753d9e61", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1394689629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf57a964f98428c95cf169927522860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4630452f-98", "ovs_interfaceid": "4630452f-98fd-475e-aac8-fc2a6fb6d82f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:0e:26,bridge_name='br-int',has_traffic_filtering=True,id=4630452f-98fd-475e-aac8-fc2a6fb6d82f,network=Network(fcf8118a-9224-4f12-b8cc-2936753d9e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4630452f-98') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG nova.objects.instance [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lazy-loading 'pci_devices' on Instance uuid 034bca55-d0dc-4d62-b95e-38bf26fee4a0 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] End _get_guest_xml xml=<domain type="kvm">
Nov 28 10:52:35 user nova-compute[74994]:   <uuid>034bca55-d0dc-4d62-b95e-38bf26fee4a0</uuid>
Nov 28 10:52:35 user nova-compute[74994]:   <name>instance-00000010</name>
Nov 28 10:52:35 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 10:52:35 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 10:52:35 user nova-compute[74994]:   <metadata>
Nov 28 10:52:35 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 10:52:35 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 10:52:35 user nova-compute[74994]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1788532294</nova:name>
Nov 28 10:52:35 user nova-compute[74994]:       <nova:creationTime>2023-11-28 10:52:35</nova:creationTime>
Nov 28 10:52:35 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 10:52:35 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 10:52:35 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 10:52:35 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 10:52:35 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 10:52:35 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 10:52:35 user nova-compute[74994]:       </nova:flavor>
Nov 28 10:52:35 user nova-compute[74994]:       <nova:owner>
Nov 28 10:52:35 user nova-compute[74994]:         <nova:user uuid="5bb3c1cbcd954e789f4a462aca3cf25d">tempest-VolumesAdminNegativeTest-230929412-project-member</nova:user>
Nov 28 10:52:35 user nova-compute[74994]:         <nova:project uuid="5cf57a964f98428c95cf169927522860">tempest-VolumesAdminNegativeTest-230929412</nova:project>
Nov 28 10:52:35 user nova-compute[74994]:       </nova:owner>
Nov 28 10:52:35 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 10:52:35 user nova-compute[74994]:       <nova:ports>
Nov 28 10:52:35 user nova-compute[74994]:         <nova:port uuid="4630452f-98fd-475e-aac8-fc2a6fb6d82f">
Nov 28 10:52:35 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 10:52:35 user nova-compute[74994]:         </nova:port>
Nov 28 10:52:35 user nova-compute[74994]:       </nova:ports>
Nov 28 10:52:35 user nova-compute[74994]:     </nova:instance>
Nov 28 10:52:35 user nova-compute[74994]:   </metadata>
Nov 28 10:52:35 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 10:52:35 user nova-compute[74994]:     <system>
Nov 28 10:52:35 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 10:52:35 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 10:52:35 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 10:52:35 user nova-compute[74994]:       <entry name="serial">034bca55-d0dc-4d62-b95e-38bf26fee4a0</entry>
Nov 28 10:52:35 user nova-compute[74994]:       <entry name="uuid">034bca55-d0dc-4d62-b95e-38bf26fee4a0</entry>
Nov 28 10:52:35 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 10:52:35 user nova-compute[74994]:     </system>
Nov 28 10:52:35 user nova-compute[74994]:   </sysinfo>
Nov 28 10:52:35 user nova-compute[74994]:   <os>
Nov 28 10:52:35 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 10:52:35 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 10:52:35 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 10:52:35 user nova-compute[74994]:   </os>
Nov 28 10:52:35 user nova-compute[74994]:   <features>
Nov 28 10:52:35 user nova-compute[74994]:     <acpi/>
Nov 28 10:52:35 user nova-compute[74994]:     <apic/>
Nov 28 10:52:35 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 10:52:35 user nova-compute[74994]:   </features>
Nov 28 10:52:35 user nova-compute[74994]:   <clock offset="utc">
Nov 28 10:52:35 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 10:52:35 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 10:52:35 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 10:52:35 user nova-compute[74994]:   </clock>
Nov 28 10:52:35 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 10:52:35 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 10:52:35 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 10:52:35 user nova-compute[74994]:   </cpu>
Nov 28 10:52:35 user nova-compute[74994]:   <devices>
Nov 28 10:52:35 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 10:52:35 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 10:52:35 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/034bca55-d0dc-4d62-b95e-38bf26fee4a0/disk"/>
Nov 28 10:52:35 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 10:52:35 user nova-compute[74994]:     </disk>
Nov 28 10:52:35 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 10:52:35 user nova-compute[74994]:       <mac address="fa:16:3e:f3:0e:26"/>
Nov 28 10:52:35 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:52:35 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 10:52:35 user nova-compute[74994]:       <target dev="tap4630452f-98"/>
Nov 28 10:52:35 user nova-compute[74994]:     </interface>
Nov 28 10:52:35 user nova-compute[74994]:     <serial type="pty">
Nov 28 10:52:35 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/034bca55-d0dc-4d62-b95e-38bf26fee4a0/console.log" append="off"/>
Nov 28 10:52:35 user nova-compute[74994]:     </serial>
Nov 28 10:52:35 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 10:52:35 user nova-compute[74994]:     <video>
Nov 28 10:52:35 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:52:35 user nova-compute[74994]:     </video>
Nov 28 10:52:35 user nova-compute[74994]:     <rng model="virtio">
Nov 28 10:52:35 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 10:52:35 user nova-compute[74994]:     </rng>
Nov 28 10:52:35 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 10:52:35 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 10:52:35 user nova-compute[74994]:       <stats period="10"/>
Nov 28 10:52:35 user nova-compute[74994]:     </memballoon>
Nov 28 10:52:35 user nova-compute[74994]:   </devices>
Nov 28 10:52:35 user nova-compute[74994]: </domain>
Nov 28 10:52:35 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:52:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1788532294',display_name='tempest-VolumesAdminNegativeTest-server-1788532294',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1788532294',id=16,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5cf57a964f98428c95cf169927522860',ramdisk_id='',reservation_id='r-1l0ru058',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-230929412',owner_user_name='tempest-VolumesAdminNegativeTest-230929412-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:52:34Z,user_data=None,user_id='5bb3c1cbcd954e789f4a462aca3cf25d',uuid=034bca55-d0dc-4d62-b95e-38bf26fee4a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4630452f-98fd-475e-aac8-fc2a6fb6d82f", "address": "fa:16:3e:f3:0e:26", "network": {"id": "fcf8118a-9224-4f12-b8cc-2936753d9e61", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1394689629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf57a964f98428c95cf169927522860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4630452f-98", "ovs_interfaceid": "4630452f-98fd-475e-aac8-fc2a6fb6d82f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Converting VIF {"id": "4630452f-98fd-475e-aac8-fc2a6fb6d82f", "address": "fa:16:3e:f3:0e:26", "network": {"id": "fcf8118a-9224-4f12-b8cc-2936753d9e61", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1394689629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf57a964f98428c95cf169927522860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4630452f-98", "ovs_interfaceid": "4630452f-98fd-475e-aac8-fc2a6fb6d82f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:0e:26,bridge_name='br-int',has_traffic_filtering=True,id=4630452f-98fd-475e-aac8-fc2a6fb6d82f,network=Network(fcf8118a-9224-4f12-b8cc-2936753d9e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4630452f-98') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG os_vif [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:0e:26,bridge_name='br-int',has_traffic_filtering=True,id=4630452f-98fd-475e-aac8-fc2a6fb6d82f,network=Network(fcf8118a-9224-4f12-b8cc-2936753d9e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4630452f-98') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1ab647de-3516-55f8-b551-35e1c715f3a7', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4630452f-98, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4630452f-98, col_values=(('qos', UUID('6e6444fb-31ad-4836-8494-d8dc07d002a3')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4630452f-98, col_values=(('external_ids', {'iface-id': '4630452f-98fd-475e-aac8-fc2a6fb6d82f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:0e:26', 'vm-uuid': '034bca55-d0dc-4d62-b95e-38bf26fee4a0'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:35 user nova-compute[74994]: INFO os_vif [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:0e:26,bridge_name='br-int',has_traffic_filtering=True,id=4630452f-98fd-475e-aac8-fc2a6fb6d82f,network=Network(fcf8118a-9224-4f12-b8cc-2936753d9e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4630452f-98')
Nov 28 10:52:35 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] No VIF found with MAC fa:16:3e:f3:0e:26, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG nova.network.neutron [req-0dcb73ef-8465-4db5-bfb5-09ae041a99ee req-72c7d1b4-041f-43d1-8946-e110378f7eea service nova] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Updated VIF entry in instance network info cache for port 4630452f-98fd-475e-aac8-fc2a6fb6d82f. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG nova.network.neutron [req-0dcb73ef-8465-4db5-bfb5-09ae041a99ee req-72c7d1b4-041f-43d1-8946-e110378f7eea service nova] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Updating instance_info_cache with network_info: [{"id": "4630452f-98fd-475e-aac8-fc2a6fb6d82f", "address": "fa:16:3e:f3:0e:26", "network": {"id": "fcf8118a-9224-4f12-b8cc-2936753d9e61", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1394689629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf57a964f98428c95cf169927522860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4630452f-98", "ovs_interfaceid": "4630452f-98fd-475e-aac8-fc2a6fb6d82f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:52:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-0dcb73ef-8465-4db5-bfb5-09ae041a99ee req-72c7d1b4-041f-43d1-8946-e110378f7eea service nova] Releasing lock "refresh_cache-034bca55-d0dc-4d62-b95e-38bf26fee4a0" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:52:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:37 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:37 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:37 user nova-compute[74994]: DEBUG nova.compute.manager [req-8bc1014b-92a4-428b-8bce-f19cdbfb44c0 req-8f45aef6-ecf0-4d06-adb1-c4b87dbe4618 service nova] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Received event network-vif-plugged-4630452f-98fd-475e-aac8-fc2a6fb6d82f {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:52:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8bc1014b-92a4-428b-8bce-f19cdbfb44c0 req-8f45aef6-ecf0-4d06-adb1-c4b87dbe4618 service nova] Acquiring lock "034bca55-d0dc-4d62-b95e-38bf26fee4a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:52:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8bc1014b-92a4-428b-8bce-f19cdbfb44c0 req-8f45aef6-ecf0-4d06-adb1-c4b87dbe4618 service nova] Lock "034bca55-d0dc-4d62-b95e-38bf26fee4a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:52:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8bc1014b-92a4-428b-8bce-f19cdbfb44c0 req-8f45aef6-ecf0-4d06-adb1-c4b87dbe4618 service nova] Lock "034bca55-d0dc-4d62-b95e-38bf26fee4a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:52:37 user nova-compute[74994]: DEBUG nova.compute.manager [req-8bc1014b-92a4-428b-8bce-f19cdbfb44c0 req-8f45aef6-ecf0-4d06-adb1-c4b87dbe4618 service nova] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] No waiting events found dispatching network-vif-plugged-4630452f-98fd-475e-aac8-fc2a6fb6d82f {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:52:37 user nova-compute[74994]: WARNING nova.compute.manager [req-8bc1014b-92a4-428b-8bce-f19cdbfb44c0 req-8f45aef6-ecf0-4d06-adb1-c4b87dbe4618 service nova] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Received unexpected event network-vif-plugged-4630452f-98fd-475e-aac8-fc2a6fb6d82f for instance with vm_state building and task_state spawning.
Nov 28 10:52:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG nova.compute.manager [req-b7322102-47f7-4532-83d9-07fc85e289b7 req-706182ed-ae0c-4bac-aadd-27f960051bd5 service nova] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Received event network-vif-plugged-4630452f-98fd-475e-aac8-fc2a6fb6d82f {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-b7322102-47f7-4532-83d9-07fc85e289b7 req-706182ed-ae0c-4bac-aadd-27f960051bd5 service nova] Acquiring lock "034bca55-d0dc-4d62-b95e-38bf26fee4a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-b7322102-47f7-4532-83d9-07fc85e289b7 req-706182ed-ae0c-4bac-aadd-27f960051bd5 service nova] Lock "034bca55-d0dc-4d62-b95e-38bf26fee4a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-b7322102-47f7-4532-83d9-07fc85e289b7 req-706182ed-ae0c-4bac-aadd-27f960051bd5 service nova] Lock "034bca55-d0dc-4d62-b95e-38bf26fee4a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG nova.compute.manager [req-b7322102-47f7-4532-83d9-07fc85e289b7 req-706182ed-ae0c-4bac-aadd-27f960051bd5 service nova] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] No waiting events found dispatching network-vif-plugged-4630452f-98fd-475e-aac8-fc2a6fb6d82f {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:52:39 user nova-compute[74994]: WARNING nova.compute.manager [req-b7322102-47f7-4532-83d9-07fc85e289b7 req-706182ed-ae0c-4bac-aadd-27f960051bd5 service nova] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Received unexpected event network-vif-plugged-4630452f-98fd-475e-aac8-fc2a6fb6d82f for instance with vm_state building and task_state spawning.
Nov 28 10:52:39 user nova-compute[74994]: DEBUG nova.compute.manager [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 10:52:39 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Instance spawned successfully.
Nov 28 10:52:39 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:52:39 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-2974d6c5-7cf8-42a9-8c2a-55bcd0e21f14 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a is timed out.
Nov 28 10:52:39 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-2974d6c5-7cf8-42a9-8c2a-55bcd0e21f14 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Successfully detached device vdb from instance 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a from the live domain config.
Nov 28 10:52:39 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2974d6c5-7cf8-42a9-8c2a-55bcd0e21f14 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2974d6c5-7cf8-42a9-8c2a-55bcd0e21f14 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KojpQYLe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '37a2129a-a661-403a-9a9f-29e54191e56b'}, None), 'kwargs': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:52:39 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-2974d6c5-7cf8-42a9-8c2a-55bcd0e21f14 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:52:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-2974d6c5-7cf8-42a9-8c2a-55bcd0e21f14 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-2974d6c5-7cf8-42a9-8c2a-55bcd0e21f14 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:39 user nova-compute[74994]: INFO nova.compute.manager [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Took 5.77 seconds to spawn the instance on the hypervisor.
Nov 28 10:52:39 user nova-compute[74994]: DEBUG nova.compute.manager [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43ca545-d45e-4acc-ab98-80237f84a3e0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2974d6c5-7cf8-42a9-8c2a-55bcd0e21f14 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 10:52:39 user nova-compute[74994]: No targets found.
Nov 28 10:52:39 user nova-compute[74994]: iSNS:
Nov 28 10:52:39 user nova-compute[74994]: No targets found.
Nov 28 10:52:39 user nova-compute[74994]: STATIC:
Nov 28 10:52:39 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b
Nov 28 10:52:39 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:52:39 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:52:39 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de
Nov 28 10:52:39 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:52:39 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:52:39 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f
Nov 28 10:52:39 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:52:39 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:52:39 user nova-compute[74994]: FIRMWARE:
Nov 28 10:52:39 user nova-compute[74994]: No targets found.
Nov 28 10:52:39 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2974d6c5-7cf8-42a9-8c2a-55bcd0e21f14 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 10:52:39 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 10:52:39 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2974d6c5-7cf8-42a9-8c2a-55bcd0e21f14 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d17ab47-dceb-4e91-948f-719a9fadf17b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a836fc1-ad56-4703-b676-39c1d5ab055a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2974d6c5-7cf8-42a9-8c2a-55bcd0e21f14 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)
Nov 28 10:52:39 user nova-compute[74994]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:52:39 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:52:39 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2974d6c5-7cf8-42a9-8c2a-55bcd0e21f14 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b (non-flash)
Nov 28 10:52:39 user nova-compute[74994]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:52:39 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:52:39 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2974d6c5-7cf8-42a9-8c2a-55bcd0e21f14 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb92071b760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b'): ({'sdf'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-2974d6c5-7cf8-42a9-8c2a-55bcd0e21f14 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Removing single pathed devices sdf {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1806658-9de5-47a5-9617-079498074213]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:39 user nova-compute[74994]: INFO nova.compute.manager [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Took 6.92 seconds to build instance.
Nov 28 10:52:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c93579-649c-48a3-a36c-7a595dd5e119]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-2974d6c5-7cf8-42a9-8c2a-55bcd0e21f14 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Flushing IO for device /dev/sdf {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ac8286fb-ac76-4f66-a9de-2ab37ee24bf9 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lock "034bca55-d0dc-4d62-b95e-38bf26fee4a0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.012s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e865b9ad-cf39-4fc3-904c-921643166538]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-2974d6c5-7cf8-42a9-8c2a-55bcd0e21f14 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.031s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d19be77-b24c-443c-8ebc-6ede12809be1]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-2974d6c5-7cf8-42a9-8c2a-55bcd0e21f14 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-2974d6c5-7cf8-42a9-8c2a-55bcd0e21f14 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] SCSI volumes sdf have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2974d6c5-7cf8-42a9-8c2a-55bcd0e21f14 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[577155c4-5d1f-46db-a8e4-2b348dad1e95]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2974d6c5-7cf8-42a9-8c2a-55bcd0e21f14 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c8169a-7b4e-472f-bcc9-a0f49b071aae]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2974d6c5-7cf8-42a9-8c2a-55bcd0e21f14 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b, portal: 172.16.0.220,3260]
Nov 28 10:52:39 user nova-compute[74994]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b, portal: 172.16.0.220,3260] successful.
Nov 28 10:52:39 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a2129a-a661-403a-9a9f-29e54191e56b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0f4bac-e633-4e47-af72-996690346f86]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2974d6c5-7cf8-42a9-8c2a-55bcd0e21f14 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-2974d6c5-7cf8-42a9-8c2a-55bcd0e21f14 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2974d6c5-7cf8-42a9-8c2a-55bcd0e21f14 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] <== disconnect_volume: return (292ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:52:39 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2974d6c5-7cf8-42a9-8c2a-55bcd0e21f14 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 10:52:40 user nova-compute[74994]: DEBUG nova.objects.instance [None req-2974d6c5-7cf8-42a9-8c2a-55bcd0e21f14 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Lazy-loading 'flavor' on Instance uuid 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:52:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2974d6c5-7cf8-42a9-8c2a-55bcd0e21f14 tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Lock "7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.703s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:52:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:45 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f5bd5699-0bd7-447b-8e87-145c2e742396 tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Acquiring lock "6e6a974e-3626-453c-8662-0d160f6e57de" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:52:45 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f5bd5699-0bd7-447b-8e87-145c2e742396 tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Lock "6e6a974e-3626-453c-8662-0d160f6e57de" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:52:45 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f5bd5699-0bd7-447b-8e87-145c2e742396 tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Acquiring lock "6e6a974e-3626-453c-8662-0d160f6e57de-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:52:45 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f5bd5699-0bd7-447b-8e87-145c2e742396 tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Lock "6e6a974e-3626-453c-8662-0d160f6e57de-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:52:45 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f5bd5699-0bd7-447b-8e87-145c2e742396 tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Lock "6e6a974e-3626-453c-8662-0d160f6e57de-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:52:45 user nova-compute[74994]: INFO nova.compute.manager [None req-f5bd5699-0bd7-447b-8e87-145c2e742396 tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Terminating instance
Nov 28 10:52:45 user nova-compute[74994]: DEBUG nova.compute.manager [None req-f5bd5699-0bd7-447b-8e87-145c2e742396 tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 10:52:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:45 user nova-compute[74994]: DEBUG nova.compute.manager [req-5f809889-a3a7-4d3a-9c2f-98bdfbae9232 req-65e3ef0f-44e4-4eef-b886-52409f4f85ff service nova] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Received event network-vif-unplugged-9854edad-1d5f-4ea8-bced-f1ae510e224a {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:52:45 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-5f809889-a3a7-4d3a-9c2f-98bdfbae9232 req-65e3ef0f-44e4-4eef-b886-52409f4f85ff service nova] Acquiring lock "6e6a974e-3626-453c-8662-0d160f6e57de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:52:45 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-5f809889-a3a7-4d3a-9c2f-98bdfbae9232 req-65e3ef0f-44e4-4eef-b886-52409f4f85ff service nova] Lock "6e6a974e-3626-453c-8662-0d160f6e57de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:52:45 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-5f809889-a3a7-4d3a-9c2f-98bdfbae9232 req-65e3ef0f-44e4-4eef-b886-52409f4f85ff service nova] Lock "6e6a974e-3626-453c-8662-0d160f6e57de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:52:45 user nova-compute[74994]: DEBUG nova.compute.manager [req-5f809889-a3a7-4d3a-9c2f-98bdfbae9232 req-65e3ef0f-44e4-4eef-b886-52409f4f85ff service nova] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] No waiting events found dispatching network-vif-unplugged-9854edad-1d5f-4ea8-bced-f1ae510e224a {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:52:45 user nova-compute[74994]: DEBUG nova.compute.manager [req-5f809889-a3a7-4d3a-9c2f-98bdfbae9232 req-65e3ef0f-44e4-4eef-b886-52409f4f85ff service nova] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Received event network-vif-unplugged-9854edad-1d5f-4ea8-bced-f1ae510e224a for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 10:52:46 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Instance destroyed successfully.
Nov 28 10:52:46 user nova-compute[74994]: DEBUG nova.objects.instance [None req-f5bd5699-0bd7-447b-8e87-145c2e742396 tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Lazy-loading 'resources' on Instance uuid 6e6a974e-3626-453c-8662-0d160f6e57de {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:52:46 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-f5bd5699-0bd7-447b-8e87-145c2e742396 tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:49:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-520088525',display_name='tempest-VolumesAssistedSnapshotsTest-server-520088525',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-520088525',id=11,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPo0BQ4NcEgut63xyqujvAXPIH9n9ipaH1zU5pISvY+ug4cvultl1EF5DdU5m0xCHfxRxrpeecbif2F+ggeipqUV4zRtcyknxlsgG3bW60m4ttldMggr5gTp1QPzEOn8gA==',key_name='tempest-keypair-281239307',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:49:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47e449ba25474e43973c86fedccea8c0',ramdisk_id='',reservation_id='r-geioep15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1511835418',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1511835418-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T10:49:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='789b88ca90ab4772a4b71c3d1dd6efbf',uuid=6e6a974e-3626-453c-8662-0d160f6e57de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9854edad-1d5f-4ea8-bced-f1ae510e224a", "address": "fa:16:3e:52:d1:90", "network": {"id": "d32e0d40-6adf-48ad-9316-b347b3ba6cf4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-883485495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e449ba25474e43973c86fedccea8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9854edad-1d", "ovs_interfaceid": "9854edad-1d5f-4ea8-bced-f1ae510e224a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 10:52:46 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-f5bd5699-0bd7-447b-8e87-145c2e742396 tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Converting VIF {"id": "9854edad-1d5f-4ea8-bced-f1ae510e224a", "address": "fa:16:3e:52:d1:90", "network": {"id": "d32e0d40-6adf-48ad-9316-b347b3ba6cf4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-883485495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47e449ba25474e43973c86fedccea8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9854edad-1d", "ovs_interfaceid": "9854edad-1d5f-4ea8-bced-f1ae510e224a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:52:46 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-f5bd5699-0bd7-447b-8e87-145c2e742396 tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:d1:90,bridge_name='br-int',has_traffic_filtering=True,id=9854edad-1d5f-4ea8-bced-f1ae510e224a,network=Network(d32e0d40-6adf-48ad-9316-b347b3ba6cf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9854edad-1d') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:52:46 user nova-compute[74994]: DEBUG os_vif [None req-f5bd5699-0bd7-447b-8e87-145c2e742396 tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:d1:90,bridge_name='br-int',has_traffic_filtering=True,id=9854edad-1d5f-4ea8-bced-f1ae510e224a,network=Network(d32e0d40-6adf-48ad-9316-b347b3ba6cf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9854edad-1d') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 10:52:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9854edad-1d, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:52:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:52:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=46780b65-1fb8-468b-b409-04ab611030a9) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:52:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:52:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:46 user nova-compute[74994]: INFO os_vif [None req-f5bd5699-0bd7-447b-8e87-145c2e742396 tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:d1:90,bridge_name='br-int',has_traffic_filtering=True,id=9854edad-1d5f-4ea8-bced-f1ae510e224a,network=Network(d32e0d40-6adf-48ad-9316-b347b3ba6cf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9854edad-1d')
Nov 28 10:52:46 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-f5bd5699-0bd7-447b-8e87-145c2e742396 tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Deleting instance files /opt/stack/data/nova/instances/6e6a974e-3626-453c-8662-0d160f6e57de_del
Nov 28 10:52:46 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-f5bd5699-0bd7-447b-8e87-145c2e742396 tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Deletion of /opt/stack/data/nova/instances/6e6a974e-3626-453c-8662-0d160f6e57de_del complete
Nov 28 10:52:46 user nova-compute[74994]: INFO nova.compute.manager [None req-f5bd5699-0bd7-447b-8e87-145c2e742396 tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 28 10:52:46 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-f5bd5699-0bd7-447b-8e87-145c2e742396 tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 10:52:46 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 10:52:46 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 10:52:47 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:52:47 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Took 0.62 seconds to deallocate network for instance.
Nov 28 10:52:47 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f5bd5699-0bd7-447b-8e87-145c2e742396 tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:52:47 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f5bd5699-0bd7-447b-8e87-145c2e742396 tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:52:47 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-f5bd5699-0bd7-447b-8e87-145c2e742396 tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:52:47 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-f5bd5699-0bd7-447b-8e87-145c2e742396 tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:52:47 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f5bd5699-0bd7-447b-8e87-145c2e742396 tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.505s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:52:47 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-f5bd5699-0bd7-447b-8e87-145c2e742396 tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Deleted allocations for instance 6e6a974e-3626-453c-8662-0d160f6e57de
Nov 28 10:52:47 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f5bd5699-0bd7-447b-8e87-145c2e742396 tempest-VolumesAssistedSnapshotsTest-1511835418 tempest-VolumesAssistedSnapshotsTest-1511835418-project-member] Lock "6e6a974e-3626-453c-8662-0d160f6e57de" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.178s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:52:47 user nova-compute[74994]: DEBUG nova.compute.manager [req-72ae9aca-b683-49ee-a79b-3883732b33d6 req-4b4fe306-58a5-4918-8548-e18489687341 service nova] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Received event network-vif-plugged-9854edad-1d5f-4ea8-bced-f1ae510e224a {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:52:47 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-72ae9aca-b683-49ee-a79b-3883732b33d6 req-4b4fe306-58a5-4918-8548-e18489687341 service nova] Acquiring lock "6e6a974e-3626-453c-8662-0d160f6e57de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:52:47 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-72ae9aca-b683-49ee-a79b-3883732b33d6 req-4b4fe306-58a5-4918-8548-e18489687341 service nova] Lock "6e6a974e-3626-453c-8662-0d160f6e57de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:52:47 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-72ae9aca-b683-49ee-a79b-3883732b33d6 req-4b4fe306-58a5-4918-8548-e18489687341 service nova] Lock "6e6a974e-3626-453c-8662-0d160f6e57de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:52:47 user nova-compute[74994]: DEBUG nova.compute.manager [req-72ae9aca-b683-49ee-a79b-3883732b33d6 req-4b4fe306-58a5-4918-8548-e18489687341 service nova] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] No waiting events found dispatching network-vif-plugged-9854edad-1d5f-4ea8-bced-f1ae510e224a {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:52:47 user nova-compute[74994]: WARNING nova.compute.manager [req-72ae9aca-b683-49ee-a79b-3883732b33d6 req-4b4fe306-58a5-4918-8548-e18489687341 service nova] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Received unexpected event network-vif-plugged-9854edad-1d5f-4ea8-bced-f1ae510e224a for instance with vm_state deleted and task_state None.
Nov 28 10:52:47 user nova-compute[74994]: DEBUG nova.compute.manager [req-72ae9aca-b683-49ee-a79b-3883732b33d6 req-4b4fe306-58a5-4918-8548-e18489687341 service nova] [instance: 6e6a974e-3626-453c-8662-0d160f6e57de] Received event network-vif-deleted-9854edad-1d5f-4ea8-bced-f1ae510e224a {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:52:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e466f065-b9cb-4b87-b5fa-18f51ca51670 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Acquiring lock "bc114bed-8d7e-46e0-86a7-7eed7ce75b5c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:52:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e466f065-b9cb-4b87-b5fa-18f51ca51670 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Lock "bc114bed-8d7e-46e0-86a7-7eed7ce75b5c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:52:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e466f065-b9cb-4b87-b5fa-18f51ca51670 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Acquiring lock "bc114bed-8d7e-46e0-86a7-7eed7ce75b5c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:52:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e466f065-b9cb-4b87-b5fa-18f51ca51670 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Lock "bc114bed-8d7e-46e0-86a7-7eed7ce75b5c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:52:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e466f065-b9cb-4b87-b5fa-18f51ca51670 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Lock "bc114bed-8d7e-46e0-86a7-7eed7ce75b5c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:52:48 user nova-compute[74994]: INFO nova.compute.manager [None req-e466f065-b9cb-4b87-b5fa-18f51ca51670 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Terminating instance
Nov 28 10:52:48 user nova-compute[74994]: DEBUG nova.compute.manager [None req-e466f065-b9cb-4b87-b5fa-18f51ca51670 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 10:52:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:49 user nova-compute[74994]: DEBUG nova.compute.manager [req-5940ecee-06d4-4b93-853a-5a689efbf0f5 req-f66c3dcf-4708-4d7d-a60a-28bf732b1014 service nova] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Received event network-vif-unplugged-4447defd-231f-48d4-aed4-b8459a768808 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:52:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-5940ecee-06d4-4b93-853a-5a689efbf0f5 req-f66c3dcf-4708-4d7d-a60a-28bf732b1014 service nova] Acquiring lock "bc114bed-8d7e-46e0-86a7-7eed7ce75b5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:52:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-5940ecee-06d4-4b93-853a-5a689efbf0f5 req-f66c3dcf-4708-4d7d-a60a-28bf732b1014 service nova] Lock "bc114bed-8d7e-46e0-86a7-7eed7ce75b5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:52:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-5940ecee-06d4-4b93-853a-5a689efbf0f5 req-f66c3dcf-4708-4d7d-a60a-28bf732b1014 service nova] Lock "bc114bed-8d7e-46e0-86a7-7eed7ce75b5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:52:49 user nova-compute[74994]: DEBUG nova.compute.manager [req-5940ecee-06d4-4b93-853a-5a689efbf0f5 req-f66c3dcf-4708-4d7d-a60a-28bf732b1014 service nova] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] No waiting events found dispatching network-vif-unplugged-4447defd-231f-48d4-aed4-b8459a768808 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:52:49 user nova-compute[74994]: DEBUG nova.compute.manager [req-5940ecee-06d4-4b93-853a-5a689efbf0f5 req-f66c3dcf-4708-4d7d-a60a-28bf732b1014 service nova] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Received event network-vif-unplugged-4447defd-231f-48d4-aed4-b8459a768808 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 10:52:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:49 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Instance destroyed successfully.
Nov 28 10:52:49 user nova-compute[74994]: DEBUG nova.objects.instance [None req-e466f065-b9cb-4b87-b5fa-18f51ca51670 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Lazy-loading 'resources' on Instance uuid bc114bed-8d7e-46e0-86a7-7eed7ce75b5c {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:52:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-e466f065-b9cb-4b87-b5fa-18f51ca51670 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:50:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-129232436',display_name='tempest-ServersNegativeTestJSON-server-129232436',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-129232436',id=13,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:51:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1c23e61575784c8baffda1deda7812fd',ramdisk_id='',reservation_id='r-wki39teo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1243683462',owner_user_name='tempest-ServersNegativeTestJSON-1243683462-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T10:51:06Z,user_data=None,user_id='3c29f1c4e20e4bfd80b1d565b58330aa',uuid=bc114bed-8d7e-46e0-86a7-7eed7ce75b5c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4447defd-231f-48d4-aed4-b8459a768808", "address": "fa:16:3e:eb:89:30", "network": {"id": "434398a7-094f-4b01-ae77-ae83f21a8390", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1446659533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c23e61575784c8baffda1deda7812fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4447defd-23", "ovs_interfaceid": "4447defd-231f-48d4-aed4-b8459a768808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 10:52:49 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-e466f065-b9cb-4b87-b5fa-18f51ca51670 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Converting VIF {"id": "4447defd-231f-48d4-aed4-b8459a768808", "address": "fa:16:3e:eb:89:30", "network": {"id": "434398a7-094f-4b01-ae77-ae83f21a8390", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1446659533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c23e61575784c8baffda1deda7812fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4447defd-23", "ovs_interfaceid": "4447defd-231f-48d4-aed4-b8459a768808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:52:49 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-e466f065-b9cb-4b87-b5fa-18f51ca51670 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:89:30,bridge_name='br-int',has_traffic_filtering=True,id=4447defd-231f-48d4-aed4-b8459a768808,network=Network(434398a7-094f-4b01-ae77-ae83f21a8390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4447defd-23') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:52:49 user nova-compute[74994]: DEBUG os_vif [None req-e466f065-b9cb-4b87-b5fa-18f51ca51670 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:89:30,bridge_name='br-int',has_traffic_filtering=True,id=4447defd-231f-48d4-aed4-b8459a768808,network=Network(434398a7-094f-4b01-ae77-ae83f21a8390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4447defd-23') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 10:52:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4447defd-23, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:52:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a93c8077-56b7-4e16-ae8e-b77b6369ef4c) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:52:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:49 user nova-compute[74994]: INFO os_vif [None req-e466f065-b9cb-4b87-b5fa-18f51ca51670 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:89:30,bridge_name='br-int',has_traffic_filtering=True,id=4447defd-231f-48d4-aed4-b8459a768808,network=Network(434398a7-094f-4b01-ae77-ae83f21a8390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4447defd-23')
Nov 28 10:52:49 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-e466f065-b9cb-4b87-b5fa-18f51ca51670 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Deleting instance files /opt/stack/data/nova/instances/bc114bed-8d7e-46e0-86a7-7eed7ce75b5c_del
Nov 28 10:52:49 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-e466f065-b9cb-4b87-b5fa-18f51ca51670 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Deletion of /opt/stack/data/nova/instances/bc114bed-8d7e-46e0-86a7-7eed7ce75b5c_del complete
Nov 28 10:52:49 user nova-compute[74994]: INFO nova.compute.manager [None req-e466f065-b9cb-4b87-b5fa-18f51ca51670 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 28 10:52:49 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-e466f065-b9cb-4b87-b5fa-18f51ca51670 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 10:52:49 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 10:52:49 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 10:52:50 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:52:50 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Took 0.60 seconds to deallocate network for instance.
Nov 28 10:52:50 user nova-compute[74994]: DEBUG nova.compute.manager [req-71b98b22-e17c-419a-af65-01ba2ab0090c req-b7ae8ae6-3c4c-42ff-8cb8-796c0e76e9fd service nova] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Received event network-vif-deleted-4447defd-231f-48d4-aed4-b8459a768808 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:52:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e466f065-b9cb-4b87-b5fa-18f51ca51670 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:52:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e466f065-b9cb-4b87-b5fa-18f51ca51670 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:52:50 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-e466f065-b9cb-4b87-b5fa-18f51ca51670 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:52:50 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-e466f065-b9cb-4b87-b5fa-18f51ca51670 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:52:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e466f065-b9cb-4b87-b5fa-18f51ca51670 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.426s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:52:50 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-e466f065-b9cb-4b87-b5fa-18f51ca51670 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Deleted allocations for instance bc114bed-8d7e-46e0-86a7-7eed7ce75b5c
Nov 28 10:52:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e466f065-b9cb-4b87-b5fa-18f51ca51670 tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Lock "bc114bed-8d7e-46e0-86a7-7eed7ce75b5c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.088s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:52:51 user nova-compute[74994]: DEBUG nova.compute.manager [req-f002b56a-b2bc-41fc-890a-05e853a95b4e req-f6c119af-839d-4a01-a4ce-dec8eddf9eac service nova] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Received event network-vif-plugged-4447defd-231f-48d4-aed4-b8459a768808 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:52:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f002b56a-b2bc-41fc-890a-05e853a95b4e req-f6c119af-839d-4a01-a4ce-dec8eddf9eac service nova] Acquiring lock "bc114bed-8d7e-46e0-86a7-7eed7ce75b5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:52:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f002b56a-b2bc-41fc-890a-05e853a95b4e req-f6c119af-839d-4a01-a4ce-dec8eddf9eac service nova] Lock "bc114bed-8d7e-46e0-86a7-7eed7ce75b5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:52:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f002b56a-b2bc-41fc-890a-05e853a95b4e req-f6c119af-839d-4a01-a4ce-dec8eddf9eac service nova] Lock "bc114bed-8d7e-46e0-86a7-7eed7ce75b5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:52:51 user nova-compute[74994]: DEBUG nova.compute.manager [req-f002b56a-b2bc-41fc-890a-05e853a95b4e req-f6c119af-839d-4a01-a4ce-dec8eddf9eac service nova] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] No waiting events found dispatching network-vif-plugged-4447defd-231f-48d4-aed4-b8459a768808 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:52:51 user nova-compute[74994]: WARNING nova.compute.manager [req-f002b56a-b2bc-41fc-890a-05e853a95b4e req-f6c119af-839d-4a01-a4ce-dec8eddf9eac service nova] [instance: bc114bed-8d7e-46e0-86a7-7eed7ce75b5c] Received unexpected event network-vif-plugged-4447defd-231f-48d4-aed4-b8459a768808 for instance with vm_state deleted and task_state None.
Nov 28 10:52:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:59 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:52:59 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:00 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ab73fa6d-4201-49b2-9b84-9c27a7bd2061 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Acquiring lock "c2925833-e88d-4aa7-a477-ff1bc1fcd724" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:00 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ab73fa6d-4201-49b2-9b84-9c27a7bd2061 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Lock "c2925833-e88d-4aa7-a477-ff1bc1fcd724" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:00 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ab73fa6d-4201-49b2-9b84-9c27a7bd2061 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Acquiring lock "c2925833-e88d-4aa7-a477-ff1bc1fcd724-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:00 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ab73fa6d-4201-49b2-9b84-9c27a7bd2061 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Lock "c2925833-e88d-4aa7-a477-ff1bc1fcd724-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:00 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ab73fa6d-4201-49b2-9b84-9c27a7bd2061 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Lock "c2925833-e88d-4aa7-a477-ff1bc1fcd724-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:00 user nova-compute[74994]: INFO nova.compute.manager [None req-ab73fa6d-4201-49b2-9b84-9c27a7bd2061 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Terminating instance
Nov 28 10:53:00 user nova-compute[74994]: DEBUG nova.compute.manager [None req-ab73fa6d-4201-49b2-9b84-9c27a7bd2061 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 10:53:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:00 user nova-compute[74994]: DEBUG nova.compute.manager [req-6ef05d22-1e31-4610-b1b1-19d5ad29a8c6 req-461e0b28-4e49-45da-b502-8c6ee2c48ab0 service nova] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Received event network-vif-unplugged-752a5c48-15a2-443c-911c-f1a0c33ca925 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:53:00 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6ef05d22-1e31-4610-b1b1-19d5ad29a8c6 req-461e0b28-4e49-45da-b502-8c6ee2c48ab0 service nova] Acquiring lock "c2925833-e88d-4aa7-a477-ff1bc1fcd724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:00 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6ef05d22-1e31-4610-b1b1-19d5ad29a8c6 req-461e0b28-4e49-45da-b502-8c6ee2c48ab0 service nova] Lock "c2925833-e88d-4aa7-a477-ff1bc1fcd724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:00 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6ef05d22-1e31-4610-b1b1-19d5ad29a8c6 req-461e0b28-4e49-45da-b502-8c6ee2c48ab0 service nova] Lock "c2925833-e88d-4aa7-a477-ff1bc1fcd724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:00 user nova-compute[74994]: DEBUG nova.compute.manager [req-6ef05d22-1e31-4610-b1b1-19d5ad29a8c6 req-461e0b28-4e49-45da-b502-8c6ee2c48ab0 service nova] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] No waiting events found dispatching network-vif-unplugged-752a5c48-15a2-443c-911c-f1a0c33ca925 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:53:00 user nova-compute[74994]: DEBUG nova.compute.manager [req-6ef05d22-1e31-4610-b1b1-19d5ad29a8c6 req-461e0b28-4e49-45da-b502-8c6ee2c48ab0 service nova] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Received event network-vif-unplugged-752a5c48-15a2-443c-911c-f1a0c33ca925 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 10:53:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:01 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Instance destroyed successfully.
Nov 28 10:53:01 user nova-compute[74994]: DEBUG nova.objects.instance [None req-ab73fa6d-4201-49b2-9b84-9c27a7bd2061 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Lazy-loading 'resources' on Instance uuid c2925833-e88d-4aa7-a477-ff1bc1fcd724 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:53:01 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-ab73fa6d-4201-49b2-9b84-9c27a7bd2061 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:49:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-185346772',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-185346772',id=10,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKb7DfQBhl9KQjX/Jy4TL5O6PXWUKL+vLgAOjfX/Q0BbK/dfYX/kuDxa2AyyjG8Tr6w0nPvpMGRLCsCXhPfUwNG1BTBUaGDIyyYhGnKPl0/QavZSldUeJCV0yh5hnereZw==',key_name='tempest-keypair-433898378',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:49:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a1413a02a3034130b4a4ec170ca2fc16',ramdisk_id='',reservation_id='r-z554pke2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1012374446',owner_user_name='tempest-TaggedAttachmentsTest-1012374446-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T10:49:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02983082e29345a491ecd8fe18268b84',uuid=c2925833-e88d-4aa7-a477-ff1bc1fcd724,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "752a5c48-15a2-443c-911c-f1a0c33ca925", "address": "fa:16:3e:a4:4b:1f", "network": {"id": "92ee00e3-fc9c-459d-9dac-4ef40e592023", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2069871364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1413a02a3034130b4a4ec170ca2fc16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap752a5c48-15", "ovs_interfaceid": "752a5c48-15a2-443c-911c-f1a0c33ca925", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 10:53:01 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-ab73fa6d-4201-49b2-9b84-9c27a7bd2061 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Converting VIF {"id": "752a5c48-15a2-443c-911c-f1a0c33ca925", "address": "fa:16:3e:a4:4b:1f", "network": {"id": "92ee00e3-fc9c-459d-9dac-4ef40e592023", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2069871364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1413a02a3034130b4a4ec170ca2fc16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap752a5c48-15", "ovs_interfaceid": "752a5c48-15a2-443c-911c-f1a0c33ca925", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:53:01 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-ab73fa6d-4201-49b2-9b84-9c27a7bd2061 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:4b:1f,bridge_name='br-int',has_traffic_filtering=True,id=752a5c48-15a2-443c-911c-f1a0c33ca925,network=Network(92ee00e3-fc9c-459d-9dac-4ef40e592023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap752a5c48-15') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:53:01 user nova-compute[74994]: DEBUG os_vif [None req-ab73fa6d-4201-49b2-9b84-9c27a7bd2061 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:4b:1f,bridge_name='br-int',has_traffic_filtering=True,id=752a5c48-15a2-443c-911c-f1a0c33ca925,network=Network(92ee00e3-fc9c-459d-9dac-4ef40e592023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap752a5c48-15') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 10:53:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap752a5c48-15, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:53:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:53:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c5ac5ad6-6df3-4fe8-86d0-4fec1dc40ed4) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:53:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:01 user nova-compute[74994]: INFO os_vif [None req-ab73fa6d-4201-49b2-9b84-9c27a7bd2061 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:4b:1f,bridge_name='br-int',has_traffic_filtering=True,id=752a5c48-15a2-443c-911c-f1a0c33ca925,network=Network(92ee00e3-fc9c-459d-9dac-4ef40e592023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap752a5c48-15')
Nov 28 10:53:01 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-ab73fa6d-4201-49b2-9b84-9c27a7bd2061 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Deleting instance files /opt/stack/data/nova/instances/c2925833-e88d-4aa7-a477-ff1bc1fcd724_del
Nov 28 10:53:01 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-ab73fa6d-4201-49b2-9b84-9c27a7bd2061 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Deletion of /opt/stack/data/nova/instances/c2925833-e88d-4aa7-a477-ff1bc1fcd724_del complete
Nov 28 10:53:01 user nova-compute[74994]: INFO nova.compute.manager [None req-ab73fa6d-4201-49b2-9b84-9c27a7bd2061 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 28 10:53:01 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-ab73fa6d-4201-49b2-9b84-9c27a7bd2061 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 10:53:01 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 10:53:01 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 10:53:02 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:53:02 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Took 0.71 seconds to deallocate network for instance.
Nov 28 10:53:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ab73fa6d-4201-49b2-9b84-9c27a7bd2061 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ab73fa6d-4201-49b2-9b84-9c27a7bd2061 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:02 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:53:02 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 10:53:02 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-ab73fa6d-4201-49b2-9b84-9c27a7bd2061 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:53:02 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-ab73fa6d-4201-49b2-9b84-9c27a7bd2061 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:53:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ab73fa6d-4201-49b2-9b84-9c27a7bd2061 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:02 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-ab73fa6d-4201-49b2-9b84-9c27a7bd2061 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Deleted allocations for instance c2925833-e88d-4aa7-a477-ff1bc1fcd724
Nov 28 10:53:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ab73fa6d-4201-49b2-9b84-9c27a7bd2061 tempest-TaggedAttachmentsTest-1012374446 tempest-TaggedAttachmentsTest-1012374446-project-member] Lock "c2925833-e88d-4aa7-a477-ff1bc1fcd724" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.199s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:02 user nova-compute[74994]: DEBUG nova.compute.manager [req-c8ecc5b4-8ed0-475e-8fd3-2fd5f7daa166 req-58453d97-4b62-4cc4-850b-ad9472686d87 service nova] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Received event network-vif-plugged-752a5c48-15a2-443c-911c-f1a0c33ca925 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:53:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c8ecc5b4-8ed0-475e-8fd3-2fd5f7daa166 req-58453d97-4b62-4cc4-850b-ad9472686d87 service nova] Acquiring lock "c2925833-e88d-4aa7-a477-ff1bc1fcd724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c8ecc5b4-8ed0-475e-8fd3-2fd5f7daa166 req-58453d97-4b62-4cc4-850b-ad9472686d87 service nova] Lock "c2925833-e88d-4aa7-a477-ff1bc1fcd724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c8ecc5b4-8ed0-475e-8fd3-2fd5f7daa166 req-58453d97-4b62-4cc4-850b-ad9472686d87 service nova] Lock "c2925833-e88d-4aa7-a477-ff1bc1fcd724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:02 user nova-compute[74994]: DEBUG nova.compute.manager [req-c8ecc5b4-8ed0-475e-8fd3-2fd5f7daa166 req-58453d97-4b62-4cc4-850b-ad9472686d87 service nova] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] No waiting events found dispatching network-vif-plugged-752a5c48-15a2-443c-911c-f1a0c33ca925 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:53:02 user nova-compute[74994]: WARNING nova.compute.manager [req-c8ecc5b4-8ed0-475e-8fd3-2fd5f7daa166 req-58453d97-4b62-4cc4-850b-ad9472686d87 service nova] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Received unexpected event network-vif-plugged-752a5c48-15a2-443c-911c-f1a0c33ca925 for instance with vm_state deleted and task_state None.
Nov 28 10:53:02 user nova-compute[74994]: DEBUG nova.compute.manager [req-c8ecc5b4-8ed0-475e-8fd3-2fd5f7daa166 req-58453d97-4b62-4cc4-850b-ad9472686d87 service nova] [instance: c2925833-e88d-4aa7-a477-ff1bc1fcd724] Received event network-vif-deleted-752a5c48-15a2-443c-911c-f1a0c33ca925 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:53:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Acquiring lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:03 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:53:03 user nova-compute[74994]: DEBUG nova.objects.instance [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lazy-loading 'flavor' on Instance uuid 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:53:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Acquiring lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:03 user nova-compute[74994]: INFO nova.compute.manager [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Attaching volume 35aee3f6-cd85-4e5a-9b2e-f9646455aa77 to /dev/vdb
Nov 28 10:53:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:04 user nova-compute[74994]: DEBUG os_brick.utils [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:53:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:04 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc45c62-c6a2-42f4-ac16-a502abbade93]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:53:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:04 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fd26c5-a51f-492f-9b4a-314511fb3ad5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:53:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:04 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c5cb92-b16d-488b-a940-23af26dd558b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:53:04 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26f42b4-67ca-42ee-ba65-fe96a3b1944d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:53:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:53:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 10:53:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:53:04 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 10:53:04 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b585bd-45db-4d1d-82a8-3c92e6645b8f]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:53:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 10:53:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 10:53:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 10:53:04 user nova-compute[74994]: DEBUG os_brick.utils [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:53:04 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Updating existing volume attachment record: 0825eba4-5f36-4dbd-8b72-7beaa71e588a {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 10:53:04 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:53:05 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:53:05 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 10:53:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "refresh_cache-279e1c4c-36f9-492f-ab3f-1b587347eadd" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:53:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquired lock "refresh_cache-279e1c4c-36f9-492f-ab3f-1b587347eadd" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:53:05 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Forcefully refreshing network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 10:53:05 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Updating instance_info_cache with network_info: [{"id": "aeaddf62-0ca1-40d1-9228-897ee0015d4a", "address": "fa:16:3e:bc:02:82", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeaddf62-0c", "ovs_interfaceid": "aeaddf62-0ca1-40d1-9228-897ee0015d4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:53:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Releasing lock "refresh_cache-279e1c4c-36f9-492f-ab3f-1b587347eadd" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:53:05 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Updated the network info_cache for instance {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 10:53:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:07 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:53:07 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:53:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:07 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 10:53:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e30565c-9f8e-4a87-8054-6c260dac4f48/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e30565c-9f8e-4a87-8054-6c260dac4f48/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e30565c-9f8e-4a87-8054-6c260dac4f48/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e30565c-9f8e-4a87-8054-6c260dac4f48/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1047177e-9690-4a45-b0e9-1cea9382bacf tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Acquiring lock "7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1047177e-9690-4a45-b0e9-1cea9382bacf tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Lock "7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1047177e-9690-4a45-b0e9-1cea9382bacf tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Acquiring lock "7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1047177e-9690-4a45-b0e9-1cea9382bacf tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Lock "7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1047177e-9690-4a45-b0e9-1cea9382bacf tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Lock "7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.003s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:09 user nova-compute[74994]: INFO nova.compute.manager [None req-1047177e-9690-4a45-b0e9-1cea9382bacf tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Terminating instance
Nov 28 10:53:09 user nova-compute[74994]: DEBUG nova.compute.manager [None req-1047177e-9690-4a45-b0e9-1cea9382bacf tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 10:53:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce813fa-bf97-41f8-8aee-c7a73354e24c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce813fa-bf97-41f8-8aee-c7a73354e24c/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce813fa-bf97-41f8-8aee-c7a73354e24c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:09 user nova-compute[74994]: DEBUG nova.compute.manager [req-d8608c28-5106-4b2d-8fa1-bda67a14b735 req-74e11dad-434e-4b38-929d-52af3b392e6a service nova] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Received event network-vif-unplugged-068d74d7-23a6-42b8-8a3c-02ba7ce746a7 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:53:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d8608c28-5106-4b2d-8fa1-bda67a14b735 req-74e11dad-434e-4b38-929d-52af3b392e6a service nova] Acquiring lock "7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d8608c28-5106-4b2d-8fa1-bda67a14b735 req-74e11dad-434e-4b38-929d-52af3b392e6a service nova] Lock "7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d8608c28-5106-4b2d-8fa1-bda67a14b735 req-74e11dad-434e-4b38-929d-52af3b392e6a service nova] Lock "7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:09 user nova-compute[74994]: DEBUG nova.compute.manager [req-d8608c28-5106-4b2d-8fa1-bda67a14b735 req-74e11dad-434e-4b38-929d-52af3b392e6a service nova] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] No waiting events found dispatching network-vif-unplugged-068d74d7-23a6-42b8-8a3c-02ba7ce746a7 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:53:09 user nova-compute[74994]: DEBUG nova.compute.manager [req-d8608c28-5106-4b2d-8fa1-bda67a14b735 req-74e11dad-434e-4b38-929d-52af3b392e6a service nova] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Received event network-vif-unplugged-068d74d7-23a6-42b8-8a3c-02ba7ce746a7 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 10:53:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce813fa-bf97-41f8-8aee-c7a73354e24c/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:10 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 10:53:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63b5b88a-f126-4e6c-926d-0a295830240d/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:10 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Instance destroyed successfully.
Nov 28 10:53:10 user nova-compute[74994]: DEBUG nova.objects.instance [None req-1047177e-9690-4a45-b0e9-1cea9382bacf tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Lazy-loading 'resources' on Instance uuid 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:53:10 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-1047177e-9690-4a45-b0e9-1cea9382bacf tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:49:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1889492132',display_name='tempest-TestVolumeSwap-server-1889492132',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1889492132',id=9,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEKmN0jSdm18k+Aexo02JdEt0XFxDiVLcmHjI0n+gja4c0moLkH+GaofYEgftuA7XyMMU7ng1dgoDUE6/CZSQwmovKyutzGdVza1+RsWUps8Rkjx8rNx3Vrf+qMaesQ3Zw==',key_name='tempest-keypair-572005247',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:49:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8add654139084d4da3e8f2c2586a9466',ramdisk_id='',reservation_id='r-asf10y2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-623433662',owner_user_name='tempest-TestVolumeSwap-623433662-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T10:49:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='86984721f70d4723b721a424ac3bb7b5',uuid=7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "068d74d7-23a6-42b8-8a3c-02ba7ce746a7", "address": "fa:16:3e:de:46:25", "network": {"id": "b7c1f696-fec6-41c2-a173-f6497212eb9d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-130325100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8add654139084d4da3e8f2c2586a9466", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068d74d7-23", "ovs_interfaceid": "068d74d7-23a6-42b8-8a3c-02ba7ce746a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 10:53:10 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-1047177e-9690-4a45-b0e9-1cea9382bacf tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Converting VIF {"id": "068d74d7-23a6-42b8-8a3c-02ba7ce746a7", "address": "fa:16:3e:de:46:25", "network": {"id": "b7c1f696-fec6-41c2-a173-f6497212eb9d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-130325100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8add654139084d4da3e8f2c2586a9466", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068d74d7-23", "ovs_interfaceid": "068d74d7-23a6-42b8-8a3c-02ba7ce746a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:53:10 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-1047177e-9690-4a45-b0e9-1cea9382bacf tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:46:25,bridge_name='br-int',has_traffic_filtering=True,id=068d74d7-23a6-42b8-8a3c-02ba7ce746a7,network=Network(b7c1f696-fec6-41c2-a173-f6497212eb9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068d74d7-23') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:53:10 user nova-compute[74994]: DEBUG os_vif [None req-1047177e-9690-4a45-b0e9-1cea9382bacf tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:46:25,bridge_name='br-int',has_traffic_filtering=True,id=068d74d7-23a6-42b8-8a3c-02ba7ce746a7,network=Network(b7c1f696-fec6-41c2-a173-f6497212eb9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068d74d7-23') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 10:53:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap068d74d7-23, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:53:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:53:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=235bc249-dd6a-4c99-be10-e102cf03208b) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:53:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:53:10 user nova-compute[74994]: INFO os_vif [None req-1047177e-9690-4a45-b0e9-1cea9382bacf tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:46:25,bridge_name='br-int',has_traffic_filtering=True,id=068d74d7-23a6-42b8-8a3c-02ba7ce746a7,network=Network(b7c1f696-fec6-41c2-a173-f6497212eb9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068d74d7-23')
Nov 28 10:53:10 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-1047177e-9690-4a45-b0e9-1cea9382bacf tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Deleting instance files /opt/stack/data/nova/instances/7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a_del
Nov 28 10:53:10 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-1047177e-9690-4a45-b0e9-1cea9382bacf tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Deletion of /opt/stack/data/nova/instances/7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a_del complete
Nov 28 10:53:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63b5b88a-f126-4e6c-926d-0a295830240d/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63b5b88a-f126-4e6c-926d-0a295830240d/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:10 user nova-compute[74994]: INFO nova.compute.manager [None req-1047177e-9690-4a45-b0e9-1cea9382bacf tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Took 1.05 seconds to destroy the instance on the hypervisor.
Nov 28 10:53:10 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-1047177e-9690-4a45-b0e9-1cea9382bacf tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 10:53:10 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 10:53:10 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 10:53:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63b5b88a-f126-4e6c-926d-0a295830240d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034bca55-d0dc-4d62-b95e-38bf26fee4a0/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034bca55-d0dc-4d62-b95e-38bf26fee4a0/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034bca55-d0dc-4d62-b95e-38bf26fee4a0/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034bca55-d0dc-4d62-b95e-38bf26fee4a0/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b51d690-8198-4748-807d-1902e75564b9/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:11 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:53:11 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Took 0.73 seconds to deallocate network for instance.
Nov 28 10:53:11 user nova-compute[74994]: DEBUG nova.compute.manager [req-8ac3936e-274c-4de7-923f-65ae65dbf103 req-e36dc403-9fee-4da5-a6d3-2d54f0bae216 service nova] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Received event network-vif-deleted-068d74d7-23a6-42b8-8a3c-02ba7ce746a7 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:53:11 user nova-compute[74994]: INFO nova.compute.manager [req-8ac3936e-274c-4de7-923f-65ae65dbf103 req-e36dc403-9fee-4da5-a6d3-2d54f0bae216 service nova] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Neutron deleted interface 068d74d7-23a6-42b8-8a3c-02ba7ce746a7; detaching it from the instance and deleting it from the info cache
Nov 28 10:53:11 user nova-compute[74994]: DEBUG nova.network.neutron [req-8ac3936e-274c-4de7-923f-65ae65dbf103 req-e36dc403-9fee-4da5-a6d3-2d54f0bae216 service nova] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:53:11 user nova-compute[74994]: DEBUG nova.compute.manager [req-8ac3936e-274c-4de7-923f-65ae65dbf103 req-e36dc403-9fee-4da5-a6d3-2d54f0bae216 service nova] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Detach interface failed, port_id=068d74d7-23a6-42b8-8a3c-02ba7ce746a7, reason: Instance 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a could not be found. {{(pid=74994) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 10:53:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b51d690-8198-4748-807d-1902e75564b9/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b51d690-8198-4748-807d-1902e75564b9/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:11 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1047177e-9690-4a45-b0e9-1cea9382bacf tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:11 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1047177e-9690-4a45-b0e9-1cea9382bacf tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b51d690-8198-4748-807d-1902e75564b9/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:11 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-1047177e-9690-4a45-b0e9-1cea9382bacf tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:53:11 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-1047177e-9690-4a45-b0e9-1cea9382bacf tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:53:11 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1047177e-9690-4a45-b0e9-1cea9382bacf tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.433s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json" returned: 0 in 0.233s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:11 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-1047177e-9690-4a45-b0e9-1cea9382bacf tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Deleted allocations for instance 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a
Nov 28 10:53:11 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1047177e-9690-4a45-b0e9-1cea9382bacf tempest-TestVolumeSwap-623433662 tempest-TestVolumeSwap-623433662-project-member] Lock "7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.501s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:12 user nova-compute[74994]: DEBUG nova.compute.manager [req-f1822265-1cd4-4e3d-9f8d-7b4d5c567c8e req-1f385e38-81d8-4bfa-b1f1-3eb33af6bb29 service nova] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Received event network-vif-plugged-068d74d7-23a6-42b8-8a3c-02ba7ce746a7 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:53:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f1822265-1cd4-4e3d-9f8d-7b4d5c567c8e req-1f385e38-81d8-4bfa-b1f1-3eb33af6bb29 service nova] Acquiring lock "7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f1822265-1cd4-4e3d-9f8d-7b4d5c567c8e req-1f385e38-81d8-4bfa-b1f1-3eb33af6bb29 service nova] Lock "7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f1822265-1cd4-4e3d-9f8d-7b4d5c567c8e req-1f385e38-81d8-4bfa-b1f1-3eb33af6bb29 service nova] Lock "7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:12 user nova-compute[74994]: DEBUG nova.compute.manager [req-f1822265-1cd4-4e3d-9f8d-7b4d5c567c8e req-1f385e38-81d8-4bfa-b1f1-3eb33af6bb29 service nova] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] No waiting events found dispatching network-vif-plugged-068d74d7-23a6-42b8-8a3c-02ba7ce746a7 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:53:12 user nova-compute[74994]: WARNING nova.compute.manager [req-f1822265-1cd4-4e3d-9f8d-7b4d5c567c8e req-1f385e38-81d8-4bfa-b1f1-3eb33af6bb29 service nova] [instance: 7b4f19d5-d5e9-44ee-9e58-5ccf83592b9a] Received unexpected event network-vif-plugged-068d74d7-23a6-42b8-8a3c-02ba7ce746a7 for instance with vm_state deleted and task_state None.
Nov 28 10:53:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:12 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 10:53:12 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:53:12 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:53:12 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=7590MB free_disk=25.421916961669922GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 10:53:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:12 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:53:12 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance bf357856-2d97-42e8-928d-71d0378f48c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:53:12 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 279e1c4c-36f9-492f-ab3f-1b587347eadd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:53:12 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 5b51d690-8198-4748-807d-1902e75564b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:53:12 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance cce813fa-bf97-41f8-8aee-c7a73354e24c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:53:12 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:53:12 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 2e30565c-9f8e-4a87-8054-6c260dac4f48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:53:12 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 63b5b88a-f126-4e6c-926d-0a295830240d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:53:12 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 759fbcfd-ab13-438f-b860-6393a97d1205 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:53:12 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 034bca55-d0dc-4d62-b95e-38bf26fee4a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:53:12 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 10:53:12 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 10:53:13 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:53:13 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:53:13 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 10:53:13 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.499s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:13 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Acquiring lock "b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:13 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Lock "b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:13 user nova-compute[74994]: DEBUG nova.compute.manager [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 10:53:13 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:13 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:13 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 10:53:13 user nova-compute[74994]: INFO nova.compute.claims [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Claim successful on node user
Nov 28 10:53:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QFVecHNB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:53:14 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:53:14 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:53:14 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:53:14 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:53:14 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.474s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG nova.compute.manager [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3491a905-967e-4014-bddc-fcc04cb696b5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 10:53:14 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1779a4f-1945-46c0-9321-6133e26d7f9c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77] added
Nov 28 10:53:14 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4272b7-0055-4a45-8489-fe861852e2da]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG nova.compute.manager [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG nova.network.neutron [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4540458e-d549-4b72-b00e-fb22ed3243db]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:53:14 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QFVecHNB {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG nova.compute.manager [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QFVecHNB" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2987ce-af60-4b72-adcc-632cca76e61e]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QFVecHNB'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e8aae7-29d1-41c7-a107-e4caf6a6ef8d]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG nova.policy [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '89011c8506684d7c8334479ceb563468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9120da612e254822a611672d14e37690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab80464-71f2-418c-a279-5d28980b5b98]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:53:14 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:53:14 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:53:14 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:53:14 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG nova.compute.manager [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 10:53:14 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Creating image(s)
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Acquiring lock "/opt/stack/data/nova/instances/b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Lock "/opt/stack/data/nova/instances/b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Lock "/opt/stack/data/nova/instances/b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c891466d-41ca-43cd-98bf-5e86ea6ed834]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77, portal: 172.16.0.220,3260]
Nov 28 10:53:14 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77, portal: 172.16.0.220,3260] successful.
Nov 28 10:53:14 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[210b808c-346e-4cb9-a8c6-1d69add8df1e]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2051781f-22f8-4ba5-8265-396cdf389180]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:53:14 user nova-compute[74994]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)
Nov 28 10:53:14 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:53:14 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:53:14 user nova-compute[74994]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)
Nov 28 10:53:14 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:53:14 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f279e3c-e8ea-4121-97c7-f8b854312e25]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QFVecHNB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.209s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Acquiring lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG nova.compute.manager [req-107c3ef2-a467-41cc-b1b6-7997a79eedb5 req-379e80df-f0c7-44de-8561-8335d140bfcb service nova] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Received event network-changed-59550f49-12c8-4ca1-b957-2c0a631dfa84 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG nova.compute.manager [req-107c3ef2-a467-41cc-b1b6-7997a79eedb5 req-379e80df-f0c7-44de-8561-8335d140bfcb service nova] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Refreshing instance network info cache due to event network-changed-59550f49-12c8-4ca1-b957-2c0a631dfa84. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-107c3ef2-a467-41cc-b1b6-7997a79eedb5 req-379e80df-f0c7-44de-8561-8335d140bfcb service nova] Acquiring lock "refresh_cache-63b5b88a-f126-4e6c-926d-0a295830240d" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-107c3ef2-a467-41cc-b1b6-7997a79eedb5 req-379e80df-f0c7-44de-8561-8335d140bfcb service nova] Acquired lock "refresh_cache-63b5b88a-f126-4e6c-926d-0a295830240d" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG nova.network.neutron [req-107c3ef2-a467-41cc-b1b6-7997a79eedb5 req-379e80df-f0c7-44de-8561-8335d140bfcb service nova] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Refreshing network info cache for port 59550f49-12c8-4ca1-b957-2c0a631dfa84 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.188s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6/disk 1073741824 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6/disk 1073741824" returned: 0 in 0.052s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:15 user nova-compute[74994]: DEBUG nova.network.neutron [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Successfully created port: 4dfa3aa6-df94-4d84-ac44-2e0c807640bb {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 10:53:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-90e6cfcc-70fe-438c-8a33-79c9a6584f77 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "63b5b88a-f126-4e6c-926d-0a295830240d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-90e6cfcc-70fe-438c-8a33-79c9a6584f77 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "63b5b88a-f126-4e6c-926d-0a295830240d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-90e6cfcc-70fe-438c-8a33-79c9a6584f77 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "63b5b88a-f126-4e6c-926d-0a295830240d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-90e6cfcc-70fe-438c-8a33-79c9a6584f77 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "63b5b88a-f126-4e6c-926d-0a295830240d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-90e6cfcc-70fe-438c-8a33-79c9a6584f77 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "63b5b88a-f126-4e6c-926d-0a295830240d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:15 user nova-compute[74994]: INFO nova.compute.manager [None req-90e6cfcc-70fe-438c-8a33-79c9a6584f77 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Terminating instance
Nov 28 10:53:15 user nova-compute[74994]: DEBUG nova.compute.manager [None req-90e6cfcc-70fe-438c-8a33-79c9a6584f77 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 10:53:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.241s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:15 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6/disk. size=1073741824 {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 10:53:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:15 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Cannot resize image /opt/stack/data/nova/instances/b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6/disk to a smaller size. {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 10:53:15 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Created local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 10:53:15 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Ensure instance console log exists: /opt/stack/data/nova/instances/b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 10:53:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:15 user nova-compute[74994]: DEBUG nova.network.neutron [req-107c3ef2-a467-41cc-b1b6-7997a79eedb5 req-379e80df-f0c7-44de-8561-8335d140bfcb service nova] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Updated VIF entry in instance network info cache for port 59550f49-12c8-4ca1-b957-2c0a631dfa84. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 10:53:15 user nova-compute[74994]: DEBUG nova.network.neutron [req-107c3ef2-a467-41cc-b1b6-7997a79eedb5 req-379e80df-f0c7-44de-8561-8335d140bfcb service nova] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Updating instance_info_cache with network_info: [{"id": "59550f49-12c8-4ca1-b957-2c0a631dfa84", "address": "fa:16:3e:1a:59:9b", "network": {"id": "d9bcdec6-69e0-4e65-8a26-1af1f8232365", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1227861580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "636fa9a1f046425e9332cc3807f8fb46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59550f49-12", "ovs_interfaceid": "59550f49-12c8-4ca1-b957-2c0a631dfa84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:53:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-107c3ef2-a467-41cc-b1b6-7997a79eedb5 req-379e80df-f0c7-44de-8561-8335d140bfcb service nova] Releasing lock "refresh_cache-63b5b88a-f126-4e6c-926d-0a295830240d" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:53:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:15 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:53:15 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '26365386661363434', 'path': '/dev/sdc'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:53:15 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365386661363434', 'path': '/dev/sdc'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 10:53:15 user nova-compute[74994]: DEBUG nova.objects.instance [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lazy-loading 'flavor' on Instance uuid 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:53:15 user nova-compute[74994]: DEBUG nova.compute.manager [req-f6fcbc78-96a0-4960-9b75-4a1777a864a4 req-87b74e95-f1b3-4764-8033-2d2ce32fd7ca service nova] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Received event network-vif-unplugged-59550f49-12c8-4ca1-b957-2c0a631dfa84 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:53:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f6fcbc78-96a0-4960-9b75-4a1777a864a4 req-87b74e95-f1b3-4764-8033-2d2ce32fd7ca service nova] Acquiring lock "63b5b88a-f126-4e6c-926d-0a295830240d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f6fcbc78-96a0-4960-9b75-4a1777a864a4 req-87b74e95-f1b3-4764-8033-2d2ce32fd7ca service nova] Lock "63b5b88a-f126-4e6c-926d-0a295830240d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f6fcbc78-96a0-4960-9b75-4a1777a864a4 req-87b74e95-f1b3-4764-8033-2d2ce32fd7ca service nova] Lock "63b5b88a-f126-4e6c-926d-0a295830240d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:15 user nova-compute[74994]: DEBUG nova.compute.manager [req-f6fcbc78-96a0-4960-9b75-4a1777a864a4 req-87b74e95-f1b3-4764-8033-2d2ce32fd7ca service nova] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] No waiting events found dispatching network-vif-unplugged-59550f49-12c8-4ca1-b957-2c0a631dfa84 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:53:15 user nova-compute[74994]: DEBUG nova.compute.manager [req-f6fcbc78-96a0-4960-9b75-4a1777a864a4 req-87b74e95-f1b3-4764-8033-2d2ce32fd7ca service nova] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Received event network-vif-unplugged-59550f49-12c8-4ca1-b957-2c0a631dfa84 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 10:53:15 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 10:53:15 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 10:53:15 user nova-compute[74994]:   <source dev="/dev/sdc"/>
Nov 28 10:53:15 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 10:53:15 user nova-compute[74994]:   <serial>35aee3f6-cd85-4e5a-9b2e-f9646455aa77</serial>
Nov 28 10:53:15 user nova-compute[74994]: </disk>
Nov 28 10:53:15 user nova-compute[74994]:  {{(pid=74994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 10:53:15 user nova-compute[74994]: DEBUG nova.network.neutron [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Successfully updated port: 4dfa3aa6-df94-4d84-ac44-2e0c807640bb {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 10:53:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Acquiring lock "refresh_cache-b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:53:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Acquired lock "refresh_cache-b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:53:15 user nova-compute[74994]: DEBUG nova.network.neutron [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 10:53:15 user nova-compute[74994]: DEBUG nova.compute.manager [req-9b1ddec6-8a5b-4eff-8e69-0657f218ae6b req-711a065b-f92e-45f1-b10d-bc3c06215e52 service nova] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Received event network-changed-4dfa3aa6-df94-4d84-ac44-2e0c807640bb {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:53:15 user nova-compute[74994]: DEBUG nova.compute.manager [req-9b1ddec6-8a5b-4eff-8e69-0657f218ae6b req-711a065b-f92e-45f1-b10d-bc3c06215e52 service nova] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Refreshing instance network info cache due to event network-changed-4dfa3aa6-df94-4d84-ac44-2e0c807640bb. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:53:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9b1ddec6-8a5b-4eff-8e69-0657f218ae6b req-711a065b-f92e-45f1-b10d-bc3c06215e52 service nova] Acquiring lock "refresh_cache-b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG nova.network.neutron [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG nova.network.neutron [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Updating instance_info_cache with network_info: [{"id": "4dfa3aa6-df94-4d84-ac44-2e0c807640bb", "address": "fa:16:3e:ab:1e:fc", "network": {"id": "aeb89ffc-c2f3-4a19-b7cb-e273021f655a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-334414746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9120da612e254822a611672d14e37690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dfa3aa6-df", "ovs_interfaceid": "4dfa3aa6-df94-4d84-ac44-2e0c807640bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Releasing lock "refresh_cache-b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG nova.compute.manager [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Instance network_info: |[{"id": "4dfa3aa6-df94-4d84-ac44-2e0c807640bb", "address": "fa:16:3e:ab:1e:fc", "network": {"id": "aeb89ffc-c2f3-4a19-b7cb-e273021f655a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-334414746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9120da612e254822a611672d14e37690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dfa3aa6-df", "ovs_interfaceid": "4dfa3aa6-df94-4d84-ac44-2e0c807640bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9b1ddec6-8a5b-4eff-8e69-0657f218ae6b req-711a065b-f92e-45f1-b10d-bc3c06215e52 service nova] Acquired lock "refresh_cache-b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG nova.network.neutron [req-9b1ddec6-8a5b-4eff-8e69-0657f218ae6b req-711a065b-f92e-45f1-b10d-bc3c06215e52 service nova] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Refreshing network info cache for port 4dfa3aa6-df94-4d84-ac44-2e0c807640bb {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Start _get_guest_xml network_info=[{"id": "4dfa3aa6-df94-4d84-ac44-2e0c807640bb", "address": "fa:16:3e:ab:1e:fc", "network": {"id": "aeb89ffc-c2f3-4a19-b7cb-e273021f655a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-334414746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9120da612e254822a611672d14e37690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dfa3aa6-df", "ovs_interfaceid": "4dfa3aa6-df94-4d84-ac44-2e0c807640bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'aa939d1b-b8a6-4391-935b-0191bf5ccd0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 10:53:16 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Instance destroyed successfully.
Nov 28 10:53:16 user nova-compute[74994]: DEBUG nova.objects.instance [None req-90e6cfcc-70fe-438c-8a33-79c9a6584f77 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lazy-loading 'resources' on Instance uuid 63b5b88a-f126-4e6c-926d-0a295830240d {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:53:16 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:53:16 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:53:16 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-90e6cfcc-70fe-438c-8a33-79c9a6584f77 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:51:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1117895133',display_name='tempest-AttachVolumeNegativeTest-server-1117895133',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1117895133',id=14,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEH1KcPGoGPtQOzn5rBVy1i6ItldzWcHpQ1PquDF1As9wYO1hdMQZPOQzKiishEgDMknfICbgGzofeNdERRvGofm+3hNx6j4nbVv9JgNI+3hFC4tqWd1XfqEEyvxAfrFg==',key_name='tempest-keypair-1873639358',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:51:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='636fa9a1f046425e9332cc3807f8fb46',ramdisk_id='',reservation_id='r-l8f9vy9a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-3431122',owner_user_name='tempest-AttachVolumeNegativeTest-3431122-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T10:51:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa362c35530641a687a33182012c2332',uuid=63b5b88a-f126-4e6c-926d-0a295830240d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59550f49-12c8-4ca1-b957-2c0a631dfa84", "address": "fa:16:3e:1a:59:9b", "network": {"id": "d9bcdec6-69e0-4e65-8a26-1af1f8232365", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1227861580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "636fa9a1f046425e9332cc3807f8fb46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59550f49-12", "ovs_interfaceid": "59550f49-12c8-4ca1-b957-2c0a631dfa84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-90e6cfcc-70fe-438c-8a33-79c9a6584f77 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Converting VIF {"id": "59550f49-12c8-4ca1-b957-2c0a631dfa84", "address": "fa:16:3e:1a:59:9b", "network": {"id": "d9bcdec6-69e0-4e65-8a26-1af1f8232365", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1227861580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "636fa9a1f046425e9332cc3807f8fb46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59550f49-12", "ovs_interfaceid": "59550f49-12c8-4ca1-b957-2c0a631dfa84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-90e6cfcc-70fe-438c-8a33-79c9a6584f77 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:59:9b,bridge_name='br-int',has_traffic_filtering=True,id=59550f49-12c8-4ca1-b957-2c0a631dfa84,network=Network(d9bcdec6-69e0-4e65-8a26-1af1f8232365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59550f49-12') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG os_vif [None req-90e6cfcc-70fe-438c-8a33-79c9a6584f77 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:59:9b,bridge_name='br-int',has_traffic_filtering=True,id=59550f49-12c8-4ca1-b957-2c0a631dfa84,network=Network(d9bcdec6-69e0-4e65-8a26-1af1f8232365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59550f49-12') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap59550f49-12, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:53:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-334407463',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-334407463',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3344074',id=17,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAZD7cCV7qdiRDWORJYCVPD9BojVA/1PpPODS5g7foZBf4nGVbj2vd37Q5iWC7o7bL/HIvxEvdfj3u8xJu1kfOZQQZiLcun8yBQtArxEann9z8uDB+QC+TyTIenS55e+g==',key_name='tempest-keypair-722068600',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9120da612e254822a611672d14e37690',ramdisk_id='',reservation_id='r-842ks1jt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2035264822',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:53:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89011c8506684d7c8334479ceb563468',uuid=b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4dfa3aa6-df94-4d84-ac44-2e0c807640bb", "address": "fa:16:3e:ab:1e:fc", "network": {"id": "aeb89ffc-c2f3-4a19-b7cb-e273021f655a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-334414746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9120da612e254822a611672d14e37690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dfa3aa6-df", "ovs_interfaceid": "4dfa3aa6-df94-4d84-ac44-2e0c807640bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Converting VIF {"id": "4dfa3aa6-df94-4d84-ac44-2e0c807640bb", "address": "fa:16:3e:ab:1e:fc", "network": {"id": "aeb89ffc-c2f3-4a19-b7cb-e273021f655a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-334414746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9120da612e254822a611672d14e37690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dfa3aa6-df", "ovs_interfaceid": "4dfa3aa6-df94-4d84-ac44-2e0c807640bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:1e:fc,bridge_name='br-int',has_traffic_filtering=True,id=4dfa3aa6-df94-4d84-ac44-2e0c807640bb,network=Network(aeb89ffc-c2f3-4a19-b7cb-e273021f655a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dfa3aa6-df') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG nova.objects.instance [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Lazy-loading 'pci_devices' on Instance uuid b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c295f6d7-7ca0-467e-af38-1a7be16c4808) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] End _get_guest_xml xml=<domain type="kvm">
Nov 28 10:53:16 user nova-compute[74994]:   <uuid>b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6</uuid>
Nov 28 10:53:16 user nova-compute[74994]:   <name>instance-00000011</name>
Nov 28 10:53:16 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 10:53:16 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 10:53:16 user nova-compute[74994]:   <metadata>
Nov 28 10:53:16 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 10:53:16 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 10:53:16 user nova-compute[74994]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-334407463</nova:name>
Nov 28 10:53:16 user nova-compute[74994]:       <nova:creationTime>2023-11-28 10:53:16</nova:creationTime>
Nov 28 10:53:16 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 10:53:16 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 10:53:16 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 10:53:16 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 10:53:16 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 10:53:16 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 10:53:16 user nova-compute[74994]:       </nova:flavor>
Nov 28 10:53:16 user nova-compute[74994]:       <nova:owner>
Nov 28 10:53:16 user nova-compute[74994]:         <nova:user uuid="89011c8506684d7c8334479ceb563468">tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member</nova:user>
Nov 28 10:53:16 user nova-compute[74994]:         <nova:project uuid="9120da612e254822a611672d14e37690">tempest-TestServerVolumeAttachScenarioOldVersion-2035264822</nova:project>
Nov 28 10:53:16 user nova-compute[74994]:       </nova:owner>
Nov 28 10:53:16 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 10:53:16 user nova-compute[74994]:       <nova:ports>
Nov 28 10:53:16 user nova-compute[74994]:         <nova:port uuid="4dfa3aa6-df94-4d84-ac44-2e0c807640bb">
Nov 28 10:53:16 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 10:53:16 user nova-compute[74994]:         </nova:port>
Nov 28 10:53:16 user nova-compute[74994]:       </nova:ports>
Nov 28 10:53:16 user nova-compute[74994]:     </nova:instance>
Nov 28 10:53:16 user nova-compute[74994]:   </metadata>
Nov 28 10:53:16 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 10:53:16 user nova-compute[74994]:     <system>
Nov 28 10:53:16 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 10:53:16 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 10:53:16 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 10:53:16 user nova-compute[74994]:       <entry name="serial">b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6</entry>
Nov 28 10:53:16 user nova-compute[74994]:       <entry name="uuid">b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6</entry>
Nov 28 10:53:16 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 10:53:16 user nova-compute[74994]:     </system>
Nov 28 10:53:16 user nova-compute[74994]:   </sysinfo>
Nov 28 10:53:16 user nova-compute[74994]:   <os>
Nov 28 10:53:16 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 10:53:16 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 10:53:16 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 10:53:16 user nova-compute[74994]:   </os>
Nov 28 10:53:16 user nova-compute[74994]:   <features>
Nov 28 10:53:16 user nova-compute[74994]:     <acpi/>
Nov 28 10:53:16 user nova-compute[74994]:     <apic/>
Nov 28 10:53:16 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 10:53:16 user nova-compute[74994]:   </features>
Nov 28 10:53:16 user nova-compute[74994]:   <clock offset="utc">
Nov 28 10:53:16 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 10:53:16 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 10:53:16 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 10:53:16 user nova-compute[74994]:   </clock>
Nov 28 10:53:16 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 10:53:16 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 10:53:16 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 10:53:16 user nova-compute[74994]:   </cpu>
Nov 28 10:53:16 user nova-compute[74994]:   <devices>
Nov 28 10:53:16 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 10:53:16 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 10:53:16 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6/disk"/>
Nov 28 10:53:16 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 10:53:16 user nova-compute[74994]:     </disk>
Nov 28 10:53:16 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 10:53:16 user nova-compute[74994]:       <mac address="fa:16:3e:ab:1e:fc"/>
Nov 28 10:53:16 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:53:16 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 10:53:16 user nova-compute[74994]:       <target dev="tap4dfa3aa6-df"/>
Nov 28 10:53:16 user nova-compute[74994]:     </interface>
Nov 28 10:53:16 user nova-compute[74994]:     <serial type="pty">
Nov 28 10:53:16 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6/console.log" append="off"/>
Nov 28 10:53:16 user nova-compute[74994]:     </serial>
Nov 28 10:53:16 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 10:53:16 user nova-compute[74994]:     <video>
Nov 28 10:53:16 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:53:16 user nova-compute[74994]:     </video>
Nov 28 10:53:16 user nova-compute[74994]:     <rng model="virtio">
Nov 28 10:53:16 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 10:53:16 user nova-compute[74994]:     </rng>
Nov 28 10:53:16 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 10:53:16 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 10:53:16 user nova-compute[74994]:       <stats period="10"/>
Nov 28 10:53:16 user nova-compute[74994]:     </memballoon>
Nov 28 10:53:16 user nova-compute[74994]:   </devices>
Nov 28 10:53:16 user nova-compute[74994]: </domain>
Nov 28 10:53:16 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:53:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-334407463',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-334407463',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3344074',id=17,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAZD7cCV7qdiRDWORJYCVPD9BojVA/1PpPODS5g7foZBf4nGVbj2vd37Q5iWC7o7bL/HIvxEvdfj3u8xJu1kfOZQQZiLcun8yBQtArxEann9z8uDB+QC+TyTIenS55e+g==',key_name='tempest-keypair-722068600',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9120da612e254822a611672d14e37690',ramdisk_id='',reservation_id='r-842ks1jt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2035264822',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:53:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89011c8506684d7c8334479ceb563468',uuid=b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4dfa3aa6-df94-4d84-ac44-2e0c807640bb", "address": "fa:16:3e:ab:1e:fc", "network": {"id": "aeb89ffc-c2f3-4a19-b7cb-e273021f655a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-334414746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9120da612e254822a611672d14e37690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dfa3aa6-df", "ovs_interfaceid": "4dfa3aa6-df94-4d84-ac44-2e0c807640bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Converting VIF {"id": "4dfa3aa6-df94-4d84-ac44-2e0c807640bb", "address": "fa:16:3e:ab:1e:fc", "network": {"id": "aeb89ffc-c2f3-4a19-b7cb-e273021f655a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-334414746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9120da612e254822a611672d14e37690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dfa3aa6-df", "ovs_interfaceid": "4dfa3aa6-df94-4d84-ac44-2e0c807640bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:1e:fc,bridge_name='br-int',has_traffic_filtering=True,id=4dfa3aa6-df94-4d84-ac44-2e0c807640bb,network=Network(aeb89ffc-c2f3-4a19-b7cb-e273021f655a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dfa3aa6-df') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG os_vif [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:1e:fc,bridge_name='br-int',has_traffic_filtering=True,id=4dfa3aa6-df94-4d84-ac44-2e0c807640bb,network=Network(aeb89ffc-c2f3-4a19-b7cb-e273021f655a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dfa3aa6-df') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b51bfec9-39a9-5077-aefb-ada6538006f4', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:53:16 user nova-compute[74994]: INFO os_vif [None req-90e6cfcc-70fe-438c-8a33-79c9a6584f77 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:59:9b,bridge_name='br-int',has_traffic_filtering=True,id=59550f49-12c8-4ca1-b957-2c0a631dfa84,network=Network(d9bcdec6-69e0-4e65-8a26-1af1f8232365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59550f49-12')
Nov 28 10:53:16 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-90e6cfcc-70fe-438c-8a33-79c9a6584f77 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Deleting instance files /opt/stack/data/nova/instances/63b5b88a-f126-4e6c-926d-0a295830240d_del
Nov 28 10:53:16 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-90e6cfcc-70fe-438c-8a33-79c9a6584f77 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Deletion of /opt/stack/data/nova/instances/63b5b88a-f126-4e6c-926d-0a295830240d_del complete
Nov 28 10:53:16 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] No VIF found with MAC fa:16:3e:5d:59:b1, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4dfa3aa6-df, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4dfa3aa6-df, col_values=(('qos', UUID('ce1c5c89-5e17-4bff-9aa8-95715031bdab')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4dfa3aa6-df, col_values=(('external_ids', {'iface-id': '4dfa3aa6-df94-4d84-ac44-2e0c807640bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:1e:fc', 'vm-uuid': 'b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:16 user nova-compute[74994]: INFO os_vif [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:1e:fc,bridge_name='br-int',has_traffic_filtering=True,id=4dfa3aa6-df94-4d84-ac44-2e0c807640bb,network=Network(aeb89ffc-c2f3-4a19-b7cb-e273021f655a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dfa3aa6-df')
Nov 28 10:53:16 user nova-compute[74994]: INFO nova.compute.manager [None req-90e6cfcc-70fe-438c-8a33-79c9a6584f77 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Took 1.29 seconds to destroy the instance on the hypervisor.
Nov 28 10:53:16 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-90e6cfcc-70fe-438c-8a33-79c9a6584f77 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] No VIF found with MAC fa:16:3e:ab:1e:fc, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3238a195-f619-4674-84fc-ff9c1f2456c2 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.868s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG nova.network.neutron [req-9b1ddec6-8a5b-4eff-8e69-0657f218ae6b req-711a065b-f92e-45f1-b10d-bc3c06215e52 service nova] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Updated VIF entry in instance network info cache for port 4dfa3aa6-df94-4d84-ac44-2e0c807640bb. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG nova.network.neutron [req-9b1ddec6-8a5b-4eff-8e69-0657f218ae6b req-711a065b-f92e-45f1-b10d-bc3c06215e52 service nova] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Updating instance_info_cache with network_info: [{"id": "4dfa3aa6-df94-4d84-ac44-2e0c807640bb", "address": "fa:16:3e:ab:1e:fc", "network": {"id": "aeb89ffc-c2f3-4a19-b7cb-e273021f655a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-334414746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9120da612e254822a611672d14e37690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dfa3aa6-df", "ovs_interfaceid": "4dfa3aa6-df94-4d84-ac44-2e0c807640bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:53:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9b1ddec6-8a5b-4eff-8e69-0657f218ae6b req-711a065b-f92e-45f1-b10d-bc3c06215e52 service nova] Releasing lock "refresh_cache-b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:53:17 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:53:17 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Took 0.97 seconds to deallocate network for instance.
Nov 28 10:53:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-90e6cfcc-70fe-438c-8a33-79c9a6584f77 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-90e6cfcc-70fe-438c-8a33-79c9a6584f77 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:17 user nova-compute[74994]: DEBUG nova.compute.manager [req-174226ea-3515-4ac4-ad33-f67add57d716 req-0a6635a2-a326-4352-b464-1855920dd536 service nova] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Received event network-vif-plugged-59550f49-12c8-4ca1-b957-2c0a631dfa84 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:53:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-174226ea-3515-4ac4-ad33-f67add57d716 req-0a6635a2-a326-4352-b464-1855920dd536 service nova] Acquiring lock "63b5b88a-f126-4e6c-926d-0a295830240d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-174226ea-3515-4ac4-ad33-f67add57d716 req-0a6635a2-a326-4352-b464-1855920dd536 service nova] Lock "63b5b88a-f126-4e6c-926d-0a295830240d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-174226ea-3515-4ac4-ad33-f67add57d716 req-0a6635a2-a326-4352-b464-1855920dd536 service nova] Lock "63b5b88a-f126-4e6c-926d-0a295830240d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:17 user nova-compute[74994]: DEBUG nova.compute.manager [req-174226ea-3515-4ac4-ad33-f67add57d716 req-0a6635a2-a326-4352-b464-1855920dd536 service nova] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] No waiting events found dispatching network-vif-plugged-59550f49-12c8-4ca1-b957-2c0a631dfa84 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:53:17 user nova-compute[74994]: WARNING nova.compute.manager [req-174226ea-3515-4ac4-ad33-f67add57d716 req-0a6635a2-a326-4352-b464-1855920dd536 service nova] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Received unexpected event network-vif-plugged-59550f49-12c8-4ca1-b957-2c0a631dfa84 for instance with vm_state deleted and task_state None.
Nov 28 10:53:17 user nova-compute[74994]: DEBUG nova.compute.manager [req-174226ea-3515-4ac4-ad33-f67add57d716 req-0a6635a2-a326-4352-b464-1855920dd536 service nova] [instance: 63b5b88a-f126-4e6c-926d-0a295830240d] Received event network-vif-deleted-59550f49-12c8-4ca1-b957-2c0a631dfa84 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:53:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:17 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-90e6cfcc-70fe-438c-8a33-79c9a6584f77 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:53:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:17 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-90e6cfcc-70fe-438c-8a33-79c9a6584f77 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:53:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-90e6cfcc-70fe-438c-8a33-79c9a6584f77 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.398s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:17 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-90e6cfcc-70fe-438c-8a33-79c9a6584f77 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Deleted allocations for instance 63b5b88a-f126-4e6c-926d-0a295830240d
Nov 28 10:53:18 user nova-compute[74994]: DEBUG nova.compute.manager [req-3b1f0276-139d-47dc-9a35-65528cc8d118 req-0bb487d9-ee17-4b58-b117-b8152ef51a2a service nova] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Received event network-vif-plugged-4dfa3aa6-df94-4d84-ac44-2e0c807640bb {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:53:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-3b1f0276-139d-47dc-9a35-65528cc8d118 req-0bb487d9-ee17-4b58-b117-b8152ef51a2a service nova] Acquiring lock "b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-3b1f0276-139d-47dc-9a35-65528cc8d118 req-0bb487d9-ee17-4b58-b117-b8152ef51a2a service nova] Lock "b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-3b1f0276-139d-47dc-9a35-65528cc8d118 req-0bb487d9-ee17-4b58-b117-b8152ef51a2a service nova] Lock "b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:18 user nova-compute[74994]: DEBUG nova.compute.manager [req-3b1f0276-139d-47dc-9a35-65528cc8d118 req-0bb487d9-ee17-4b58-b117-b8152ef51a2a service nova] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] No waiting events found dispatching network-vif-plugged-4dfa3aa6-df94-4d84-ac44-2e0c807640bb {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:53:18 user nova-compute[74994]: WARNING nova.compute.manager [req-3b1f0276-139d-47dc-9a35-65528cc8d118 req-0bb487d9-ee17-4b58-b117-b8152ef51a2a service nova] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Received unexpected event network-vif-plugged-4dfa3aa6-df94-4d84-ac44-2e0c807640bb for instance with vm_state building and task_state spawning.
Nov 28 10:53:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-90e6cfcc-70fe-438c-8a33-79c9a6584f77 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "63b5b88a-f126-4e6c-926d-0a295830240d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.905s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:18 user nova-compute[74994]: DEBUG nova.compute.manager [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Stashing vm_state: active {{(pid=74994) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 28 10:53:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:18 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 10:53:18 user nova-compute[74994]: INFO nova.compute.claims [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Claim successful on node user
Nov 28 10:53:18 user nova-compute[74994]: INFO nova.compute.resource_tracker [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Updating resource usage from migration fc984819-af57-4b88-9e1c-f21db2a5d0cf
Nov 28 10:53:18 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:53:18 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:53:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.472s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:18 user nova-compute[74994]: INFO nova.compute.manager [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Migrating
Nov 28 10:53:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:53:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:53:18 user nova-compute[74994]: INFO nova.compute.rpcapi [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 28 10:53:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:53:19 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Acquiring lock "refresh_cache-2535b6f2-2a4b-4ce1-bd47-0f97d15700fb" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:53:19 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Acquired lock "refresh_cache-2535b6f2-2a4b-4ce1-bd47-0f97d15700fb" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:53:19 user nova-compute[74994]: DEBUG nova.network.neutron [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 10:53:19 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:19 user nova-compute[74994]: DEBUG nova.network.neutron [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Updating instance_info_cache with network_info: [{"id": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "address": "fa:16:3e:5d:59:b1", "network": {"id": "670b5fe0-96f5-4414-9425-31ee24eda138", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1327797043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9bc007c45c84765bb2739844c7af055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcb29ac-ee", "ovs_interfaceid": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:53:19 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Releasing lock "refresh_cache-2535b6f2-2a4b-4ce1-bd47-0f97d15700fb" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:53:19 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Starting migrate_disk_and_power_off {{(pid=74994) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 28 10:53:19 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:19 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:19 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:19 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG nova.compute.manager [req-144f2a24-dc5a-4603-94ae-873f60b61477 req-bc4490ad-9024-4a9d-ae7e-cb67ba98069a service nova] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Received event network-vif-unplugged-7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-144f2a24-dc5a-4603-94ae-873f60b61477 req-bc4490ad-9024-4a9d-ae7e-cb67ba98069a service nova] Acquiring lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-144f2a24-dc5a-4603-94ae-873f60b61477 req-bc4490ad-9024-4a9d-ae7e-cb67ba98069a service nova] Lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-144f2a24-dc5a-4603-94ae-873f60b61477 req-bc4490ad-9024-4a9d-ae7e-cb67ba98069a service nova] Lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG nova.compute.manager [req-144f2a24-dc5a-4603-94ae-873f60b61477 req-bc4490ad-9024-4a9d-ae7e-cb67ba98069a service nova] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] No waiting events found dispatching network-vif-unplugged-7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:53:20 user nova-compute[74994]: WARNING nova.compute.manager [req-144f2a24-dc5a-4603-94ae-873f60b61477 req-bc4490ad-9024-4a9d-ae7e-cb67ba98069a service nova] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Received unexpected event network-vif-unplugged-7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a for instance with vm_state active and task_state resize_migrating.
Nov 28 10:53:20 user nova-compute[74994]: DEBUG nova.compute.manager [req-51355bd1-df85-4dba-95e9-e95b5bcd61ec req-78bf583e-2d51-494c-bdf6-f7990a5cf2f0 service nova] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Received event network-vif-plugged-4dfa3aa6-df94-4d84-ac44-2e0c807640bb {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-51355bd1-df85-4dba-95e9-e95b5bcd61ec req-78bf583e-2d51-494c-bdf6-f7990a5cf2f0 service nova] Acquiring lock "b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-51355bd1-df85-4dba-95e9-e95b5bcd61ec req-78bf583e-2d51-494c-bdf6-f7990a5cf2f0 service nova] Lock "b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-51355bd1-df85-4dba-95e9-e95b5bcd61ec req-78bf583e-2d51-494c-bdf6-f7990a5cf2f0 service nova] Lock "b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG nova.compute.manager [req-51355bd1-df85-4dba-95e9-e95b5bcd61ec req-78bf583e-2d51-494c-bdf6-f7990a5cf2f0 service nova] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] No waiting events found dispatching network-vif-plugged-4dfa3aa6-df94-4d84-ac44-2e0c807640bb {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:53:20 user nova-compute[74994]: WARNING nova.compute.manager [req-51355bd1-df85-4dba-95e9-e95b5bcd61ec req-78bf583e-2d51-494c-bdf6-f7990a5cf2f0 service nova] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Received unexpected event network-vif-plugged-4dfa3aa6-df94-4d84-ac44-2e0c807640bb for instance with vm_state building and task_state spawning.
Nov 28 10:53:20 user nova-compute[74994]: DEBUG nova.compute.manager [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 10:53:20 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Instance spawned successfully.
Nov 28 10:53:20 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:20 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Instance destroyed successfully.
Nov 28 10:53:20 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:49:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-502885888',display_name='tempest-ServerActionsTestOtherB-server-502885888',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-502885888',id=7,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAP2WYAYbmEHvo9gpy8E02p/bOJRkvsKNh1AOdzva6YpAs9spAOOEI0cMhVl9gL/EJuJSrtBF2pmysHal8/jsBIX9uFnmSQR89/cpFlQWiHlWT+1v4Gox5jUD1SpkJCj+g==',key_name='tempest-keypair-1209998822',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:49:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b9bc007c45c84765bb2739844c7af055',ramdisk_id='',reservation_id='r-w4ylqmii',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-585983328',owner_user_name='tempest-ServerActionsTestOtherB-585983328-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:53:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d4253b9511f408a9c62c79cff8fc0d7',uuid=2535b6f2-2a4b-4ce1-bd47-0f97d15700fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "address": "fa:16:3e:5d:59:b1", "network": {"id": "670b5fe0-96f5-4414-9425-31ee24eda138", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1327797043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1327797043-network", "vif_mac": "fa:16:3e:5d:59:b1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9bc007c45c84765bb2739844c7af055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcb29ac-ee", "ovs_interfaceid": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Converting VIF {"id": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "address": "fa:16:3e:5d:59:b1", "network": {"id": "670b5fe0-96f5-4414-9425-31ee24eda138", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1327797043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1327797043-network", "vif_mac": "fa:16:3e:5d:59:b1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9bc007c45c84765bb2739844c7af055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcb29ac-ee", "ovs_interfaceid": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:59:b1,bridge_name='br-int',has_traffic_filtering=True,id=7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a,network=Network(670b5fe0-96f5-4414-9425-31ee24eda138),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bcb29ac-ee') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG os_vif [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:59:b1,bridge_name='br-int',has_traffic_filtering=True,id=7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a,network=Network(670b5fe0-96f5-4414-9425-31ee24eda138),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bcb29ac-ee') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7bcb29ac-ee, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f1e81a78-52c0-4f15-af5e-c738e48dfeeb) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:20 user nova-compute[74994]: INFO os_vif [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:59:b1,bridge_name='br-int',has_traffic_filtering=True,id=7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a,network=Network(670b5fe0-96f5-4414-9425-31ee24eda138),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bcb29ac-ee')
Nov 28 10:53:20 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QFVecHNB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:53:20 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:53:20 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:53:20 user nova-compute[74994]: INFO nova.compute.manager [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Took 6.28 seconds to spawn the instance on the hypervisor.
Nov 28 10:53:20 user nova-compute[74994]: DEBUG nova.compute.manager [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[347288f0-acc5-45cb-8de6-d3aed64e17e2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 10:53:20 user nova-compute[74994]: No targets found.
Nov 28 10:53:20 user nova-compute[74994]: iSNS:
Nov 28 10:53:20 user nova-compute[74994]: No targets found.
Nov 28 10:53:20 user nova-compute[74994]: STATIC:
Nov 28 10:53:20 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77
Nov 28 10:53:20 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:53:20 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:53:20 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de
Nov 28 10:53:20 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:53:20 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:53:20 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f
Nov 28 10:53:20 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:53:20 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:53:20 user nova-compute[74994]: FIRMWARE:
Nov 28 10:53:20 user nova-compute[74994]: No targets found.
Nov 28 10:53:20 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 10:53:20 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 10:53:20 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c89a1f-80a4-440f-8ca5-6acad166fb7a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c7f799-d1ea-45c4-908d-d86fb4cf0d74]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:53:20 user nova-compute[74994]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)
Nov 28 10:53:20 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:53:20 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:53:20 user nova-compute[74994]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)
Nov 28 10:53:20 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:53:20 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9206b3640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77'): ({'sdc'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Removing single pathed devices sdc {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:20 user nova-compute[74994]: INFO nova.compute.manager [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Took 7.12 seconds to build instance.
Nov 28 10:53:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed5534b-c766-4c56-b3ff-2c3fa9b2427f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1da2ab5d-3695-4e7a-887d-c5d1e6bf2b63 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Lock "b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.256s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31a7b5f-b830-49a2-8de6-2da071f351ed]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Flushing IO for device /dev/sdc {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b0935f-cd0f-4093-b24c-b5f9701c4bda]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aba0aae-3c34-41da-a8b9-68ba01b3b52e]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] SCSI volumes sdc have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 10:53:20 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 10:53:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:21 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb51e13b-2ece-40af-8400-e86d6e00d0fb]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:53:21 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:53:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:21 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6546b267-321b-480c-ab59-367f80c42c18]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:53:21 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77, portal: 172.16.0.220,3260]
Nov 28 10:53:21 user nova-compute[74994]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77, portal: 172.16.0.220,3260] successful.
Nov 28 10:53:21 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:53:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:21 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf87f4a-14ee-41dc-9808-1db20b0ce3bd]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:53:21 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:53:21 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:53:21 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] <== disconnect_volume: return (312ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:53:21 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 10:53:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:21 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 10:53:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb_resize/disk /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] CMD "cp -r /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb_resize/disk /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk" returned: 0 in 0.345s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb_resize/disk.info /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk.info {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] CMD "cp -r /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb_resize/disk.info /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk.info" returned: 0 in 0.042s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:22 user nova-compute[74994]: DEBUG nova.compute.manager [req-a21b7f46-1b1f-4e8a-a512-2be6a428e71d req-67fb91fa-1707-447c-8a92-6ee03b92c6c5 service nova] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Received event network-vif-plugged-7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:53:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a21b7f46-1b1f-4e8a-a512-2be6a428e71d req-67fb91fa-1707-447c-8a92-6ee03b92c6c5 service nova] Acquiring lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a21b7f46-1b1f-4e8a-a512-2be6a428e71d req-67fb91fa-1707-447c-8a92-6ee03b92c6c5 service nova] Lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a21b7f46-1b1f-4e8a-a512-2be6a428e71d req-67fb91fa-1707-447c-8a92-6ee03b92c6c5 service nova] Lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:22 user nova-compute[74994]: DEBUG nova.compute.manager [req-a21b7f46-1b1f-4e8a-a512-2be6a428e71d req-67fb91fa-1707-447c-8a92-6ee03b92c6c5 service nova] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] No waiting events found dispatching network-vif-plugged-7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:53:22 user nova-compute[74994]: WARNING nova.compute.manager [req-a21b7f46-1b1f-4e8a-a512-2be6a428e71d req-67fb91fa-1707-447c-8a92-6ee03b92c6c5 service nova] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Received unexpected event network-vif-plugged-7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a for instance with vm_state active and task_state resize_migrating.
Nov 28 10:53:22 user nova-compute[74994]: DEBUG nova.network.neutron [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Port 7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a binding to destination host user is already ACTIVE {{(pid=74994) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 28 10:53:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Acquiring lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Acquiring lock "refresh_cache-2535b6f2-2a4b-4ce1-bd47-0f97d15700fb" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:53:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Acquired lock "refresh_cache-2535b6f2-2a4b-4ce1-bd47-0f97d15700fb" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:53:23 user nova-compute[74994]: DEBUG nova.network.neutron [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 10:53:23 user nova-compute[74994]: DEBUG nova.network.neutron [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Updating instance_info_cache with network_info: [{"id": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "address": "fa:16:3e:5d:59:b1", "network": {"id": "670b5fe0-96f5-4414-9425-31ee24eda138", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1327797043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9bc007c45c84765bb2739844c7af055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcb29ac-ee", "ovs_interfaceid": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:53:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Releasing lock "refresh_cache-2535b6f2-2a4b-4ce1-bd47-0f97d15700fb" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:53:23 user nova-compute[74994]: DEBUG os_brick.utils [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:53:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eeb2748-260e-46f9-a77b-29ebdcc88e5d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:53:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:24 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ccba0f-46cd-47db-b154-ac3d1588d85e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:53:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:24 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9635af44-aa13-44a8-924b-6821c576351d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:53:24 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bab0022-5628-49de-adac-fa7a54ab3eda]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:53:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:53:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 10:53:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:53:24 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 10:53:24 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64514d4-e88a-4b1d-a058-44f457e9e16b]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:53:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 10:53:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 10:53:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 10:53:24 user nova-compute[74994]: DEBUG os_brick.utils [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:53:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:31 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Starting finish_migration {{(pid=74994) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 28 10:53:31 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Instance directory exists: not creating {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 10:53:31 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Creating image(s)
Nov 28 10:53:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.176s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:31 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk. size=21474836480 {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 10:53:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk 21474836480 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk 21474836480" returned: 0 in 0.043s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:31 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Did not create local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 10:53:31 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Ensure instance console log exists: /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 10:53:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:31 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Start _get_guest_xml network_info=[{"id": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "address": "fa:16:3e:5d:59:b1", "network": {"id": "670b5fe0-96f5-4414-9425-31ee24eda138", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1327797043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1327797043-network", "vif_mac": "fa:16:3e:5d:59:b1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9bc007c45c84765bb2739844c7af055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcb29ac-ee", "ovs_interfaceid": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'aa939d1b-b8a6-4391-935b-0191bf5ccd0a'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QFVecHNB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '2535b6f2-2a4b-4ce1-bd47-0f97d15700fb', 'attached_at': '2023-11-28T10:53:31.000000', 'detached_at': '', 'volume_id': '35aee3f6-cd85-4e5a-9b2e-f9646455aa77', 'serial': '35aee3f6-cd85-4e5a-9b2e-f9646455aa77'}, 'attachment_id': '37270ec8-af6d-4817-975f-f655c09d0685', 'boot_index': None, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 10:53:31 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:53:31 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:53:31 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 10:53:31 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 10:53:31 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 10:53:31 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 10:53:31 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 10:53:31 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 10:53:31 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 10:53:31 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 10:53:31 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 10:53:31 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 10:53:31 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 10:53:31 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 10:53:31 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 10:53:31 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 10:53:31 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 10:53:31 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 10:53:31 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 10:53:31 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QFVecHNB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:53:31 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:53:31 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:53:31 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:53:31 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:53:31 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:53:31 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:53:31 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 10:53:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:31 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f644a9c6-7c44-4fe6-b122-78192115b835]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:53:31 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 10:53:31 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:53:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:32 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[405154b8-e145-43ef-9a8a-9b39067c3e12]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:53:32 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77] added
Nov 28 10:53:32 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:53:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:32 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c3eca9-5a52-4208-805f-5d78b3011386]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:53:32 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:53:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:32 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa62817-4430-46bc-a195-974cb740f334]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:53:32 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:53:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QFVecHNB {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QFVecHNB" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:32 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7700fa-f75f-4038-84a9-57042ad59749]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:53:32 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QFVecHNB'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:53:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:32 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c2da6a-7cd5-4262-b704-3225357218e6]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:53:32 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:53:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:32 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce27091-af4c-4c82-af4e-ba875fc20daf]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:53:32 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:53:32 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:53:32 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:53:32 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:53:32 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:53:32 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:53:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:32 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[987da5d4-a9d3-44d6-8563-7c684acf80ce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:53:32 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77, portal: 172.16.0.220,3260]
Nov 28 10:53:32 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77, portal: 172.16.0.220,3260] successful.
Nov 28 10:53:32 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:53:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:32 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3865e17e-af99-4fcb-9453-ff037bfce5e2]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:53:32 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:53:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:32 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce60f76-9f4a-4838-a42a-02969cba6e0b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:53:32 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:53:32 user nova-compute[74994]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)
Nov 28 10:53:32 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:53:32 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:53:32 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:53:32 user nova-compute[74994]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)
Nov 28 10:53:32 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:53:32 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:53:32 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:53:32 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 10:53:32 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 10:53:32 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 10:53:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:32 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b607d45-290e-4d9b-9b4f-006c5d3cf2f1]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:53:32 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 10:53:32 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QFVecHNB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 10:53:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:53:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '26365386661363434', 'path': '/dev/sdc'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:53:33 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365386661363434', 'path': '/dev/sdc'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 10:53:33 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:49:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-502885888',display_name='tempest-ServerActionsTestOtherB-server-502885888',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-502885888',id=7,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAP2WYAYbmEHvo9gpy8E02p/bOJRkvsKNh1AOdzva6YpAs9spAOOEI0cMhVl9gL/EJuJSrtBF2pmysHal8/jsBIX9uFnmSQR89/cpFlQWiHlWT+1v4Gox5jUD1SpkJCj+g==',key_name='tempest-keypair-1209998822',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:49:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b9bc007c45c84765bb2739844c7af055',ramdisk_id='',reservation_id='r-w4ylqmii',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-585983328',owner_user_name='tempest-ServerActionsTestOtherB-585983328-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:53:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d4253b9511f408a9c62c79cff8fc0d7',uuid=2535b6f2-2a4b-4ce1-bd47-0f97d15700fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "address": "fa:16:3e:5d:59:b1", "network": {"id": "670b5fe0-96f5-4414-9425-31ee24eda138", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1327797043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1327797043-network", "vif_mac": "fa:16:3e:5d:59:b1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9bc007c45c84765bb2739844c7af055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcb29ac-ee", "ovs_interfaceid": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:53:33 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Converting VIF {"id": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "address": "fa:16:3e:5d:59:b1", "network": {"id": "670b5fe0-96f5-4414-9425-31ee24eda138", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1327797043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1327797043-network", "vif_mac": "fa:16:3e:5d:59:b1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9bc007c45c84765bb2739844c7af055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcb29ac-ee", "ovs_interfaceid": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:53:33 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:59:b1,bridge_name='br-int',has_traffic_filtering=True,id=7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a,network=Network(670b5fe0-96f5-4414-9425-31ee24eda138),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bcb29ac-ee') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:53:33 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] End _get_guest_xml xml=<domain type="kvm">
Nov 28 10:53:33 user nova-compute[74994]:   <uuid>2535b6f2-2a4b-4ce1-bd47-0f97d15700fb</uuid>
Nov 28 10:53:33 user nova-compute[74994]:   <name>instance-00000007</name>
Nov 28 10:53:33 user nova-compute[74994]:   <memory>2097152</memory>
Nov 28 10:53:33 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 10:53:33 user nova-compute[74994]:   <metadata>
Nov 28 10:53:33 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 10:53:33 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 10:53:33 user nova-compute[74994]:       <nova:name>tempest-ServerActionsTestOtherB-server-502885888</nova:name>
Nov 28 10:53:33 user nova-compute[74994]:       <nova:creationTime>2023-11-28 10:53:31</nova:creationTime>
Nov 28 10:53:33 user nova-compute[74994]:       <nova:flavor name="m1.small">
Nov 28 10:53:33 user nova-compute[74994]:         <nova:memory>2048</nova:memory>
Nov 28 10:53:33 user nova-compute[74994]:         <nova:disk>20</nova:disk>
Nov 28 10:53:33 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 10:53:33 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 10:53:33 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 10:53:33 user nova-compute[74994]:       </nova:flavor>
Nov 28 10:53:33 user nova-compute[74994]:       <nova:owner>
Nov 28 10:53:33 user nova-compute[74994]:         <nova:user uuid="0d4253b9511f408a9c62c79cff8fc0d7">tempest-ServerActionsTestOtherB-585983328-project-member</nova:user>
Nov 28 10:53:33 user nova-compute[74994]:         <nova:project uuid="b9bc007c45c84765bb2739844c7af055">tempest-ServerActionsTestOtherB-585983328</nova:project>
Nov 28 10:53:33 user nova-compute[74994]:       </nova:owner>
Nov 28 10:53:33 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 10:53:33 user nova-compute[74994]:       <nova:ports>
Nov 28 10:53:33 user nova-compute[74994]:         <nova:port uuid="7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a">
Nov 28 10:53:33 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 28 10:53:33 user nova-compute[74994]:         </nova:port>
Nov 28 10:53:33 user nova-compute[74994]:       </nova:ports>
Nov 28 10:53:33 user nova-compute[74994]:     </nova:instance>
Nov 28 10:53:33 user nova-compute[74994]:   </metadata>
Nov 28 10:53:33 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 10:53:33 user nova-compute[74994]:     <system>
Nov 28 10:53:33 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 10:53:33 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 10:53:33 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 10:53:33 user nova-compute[74994]:       <entry name="serial">2535b6f2-2a4b-4ce1-bd47-0f97d15700fb</entry>
Nov 28 10:53:33 user nova-compute[74994]:       <entry name="uuid">2535b6f2-2a4b-4ce1-bd47-0f97d15700fb</entry>
Nov 28 10:53:33 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 10:53:33 user nova-compute[74994]:     </system>
Nov 28 10:53:33 user nova-compute[74994]:   </sysinfo>
Nov 28 10:53:33 user nova-compute[74994]:   <os>
Nov 28 10:53:33 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 10:53:33 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 10:53:33 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 10:53:33 user nova-compute[74994]:   </os>
Nov 28 10:53:33 user nova-compute[74994]:   <features>
Nov 28 10:53:33 user nova-compute[74994]:     <acpi/>
Nov 28 10:53:33 user nova-compute[74994]:     <apic/>
Nov 28 10:53:33 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 10:53:33 user nova-compute[74994]:   </features>
Nov 28 10:53:33 user nova-compute[74994]:   <clock offset="utc">
Nov 28 10:53:33 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 10:53:33 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 10:53:33 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 10:53:33 user nova-compute[74994]:   </clock>
Nov 28 10:53:33 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 10:53:33 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 10:53:33 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 10:53:33 user nova-compute[74994]:   </cpu>
Nov 28 10:53:33 user nova-compute[74994]:   <devices>
Nov 28 10:53:33 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 10:53:33 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 10:53:33 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk"/>
Nov 28 10:53:33 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 10:53:33 user nova-compute[74994]:     </disk>
Nov 28 10:53:33 user nova-compute[74994]:     <disk type="block" device="disk">
Nov 28 10:53:33 user nova-compute[74994]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 10:53:33 user nova-compute[74994]:       <source dev="/dev/sdc"/>
Nov 28 10:53:33 user nova-compute[74994]:       <target dev="vdb" bus="virtio"/>
Nov 28 10:53:33 user nova-compute[74994]:       <serial>35aee3f6-cd85-4e5a-9b2e-f9646455aa77</serial>
Nov 28 10:53:33 user nova-compute[74994]:     </disk>
Nov 28 10:53:33 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 10:53:33 user nova-compute[74994]:       <mac address="fa:16:3e:5d:59:b1"/>
Nov 28 10:53:33 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:53:33 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 10:53:33 user nova-compute[74994]:       <target dev="tap7bcb29ac-ee"/>
Nov 28 10:53:33 user nova-compute[74994]:     </interface>
Nov 28 10:53:33 user nova-compute[74994]:     <serial type="pty">
Nov 28 10:53:33 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/console.log" append="off"/>
Nov 28 10:53:33 user nova-compute[74994]:     </serial>
Nov 28 10:53:33 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 10:53:33 user nova-compute[74994]:     <video>
Nov 28 10:53:33 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:53:33 user nova-compute[74994]:     </video>
Nov 28 10:53:33 user nova-compute[74994]:     <rng model="virtio">
Nov 28 10:53:33 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 10:53:33 user nova-compute[74994]:     </rng>
Nov 28 10:53:33 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 10:53:33 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 10:53:33 user nova-compute[74994]:       <stats period="10"/>
Nov 28 10:53:33 user nova-compute[74994]:     </memballoon>
Nov 28 10:53:33 user nova-compute[74994]:   </devices>
Nov 28 10:53:33 user nova-compute[74994]: </domain>
Nov 28 10:53:33 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 10:53:33 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:49:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-502885888',display_name='tempest-ServerActionsTestOtherB-server-502885888',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-502885888',id=7,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAP2WYAYbmEHvo9gpy8E02p/bOJRkvsKNh1AOdzva6YpAs9spAOOEI0cMhVl9gL/EJuJSrtBF2pmysHal8/jsBIX9uFnmSQR89/cpFlQWiHlWT+1v4Gox5jUD1SpkJCj+g==',key_name='tempest-keypair-1209998822',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:49:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b9bc007c45c84765bb2739844c7af055',ramdisk_id='',reservation_id='r-w4ylqmii',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-585983328',owner_user_name='tempest-ServerActionsTestOtherB-585983328-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:53:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d4253b9511f408a9c62c79cff8fc0d7',uuid=2535b6f2-2a4b-4ce1-bd47-0f97d15700fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "address": "fa:16:3e:5d:59:b1", "network": {"id": "670b5fe0-96f5-4414-9425-31ee24eda138", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1327797043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1327797043-network", "vif_mac": "fa:16:3e:5d:59:b1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9bc007c45c84765bb2739844c7af055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcb29ac-ee", "ovs_interfaceid": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 10:53:33 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Converting VIF {"id": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "address": "fa:16:3e:5d:59:b1", "network": {"id": "670b5fe0-96f5-4414-9425-31ee24eda138", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1327797043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1327797043-network", "vif_mac": "fa:16:3e:5d:59:b1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9bc007c45c84765bb2739844c7af055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcb29ac-ee", "ovs_interfaceid": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:53:33 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:59:b1,bridge_name='br-int',has_traffic_filtering=True,id=7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a,network=Network(670b5fe0-96f5-4414-9425-31ee24eda138),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bcb29ac-ee') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:53:33 user nova-compute[74994]: DEBUG os_vif [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:59:b1,bridge_name='br-int',has_traffic_filtering=True,id=7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a,network=Network(670b5fe0-96f5-4414-9425-31ee24eda138),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bcb29ac-ee') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 10:53:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:53:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 10:53:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7f9fa96b-511c-51dd-a4c6-ed21b3371ab7', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:53:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7bcb29ac-ee, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:53:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7bcb29ac-ee, col_values=(('qos', UUID('d43ba8ba-1313-4244-9264-7cb7edc1be16')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:53:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7bcb29ac-ee, col_values=(('external_ids', {'iface-id': '7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:59:b1', 'vm-uuid': '2535b6f2-2a4b-4ce1-bd47-0f97d15700fb'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:53:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:53:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:33 user nova-compute[74994]: INFO os_vif [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:59:b1,bridge_name='br-int',has_traffic_filtering=True,id=7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a,network=Network(670b5fe0-96f5-4414-9425-31ee24eda138),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bcb29ac-ee')
Nov 28 10:53:33 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:53:33 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:53:33 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] No VIF found with MAC fa:16:3e:5d:59:b1, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:53:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:35 user nova-compute[74994]: DEBUG nova.compute.manager [req-19833311-6623-4f69-9a5b-861106f6373c req-49186247-47f8-4de1-bc4c-24f09afedc63 service nova] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Received event network-vif-plugged-7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:53:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-19833311-6623-4f69-9a5b-861106f6373c req-49186247-47f8-4de1-bc4c-24f09afedc63 service nova] Acquiring lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-19833311-6623-4f69-9a5b-861106f6373c req-49186247-47f8-4de1-bc4c-24f09afedc63 service nova] Lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-19833311-6623-4f69-9a5b-861106f6373c req-49186247-47f8-4de1-bc4c-24f09afedc63 service nova] Lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:35 user nova-compute[74994]: DEBUG nova.compute.manager [req-19833311-6623-4f69-9a5b-861106f6373c req-49186247-47f8-4de1-bc4c-24f09afedc63 service nova] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] No waiting events found dispatching network-vif-plugged-7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:53:35 user nova-compute[74994]: WARNING nova.compute.manager [req-19833311-6623-4f69-9a5b-861106f6373c req-49186247-47f8-4de1-bc4c-24f09afedc63 service nova] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Received unexpected event network-vif-plugged-7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a for instance with vm_state active and task_state resize_finish.
Nov 28 10:53:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:36 user nova-compute[74994]: DEBUG nova.compute.manager [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 10:53:37 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Instance running successfully.
Nov 28 10:53:37 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Failed to set time: agent not configured {{(pid=74994) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 28 10:53:37 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-289f3131-60cc-4a8e-b6da-2681102f9ea7 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] finish_migration finished successfully. {{(pid=74994) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 28 10:53:37 user nova-compute[74994]: DEBUG nova.compute.manager [req-05bc5882-4a57-4e54-b87b-e4f756febb1f req-319d5d3a-bd34-447c-9467-f7ecce565c9b service nova] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Received event network-vif-plugged-7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:53:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-05bc5882-4a57-4e54-b87b-e4f756febb1f req-319d5d3a-bd34-447c-9467-f7ecce565c9b service nova] Acquiring lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-05bc5882-4a57-4e54-b87b-e4f756febb1f req-319d5d3a-bd34-447c-9467-f7ecce565c9b service nova] Lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-05bc5882-4a57-4e54-b87b-e4f756febb1f req-319d5d3a-bd34-447c-9467-f7ecce565c9b service nova] Lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:37 user nova-compute[74994]: DEBUG nova.compute.manager [req-05bc5882-4a57-4e54-b87b-e4f756febb1f req-319d5d3a-bd34-447c-9467-f7ecce565c9b service nova] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] No waiting events found dispatching network-vif-plugged-7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:53:37 user nova-compute[74994]: WARNING nova.compute.manager [req-05bc5882-4a57-4e54-b87b-e4f756febb1f req-319d5d3a-bd34-447c-9467-f7ecce565c9b service nova] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Received unexpected event network-vif-plugged-7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a for instance with vm_state active and task_state resize_finish.
Nov 28 10:53:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:44 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:45 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "20716905-c56a-4729-8c5b-9188502dc477" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:45 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "20716905-c56a-4729-8c5b-9188502dc477" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:45 user nova-compute[74994]: DEBUG nova.compute.manager [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 10:53:45 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:45 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:45 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 10:53:45 user nova-compute[74994]: INFO nova.compute.claims [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Claim successful on node user
Nov 28 10:53:46 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:53:46 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:53:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.489s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:46 user nova-compute[74994]: DEBUG nova.compute.manager [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 10:53:46 user nova-compute[74994]: DEBUG nova.compute.manager [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 10:53:46 user nova-compute[74994]: DEBUG nova.network.neutron [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20716905-c56a-4729-8c5b-9188502dc477] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 10:53:46 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 10:53:46 user nova-compute[74994]: DEBUG nova.compute.manager [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 10:53:46 user nova-compute[74994]: DEBUG nova.policy [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd51be473c7284977a6533756a1f677f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb43a8fc7bd47728600741762f71112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 10:53:46 user nova-compute[74994]: DEBUG nova.compute.manager [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 10:53:46 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 10:53:46 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Creating image(s)
Nov 28 10:53:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "/opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "/opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "/opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.085s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.225s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.203s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk 1073741824 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk 1073741824" returned: 0 in 0.058s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:47 user nova-compute[74994]: DEBUG nova.network.neutron [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Successfully created port: 10b84648-2b56-4451-b4f3-3ec4ad7b7771 {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 10:53:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.193s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:47 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Checking if we can resize image /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk. size=1073741824 {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 10:53:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:47 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Cannot resize image /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk to a smaller size. {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 10:53:47 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Created local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 10:53:47 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Ensure instance console log exists: /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 10:53:47 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:47 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:47 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG nova.network.neutron [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Successfully updated port: 10b84648-2b56-4451-b4f3-3ec4ad7b7771 {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "refresh_cache-20716905-c56a-4729-8c5b-9188502dc477" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquired lock "refresh_cache-20716905-c56a-4729-8c5b-9188502dc477" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG nova.network.neutron [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG nova.compute.manager [req-282da3b5-3ea6-4fb5-9c08-a915ed55e18b req-d968a190-7dc4-4514-abd8-ecf133191718 service nova] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Received event network-changed-10b84648-2b56-4451-b4f3-3ec4ad7b7771 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG nova.compute.manager [req-282da3b5-3ea6-4fb5-9c08-a915ed55e18b req-d968a190-7dc4-4514-abd8-ecf133191718 service nova] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Refreshing instance network info cache due to event network-changed-10b84648-2b56-4451-b4f3-3ec4ad7b7771. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-282da3b5-3ea6-4fb5-9c08-a915ed55e18b req-d968a190-7dc4-4514-abd8-ecf133191718 service nova] Acquiring lock "refresh_cache-20716905-c56a-4729-8c5b-9188502dc477" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG nova.network.neutron [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG nova.network.neutron [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Updating instance_info_cache with network_info: [{"id": "10b84648-2b56-4451-b4f3-3ec4ad7b7771", "address": "fa:16:3e:96:e0:ac", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b84648-2b", "ovs_interfaceid": "10b84648-2b56-4451-b4f3-3ec4ad7b7771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Releasing lock "refresh_cache-20716905-c56a-4729-8c5b-9188502dc477" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG nova.compute.manager [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Instance network_info: |[{"id": "10b84648-2b56-4451-b4f3-3ec4ad7b7771", "address": "fa:16:3e:96:e0:ac", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b84648-2b", "ovs_interfaceid": "10b84648-2b56-4451-b4f3-3ec4ad7b7771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-282da3b5-3ea6-4fb5-9c08-a915ed55e18b req-d968a190-7dc4-4514-abd8-ecf133191718 service nova] Acquired lock "refresh_cache-20716905-c56a-4729-8c5b-9188502dc477" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG nova.network.neutron [req-282da3b5-3ea6-4fb5-9c08-a915ed55e18b req-d968a190-7dc4-4514-abd8-ecf133191718 service nova] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Refreshing network info cache for port 10b84648-2b56-4451-b4f3-3ec4ad7b7771 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Start _get_guest_xml network_info=[{"id": "10b84648-2b56-4451-b4f3-3ec4ad7b7771", "address": "fa:16:3e:96:e0:ac", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b84648-2b", "ovs_interfaceid": "10b84648-2b56-4451-b4f3-3ec4ad7b7771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'aa939d1b-b8a6-4391-935b-0191bf5ccd0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 10:53:48 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:53:48 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:53:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:53:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2083256391',display_name='tempest-ServerActionsTestOtherA-server-2083256391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2083256391',id=18,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPW6Lty9ow0zAcm936yuU8WeLpHxpamSCaeKsFRdduK4jmYnIbGWXIhKjvJDlhN8evt/Hb3F2U1wYmR8qRXarp7uOZi0MsdjDWCq+Ku3i87+sooae0XVTHruzSkrMSatFQ==',key_name='tempest-keypair-1409463142',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5eb43a8fc7bd47728600741762f71112',ramdisk_id='',reservation_id='r-wrqbieqq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1927948343',owner_user_name='tempest-ServerActionsTestOtherA-1927948343-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:53:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d51be473c7284977a6533756a1f677f9',uuid=20716905-c56a-4729-8c5b-9188502dc477,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10b84648-2b56-4451-b4f3-3ec4ad7b7771", "address": "fa:16:3e:96:e0:ac", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b84648-2b", "ovs_interfaceid": "10b84648-2b56-4451-b4f3-3ec4ad7b7771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Converting VIF {"id": "10b84648-2b56-4451-b4f3-3ec4ad7b7771", "address": "fa:16:3e:96:e0:ac", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b84648-2b", "ovs_interfaceid": "10b84648-2b56-4451-b4f3-3ec4ad7b7771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:e0:ac,bridge_name='br-int',has_traffic_filtering=True,id=10b84648-2b56-4451-b4f3-3ec4ad7b7771,network=Network(16dd32cd-5a00-4111-92e2-283e7635540f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10b84648-2b') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG nova.objects.instance [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lazy-loading 'pci_devices' on Instance uuid 20716905-c56a-4729-8c5b-9188502dc477 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20716905-c56a-4729-8c5b-9188502dc477] End _get_guest_xml xml=<domain type="kvm">
Nov 28 10:53:48 user nova-compute[74994]:   <uuid>20716905-c56a-4729-8c5b-9188502dc477</uuid>
Nov 28 10:53:48 user nova-compute[74994]:   <name>instance-00000012</name>
Nov 28 10:53:48 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 10:53:48 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 10:53:48 user nova-compute[74994]:   <metadata>
Nov 28 10:53:48 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 10:53:48 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 10:53:48 user nova-compute[74994]:       <nova:name>tempest-ServerActionsTestOtherA-server-2083256391</nova:name>
Nov 28 10:53:48 user nova-compute[74994]:       <nova:creationTime>2023-11-28 10:53:48</nova:creationTime>
Nov 28 10:53:48 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 10:53:48 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 10:53:48 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 10:53:48 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 10:53:48 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 10:53:48 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 10:53:48 user nova-compute[74994]:       </nova:flavor>
Nov 28 10:53:48 user nova-compute[74994]:       <nova:owner>
Nov 28 10:53:48 user nova-compute[74994]:         <nova:user uuid="d51be473c7284977a6533756a1f677f9">tempest-ServerActionsTestOtherA-1927948343-project-member</nova:user>
Nov 28 10:53:48 user nova-compute[74994]:         <nova:project uuid="5eb43a8fc7bd47728600741762f71112">tempest-ServerActionsTestOtherA-1927948343</nova:project>
Nov 28 10:53:48 user nova-compute[74994]:       </nova:owner>
Nov 28 10:53:48 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 10:53:48 user nova-compute[74994]:       <nova:ports>
Nov 28 10:53:48 user nova-compute[74994]:         <nova:port uuid="10b84648-2b56-4451-b4f3-3ec4ad7b7771">
Nov 28 10:53:48 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 10:53:48 user nova-compute[74994]:         </nova:port>
Nov 28 10:53:48 user nova-compute[74994]:       </nova:ports>
Nov 28 10:53:48 user nova-compute[74994]:     </nova:instance>
Nov 28 10:53:48 user nova-compute[74994]:   </metadata>
Nov 28 10:53:48 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 10:53:48 user nova-compute[74994]:     <system>
Nov 28 10:53:48 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 10:53:48 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 10:53:48 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 10:53:48 user nova-compute[74994]:       <entry name="serial">20716905-c56a-4729-8c5b-9188502dc477</entry>
Nov 28 10:53:48 user nova-compute[74994]:       <entry name="uuid">20716905-c56a-4729-8c5b-9188502dc477</entry>
Nov 28 10:53:48 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 10:53:48 user nova-compute[74994]:     </system>
Nov 28 10:53:48 user nova-compute[74994]:   </sysinfo>
Nov 28 10:53:48 user nova-compute[74994]:   <os>
Nov 28 10:53:48 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 10:53:48 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 10:53:48 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 10:53:48 user nova-compute[74994]:   </os>
Nov 28 10:53:48 user nova-compute[74994]:   <features>
Nov 28 10:53:48 user nova-compute[74994]:     <acpi/>
Nov 28 10:53:48 user nova-compute[74994]:     <apic/>
Nov 28 10:53:48 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 10:53:48 user nova-compute[74994]:   </features>
Nov 28 10:53:48 user nova-compute[74994]:   <clock offset="utc">
Nov 28 10:53:48 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 10:53:48 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 10:53:48 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 10:53:48 user nova-compute[74994]:   </clock>
Nov 28 10:53:48 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 10:53:48 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 10:53:48 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 10:53:48 user nova-compute[74994]:   </cpu>
Nov 28 10:53:48 user nova-compute[74994]:   <devices>
Nov 28 10:53:48 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 10:53:48 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 10:53:48 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk"/>
Nov 28 10:53:48 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 10:53:48 user nova-compute[74994]:     </disk>
Nov 28 10:53:48 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 10:53:48 user nova-compute[74994]:       <mac address="fa:16:3e:96:e0:ac"/>
Nov 28 10:53:48 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:53:48 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 10:53:48 user nova-compute[74994]:       <target dev="tap10b84648-2b"/>
Nov 28 10:53:48 user nova-compute[74994]:     </interface>
Nov 28 10:53:48 user nova-compute[74994]:     <serial type="pty">
Nov 28 10:53:48 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/console.log" append="off"/>
Nov 28 10:53:48 user nova-compute[74994]:     </serial>
Nov 28 10:53:48 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 10:53:48 user nova-compute[74994]:     <video>
Nov 28 10:53:48 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:53:48 user nova-compute[74994]:     </video>
Nov 28 10:53:48 user nova-compute[74994]:     <rng model="virtio">
Nov 28 10:53:48 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 10:53:48 user nova-compute[74994]:     </rng>
Nov 28 10:53:48 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 10:53:48 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 10:53:48 user nova-compute[74994]:       <stats period="10"/>
Nov 28 10:53:48 user nova-compute[74994]:     </memballoon>
Nov 28 10:53:48 user nova-compute[74994]:   </devices>
Nov 28 10:53:48 user nova-compute[74994]: </domain>
Nov 28 10:53:48 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:53:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2083256391',display_name='tempest-ServerActionsTestOtherA-server-2083256391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2083256391',id=18,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPW6Lty9ow0zAcm936yuU8WeLpHxpamSCaeKsFRdduK4jmYnIbGWXIhKjvJDlhN8evt/Hb3F2U1wYmR8qRXarp7uOZi0MsdjDWCq+Ku3i87+sooae0XVTHruzSkrMSatFQ==',key_name='tempest-keypair-1409463142',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5eb43a8fc7bd47728600741762f71112',ramdisk_id='',reservation_id='r-wrqbieqq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1927948343',owner_user_name='tempest-ServerActionsTestOtherA-1927948343-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:53:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d51be473c7284977a6533756a1f677f9',uuid=20716905-c56a-4729-8c5b-9188502dc477,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10b84648-2b56-4451-b4f3-3ec4ad7b7771", "address": "fa:16:3e:96:e0:ac", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b84648-2b", "ovs_interfaceid": "10b84648-2b56-4451-b4f3-3ec4ad7b7771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Converting VIF {"id": "10b84648-2b56-4451-b4f3-3ec4ad7b7771", "address": "fa:16:3e:96:e0:ac", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b84648-2b", "ovs_interfaceid": "10b84648-2b56-4451-b4f3-3ec4ad7b7771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:e0:ac,bridge_name='br-int',has_traffic_filtering=True,id=10b84648-2b56-4451-b4f3-3ec4ad7b7771,network=Network(16dd32cd-5a00-4111-92e2-283e7635540f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10b84648-2b') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG os_vif [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:e0:ac,bridge_name='br-int',has_traffic_filtering=True,id=10b84648-2b56-4451-b4f3-3ec4ad7b7771,network=Network(16dd32cd-5a00-4111-92e2-283e7635540f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10b84648-2b') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '14d87a94-23f1-53ca-ad1d-da8f9dd87951', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap10b84648-2b, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap10b84648-2b, col_values=(('qos', UUID('fe1c3a25-4efe-458e-af04-2a8dd45b76a0')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap10b84648-2b, col_values=(('external_ids', {'iface-id': '10b84648-2b56-4451-b4f3-3ec4ad7b7771', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:e0:ac', 'vm-uuid': '20716905-c56a-4729-8c5b-9188502dc477'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:48 user nova-compute[74994]: INFO os_vif [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:e0:ac,bridge_name='br-int',has_traffic_filtering=True,id=10b84648-2b56-4451-b4f3-3ec4ad7b7771,network=Network(16dd32cd-5a00-4111-92e2-283e7635540f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10b84648-2b')
Nov 28 10:53:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:53:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] No VIF found with MAC fa:16:3e:96:e0:ac, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:53:49 user nova-compute[74994]: DEBUG nova.network.neutron [req-282da3b5-3ea6-4fb5-9c08-a915ed55e18b req-d968a190-7dc4-4514-abd8-ecf133191718 service nova] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Updated VIF entry in instance network info cache for port 10b84648-2b56-4451-b4f3-3ec4ad7b7771. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 10:53:49 user nova-compute[74994]: DEBUG nova.network.neutron [req-282da3b5-3ea6-4fb5-9c08-a915ed55e18b req-d968a190-7dc4-4514-abd8-ecf133191718 service nova] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Updating instance_info_cache with network_info: [{"id": "10b84648-2b56-4451-b4f3-3ec4ad7b7771", "address": "fa:16:3e:96:e0:ac", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b84648-2b", "ovs_interfaceid": "10b84648-2b56-4451-b4f3-3ec4ad7b7771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:53:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-282da3b5-3ea6-4fb5-9c08-a915ed55e18b req-d968a190-7dc4-4514-abd8-ecf133191718 service nova] Releasing lock "refresh_cache-20716905-c56a-4729-8c5b-9188502dc477" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:53:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:50 user nova-compute[74994]: DEBUG nova.compute.manager [req-c092c921-dfab-4cc5-83af-3156a9cff588 req-8779a8af-c649-483c-9983-93e075747f9f service nova] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Received event network-vif-plugged-10b84648-2b56-4451-b4f3-3ec4ad7b7771 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:53:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c092c921-dfab-4cc5-83af-3156a9cff588 req-8779a8af-c649-483c-9983-93e075747f9f service nova] Acquiring lock "20716905-c56a-4729-8c5b-9188502dc477-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c092c921-dfab-4cc5-83af-3156a9cff588 req-8779a8af-c649-483c-9983-93e075747f9f service nova] Lock "20716905-c56a-4729-8c5b-9188502dc477-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c092c921-dfab-4cc5-83af-3156a9cff588 req-8779a8af-c649-483c-9983-93e075747f9f service nova] Lock "20716905-c56a-4729-8c5b-9188502dc477-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:50 user nova-compute[74994]: DEBUG nova.compute.manager [req-c092c921-dfab-4cc5-83af-3156a9cff588 req-8779a8af-c649-483c-9983-93e075747f9f service nova] [instance: 20716905-c56a-4729-8c5b-9188502dc477] No waiting events found dispatching network-vif-plugged-10b84648-2b56-4451-b4f3-3ec4ad7b7771 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:53:50 user nova-compute[74994]: WARNING nova.compute.manager [req-c092c921-dfab-4cc5-83af-3156a9cff588 req-8779a8af-c649-483c-9983-93e075747f9f service nova] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Received unexpected event network-vif-plugged-10b84648-2b56-4451-b4f3-3ec4ad7b7771 for instance with vm_state building and task_state spawning.
Nov 28 10:53:50 user nova-compute[74994]: INFO nova.compute.manager [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Rescuing
Nov 28 10:53:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquiring lock "refresh_cache-bf357856-2d97-42e8-928d-71d0378f48c8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:53:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquired lock "refresh_cache-bf357856-2d97-42e8-928d-71d0378f48c8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:53:50 user nova-compute[74994]: DEBUG nova.network.neutron [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 10:53:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:51 user nova-compute[74994]: DEBUG nova.network.neutron [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Updating instance_info_cache with network_info: [{"id": "6a884296-8f6f-4647-b4c6-09d7f4e92887", "address": "fa:16:3e:a2:e1:5b", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a884296-8f", "ovs_interfaceid": "6a884296-8f6f-4647-b4c6-09d7f4e92887", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:53:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Releasing lock "refresh_cache-bf357856-2d97-42e8-928d-71d0378f48c8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:53:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:51 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Instance destroyed successfully.
Nov 28 10:53:51 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Attempting rescue
Nov 28 10:53:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74994) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 10:53:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Instance directory exists: not creating {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 10:53:51 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Creating image(s)
Nov 28 10:53:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquiring lock "/opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "/opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "/opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:51 user nova-compute[74994]: DEBUG nova.objects.instance [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lazy-loading 'trusted_certs' on Instance uuid bf357856-2d97-42e8-928d-71d0378f48c8 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:53:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquiring lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.189s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk.rescue {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk.rescue" returned: 0 in 0.052s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.objects.instance [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lazy-loading 'migration_context' on Instance uuid bf357856-2d97-42e8-928d-71d0378f48c8 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.objects.base [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Object Instance<bf357856-2d97-42e8-928d-71d0378f48c8> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Created local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Start _get_guest_xml network_info=[{"id": "6a884296-8f6f-4647-b4c6-09d7f4e92887", "address": "fa:16:3e:a2:e1:5b", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "vif_mac": "fa:16:3e:a2:e1:5b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a884296-8f", "ovs_interfaceid": "6a884296-8f6f-4647-b4c6-09d7f4e92887", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'aa939d1b-b8a6-4391-935b-0191bf5ccd0a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.objects.instance [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lazy-loading 'resources' on Instance uuid bf357856-2d97-42e8-928d-71d0378f48c8 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.objects.base [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Object Instance<bf357856-2d97-42e8-928d-71d0378f48c8> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.objects.instance [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lazy-loading 'numa_topology' on Instance uuid bf357856-2d97-42e8-928d-71d0378f48c8 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.objects.base [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Object Instance<bf357856-2d97-42e8-928d-71d0378f48c8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 10:53:52 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:53:52 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.objects.instance [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lazy-loading 'vcpu_model' on Instance uuid bf357856-2d97-42e8-928d-71d0378f48c8 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.objects.base [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Object Instance<bf357856-2d97-42e8-928d-71d0378f48c8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:49:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1148888058',display_name='tempest-ServerRescueNegativeTestJSON-server-1148888058',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1148888058',id=3,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:49:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77126f6f39db4a628b74551ea7d0aa21',ramdisk_id='',reservation_id='r-kyiocy2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1900175697',owner_user_name='tempest-ServerRescueNegativeTestJSON-1900175697-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:49:25Z,user_data=None,user_id='6b5c1a1f2efc4a2faf8b82d467681d45',uuid=bf357856-2d97-42e8-928d-71d0378f48c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a884296-8f6f-4647-b4c6-09d7f4e92887", "address": "fa:16:3e:a2:e1:5b", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "vif_mac": "fa:16:3e:a2:e1:5b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a884296-8f", "ovs_interfaceid": "6a884296-8f6f-4647-b4c6-09d7f4e92887", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Converting VIF {"id": "6a884296-8f6f-4647-b4c6-09d7f4e92887", "address": "fa:16:3e:a2:e1:5b", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "vif_mac": "fa:16:3e:a2:e1:5b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a884296-8f", "ovs_interfaceid": "6a884296-8f6f-4647-b4c6-09d7f4e92887", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:e1:5b,bridge_name='br-int',has_traffic_filtering=True,id=6a884296-8f6f-4647-b4c6-09d7f4e92887,network=Network(77bc68aa-1654-4e4d-9c65-7515fe6f4b2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a884296-8f') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.objects.instance [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lazy-loading 'pci_devices' on Instance uuid bf357856-2d97-42e8-928d-71d0378f48c8 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.compute.manager [req-1ad37808-bae4-4995-9cde-0819816020b1 req-3852377c-5902-43ed-9b25-a6c51db02da4 service nova] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Received event network-vif-plugged-10b84648-2b56-4451-b4f3-3ec4ad7b7771 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-1ad37808-bae4-4995-9cde-0819816020b1 req-3852377c-5902-43ed-9b25-a6c51db02da4 service nova] Acquiring lock "20716905-c56a-4729-8c5b-9188502dc477-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-1ad37808-bae4-4995-9cde-0819816020b1 req-3852377c-5902-43ed-9b25-a6c51db02da4 service nova] Lock "20716905-c56a-4729-8c5b-9188502dc477-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-1ad37808-bae4-4995-9cde-0819816020b1 req-3852377c-5902-43ed-9b25-a6c51db02da4 service nova] Lock "20716905-c56a-4729-8c5b-9188502dc477-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.compute.manager [req-1ad37808-bae4-4995-9cde-0819816020b1 req-3852377c-5902-43ed-9b25-a6c51db02da4 service nova] [instance: 20716905-c56a-4729-8c5b-9188502dc477] No waiting events found dispatching network-vif-plugged-10b84648-2b56-4451-b4f3-3ec4ad7b7771 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:53:52 user nova-compute[74994]: WARNING nova.compute.manager [req-1ad37808-bae4-4995-9cde-0819816020b1 req-3852377c-5902-43ed-9b25-a6c51db02da4 service nova] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Received unexpected event network-vif-plugged-10b84648-2b56-4451-b4f3-3ec4ad7b7771 for instance with vm_state building and task_state spawning.
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.compute.manager [req-1ad37808-bae4-4995-9cde-0819816020b1 req-3852377c-5902-43ed-9b25-a6c51db02da4 service nova] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Received event network-vif-unplugged-6a884296-8f6f-4647-b4c6-09d7f4e92887 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-1ad37808-bae4-4995-9cde-0819816020b1 req-3852377c-5902-43ed-9b25-a6c51db02da4 service nova] Acquiring lock "bf357856-2d97-42e8-928d-71d0378f48c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-1ad37808-bae4-4995-9cde-0819816020b1 req-3852377c-5902-43ed-9b25-a6c51db02da4 service nova] Lock "bf357856-2d97-42e8-928d-71d0378f48c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-1ad37808-bae4-4995-9cde-0819816020b1 req-3852377c-5902-43ed-9b25-a6c51db02da4 service nova] Lock "bf357856-2d97-42e8-928d-71d0378f48c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.compute.manager [req-1ad37808-bae4-4995-9cde-0819816020b1 req-3852377c-5902-43ed-9b25-a6c51db02da4 service nova] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] No waiting events found dispatching network-vif-unplugged-6a884296-8f6f-4647-b4c6-09d7f4e92887 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:53:52 user nova-compute[74994]: WARNING nova.compute.manager [req-1ad37808-bae4-4995-9cde-0819816020b1 req-3852377c-5902-43ed-9b25-a6c51db02da4 service nova] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Received unexpected event network-vif-unplugged-6a884296-8f6f-4647-b4c6-09d7f4e92887 for instance with vm_state active and task_state rescuing.
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.compute.manager [req-1ad37808-bae4-4995-9cde-0819816020b1 req-3852377c-5902-43ed-9b25-a6c51db02da4 service nova] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Received event network-vif-plugged-6a884296-8f6f-4647-b4c6-09d7f4e92887 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-1ad37808-bae4-4995-9cde-0819816020b1 req-3852377c-5902-43ed-9b25-a6c51db02da4 service nova] Acquiring lock "bf357856-2d97-42e8-928d-71d0378f48c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-1ad37808-bae4-4995-9cde-0819816020b1 req-3852377c-5902-43ed-9b25-a6c51db02da4 service nova] Lock "bf357856-2d97-42e8-928d-71d0378f48c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-1ad37808-bae4-4995-9cde-0819816020b1 req-3852377c-5902-43ed-9b25-a6c51db02da4 service nova] Lock "bf357856-2d97-42e8-928d-71d0378f48c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.compute.manager [req-1ad37808-bae4-4995-9cde-0819816020b1 req-3852377c-5902-43ed-9b25-a6c51db02da4 service nova] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] No waiting events found dispatching network-vif-plugged-6a884296-8f6f-4647-b4c6-09d7f4e92887 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:53:52 user nova-compute[74994]: WARNING nova.compute.manager [req-1ad37808-bae4-4995-9cde-0819816020b1 req-3852377c-5902-43ed-9b25-a6c51db02da4 service nova] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Received unexpected event network-vif-plugged-6a884296-8f6f-4647-b4c6-09d7f4e92887 for instance with vm_state active and task_state rescuing.
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.objects.base [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Object Instance<bf357856-2d97-42e8-928d-71d0378f48c8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] End _get_guest_xml xml=<domain type="kvm">
Nov 28 10:53:52 user nova-compute[74994]:   <uuid>bf357856-2d97-42e8-928d-71d0378f48c8</uuid>
Nov 28 10:53:52 user nova-compute[74994]:   <name>instance-00000003</name>
Nov 28 10:53:52 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 10:53:52 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 10:53:52 user nova-compute[74994]:   <metadata>
Nov 28 10:53:52 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 10:53:52 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 10:53:52 user nova-compute[74994]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1148888058</nova:name>
Nov 28 10:53:52 user nova-compute[74994]:       <nova:creationTime>2023-11-28 10:53:52</nova:creationTime>
Nov 28 10:53:52 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 10:53:52 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 10:53:52 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 10:53:52 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 10:53:52 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 10:53:52 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 10:53:52 user nova-compute[74994]:       </nova:flavor>
Nov 28 10:53:52 user nova-compute[74994]:       <nova:owner>
Nov 28 10:53:52 user nova-compute[74994]:         <nova:user uuid="6b5c1a1f2efc4a2faf8b82d467681d45">tempest-ServerRescueNegativeTestJSON-1900175697-project-member</nova:user>
Nov 28 10:53:52 user nova-compute[74994]:         <nova:project uuid="77126f6f39db4a628b74551ea7d0aa21">tempest-ServerRescueNegativeTestJSON-1900175697</nova:project>
Nov 28 10:53:52 user nova-compute[74994]:       </nova:owner>
Nov 28 10:53:52 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 10:53:52 user nova-compute[74994]:       <nova:ports>
Nov 28 10:53:52 user nova-compute[74994]:         <nova:port uuid="6a884296-8f6f-4647-b4c6-09d7f4e92887">
Nov 28 10:53:52 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 10:53:52 user nova-compute[74994]:         </nova:port>
Nov 28 10:53:52 user nova-compute[74994]:       </nova:ports>
Nov 28 10:53:52 user nova-compute[74994]:     </nova:instance>
Nov 28 10:53:52 user nova-compute[74994]:   </metadata>
Nov 28 10:53:52 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 10:53:52 user nova-compute[74994]:     <system>
Nov 28 10:53:52 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 10:53:52 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 10:53:52 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 10:53:52 user nova-compute[74994]:       <entry name="serial">bf357856-2d97-42e8-928d-71d0378f48c8</entry>
Nov 28 10:53:52 user nova-compute[74994]:       <entry name="uuid">bf357856-2d97-42e8-928d-71d0378f48c8</entry>
Nov 28 10:53:52 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 10:53:52 user nova-compute[74994]:     </system>
Nov 28 10:53:52 user nova-compute[74994]:   </sysinfo>
Nov 28 10:53:52 user nova-compute[74994]:   <os>
Nov 28 10:53:52 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 10:53:52 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 10:53:52 user nova-compute[74994]:   </os>
Nov 28 10:53:52 user nova-compute[74994]:   <features>
Nov 28 10:53:52 user nova-compute[74994]:     <acpi/>
Nov 28 10:53:52 user nova-compute[74994]:     <apic/>
Nov 28 10:53:52 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 10:53:52 user nova-compute[74994]:   </features>
Nov 28 10:53:52 user nova-compute[74994]:   <clock offset="utc">
Nov 28 10:53:52 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 10:53:52 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 10:53:52 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 10:53:52 user nova-compute[74994]:   </clock>
Nov 28 10:53:52 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 10:53:52 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 10:53:52 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 10:53:52 user nova-compute[74994]:   </cpu>
Nov 28 10:53:52 user nova-compute[74994]:   <devices>
Nov 28 10:53:52 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 10:53:52 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 10:53:52 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk.rescue"/>
Nov 28 10:53:52 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 10:53:52 user nova-compute[74994]:     </disk>
Nov 28 10:53:52 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 10:53:52 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 10:53:52 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk"/>
Nov 28 10:53:52 user nova-compute[74994]:       <target dev="vdb" bus="virtio"/>
Nov 28 10:53:52 user nova-compute[74994]:     </disk>
Nov 28 10:53:52 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 10:53:52 user nova-compute[74994]:       <mac address="fa:16:3e:a2:e1:5b"/>
Nov 28 10:53:52 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:53:52 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 10:53:52 user nova-compute[74994]:       <target dev="tap6a884296-8f"/>
Nov 28 10:53:52 user nova-compute[74994]:     </interface>
Nov 28 10:53:52 user nova-compute[74994]:     <serial type="pty">
Nov 28 10:53:52 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/console.log" append="off"/>
Nov 28 10:53:52 user nova-compute[74994]:     </serial>
Nov 28 10:53:52 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 10:53:52 user nova-compute[74994]:     <video>
Nov 28 10:53:52 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:53:52 user nova-compute[74994]:     </video>
Nov 28 10:53:52 user nova-compute[74994]:     <rng model="virtio">
Nov 28 10:53:52 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 10:53:52 user nova-compute[74994]:     </rng>
Nov 28 10:53:52 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 10:53:52 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 10:53:52 user nova-compute[74994]:       <stats period="10"/>
Nov 28 10:53:52 user nova-compute[74994]:     </memballoon>
Nov 28 10:53:52 user nova-compute[74994]:   </devices>
Nov 28 10:53:52 user nova-compute[74994]: </domain>
Nov 28 10:53:52 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 10:53:52 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Instance destroyed successfully.
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] No VIF found with MAC fa:16:3e:a2:e1:5b, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.compute.manager [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 10:53:52 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Instance spawned successfully.
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:53:52 user nova-compute[74994]: INFO nova.compute.manager [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Took 6.30 seconds to spawn the instance on the hypervisor.
Nov 28 10:53:52 user nova-compute[74994]: DEBUG nova.compute.manager [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 10:53:52 user nova-compute[74994]: INFO nova.compute.manager [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Took 7.14 seconds to build instance.
Nov 28 10:53:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2f423f24-56a0-48bd-8a15-1a0ca55846de tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "20716905-c56a-4729-8c5b-9188502dc477" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.269s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:54 user nova-compute[74994]: INFO nova.compute.manager [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Rescuing
Nov 28 10:53:54 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "refresh_cache-759fbcfd-ab13-438f-b860-6393a97d1205" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:53:54 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquired lock "refresh_cache-759fbcfd-ab13-438f-b860-6393a97d1205" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:53:54 user nova-compute[74994]: DEBUG nova.network.neutron [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 10:53:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:54 user nova-compute[74994]: DEBUG nova.compute.manager [req-ff32887a-7caf-4a53-9a89-9a05ec85814b req-7e1d38fc-9a29-4e04-9031-e68cf87ffe63 service nova] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Received event network-vif-plugged-6a884296-8f6f-4647-b4c6-09d7f4e92887 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:53:54 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ff32887a-7caf-4a53-9a89-9a05ec85814b req-7e1d38fc-9a29-4e04-9031-e68cf87ffe63 service nova] Acquiring lock "bf357856-2d97-42e8-928d-71d0378f48c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:54 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ff32887a-7caf-4a53-9a89-9a05ec85814b req-7e1d38fc-9a29-4e04-9031-e68cf87ffe63 service nova] Lock "bf357856-2d97-42e8-928d-71d0378f48c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:54 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ff32887a-7caf-4a53-9a89-9a05ec85814b req-7e1d38fc-9a29-4e04-9031-e68cf87ffe63 service nova] Lock "bf357856-2d97-42e8-928d-71d0378f48c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:54 user nova-compute[74994]: DEBUG nova.compute.manager [req-ff32887a-7caf-4a53-9a89-9a05ec85814b req-7e1d38fc-9a29-4e04-9031-e68cf87ffe63 service nova] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] No waiting events found dispatching network-vif-plugged-6a884296-8f6f-4647-b4c6-09d7f4e92887 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:53:54 user nova-compute[74994]: WARNING nova.compute.manager [req-ff32887a-7caf-4a53-9a89-9a05ec85814b req-7e1d38fc-9a29-4e04-9031-e68cf87ffe63 service nova] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Received unexpected event network-vif-plugged-6a884296-8f6f-4647-b4c6-09d7f4e92887 for instance with vm_state active and task_state rescuing.
Nov 28 10:53:54 user nova-compute[74994]: DEBUG nova.network.neutron [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Updating instance_info_cache with network_info: [{"id": "7d4a82ba-d222-44bb-baac-6642f24b9528", "address": "fa:16:3e:4f:75:25", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d4a82ba-d2", "ovs_interfaceid": "7d4a82ba-d222-44bb-baac-6642f24b9528", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:53:54 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Releasing lock "refresh_cache-759fbcfd-ab13-438f-b860-6393a97d1205" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:53:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:55 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Instance destroyed successfully.
Nov 28 10:53:55 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Attempting a stable device rescue
Nov 28 10:53:55 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74994) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 10:53:55 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Instance directory exists: not creating {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 10:53:55 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Creating image(s)
Nov 28 10:53:55 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "/opt/stack/data/nova/instances/759fbcfd-ab13-438f-b860-6393a97d1205/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:55 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "/opt/stack/data/nova/instances/759fbcfd-ab13-438f-b860-6393a97d1205/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:55 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "/opt/stack/data/nova/instances/759fbcfd-ab13-438f-b860-6393a97d1205/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:55 user nova-compute[74994]: DEBUG nova.objects.instance [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lazy-loading 'trusted_certs' on Instance uuid 759fbcfd-ab13-438f-b860-6393a97d1205 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:53:55 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "1fa91fbd8c27e3441a4523e04020c2c6709d43a5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:55 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "1fa91fbd8c27e3441a4523e04020c2c6709d43a5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:56 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fa91fbd8c27e3441a4523e04020c2c6709d43a5.part --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:56 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:57 user nova-compute[74994]: DEBUG nova.compute.manager [req-0280833a-b3c3-4195-bdc7-1f686079c55a req-520f8afb-498e-47ad-84f7-e7dd66e82eca service nova] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Received event network-vif-plugged-6a884296-8f6f-4647-b4c6-09d7f4e92887 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:53:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-0280833a-b3c3-4195-bdc7-1f686079c55a req-520f8afb-498e-47ad-84f7-e7dd66e82eca service nova] Acquiring lock "bf357856-2d97-42e8-928d-71d0378f48c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-0280833a-b3c3-4195-bdc7-1f686079c55a req-520f8afb-498e-47ad-84f7-e7dd66e82eca service nova] Lock "bf357856-2d97-42e8-928d-71d0378f48c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-0280833a-b3c3-4195-bdc7-1f686079c55a req-520f8afb-498e-47ad-84f7-e7dd66e82eca service nova] Lock "bf357856-2d97-42e8-928d-71d0378f48c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:57 user nova-compute[74994]: DEBUG nova.compute.manager [req-0280833a-b3c3-4195-bdc7-1f686079c55a req-520f8afb-498e-47ad-84f7-e7dd66e82eca service nova] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] No waiting events found dispatching network-vif-plugged-6a884296-8f6f-4647-b4c6-09d7f4e92887 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:53:57 user nova-compute[74994]: WARNING nova.compute.manager [req-0280833a-b3c3-4195-bdc7-1f686079c55a req-520f8afb-498e-47ad-84f7-e7dd66e82eca service nova] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Received unexpected event network-vif-plugged-6a884296-8f6f-4647-b4c6-09d7f4e92887 for instance with vm_state active and task_state rescuing.
Nov 28 10:53:57 user nova-compute[74994]: DEBUG nova.compute.manager [req-0280833a-b3c3-4195-bdc7-1f686079c55a req-520f8afb-498e-47ad-84f7-e7dd66e82eca service nova] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Received event network-vif-unplugged-7d4a82ba-d222-44bb-baac-6642f24b9528 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:53:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-0280833a-b3c3-4195-bdc7-1f686079c55a req-520f8afb-498e-47ad-84f7-e7dd66e82eca service nova] Acquiring lock "759fbcfd-ab13-438f-b860-6393a97d1205-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-0280833a-b3c3-4195-bdc7-1f686079c55a req-520f8afb-498e-47ad-84f7-e7dd66e82eca service nova] Lock "759fbcfd-ab13-438f-b860-6393a97d1205-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-0280833a-b3c3-4195-bdc7-1f686079c55a req-520f8afb-498e-47ad-84f7-e7dd66e82eca service nova] Lock "759fbcfd-ab13-438f-b860-6393a97d1205-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:57 user nova-compute[74994]: DEBUG nova.compute.manager [req-0280833a-b3c3-4195-bdc7-1f686079c55a req-520f8afb-498e-47ad-84f7-e7dd66e82eca service nova] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] No waiting events found dispatching network-vif-unplugged-7d4a82ba-d222-44bb-baac-6642f24b9528 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:53:57 user nova-compute[74994]: WARNING nova.compute.manager [req-0280833a-b3c3-4195-bdc7-1f686079c55a req-520f8afb-498e-47ad-84f7-e7dd66e82eca service nova] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Received unexpected event network-vif-unplugged-7d4a82ba-d222-44bb-baac-6642f24b9528 for instance with vm_state active and task_state rescuing.
Nov 28 10:53:57 user nova-compute[74994]: DEBUG nova.compute.manager [req-0280833a-b3c3-4195-bdc7-1f686079c55a req-520f8afb-498e-47ad-84f7-e7dd66e82eca service nova] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Received event network-vif-plugged-7d4a82ba-d222-44bb-baac-6642f24b9528 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:53:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-0280833a-b3c3-4195-bdc7-1f686079c55a req-520f8afb-498e-47ad-84f7-e7dd66e82eca service nova] Acquiring lock "759fbcfd-ab13-438f-b860-6393a97d1205-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-0280833a-b3c3-4195-bdc7-1f686079c55a req-520f8afb-498e-47ad-84f7-e7dd66e82eca service nova] Lock "759fbcfd-ab13-438f-b860-6393a97d1205-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-0280833a-b3c3-4195-bdc7-1f686079c55a req-520f8afb-498e-47ad-84f7-e7dd66e82eca service nova] Lock "759fbcfd-ab13-438f-b860-6393a97d1205-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:57 user nova-compute[74994]: DEBUG nova.compute.manager [req-0280833a-b3c3-4195-bdc7-1f686079c55a req-520f8afb-498e-47ad-84f7-e7dd66e82eca service nova] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] No waiting events found dispatching network-vif-plugged-7d4a82ba-d222-44bb-baac-6642f24b9528 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:53:57 user nova-compute[74994]: WARNING nova.compute.manager [req-0280833a-b3c3-4195-bdc7-1f686079c55a req-520f8afb-498e-47ad-84f7-e7dd66e82eca service nova] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Received unexpected event network-vif-plugged-7d4a82ba-d222-44bb-baac-6642f24b9528 for instance with vm_state active and task_state rescuing.
Nov 28 10:53:57 user nova-compute[74994]: DEBUG nova.compute.manager [None req-32c36e54-af75-4249-86e8-f3a2d8925375 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 10:53:57 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fa91fbd8c27e3441a4523e04020c2c6709d43a5.part --force-share --output=json" returned: 0 in 0.237s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:57 user nova-compute[74994]: DEBUG nova.virt.images [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] 9cb18fd8-34fa-4897-8fd3-1cfd31085f41 was qcow2, converting to raw {{(pid=74994) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 10:53:57 user nova-compute[74994]: DEBUG nova.privsep.utils [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74994) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 10:53:57 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1fa91fbd8c27e3441a4523e04020c2c6709d43a5.part /opt/stack/data/nova/instances/_base/1fa91fbd8c27e3441a4523e04020c2c6709d43a5.converted {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:57 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1fa91fbd8c27e3441a4523e04020c2c6709d43a5.part /opt/stack/data/nova/instances/_base/1fa91fbd8c27e3441a4523e04020c2c6709d43a5.converted" returned: 0 in 0.757s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fa91fbd8c27e3441a4523e04020c2c6709d43a5.converted --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fa91fbd8c27e3441a4523e04020c2c6709d43a5.converted --force-share --output=json" returned: 0 in 0.231s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "1fa91fbd8c27e3441a4523e04020c2c6709d43a5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.272s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "1fa91fbd8c27e3441a4523e04020c2c6709d43a5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "1fa91fbd8c27e3441a4523e04020c2c6709d43a5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fa91fbd8c27e3441a4523e04020c2c6709d43a5 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fa91fbd8c27e3441a4523e04020c2c6709d43a5 --force-share --output=json" returned: 0 in 0.210s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1fa91fbd8c27e3441a4523e04020c2c6709d43a5,backing_fmt=raw /opt/stack/data/nova/instances/759fbcfd-ab13-438f-b860-6393a97d1205/disk.rescue {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1fa91fbd8c27e3441a4523e04020c2c6709d43a5,backing_fmt=raw /opt/stack/data/nova/instances/759fbcfd-ab13-438f-b860-6393a97d1205/disk.rescue" returned: 0 in 0.063s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "1fa91fbd8c27e3441a4523e04020c2c6709d43a5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG nova.objects.instance [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lazy-loading 'migration_context' on Instance uuid 759fbcfd-ab13-438f-b860-6393a97d1205 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG nova.objects.base [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Object Instance<759fbcfd-ab13-438f-b860-6393a97d1205> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Created local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Start _get_guest_xml network_info=[{"id": "7d4a82ba-d222-44bb-baac-6642f24b9528", "address": "fa:16:3e:4f:75:25", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "vif_mac": "fa:16:3e:4f:75:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d4a82ba-d2", "ovs_interfaceid": "7d4a82ba-d222-44bb-baac-6642f24b9528", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9cb18fd8-34fa-4897-8fd3-1cfd31085f41', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'npJsWGzr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '759fbcfd-ab13-438f-b860-6393a97d1205', 'attached_at': '', 'detached_at': '', 'volume_id': '6b722d69-93d3-49c4-ab46-38ce89b057de', 'serial': '6b722d69-93d3-49c4-ab46-38ce89b057de'}, 'attachment_id': '890f2169-c3bd-43db-af23-286ea1c0fdcb', 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG nova.objects.instance [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lazy-loading 'resources' on Instance uuid 759fbcfd-ab13-438f-b860-6393a97d1205 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG nova.objects.base [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Object Instance<759fbcfd-ab13-438f-b860-6393a97d1205> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG nova.objects.instance [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lazy-loading 'numa_topology' on Instance uuid 759fbcfd-ab13-438f-b860-6393a97d1205 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG nova.objects.base [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Object Instance<759fbcfd-ab13-438f-b860-6393a97d1205> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 10:53:58 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:53:58 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:53:58 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG nova.objects.instance [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lazy-loading 'vcpu_model' on Instance uuid 759fbcfd-ab13-438f-b860-6393a97d1205 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG nova.objects.base [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Object Instance<759fbcfd-ab13-438f-b860-6393a97d1205> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'npJsWGzr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:53:58 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:53:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:53:58 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:53:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:53:58 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 10:53:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a3388d-f6a0-4742-b932-e43bb76143ea]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = npJsWGzr\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 28 10:53:58 user nova-compute[74994]: node.name = iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de
Nov 28 10:53:58 user nova-compute[74994]: node.tpgt = -1
Nov 28 10:53:58 user nova-compute[74994]: node.startup = automatic
Nov 28 10:53:58 user nova-compute[74994]: node.leading_login = No
Nov 28 10:53:58 user nova-compute[74994]: iface.iscsi_ifacename = default
Nov 28 10:53:58 user nova-compute[74994]: iface.net_ifacename = <empty>
Nov 28 10:53:58 user nova-compute[74994]: iface.ipaddress = <empty>
Nov 28 10:53:58 user nova-compute[74994]: iface.prefix_len = 0
Nov 28 10:53:58 user nova-compute[74994]: iface.hwaddress = <empty>
Nov 28 10:53:58 user nova-compute[74994]: iface.transport_name = tcp
Nov 28 10:53:58 user nova-compute[74994]: iface.initiatorname = <empty>
Nov 28 10:53:58 user nova-compute[74994]: iface.state = <empty>
Nov 28 10:53:58 user nova-compute[74994]: iface.vlan_id = 0
Nov 28 10:53:58 user nova-compute[74994]: iface.vlan_priority = 0
Nov 28 10:53:58 user nova-compute[74994]: iface.vlan_state = <empty>
Nov 28 10:53:58 user nova-compute[74994]: iface.iface_num = 0
Nov 28 10:53:58 user nova-compute[74994]: iface.mtu = 0
Nov 28 10:53:58 user nova-compute[74994]: iface.port = 0
Nov 28 10:53:58 user nova-compute[74994]: iface.bootproto = <empty>
Nov 28 10:53:58 user nova-compute[74994]: iface.subnet_mask = <empty>
Nov 28 10:53:58 user nova-compute[74994]: iface.gateway = <empty>
Nov 28 10:53:58 user nova-compute[74994]: iface.dhcp_alt_client_id_state = <empty>
Nov 28 10:53:58 user nova-compute[74994]: iface.dhcp_alt_client_id = <empty>
Nov 28 10:53:58 user nova-compute[74994]: iface.dhcp_dns = <empty>
Nov 28 10:53:58 user nova-compute[74994]: iface.dhcp_learn_iqn = <empty>
Nov 28 10:53:58 user nova-compute[74994]: iface.dhcp_req_vendor_id_state = <empty>
Nov 28 10:53:58 user nova-compute[74994]: iface.dhcp_vendor_id_state = <empty>
Nov 28 10:53:58 user nova-compute[74994]: iface.dhcp_vendor_id = <empty>
Nov 28 10:53:58 user nova-compute[74994]: iface.dhcp_slp_da = <empty>
Nov 28 10:53:58 user nova-compute[74994]: iface.fragmentation = <empty>
Nov 28 10:53:58 user nova-compute[74994]: iface.gratuitous_arp = <empty>
Nov 28 10:53:58 user nova-compute[74994]: iface.incoming_forwarding = <empty>
Nov 28 10:53:58 user nova-compute[74994]: iface.tos_state = <empty>
Nov 28 10:53:58 user nova-compute[74994]: iface.tos = 0
Nov 28 10:53:58 user nova-compute[74994]: iface.ttl = 0
Nov 28 10:53:58 user nova-compute[74994]: iface.delayed_ack = <empty>
Nov 28 10:53:58 user nova-compute[74994]: iface.tcp_nagle = <empty>
Nov 28 10:53:58 user nova-compute[74994]: iface.tcp_wsf_state = <empty>
Nov 28 10:53:58 user nova-compute[74994]: iface.tcp_wsf = 0
Nov 28 10:53:58 user nova-compute[74994]: iface.tcp_timer_scale = 0
Nov 28 10:53:58 user nova-compute[74994]: iface.tcp_timestamp = <empty>
Nov 28 10:53:58 user nova-compute[74994]: iface.redirect = <empty>
Nov 28 10:53:58 user nova-compute[74994]: iface.def_task_mgmt_timeout = 0
Nov 28 10:53:58 user nova-compute[74994]: iface.header_digest = <empty>
Nov 28 10:53:58 user nova-compute[74994]: iface.data_digest = <empty>
Nov 28 10:53:58 user nova-compute[74994]: iface.immediate_data = <empty>
Nov 28 10:53:58 user nova-compute[74994]: iface.initial_r2t = <empty>
Nov 28 10:53:58 user nova-compute[74994]: iface.data_seq_inorder = <empty>
Nov 28 10:53:58 user nova-compute[74994]: iface.data_pdu_inorder = <empty>
Nov 28 10:53:58 user nova-compute[74994]: iface.erl = 0
Nov 28 10:53:58 user nova-compute[74994]: iface.max_receive_data_len = 0
Nov 28 10:53:58 user nova-compute[74994]: iface.first_burst_len = 0
Nov 28 10:53:58 user nova-compute[74994]: iface.max_outstanding_r2t = 0
Nov 28 10:53:58 user nova-compute[74994]: iface.max_burst_len = 0
Nov 28 10:53:58 user nova-compute[74994]: iface.chap_auth = <empty>
Nov 28 10:53:58 user nova-compute[74994]: iface.bidi_chap = <empty>
Nov 28 10:53:58 user nova-compute[74994]: iface.strict_login_compliance = <empty>
Nov 28 10:53:58 user nova-compute[74994]: iface.discovery_auth = <empty>
Nov 28 10:53:58 user nova-compute[74994]: iface.discovery_logout = <empty>
Nov 28 10:53:58 user nova-compute[74994]: node.discovery_address = <empty>
Nov 28 10:53:58 user nova-compute[74994]: node.discovery_port = 0
Nov 28 10:53:58 user nova-compute[74994]: node.discovery_type = static
Nov 28 10:53:58 user nova-compute[74994]: node.session.initial_cmdsn = 0
Nov 28 10:53:58 user nova-compute[74994]: node.session.initial_login_retry_max = 8
Nov 28 10:53:58 user nova-compute[74994]: node.session.xmit_thread_priority = -20
Nov 28 10:53:58 user nova-compute[74994]: node.session.cmds_max = 128
Nov 28 10:53:58 user nova-compute[74994]: node.session.queue_depth = 32
Nov 28 10:53:58 user nova-compute[74994]: node.session.nr_sessions = 1
Nov 28 10:53:58 user nova-compute[74994]: node.session.auth.authmethod = CHAP
Nov 28 10:53:58 user nova-compute[74994]: node.session.auth.username = npJsWGzr
Nov 28 10:53:58 user nova-compute[74994]: node.session.auth.password = ***
Nov 28 10:53:58 user nova-compute[74994]: node.session.auth.username_in = <empty>
Nov 28 10:53:58 user nova-compute[74994]: node.session.auth.password_in = <empty>
Nov 28 10:53:58 user nova-compute[74994]: node.session.auth.chap_algs = MD5
Nov 28 10:53:58 user nova-compute[74994]: node.session.timeo.replacement_timeout = 120
Nov 28 10:53:58 user nova-compute[74994]: node.session.err_timeo.abort_timeout = 15
Nov 28 10:53:58 user nova-compute[74994]: node.session.err_timeo.lu_reset_timeout = 30
Nov 28 10:53:58 user nova-compute[74994]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 28 10:53:58 user nova-compute[74994]: node.session.err_timeo.host_reset_timeout = 60
Nov 28 10:53:58 user nova-compute[74994]: node.session.iscsi.FastAbort = Yes
Nov 28 10:53:58 user nova-compute[74994]: node.session.iscsi.InitialR2T = No
Nov 28 10:53:58 user nova-compute[74994]: node.session.iscsi.ImmediateData = Yes
Nov 28 10:53:58 user nova-compute[74994]: node.session.iscsi.FirstBurstLength = 262144
Nov 28 10:53:58 user nova-compute[74994]: node.session.iscsi.MaxBurstLength = 16776192
Nov 28 10:53:58 user nova-compute[74994]: node.session.iscsi.DefaultTime2Retain = 0
Nov 28 10:53:58 user nova-compute[74994]: node.session.iscsi.DefaultTime2Wait = 2
Nov 28 10:53:58 user nova-compute[74994]: node.session.iscsi.MaxConnections = 1
Nov 28 10:53:58 user nova-compute[74994]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 28 10:53:58 user nova-compute[74994]: node.session.iscsi.ERL = 0
Nov 28 10:53:58 user nova-compute[74994]: node.session.scan = manual
Nov 28 10:53:58 user nova-compute[74994]: node.session.reopen_max = 0
Nov 28 10:53:58 user nova-compute[74994]: node.conn[0].address = 172.16.0.220
Nov 28 10:53:58 user nova-compute[74994]: node.conn[0].port = 3260
Nov 28 10:53:58 user nova-compute[74994]: node.conn[0].startup = manual
Nov 28 10:53:58 user nova-compute[74994]: node.conn[0].tcp.window_size = 524288
Nov 28 10:53:58 user nova-compute[74994]: node.conn[0].tcp.type_of_service = 0
Nov 28 10:53:58 user nova-compute[74994]: node.conn[0].timeo.logout_timeout = 15
Nov 28 10:53:58 user nova-compute[74994]: node.conn[0].timeo.login_timeout = 15
Nov 28 10:53:58 user nova-compute[74994]: node.conn[0].timeo.auth_timeout = 45
Nov 28 10:53:58 user nova-compute[74994]: node.conn[0].timeo.noop_out_interval = 5
Nov 28 10:53:58 user nova-compute[74994]: node.conn[0].timeo.noop_out_timeout = 5
Nov 28 10:53:58 user nova-compute[74994]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 28 10:53:58 user nova-compute[74994]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 28 10:53:58 user nova-compute[74994]: node.conn[0].iscsi.HeaderDigest = None
Nov 28 10:53:58 user nova-compute[74994]: node.conn[0].iscsi.DataDigest = None
Nov 28 10:53:58 user nova-compute[74994]: node.conn[0].iscsi.IFMarker = No
Nov 28 10:53:58 user nova-compute[74994]: node.conn[0].iscsi.OFMarker = No
Nov 28 10:53:58 user nova-compute[74994]: # END RECORD
Nov 28 10:53:58 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba20c248-c108-4c82-ae9c-5c2c86776128]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c5e867-7795-44c4-a4c1-ef41a9bb2bac]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v npJsWGzr {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v npJsWGzr" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[53fc29ac-5662-46cf-8048-c0cf0731211a]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'npJsWGzr'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4eb0bbc-f8c1-4ab5-9f5c-bdfd4ed1513a]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf7117f-1171-444e-a135-fc2c6c1207d2]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:53:58 user nova-compute[74994]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)
Nov 28 10:53:58 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:53:58 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:53:58 user nova-compute[74994]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)
Nov 28 10:53:58 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:53:58 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.165s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] HCTL ('33', '0', '0', 0) found on session 13 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4da275-e179-4dcb-817b-a88a7acb5a4c]: (4, ('0 0 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Searching for a device in session 13 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'npJsWGzr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.197s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] <== connect_volume: return (198ms) {'type': 'block', 'scsi_wwn': '26338343861366666', 'path': '/dev/sdb'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338343861366666', 'path': '/dev/sdb'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:52:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-478607448',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-478607448',id=15,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:52:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='612ae9ec21ad40a4b68e0926843874ae',ramdisk_id='',reservation_id='r-51gyvey2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-332508527',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:52:30Z,user_data=None,user_id='6c49cba00cff4c4b80080c5f917b4176',uuid=759fbcfd-ab13-438f-b860-6393a97d1205,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d4a82ba-d222-44bb-baac-6642f24b9528", "address": "fa:16:3e:4f:75:25", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "vif_mac": "fa:16:3e:4f:75:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d4a82ba-d2", "ovs_interfaceid": "7d4a82ba-d222-44bb-baac-6642f24b9528", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Converting VIF {"id": "7d4a82ba-d222-44bb-baac-6642f24b9528", "address": "fa:16:3e:4f:75:25", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "vif_mac": "fa:16:3e:4f:75:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d4a82ba-d2", "ovs_interfaceid": "7d4a82ba-d222-44bb-baac-6642f24b9528", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:75:25,bridge_name='br-int',has_traffic_filtering=True,id=7d4a82ba-d222-44bb-baac-6642f24b9528,network=Network(a1692a13-d1d7-4df6-bfc0-54f231846889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d4a82ba-d2') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG nova.objects.instance [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lazy-loading 'pci_devices' on Instance uuid 759fbcfd-ab13-438f-b860-6393a97d1205 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG nova.objects.base [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Object Instance<759fbcfd-ab13-438f-b860-6393a97d1205> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 10:53:58 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] End _get_guest_xml xml=<domain type="kvm">
Nov 28 10:53:58 user nova-compute[74994]:   <uuid>759fbcfd-ab13-438f-b860-6393a97d1205</uuid>
Nov 28 10:53:58 user nova-compute[74994]:   <name>instance-0000000f</name>
Nov 28 10:53:58 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 10:53:58 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 10:53:58 user nova-compute[74994]:   <metadata>
Nov 28 10:53:58 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 10:53:58 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 10:53:58 user nova-compute[74994]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-478607448</nova:name>
Nov 28 10:53:58 user nova-compute[74994]:       <nova:creationTime>2023-11-28 10:53:58</nova:creationTime>
Nov 28 10:53:58 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 10:53:58 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 10:53:58 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 10:53:58 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 10:53:58 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 10:53:58 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 10:53:58 user nova-compute[74994]:       </nova:flavor>
Nov 28 10:53:58 user nova-compute[74994]:       <nova:owner>
Nov 28 10:53:58 user nova-compute[74994]:         <nova:user uuid="6c49cba00cff4c4b80080c5f917b4176">tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member</nova:user>
Nov 28 10:53:58 user nova-compute[74994]:         <nova:project uuid="612ae9ec21ad40a4b68e0926843874ae">tempest-ServerBootFromVolumeStableRescueTest-332508527</nova:project>
Nov 28 10:53:58 user nova-compute[74994]:       </nova:owner>
Nov 28 10:53:58 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 10:53:58 user nova-compute[74994]:       <nova:ports>
Nov 28 10:53:58 user nova-compute[74994]:         <nova:port uuid="7d4a82ba-d222-44bb-baac-6642f24b9528">
Nov 28 10:53:58 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 10:53:58 user nova-compute[74994]:         </nova:port>
Nov 28 10:53:58 user nova-compute[74994]:       </nova:ports>
Nov 28 10:53:58 user nova-compute[74994]:     </nova:instance>
Nov 28 10:53:58 user nova-compute[74994]:   </metadata>
Nov 28 10:53:58 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 10:53:58 user nova-compute[74994]:     <system>
Nov 28 10:53:58 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 10:53:58 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 10:53:58 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 10:53:58 user nova-compute[74994]:       <entry name="serial">759fbcfd-ab13-438f-b860-6393a97d1205</entry>
Nov 28 10:53:58 user nova-compute[74994]:       <entry name="uuid">759fbcfd-ab13-438f-b860-6393a97d1205</entry>
Nov 28 10:53:58 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 10:53:58 user nova-compute[74994]:     </system>
Nov 28 10:53:58 user nova-compute[74994]:   </sysinfo>
Nov 28 10:53:58 user nova-compute[74994]:   <os>
Nov 28 10:53:58 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 10:53:58 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 10:53:58 user nova-compute[74994]:   </os>
Nov 28 10:53:58 user nova-compute[74994]:   <features>
Nov 28 10:53:58 user nova-compute[74994]:     <acpi/>
Nov 28 10:53:58 user nova-compute[74994]:     <apic/>
Nov 28 10:53:58 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 10:53:58 user nova-compute[74994]:   </features>
Nov 28 10:53:58 user nova-compute[74994]:   <clock offset="utc">
Nov 28 10:53:58 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 10:53:58 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 10:53:58 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 10:53:58 user nova-compute[74994]:   </clock>
Nov 28 10:53:58 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 10:53:58 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 10:53:58 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 10:53:58 user nova-compute[74994]:   </cpu>
Nov 28 10:53:58 user nova-compute[74994]:   <devices>
Nov 28 10:53:58 user nova-compute[74994]:     <disk type="block" device="disk">
Nov 28 10:53:58 user nova-compute[74994]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 10:53:58 user nova-compute[74994]:       <source dev="/dev/sdb"/>
Nov 28 10:53:58 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 10:53:58 user nova-compute[74994]:       <serial>6b722d69-93d3-49c4-ab46-38ce89b057de</serial>
Nov 28 10:53:58 user nova-compute[74994]:     </disk>
Nov 28 10:53:58 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 10:53:58 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 10:53:58 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/759fbcfd-ab13-438f-b860-6393a97d1205/disk.rescue"/>
Nov 28 10:53:58 user nova-compute[74994]:       <target dev="vdb" bus="virtio"/>
Nov 28 10:53:58 user nova-compute[74994]:       <boot order="1"/>
Nov 28 10:53:58 user nova-compute[74994]:     </disk>
Nov 28 10:53:58 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 10:53:58 user nova-compute[74994]:       <mac address="fa:16:3e:4f:75:25"/>
Nov 28 10:53:58 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:53:58 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 10:53:58 user nova-compute[74994]:       <target dev="tap7d4a82ba-d2"/>
Nov 28 10:53:58 user nova-compute[74994]:     </interface>
Nov 28 10:53:58 user nova-compute[74994]:     <serial type="pty">
Nov 28 10:53:58 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/759fbcfd-ab13-438f-b860-6393a97d1205/console.log" append="off"/>
Nov 28 10:53:58 user nova-compute[74994]:     </serial>
Nov 28 10:53:58 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 10:53:58 user nova-compute[74994]:     <video>
Nov 28 10:53:58 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:53:58 user nova-compute[74994]:     </video>
Nov 28 10:53:58 user nova-compute[74994]:     <rng model="virtio">
Nov 28 10:53:58 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 10:53:58 user nova-compute[74994]:     </rng>
Nov 28 10:53:58 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 10:53:58 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 10:53:58 user nova-compute[74994]:       <stats period="10"/>
Nov 28 10:53:58 user nova-compute[74994]:     </memballoon>
Nov 28 10:53:58 user nova-compute[74994]:   </devices>
Nov 28 10:53:58 user nova-compute[74994]: </domain>
Nov 28 10:53:58 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 10:53:58 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Instance destroyed successfully.
Nov 28 10:53:59 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:53:59 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:53:59 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] No VIF found with MAC fa:16:3e:4f:75:25, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:53:59 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:00 user nova-compute[74994]: DEBUG nova.compute.manager [req-323eecbb-c97e-49b2-ae52-8009852852ec req-1e795378-100a-44bc-9499-8a84ee32a83c service nova] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Received event network-vif-plugged-7d4a82ba-d222-44bb-baac-6642f24b9528 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:54:00 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-323eecbb-c97e-49b2-ae52-8009852852ec req-1e795378-100a-44bc-9499-8a84ee32a83c service nova] Acquiring lock "759fbcfd-ab13-438f-b860-6393a97d1205-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:54:00 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-323eecbb-c97e-49b2-ae52-8009852852ec req-1e795378-100a-44bc-9499-8a84ee32a83c service nova] Lock "759fbcfd-ab13-438f-b860-6393a97d1205-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:54:00 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-323eecbb-c97e-49b2-ae52-8009852852ec req-1e795378-100a-44bc-9499-8a84ee32a83c service nova] Lock "759fbcfd-ab13-438f-b860-6393a97d1205-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:54:00 user nova-compute[74994]: DEBUG nova.compute.manager [req-323eecbb-c97e-49b2-ae52-8009852852ec req-1e795378-100a-44bc-9499-8a84ee32a83c service nova] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] No waiting events found dispatching network-vif-plugged-7d4a82ba-d222-44bb-baac-6642f24b9528 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:54:00 user nova-compute[74994]: WARNING nova.compute.manager [req-323eecbb-c97e-49b2-ae52-8009852852ec req-1e795378-100a-44bc-9499-8a84ee32a83c service nova] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Received unexpected event network-vif-plugged-7d4a82ba-d222-44bb-baac-6642f24b9528 for instance with vm_state active and task_state rescuing.
Nov 28 10:54:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:02 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:03 user nova-compute[74994]: DEBUG nova.compute.manager [req-fcf62364-89f7-4aeb-94dc-f7d7aeea19a5 req-bb6762d5-c374-4621-b739-7d7ad3657574 service nova] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Received event network-vif-plugged-7d4a82ba-d222-44bb-baac-6642f24b9528 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:54:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-fcf62364-89f7-4aeb-94dc-f7d7aeea19a5 req-bb6762d5-c374-4621-b739-7d7ad3657574 service nova] Acquiring lock "759fbcfd-ab13-438f-b860-6393a97d1205-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:54:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-fcf62364-89f7-4aeb-94dc-f7d7aeea19a5 req-bb6762d5-c374-4621-b739-7d7ad3657574 service nova] Lock "759fbcfd-ab13-438f-b860-6393a97d1205-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:54:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-fcf62364-89f7-4aeb-94dc-f7d7aeea19a5 req-bb6762d5-c374-4621-b739-7d7ad3657574 service nova] Lock "759fbcfd-ab13-438f-b860-6393a97d1205-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:54:03 user nova-compute[74994]: DEBUG nova.compute.manager [req-fcf62364-89f7-4aeb-94dc-f7d7aeea19a5 req-bb6762d5-c374-4621-b739-7d7ad3657574 service nova] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] No waiting events found dispatching network-vif-plugged-7d4a82ba-d222-44bb-baac-6642f24b9528 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:54:03 user nova-compute[74994]: WARNING nova.compute.manager [req-fcf62364-89f7-4aeb-94dc-f7d7aeea19a5 req-bb6762d5-c374-4621-b739-7d7ad3657574 service nova] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Received unexpected event network-vif-plugged-7d4a82ba-d222-44bb-baac-6642f24b9528 for instance with vm_state active and task_state rescuing.
Nov 28 10:54:03 user nova-compute[74994]: DEBUG nova.compute.manager [None req-324a4d80-248f-4840-976a-8f7f15a59c6f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 10:54:03 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:54:03 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 10:54:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:04 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:54:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:06 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:54:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e49324c4-e34b-4bb6-8395-93c5d42c2b17 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "cce813fa-bf97-41f8-8aee-c7a73354e24c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:54:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e49324c4-e34b-4bb6-8395-93c5d42c2b17 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "cce813fa-bf97-41f8-8aee-c7a73354e24c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:54:07 user nova-compute[74994]: INFO nova.compute.manager [None req-e49324c4-e34b-4bb6-8395-93c5d42c2b17 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Detaching volume 4b9fff2c-c9af-4563-8213-ebc7815d3d2f
Nov 28 10:54:07 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:07 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:54:07 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 10:54:07 user nova-compute[74994]: INFO nova.virt.block_device [None req-e49324c4-e34b-4bb6-8395-93c5d42c2b17 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Attempting to driver detach volume 4b9fff2c-c9af-4563-8213-ebc7815d3d2f from mountpoint /dev/vdb
Nov 28 10:54:07 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-e49324c4-e34b-4bb6-8395-93c5d42c2b17 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Attempting to detach device vdb from instance cce813fa-bf97-41f8-8aee-c7a73354e24c from the persistent domain config. {{(pid=74994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 10:54:07 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-e49324c4-e34b-4bb6-8395-93c5d42c2b17 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 10:54:07 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 10:54:07 user nova-compute[74994]:   <source dev="/dev/sde"/>
Nov 28 10:54:07 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 10:54:07 user nova-compute[74994]:   <serial>4b9fff2c-c9af-4563-8213-ebc7815d3d2f</serial>
Nov 28 10:54:07 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 10:54:07 user nova-compute[74994]: </disk>
Nov 28 10:54:07 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 10:54:07 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-e49324c4-e34b-4bb6-8395-93c5d42c2b17 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Successfully detached device vdb from instance cce813fa-bf97-41f8-8aee-c7a73354e24c from the persistent domain config.
Nov 28 10:54:07 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-e49324c4-e34b-4bb6-8395-93c5d42c2b17 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cce813fa-bf97-41f8-8aee-c7a73354e24c from the live domain config. {{(pid=74994) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 10:54:07 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-e49324c4-e34b-4bb6-8395-93c5d42c2b17 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 10:54:07 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 10:54:07 user nova-compute[74994]:   <source dev="/dev/sde"/>
Nov 28 10:54:07 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 10:54:07 user nova-compute[74994]:   <serial>4b9fff2c-c9af-4563-8213-ebc7815d3d2f</serial>
Nov 28 10:54:07 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 10:54:07 user nova-compute[74994]: </disk>
Nov 28 10:54:07 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 10:54:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "refresh_cache-5b51d690-8198-4748-807d-1902e75564b9" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:54:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquired lock "refresh_cache-5b51d690-8198-4748-807d-1902e75564b9" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:54:07 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Forcefully refreshing network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 10:54:08 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-e49324c4-e34b-4bb6-8395-93c5d42c2b17 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cce813fa-bf97-41f8-8aee-c7a73354e24c {{(pid=74994) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 10:54:08 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Updating instance_info_cache with network_info: [{"id": "df20cfaa-368c-4bfd-b535-9192c3f240a0", "address": "fa:16:3e:c3:4c:99", "network": {"id": "434398a7-094f-4b01-ae77-ae83f21a8390", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1446659533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c23e61575784c8baffda1deda7812fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf20cfaa-36", "ovs_interfaceid": "df20cfaa-368c-4bfd-b535-9192c3f240a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:54:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Releasing lock "refresh_cache-5b51d690-8198-4748-807d-1902e75564b9" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:54:08 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Updated the network info_cache for instance {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 10:54:08 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:54:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:54:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:54:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:54:08 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 10:54:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk.rescue --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk.rescue --force-share --output=json" returned: 0 in 0.222s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk.rescue --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e30565c-9f8e-4a87-8054-6c260dac4f48/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e30565c-9f8e-4a87-8054-6c260dac4f48/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e30565c-9f8e-4a87-8054-6c260dac4f48/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e30565c-9f8e-4a87-8054-6c260dac4f48/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:11 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 10:54:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce813fa-bf97-41f8-8aee-c7a73354e24c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce813fa-bf97-41f8-8aee-c7a73354e24c/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce813fa-bf97-41f8-8aee-c7a73354e24c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce813fa-bf97-41f8-8aee-c7a73354e24c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034bca55-d0dc-4d62-b95e-38bf26fee4a0/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034bca55-d0dc-4d62-b95e-38bf26fee4a0/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034bca55-d0dc-4d62-b95e-38bf26fee4a0/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034bca55-d0dc-4d62-b95e-38bf26fee4a0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b51d690-8198-4748-807d-1902e75564b9/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b51d690-8198-4748-807d-1902e75564b9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b51d690-8198-4748-807d-1902e75564b9/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b51d690-8198-4748-807d-1902e75564b9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json" returned: 0 in 0.295s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:13 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Acquiring lock "857e3cbc-af52-46f6-9b59-87bae405f009" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:54:13 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Lock "857e3cbc-af52-46f6-9b59-87bae405f009" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:54:13 user nova-compute[74994]: DEBUG nova.compute.manager [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 10:54:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:14 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 10:54:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/759fbcfd-ab13-438f-b860-6393a97d1205/disk.rescue --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:54:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:54:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:14 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 10:54:14 user nova-compute[74994]: INFO nova.compute.claims [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Claim successful on node user
Nov 28 10:54:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/759fbcfd-ab13-438f-b860-6393a97d1205/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/759fbcfd-ab13-438f-b860-6393a97d1205/disk.rescue --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/759fbcfd-ab13-438f-b860-6393a97d1205/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:15 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:54:15 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:54:15 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=7343MB free_disk=25.28266143798828GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 10:54:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:54:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:15 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:54:15 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:54:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.347s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:54:15 user nova-compute[74994]: DEBUG nova.compute.manager [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 10:54:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.349s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:54:15 user nova-compute[74994]: DEBUG nova.compute.manager [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 10:54:15 user nova-compute[74994]: DEBUG nova.network.neutron [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 10:54:15 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 28 10:54:15 user nova-compute[74994]: DEBUG nova.compute.manager [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 10:54:15 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Applying migration context for instance 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb as it has an incoming, in-progress migration fc984819-af57-4b88-9e1c-f21db2a5d0cf. Migration status is finished {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 28 10:54:15 user nova-compute[74994]: INFO nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Updating resource usage from migration fc984819-af57-4b88-9e1c-f21db2a5d0cf
Nov 28 10:54:15 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:54:15 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance bf357856-2d97-42e8-928d-71d0378f48c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:54:15 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 279e1c4c-36f9-492f-ab3f-1b587347eadd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:54:15 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 5b51d690-8198-4748-807d-1902e75564b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:54:15 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance cce813fa-bf97-41f8-8aee-c7a73354e24c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:54:15 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 2e30565c-9f8e-4a87-8054-6c260dac4f48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:54:15 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 759fbcfd-ab13-438f-b860-6393a97d1205 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:54:15 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 034bca55-d0dc-4d62-b95e-38bf26fee4a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:54:15 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:54:15 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Migration fc984819-af57-4b88-9e1c-f21db2a5d0cf is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 28 10:54:15 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:54:15 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 20716905-c56a-4729-8c5b-9188502dc477 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:54:15 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 857e3cbc-af52-46f6-9b59-87bae405f009 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:54:15 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 10:54:15 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=31GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 10:54:15 user nova-compute[74994]: DEBUG nova.compute.manager [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 10:54:15 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 10:54:15 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Creating image(s)
Nov 28 10:54:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Acquiring lock "/opt/stack/data/nova/instances/857e3cbc-af52-46f6-9b59-87bae405f009/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:54:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Lock "/opt/stack/data/nova/instances/857e3cbc-af52-46f6-9b59-87bae405f009/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:54:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Lock "/opt/stack/data/nova/instances/857e3cbc-af52-46f6-9b59-87bae405f009/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:54:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Acquiring lock "c51527eb498019fd71fa61da518af1eb3108284b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:54:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Lock "c51527eb498019fd71fa61da518af1eb3108284b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:54:15 user nova-compute[74994]: DEBUG nova.policy [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd0676ca6f7364e2a84ef988dae17c9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad067812a804757a4326e0ed01ebee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 10:54:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c51527eb498019fd71fa61da518af1eb3108284b.part --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c51527eb498019fd71fa61da518af1eb3108284b.part --force-share --output=json" returned: 0 in 0.198s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:16 user nova-compute[74994]: DEBUG nova.virt.images [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] 9b906531-9562-42f5-8c85-218030b4dd15 was qcow2, converting to raw {{(pid=74994) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 10:54:16 user nova-compute[74994]: DEBUG nova.privsep.utils [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74994) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 10:54:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c51527eb498019fd71fa61da518af1eb3108284b.part /opt/stack/data/nova/instances/_base/c51527eb498019fd71fa61da518af1eb3108284b.converted {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:16 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:54:16 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:54:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c51527eb498019fd71fa61da518af1eb3108284b.part /opt/stack/data/nova/instances/_base/c51527eb498019fd71fa61da518af1eb3108284b.converted" returned: 0 in 0.208s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c51527eb498019fd71fa61da518af1eb3108284b.converted --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:16 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 10:54:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.204s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:54:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c51527eb498019fd71fa61da518af1eb3108284b.converted --force-share --output=json" returned: 0 in 0.208s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Lock "c51527eb498019fd71fa61da518af1eb3108284b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.064s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:54:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c51527eb498019fd71fa61da518af1eb3108284b --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:17 user nova-compute[74994]: DEBUG nova.network.neutron [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Successfully created port: b7041f22-1202-44d0-848a-3a3019d64e28 {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 10:54:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c51527eb498019fd71fa61da518af1eb3108284b --force-share --output=json" returned: 0 in 0.212s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Acquiring lock "c51527eb498019fd71fa61da518af1eb3108284b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:54:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Lock "c51527eb498019fd71fa61da518af1eb3108284b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:54:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c51527eb498019fd71fa61da518af1eb3108284b --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c51527eb498019fd71fa61da518af1eb3108284b --force-share --output=json" returned: 0 in 0.192s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c51527eb498019fd71fa61da518af1eb3108284b,backing_fmt=raw /opt/stack/data/nova/instances/857e3cbc-af52-46f6-9b59-87bae405f009/disk 1073741824 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c51527eb498019fd71fa61da518af1eb3108284b,backing_fmt=raw /opt/stack/data/nova/instances/857e3cbc-af52-46f6-9b59-87bae405f009/disk 1073741824" returned: 0 in 0.065s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Lock "c51527eb498019fd71fa61da518af1eb3108284b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:54:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c51527eb498019fd71fa61da518af1eb3108284b --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c51527eb498019fd71fa61da518af1eb3108284b --force-share --output=json" returned: 0 in 0.192s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:17 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:54:17 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Checking if we can resize image /opt/stack/data/nova/instances/857e3cbc-af52-46f6-9b59-87bae405f009/disk. size=1073741824 {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 10:54:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/857e3cbc-af52-46f6-9b59-87bae405f009/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:17 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:54:17 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:54:17 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:54:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/857e3cbc-af52-46f6-9b59-87bae405f009/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:17 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Cannot resize image /opt/stack/data/nova/instances/857e3cbc-af52-46f6-9b59-87bae405f009/disk to a smaller size. {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 10:54:17 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Created local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 10:54:17 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Ensure instance console log exists: /opt/stack/data/nova/instances/857e3cbc-af52-46f6-9b59-87bae405f009/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 10:54:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:54:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:54:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:54:17 user nova-compute[74994]: DEBUG nova.network.neutron [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Successfully updated port: b7041f22-1202-44d0-848a-3a3019d64e28 {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 10:54:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Acquiring lock "refresh_cache-857e3cbc-af52-46f6-9b59-87bae405f009" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:54:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Acquired lock "refresh_cache-857e3cbc-af52-46f6-9b59-87bae405f009" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:54:17 user nova-compute[74994]: DEBUG nova.network.neutron [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 10:54:17 user nova-compute[74994]: DEBUG nova.network.neutron [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 10:54:18 user nova-compute[74994]: DEBUG nova.compute.manager [req-2a9626cf-393e-47da-981f-5f1b6c1caca4 req-bfaf3bb4-9edb-4c30-bc53-a8b5e879e66b service nova] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Received event network-changed-b7041f22-1202-44d0-848a-3a3019d64e28 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:54:18 user nova-compute[74994]: DEBUG nova.compute.manager [req-2a9626cf-393e-47da-981f-5f1b6c1caca4 req-bfaf3bb4-9edb-4c30-bc53-a8b5e879e66b service nova] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Refreshing instance network info cache due to event network-changed-b7041f22-1202-44d0-848a-3a3019d64e28. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:54:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-2a9626cf-393e-47da-981f-5f1b6c1caca4 req-bfaf3bb4-9edb-4c30-bc53-a8b5e879e66b service nova] Acquiring lock "refresh_cache-857e3cbc-af52-46f6-9b59-87bae405f009" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:54:18 user nova-compute[74994]: DEBUG nova.network.neutron [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Updating instance_info_cache with network_info: [{"id": "b7041f22-1202-44d0-848a-3a3019d64e28", "address": "fa:16:3e:37:c1:48", "network": {"id": "eaf51f61-18e2-4b5d-a014-e8c14a30dd64", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-390069039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ad067812a804757a4326e0ed01ebee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7041f22-12", "ovs_interfaceid": "b7041f22-1202-44d0-848a-3a3019d64e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:54:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Releasing lock "refresh_cache-857e3cbc-af52-46f6-9b59-87bae405f009" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:54:18 user nova-compute[74994]: DEBUG nova.compute.manager [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Instance network_info: |[{"id": "b7041f22-1202-44d0-848a-3a3019d64e28", "address": "fa:16:3e:37:c1:48", "network": {"id": "eaf51f61-18e2-4b5d-a014-e8c14a30dd64", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-390069039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ad067812a804757a4326e0ed01ebee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7041f22-12", "ovs_interfaceid": "b7041f22-1202-44d0-848a-3a3019d64e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 10:54:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-2a9626cf-393e-47da-981f-5f1b6c1caca4 req-bfaf3bb4-9edb-4c30-bc53-a8b5e879e66b service nova] Acquired lock "refresh_cache-857e3cbc-af52-46f6-9b59-87bae405f009" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:54:18 user nova-compute[74994]: DEBUG nova.network.neutron [req-2a9626cf-393e-47da-981f-5f1b6c1caca4 req-bfaf3bb4-9edb-4c30-bc53-a8b5e879e66b service nova] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Refreshing network info cache for port b7041f22-1202-44d0-848a-3a3019d64e28 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:54:18 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Start _get_guest_xml network_info=[{"id": "b7041f22-1202-44d0-848a-3a3019d64e28", "address": "fa:16:3e:37:c1:48", "network": {"id": "eaf51f61-18e2-4b5d-a014-e8c14a30dd64", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-390069039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ad067812a804757a4326e0ed01ebee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7041f22-12", "ovs_interfaceid": "b7041f22-1202-44d0-848a-3a3019d64e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:54:08Z,direct_url=<?>,disk_format='qcow2',id=9b906531-9562-42f5-8c85-218030b4dd15,min_disk=0,min_ram=0,name='',owner='1fccf79b6ff848cab49913f88d4f8a6c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:54:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_name': '/dev/sda', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'scsi', 'image_id': '9b906531-9562-42f5-8c85-218030b4dd15'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 10:54:18 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:54:18 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:54:18 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 10:54:18 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 10:54:18 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 10:54:18 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 10:54:18 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 10:54:18 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:54:08Z,direct_url=<?>,disk_format='qcow2',id=9b906531-9562-42f5-8c85-218030b4dd15,min_disk=0,min_ram=0,name='',owner='1fccf79b6ff848cab49913f88d4f8a6c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:54:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 10:54:18 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 10:54:18 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 10:54:18 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 10:54:18 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 10:54:18 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 10:54:18 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 10:54:18 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 10:54:18 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 10:54:18 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 10:54:18 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 10:54:18 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:54:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-903806156',display_name='tempest-AttachSCSIVolumeTestJSON-server-903806156',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-903806156',id=19,image_ref='9b906531-9562-42f5-8c85-218030b4dd15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPcUZLmEz9qP2NFqGz7dZDlDjinXbY21BrWxY4+x9M9cs8G3GHxbjbglEL/W0zXmUI949C8vNadb0OJJe8XGbmIppujSCN/mtiQi8Eld996hJ8R5ykCozM1cb2Xr9W/XNA==',key_name='tempest-keypair-617834919',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ad067812a804757a4326e0ed01ebee0',ramdisk_id='',reservation_id='r-z0xepplf',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9b906531-9562-42f5-8c85-218030b4dd15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-505349781',owner_user_name='tempest-AttachSCSIVolumeTestJSON-505349781-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:54:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0676ca6f7364e2a84ef988dae17c9e6',uuid=857e3cbc-af52-46f6-9b59-87bae405f009,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7041f22-1202-44d0-848a-3a3019d64e28", "address": "fa:16:3e:37:c1:48", "network": {"id": "eaf51f61-18e2-4b5d-a014-e8c14a30dd64", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-390069039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ad067812a804757a4326e0ed01ebee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7041f22-12", "ovs_interfaceid": "b7041f22-1202-44d0-848a-3a3019d64e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:54:18 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Converting VIF {"id": "b7041f22-1202-44d0-848a-3a3019d64e28", "address": "fa:16:3e:37:c1:48", "network": {"id": "eaf51f61-18e2-4b5d-a014-e8c14a30dd64", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-390069039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ad067812a804757a4326e0ed01ebee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7041f22-12", "ovs_interfaceid": "b7041f22-1202-44d0-848a-3a3019d64e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:54:18 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:c1:48,bridge_name='br-int',has_traffic_filtering=True,id=b7041f22-1202-44d0-848a-3a3019d64e28,network=Network(eaf51f61-18e2-4b5d-a014-e8c14a30dd64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7041f22-12') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:54:18 user nova-compute[74994]: DEBUG nova.objects.instance [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Lazy-loading 'pci_devices' on Instance uuid 857e3cbc-af52-46f6-9b59-87bae405f009 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:54:18 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] End _get_guest_xml xml=<domain type="kvm">
Nov 28 10:54:18 user nova-compute[74994]:   <uuid>857e3cbc-af52-46f6-9b59-87bae405f009</uuid>
Nov 28 10:54:18 user nova-compute[74994]:   <name>instance-00000013</name>
Nov 28 10:54:18 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 10:54:18 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 10:54:18 user nova-compute[74994]:   <metadata>
Nov 28 10:54:18 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 10:54:18 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 10:54:18 user nova-compute[74994]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-903806156</nova:name>
Nov 28 10:54:18 user nova-compute[74994]:       <nova:creationTime>2023-11-28 10:54:18</nova:creationTime>
Nov 28 10:54:18 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 10:54:18 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 10:54:18 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 10:54:18 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 10:54:18 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 10:54:18 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 10:54:18 user nova-compute[74994]:       </nova:flavor>
Nov 28 10:54:18 user nova-compute[74994]:       <nova:owner>
Nov 28 10:54:18 user nova-compute[74994]:         <nova:user uuid="d0676ca6f7364e2a84ef988dae17c9e6">tempest-AttachSCSIVolumeTestJSON-505349781-project-member</nova:user>
Nov 28 10:54:18 user nova-compute[74994]:         <nova:project uuid="9ad067812a804757a4326e0ed01ebee0">tempest-AttachSCSIVolumeTestJSON-505349781</nova:project>
Nov 28 10:54:18 user nova-compute[74994]:       </nova:owner>
Nov 28 10:54:18 user nova-compute[74994]:       <nova:root type="image" uuid="9b906531-9562-42f5-8c85-218030b4dd15"/>
Nov 28 10:54:18 user nova-compute[74994]:       <nova:ports>
Nov 28 10:54:18 user nova-compute[74994]:         <nova:port uuid="b7041f22-1202-44d0-848a-3a3019d64e28">
Nov 28 10:54:18 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 28 10:54:18 user nova-compute[74994]:         </nova:port>
Nov 28 10:54:18 user nova-compute[74994]:       </nova:ports>
Nov 28 10:54:18 user nova-compute[74994]:     </nova:instance>
Nov 28 10:54:18 user nova-compute[74994]:   </metadata>
Nov 28 10:54:18 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 10:54:18 user nova-compute[74994]:     <system>
Nov 28 10:54:18 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 10:54:18 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 10:54:18 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 10:54:18 user nova-compute[74994]:       <entry name="serial">857e3cbc-af52-46f6-9b59-87bae405f009</entry>
Nov 28 10:54:18 user nova-compute[74994]:       <entry name="uuid">857e3cbc-af52-46f6-9b59-87bae405f009</entry>
Nov 28 10:54:18 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 10:54:18 user nova-compute[74994]:     </system>
Nov 28 10:54:18 user nova-compute[74994]:   </sysinfo>
Nov 28 10:54:18 user nova-compute[74994]:   <os>
Nov 28 10:54:18 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 10:54:18 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 10:54:18 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 10:54:18 user nova-compute[74994]:   </os>
Nov 28 10:54:18 user nova-compute[74994]:   <features>
Nov 28 10:54:18 user nova-compute[74994]:     <acpi/>
Nov 28 10:54:18 user nova-compute[74994]:     <apic/>
Nov 28 10:54:18 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 10:54:18 user nova-compute[74994]:   </features>
Nov 28 10:54:18 user nova-compute[74994]:   <clock offset="utc">
Nov 28 10:54:18 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 10:54:18 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 10:54:18 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 10:54:18 user nova-compute[74994]:   </clock>
Nov 28 10:54:18 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 10:54:18 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 10:54:18 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 10:54:18 user nova-compute[74994]:   </cpu>
Nov 28 10:54:18 user nova-compute[74994]:   <devices>
Nov 28 10:54:18 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 10:54:18 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 10:54:18 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/857e3cbc-af52-46f6-9b59-87bae405f009/disk"/>
Nov 28 10:54:18 user nova-compute[74994]:       <target dev="sda" bus="scsi"/>
Nov 28 10:54:18 user nova-compute[74994]:       <address type="drive" controller="0" unit="0"/>
Nov 28 10:54:18 user nova-compute[74994]:     </disk>
Nov 28 10:54:18 user nova-compute[74994]:     <disk type="file" device="cdrom">
Nov 28 10:54:18 user nova-compute[74994]:       <driver name="qemu" type="raw" cache="none"/>
Nov 28 10:54:18 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/857e3cbc-af52-46f6-9b59-87bae405f009/disk.config"/>
Nov 28 10:54:18 user nova-compute[74994]:       <target dev="sdb" bus="scsi"/>
Nov 28 10:54:18 user nova-compute[74994]:       <address type="drive" controller="0" unit="1"/>
Nov 28 10:54:18 user nova-compute[74994]:     </disk>
Nov 28 10:54:18 user nova-compute[74994]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 28 10:54:18 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 10:54:18 user nova-compute[74994]:       <mac address="fa:16:3e:37:c1:48"/>
Nov 28 10:54:18 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:54:18 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 10:54:18 user nova-compute[74994]:       <target dev="tapb7041f22-12"/>
Nov 28 10:54:18 user nova-compute[74994]:     </interface>
Nov 28 10:54:18 user nova-compute[74994]:     <serial type="pty">
Nov 28 10:54:18 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/857e3cbc-af52-46f6-9b59-87bae405f009/console.log" append="off"/>
Nov 28 10:54:18 user nova-compute[74994]:     </serial>
Nov 28 10:54:18 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 10:54:18 user nova-compute[74994]:     <video>
Nov 28 10:54:18 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:54:18 user nova-compute[74994]:     </video>
Nov 28 10:54:18 user nova-compute[74994]:     <rng model="virtio">
Nov 28 10:54:18 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 10:54:18 user nova-compute[74994]:     </rng>
Nov 28 10:54:18 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 10:54:18 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 10:54:18 user nova-compute[74994]:       <stats period="10"/>
Nov 28 10:54:18 user nova-compute[74994]:     </memballoon>
Nov 28 10:54:18 user nova-compute[74994]:   </devices>
Nov 28 10:54:18 user nova-compute[74994]: </domain>
Nov 28 10:54:18 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 10:54:18 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:54:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-903806156',display_name='tempest-AttachSCSIVolumeTestJSON-server-903806156',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-903806156',id=19,image_ref='9b906531-9562-42f5-8c85-218030b4dd15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPcUZLmEz9qP2NFqGz7dZDlDjinXbY21BrWxY4+x9M9cs8G3GHxbjbglEL/W0zXmUI949C8vNadb0OJJe8XGbmIppujSCN/mtiQi8Eld996hJ8R5ykCozM1cb2Xr9W/XNA==',key_name='tempest-keypair-617834919',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ad067812a804757a4326e0ed01ebee0',ramdisk_id='',reservation_id='r-z0xepplf',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9b906531-9562-42f5-8c85-218030b4dd15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-505349781',owner_user_name='tempest-AttachSCSIVolumeTestJSON-505349781-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:54:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0676ca6f7364e2a84ef988dae17c9e6',uuid=857e3cbc-af52-46f6-9b59-87bae405f009,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7041f22-1202-44d0-848a-3a3019d64e28", "address": "fa:16:3e:37:c1:48", "network": {"id": "eaf51f61-18e2-4b5d-a014-e8c14a30dd64", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-390069039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ad067812a804757a4326e0ed01ebee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7041f22-12", "ovs_interfaceid": "b7041f22-1202-44d0-848a-3a3019d64e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 10:54:18 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Converting VIF {"id": "b7041f22-1202-44d0-848a-3a3019d64e28", "address": "fa:16:3e:37:c1:48", "network": {"id": "eaf51f61-18e2-4b5d-a014-e8c14a30dd64", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-390069039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ad067812a804757a4326e0ed01ebee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7041f22-12", "ovs_interfaceid": "b7041f22-1202-44d0-848a-3a3019d64e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:54:18 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:c1:48,bridge_name='br-int',has_traffic_filtering=True,id=b7041f22-1202-44d0-848a-3a3019d64e28,network=Network(eaf51f61-18e2-4b5d-a014-e8c14a30dd64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7041f22-12') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:54:18 user nova-compute[74994]: DEBUG os_vif [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:c1:48,bridge_name='br-int',has_traffic_filtering=True,id=b7041f22-1202-44d0-848a-3a3019d64e28,network=Network(eaf51f61-18e2-4b5d-a014-e8c14a30dd64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7041f22-12') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 10:54:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:54:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 10:54:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '333d5a93-ecc4-5e54-8176-1489d0d7009d', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:54:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7041f22-12, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:54:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb7041f22-12, col_values=(('qos', UUID('522cc705-9d39-4467-83c3-89c6eac46c3d')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:54:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb7041f22-12, col_values=(('external_ids', {'iface-id': 'b7041f22-1202-44d0-848a-3a3019d64e28', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:c1:48', 'vm-uuid': '857e3cbc-af52-46f6-9b59-87bae405f009'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:54:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:54:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:18 user nova-compute[74994]: INFO os_vif [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:c1:48,bridge_name='br-int',has_traffic_filtering=True,id=b7041f22-1202-44d0-848a-3a3019d64e28,network=Network(eaf51f61-18e2-4b5d-a014-e8c14a30dd64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7041f22-12')
Nov 28 10:54:18 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] No BDM found with device name sda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:54:18 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:54:18 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] No VIF found with MAC fa:16:3e:37:c1:48, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:54:18 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Using config drive
Nov 28 10:54:18 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Creating config drive at /opt/stack/data/nova/instances/857e3cbc-af52-46f6-9b59-87bae405f009/disk.config
Nov 28 10:54:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/857e3cbc-af52-46f6-9b59-87bae405f009/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp56kufwa2 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/857e3cbc-af52-46f6-9b59-87bae405f009/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp56kufwa2" returned: 0 in 0.054s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:19 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:19 user nova-compute[74994]: DEBUG nova.network.neutron [req-2a9626cf-393e-47da-981f-5f1b6c1caca4 req-bfaf3bb4-9edb-4c30-bc53-a8b5e879e66b service nova] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Updated VIF entry in instance network info cache for port b7041f22-1202-44d0-848a-3a3019d64e28. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 10:54:19 user nova-compute[74994]: DEBUG nova.network.neutron [req-2a9626cf-393e-47da-981f-5f1b6c1caca4 req-bfaf3bb4-9edb-4c30-bc53-a8b5e879e66b service nova] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Updating instance_info_cache with network_info: [{"id": "b7041f22-1202-44d0-848a-3a3019d64e28", "address": "fa:16:3e:37:c1:48", "network": {"id": "eaf51f61-18e2-4b5d-a014-e8c14a30dd64", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-390069039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ad067812a804757a4326e0ed01ebee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7041f22-12", "ovs_interfaceid": "b7041f22-1202-44d0-848a-3a3019d64e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:54:19 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-2a9626cf-393e-47da-981f-5f1b6c1caca4 req-bfaf3bb4-9edb-4c30-bc53-a8b5e879e66b service nova] Releasing lock "refresh_cache-857e3cbc-af52-46f6-9b59-87bae405f009" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:54:19 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:21 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:21 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:22 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:22 user nova-compute[74994]: DEBUG nova.compute.manager [req-9493e1af-85a5-447f-8c07-52c36dd7eb12 req-03b11b4e-028a-42bd-8d06-6f2618f82650 service nova] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Received event network-vif-plugged-b7041f22-1202-44d0-848a-3a3019d64e28 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:54:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9493e1af-85a5-447f-8c07-52c36dd7eb12 req-03b11b4e-028a-42bd-8d06-6f2618f82650 service nova] Acquiring lock "857e3cbc-af52-46f6-9b59-87bae405f009-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:54:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9493e1af-85a5-447f-8c07-52c36dd7eb12 req-03b11b4e-028a-42bd-8d06-6f2618f82650 service nova] Lock "857e3cbc-af52-46f6-9b59-87bae405f009-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:54:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9493e1af-85a5-447f-8c07-52c36dd7eb12 req-03b11b4e-028a-42bd-8d06-6f2618f82650 service nova] Lock "857e3cbc-af52-46f6-9b59-87bae405f009-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:54:22 user nova-compute[74994]: DEBUG nova.compute.manager [req-9493e1af-85a5-447f-8c07-52c36dd7eb12 req-03b11b4e-028a-42bd-8d06-6f2618f82650 service nova] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] No waiting events found dispatching network-vif-plugged-b7041f22-1202-44d0-848a-3a3019d64e28 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:54:22 user nova-compute[74994]: WARNING nova.compute.manager [req-9493e1af-85a5-447f-8c07-52c36dd7eb12 req-03b11b4e-028a-42bd-8d06-6f2618f82650 service nova] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Received unexpected event network-vif-plugged-b7041f22-1202-44d0-848a-3a3019d64e28 for instance with vm_state building and task_state spawning.
Nov 28 10:54:22 user nova-compute[74994]: DEBUG nova.compute.manager [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 10:54:22 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 10:54:22 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Instance spawned successfully.
Nov 28 10:54:22 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 10:54:22 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:54:22 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:54:22 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:54:22 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:54:22 user nova-compute[74994]: INFO nova.compute.manager [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Took 6.92 seconds to spawn the instance on the hypervisor.
Nov 28 10:54:22 user nova-compute[74994]: DEBUG nova.compute.manager [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 10:54:22 user nova-compute[74994]: INFO nova.compute.manager [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Took 8.89 seconds to build instance.
Nov 28 10:54:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-df78faa2-775b-4ade-b7ff-d896388fbd83 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Lock "857e3cbc-af52-46f6-9b59-87bae405f009" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.044s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:54:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:24 user nova-compute[74994]: DEBUG nova.compute.manager [req-3274ded9-5d6e-4232-8695-1a2597ab0152 req-295d13a0-a766-46a3-ba2a-555176f70f59 service nova] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Received event network-vif-plugged-b7041f22-1202-44d0-848a-3a3019d64e28 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:54:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-3274ded9-5d6e-4232-8695-1a2597ab0152 req-295d13a0-a766-46a3-ba2a-555176f70f59 service nova] Acquiring lock "857e3cbc-af52-46f6-9b59-87bae405f009-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:54:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-3274ded9-5d6e-4232-8695-1a2597ab0152 req-295d13a0-a766-46a3-ba2a-555176f70f59 service nova] Lock "857e3cbc-af52-46f6-9b59-87bae405f009-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:54:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-3274ded9-5d6e-4232-8695-1a2597ab0152 req-295d13a0-a766-46a3-ba2a-555176f70f59 service nova] Lock "857e3cbc-af52-46f6-9b59-87bae405f009-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:54:24 user nova-compute[74994]: DEBUG nova.compute.manager [req-3274ded9-5d6e-4232-8695-1a2597ab0152 req-295d13a0-a766-46a3-ba2a-555176f70f59 service nova] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] No waiting events found dispatching network-vif-plugged-b7041f22-1202-44d0-848a-3a3019d64e28 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:54:24 user nova-compute[74994]: WARNING nova.compute.manager [req-3274ded9-5d6e-4232-8695-1a2597ab0152 req-295d13a0-a766-46a3-ba2a-555176f70f59 service nova] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Received unexpected event network-vif-plugged-b7041f22-1202-44d0-848a-3a3019d64e28 for instance with vm_state active and task_state None.
Nov 28 10:54:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:28 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-e49324c4-e34b-4bb6-8395-93c5d42c2b17 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cce813fa-bf97-41f8-8aee-c7a73354e24c is timed out.
Nov 28 10:54:28 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-e49324c4-e34b-4bb6-8395-93c5d42c2b17 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Successfully detached device vdb from instance cce813fa-bf97-41f8-8aee-c7a73354e24c from the live domain config.
Nov 28 10:54:28 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e49324c4-e34b-4bb6-8395-93c5d42c2b17 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e49324c4-e34b-4bb6-8395-93c5d42c2b17 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ezrovKLR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:54:28 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-e49324c4-e34b-4bb6-8395-93c5d42c2b17 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:54:28 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-e49324c4-e34b-4bb6-8395-93c5d42c2b17 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-e49324c4-e34b-4bb6-8395-93c5d42c2b17 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9abcc1-37d9-4aa6-9d24-ecd4674defde]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e49324c4-e34b-4bb6-8395-93c5d42c2b17 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 10:54:28 user nova-compute[74994]: No targets found.
Nov 28 10:54:28 user nova-compute[74994]: iSNS:
Nov 28 10:54:28 user nova-compute[74994]: No targets found.
Nov 28 10:54:28 user nova-compute[74994]: STATIC:
Nov 28 10:54:28 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77
Nov 28 10:54:28 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:54:28 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:54:28 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de
Nov 28 10:54:28 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:54:28 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:54:28 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f
Nov 28 10:54:28 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:54:28 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:54:28 user nova-compute[74994]: FIRMWARE:
Nov 28 10:54:28 user nova-compute[74994]: No targets found.
Nov 28 10:54:28 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e49324c4-e34b-4bb6-8395-93c5d42c2b17 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 10:54:28 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 10:54:28 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e49324c4-e34b-4bb6-8395-93c5d42c2b17 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fe3438-9c37-4fd9-9ffb-4297d007c020]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[52783047-f404-441f-9edf-961eb51947c8]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e49324c4-e34b-4bb6-8395-93c5d42c2b17 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:54:28 user nova-compute[74994]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)
Nov 28 10:54:28 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:54:28 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e49324c4-e34b-4bb6-8395-93c5d42c2b17 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:54:28 user nova-compute[74994]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)
Nov 28 10:54:28 user nova-compute[74994]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f (non-flash)
Nov 28 10:54:28 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e49324c4-e34b-4bb6-8395-93c5d42c2b17 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9206bb1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f'): ({'sde'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-e49324c4-e34b-4bb6-8395-93c5d42c2b17 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Removing single pathed devices sde {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b86ce98-966e-4ac3-a9f0-d4358c1f36b6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[018aecf8-964e-45e1-8c03-03e5f80af105]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-e49324c4-e34b-4bb6-8395-93c5d42c2b17 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Flushing IO for device /dev/sde {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca876e0-e57b-4354-a341-99b8d36b3c56]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-e49324c4-e34b-4bb6-8395-93c5d42c2b17 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae5dea6-82aa-46b9-8680-3e8353cb7d04]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-e49324c4-e34b-4bb6-8395-93c5d42c2b17 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-e49324c4-e34b-4bb6-8395-93c5d42c2b17 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] SCSI volumes sde have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e49324c4-e34b-4bb6-8395-93c5d42c2b17 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cefbb60-d49e-45b1-b203-0f9991d1ebd8]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e49324c4-e34b-4bb6-8395-93c5d42c2b17 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ebe8e4-a67d-4c58-bbb9-bd7aa130a7e1]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e49324c4-e34b-4bb6-8395-93c5d42c2b17 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f, portal: 172.16.0.220,3260]
Nov 28 10:54:28 user nova-compute[74994]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f, portal: 172.16.0.220,3260] successful.
Nov 28 10:54:28 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b9fff2c-c9af-4563-8213-ebc7815d3d2f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e89f97-be32-42c4-97df-1d056e083587]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e49324c4-e34b-4bb6-8395-93c5d42c2b17 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-e49324c4-e34b-4bb6-8395-93c5d42c2b17 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e49324c4-e34b-4bb6-8395-93c5d42c2b17 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] <== disconnect_volume: return (334ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e49324c4-e34b-4bb6-8395-93c5d42c2b17 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 10:54:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Acquiring lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:54:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:54:30 user nova-compute[74994]: DEBUG nova.compute.manager [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 10:54:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:54:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:54:30 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 10:54:30 user nova-compute[74994]: INFO nova.compute.claims [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Claim successful on node user
Nov 28 10:54:31 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:54:31 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:54:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.815s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:54:31 user nova-compute[74994]: DEBUG nova.compute.manager [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 10:54:31 user nova-compute[74994]: DEBUG nova.compute.manager [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 10:54:31 user nova-compute[74994]: DEBUG nova.network.neutron [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 10:54:31 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 10:54:31 user nova-compute[74994]: DEBUG nova.compute.manager [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 10:54:31 user nova-compute[74994]: DEBUG nova.policy [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '44e7cead5a1a4ed09ee100e9b7a4968d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33727b28c7d94b7bbe8987c1301eec04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 10:54:31 user nova-compute[74994]: DEBUG nova.compute.manager [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 10:54:31 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 10:54:31 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Creating image(s)
Nov 28 10:54:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Acquiring lock "/opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:54:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "/opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:54:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "/opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:54:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.196s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Acquiring lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:54:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:54:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.184s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk 1073741824 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk 1073741824" returned: 0 in 0.061s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:54:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4b177fba-c22d-458a-9484-96faa06a49a2 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Acquiring lock "034bca55-d0dc-4d62-b95e-38bf26fee4a0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:54:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4b177fba-c22d-458a-9484-96faa06a49a2 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lock "034bca55-d0dc-4d62-b95e-38bf26fee4a0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:54:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4b177fba-c22d-458a-9484-96faa06a49a2 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Acquiring lock "034bca55-d0dc-4d62-b95e-38bf26fee4a0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:54:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4b177fba-c22d-458a-9484-96faa06a49a2 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lock "034bca55-d0dc-4d62-b95e-38bf26fee4a0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:54:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4b177fba-c22d-458a-9484-96faa06a49a2 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lock "034bca55-d0dc-4d62-b95e-38bf26fee4a0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:54:32 user nova-compute[74994]: INFO nova.compute.manager [None req-4b177fba-c22d-458a-9484-96faa06a49a2 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Terminating instance
Nov 28 10:54:32 user nova-compute[74994]: DEBUG nova.compute.manager [None req-4b177fba-c22d-458a-9484-96faa06a49a2 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 10:54:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.221s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:32 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk. size=1073741824 {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 10:54:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:32 user nova-compute[74994]: DEBUG nova.network.neutron [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Successfully created port: 068080a2-5847-4053-a463-9fc29cb64bb4 {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 10:54:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:32 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Cannot resize image /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk to a smaller size. {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 10:54:32 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Created local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 10:54:32 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Ensure instance console log exists: /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 10:54:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:54:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:54:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:54:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:33 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Instance destroyed successfully.
Nov 28 10:54:33 user nova-compute[74994]: DEBUG nova.objects.instance [None req-4b177fba-c22d-458a-9484-96faa06a49a2 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lazy-loading 'resources' on Instance uuid 034bca55-d0dc-4d62-b95e-38bf26fee4a0 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:54:33 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-4b177fba-c22d-458a-9484-96faa06a49a2 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:52:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1788532294',display_name='tempest-VolumesAdminNegativeTest-server-1788532294',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1788532294',id=16,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:52:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5cf57a964f98428c95cf169927522860',ramdisk_id='',reservation_id='r-1l0ru058',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-230929412',owner_user_name='tempest-VolumesAdminNegativeTest-230929412-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T10:52:40Z,user_data=None,user_id='5bb3c1cbcd954e789f4a462aca3cf25d',uuid=034bca55-d0dc-4d62-b95e-38bf26fee4a0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4630452f-98fd-475e-aac8-fc2a6fb6d82f", "address": "fa:16:3e:f3:0e:26", "network": {"id": "fcf8118a-9224-4f12-b8cc-2936753d9e61", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1394689629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf57a964f98428c95cf169927522860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4630452f-98", "ovs_interfaceid": "4630452f-98fd-475e-aac8-fc2a6fb6d82f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 10:54:33 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-4b177fba-c22d-458a-9484-96faa06a49a2 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Converting VIF {"id": "4630452f-98fd-475e-aac8-fc2a6fb6d82f", "address": "fa:16:3e:f3:0e:26", "network": {"id": "fcf8118a-9224-4f12-b8cc-2936753d9e61", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1394689629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf57a964f98428c95cf169927522860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4630452f-98", "ovs_interfaceid": "4630452f-98fd-475e-aac8-fc2a6fb6d82f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:54:33 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-4b177fba-c22d-458a-9484-96faa06a49a2 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:0e:26,bridge_name='br-int',has_traffic_filtering=True,id=4630452f-98fd-475e-aac8-fc2a6fb6d82f,network=Network(fcf8118a-9224-4f12-b8cc-2936753d9e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4630452f-98') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:54:33 user nova-compute[74994]: DEBUG os_vif [None req-4b177fba-c22d-458a-9484-96faa06a49a2 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:0e:26,bridge_name='br-int',has_traffic_filtering=True,id=4630452f-98fd-475e-aac8-fc2a6fb6d82f,network=Network(fcf8118a-9224-4f12-b8cc-2936753d9e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4630452f-98') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 10:54:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4630452f-98, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:54:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:54:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6e6444fb-31ad-4836-8494-d8dc07d002a3) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:54:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:54:33 user nova-compute[74994]: INFO os_vif [None req-4b177fba-c22d-458a-9484-96faa06a49a2 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:0e:26,bridge_name='br-int',has_traffic_filtering=True,id=4630452f-98fd-475e-aac8-fc2a6fb6d82f,network=Network(fcf8118a-9224-4f12-b8cc-2936753d9e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4630452f-98')
Nov 28 10:54:33 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-4b177fba-c22d-458a-9484-96faa06a49a2 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Deleting instance files /opt/stack/data/nova/instances/034bca55-d0dc-4d62-b95e-38bf26fee4a0_del
Nov 28 10:54:33 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-4b177fba-c22d-458a-9484-96faa06a49a2 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Deletion of /opt/stack/data/nova/instances/034bca55-d0dc-4d62-b95e-38bf26fee4a0_del complete
Nov 28 10:54:33 user nova-compute[74994]: INFO nova.compute.manager [None req-4b177fba-c22d-458a-9484-96faa06a49a2 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 28 10:54:33 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-4b177fba-c22d-458a-9484-96faa06a49a2 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 10:54:33 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 10:54:33 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 10:54:33 user nova-compute[74994]: DEBUG nova.network.neutron [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Successfully updated port: 068080a2-5847-4053-a463-9fc29cb64bb4 {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 10:54:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Acquiring lock "refresh_cache-2f4b631a-46c8-4f9b-b5f9-6e2542484658" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:54:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Acquired lock "refresh_cache-2f4b631a-46c8-4f9b-b5f9-6e2542484658" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:54:33 user nova-compute[74994]: DEBUG nova.network.neutron [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 10:54:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:33 user nova-compute[74994]: DEBUG nova.compute.manager [req-580a6aa4-f648-4843-9526-4fc68e962e4a req-fe2e41c0-ad2e-4abf-a84a-ec24993cbaf6 service nova] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Received event network-vif-unplugged-4630452f-98fd-475e-aac8-fc2a6fb6d82f {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:54:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-580a6aa4-f648-4843-9526-4fc68e962e4a req-fe2e41c0-ad2e-4abf-a84a-ec24993cbaf6 service nova] Acquiring lock "034bca55-d0dc-4d62-b95e-38bf26fee4a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:54:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-580a6aa4-f648-4843-9526-4fc68e962e4a req-fe2e41c0-ad2e-4abf-a84a-ec24993cbaf6 service nova] Lock "034bca55-d0dc-4d62-b95e-38bf26fee4a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.008s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:54:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-580a6aa4-f648-4843-9526-4fc68e962e4a req-fe2e41c0-ad2e-4abf-a84a-ec24993cbaf6 service nova] Lock "034bca55-d0dc-4d62-b95e-38bf26fee4a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:54:33 user nova-compute[74994]: DEBUG nova.compute.manager [req-580a6aa4-f648-4843-9526-4fc68e962e4a req-fe2e41c0-ad2e-4abf-a84a-ec24993cbaf6 service nova] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] No waiting events found dispatching network-vif-unplugged-4630452f-98fd-475e-aac8-fc2a6fb6d82f {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:54:33 user nova-compute[74994]: DEBUG nova.compute.manager [req-580a6aa4-f648-4843-9526-4fc68e962e4a req-fe2e41c0-ad2e-4abf-a84a-ec24993cbaf6 service nova] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Received event network-vif-unplugged-4630452f-98fd-475e-aac8-fc2a6fb6d82f for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 10:54:33 user nova-compute[74994]: DEBUG nova.compute.manager [req-6454408d-833e-4fba-b56b-4b9e94043ae5 req-ca2ad312-9d3b-487c-b784-bdbfb555c734 service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Received event network-changed-068080a2-5847-4053-a463-9fc29cb64bb4 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:54:33 user nova-compute[74994]: DEBUG nova.compute.manager [req-6454408d-833e-4fba-b56b-4b9e94043ae5 req-ca2ad312-9d3b-487c-b784-bdbfb555c734 service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Refreshing instance network info cache due to event network-changed-068080a2-5847-4053-a463-9fc29cb64bb4. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:54:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6454408d-833e-4fba-b56b-4b9e94043ae5 req-ca2ad312-9d3b-487c-b784-bdbfb555c734 service nova] Acquiring lock "refresh_cache-2f4b631a-46c8-4f9b-b5f9-6e2542484658" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:54:33 user nova-compute[74994]: DEBUG nova.network.neutron [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 10:54:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:33 user nova-compute[74994]: DEBUG nova.network.neutron [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Updating instance_info_cache with network_info: [{"id": "068080a2-5847-4053-a463-9fc29cb64bb4", "address": "fa:16:3e:21:e9:f5", "network": {"id": "844b3eab-57f3-4582-9fcc-04594e44081b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-233988918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33727b28c7d94b7bbe8987c1301eec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068080a2-58", "ovs_interfaceid": "068080a2-5847-4053-a463-9fc29cb64bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:54:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Releasing lock "refresh_cache-2f4b631a-46c8-4f9b-b5f9-6e2542484658" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:54:33 user nova-compute[74994]: DEBUG nova.compute.manager [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Instance network_info: |[{"id": "068080a2-5847-4053-a463-9fc29cb64bb4", "address": "fa:16:3e:21:e9:f5", "network": {"id": "844b3eab-57f3-4582-9fcc-04594e44081b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-233988918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33727b28c7d94b7bbe8987c1301eec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068080a2-58", "ovs_interfaceid": "068080a2-5847-4053-a463-9fc29cb64bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 10:54:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6454408d-833e-4fba-b56b-4b9e94043ae5 req-ca2ad312-9d3b-487c-b784-bdbfb555c734 service nova] Acquired lock "refresh_cache-2f4b631a-46c8-4f9b-b5f9-6e2542484658" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:54:33 user nova-compute[74994]: DEBUG nova.network.neutron [req-6454408d-833e-4fba-b56b-4b9e94043ae5 req-ca2ad312-9d3b-487c-b784-bdbfb555c734 service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Refreshing network info cache for port 068080a2-5847-4053-a463-9fc29cb64bb4 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:54:33 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Start _get_guest_xml network_info=[{"id": "068080a2-5847-4053-a463-9fc29cb64bb4", "address": "fa:16:3e:21:e9:f5", "network": {"id": "844b3eab-57f3-4582-9fcc-04594e44081b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-233988918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33727b28c7d94b7bbe8987c1301eec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068080a2-58", "ovs_interfaceid": "068080a2-5847-4053-a463-9fc29cb64bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'aa939d1b-b8a6-4391-935b-0191bf5ccd0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 10:54:34 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:54:34 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:54:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 10:54:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 10:54:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 10:54:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 10:54:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 10:54:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 10:54:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 10:54:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 10:54:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 10:54:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 10:54:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 10:54:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 10:54:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 10:54:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 10:54:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 10:54:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 10:54:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:54:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-107367549',display_name='tempest-AttachVolumeTestJSON-server-107367549',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-107367549',id=20,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPaObEUIaQ+CDNwt47CPRXIZ7eFISJE/iAezjV3I0JL+MYNy2O/xy+BPGpqSlurI4jnHrFjLiC5c/eman9PMAcvN7snGFvVpuVRua1rqVAVoDQMEJZ1527ex29ZklUbnQ==',key_name='tempest-keypair-1250905933',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33727b28c7d94b7bbe8987c1301eec04',ramdisk_id='',reservation_id='r-5ou66u0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-565652019',owner_user_name='tempest-AttachVolumeTestJSON-565652019-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:54:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44e7cead5a1a4ed09ee100e9b7a4968d',uuid=2f4b631a-46c8-4f9b-b5f9-6e2542484658,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "068080a2-5847-4053-a463-9fc29cb64bb4", "address": "fa:16:3e:21:e9:f5", "network": {"id": "844b3eab-57f3-4582-9fcc-04594e44081b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-233988918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33727b28c7d94b7bbe8987c1301eec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068080a2-58", "ovs_interfaceid": "068080a2-5847-4053-a463-9fc29cb64bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:54:34 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Converting VIF {"id": "068080a2-5847-4053-a463-9fc29cb64bb4", "address": "fa:16:3e:21:e9:f5", "network": {"id": "844b3eab-57f3-4582-9fcc-04594e44081b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-233988918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33727b28c7d94b7bbe8987c1301eec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068080a2-58", "ovs_interfaceid": "068080a2-5847-4053-a463-9fc29cb64bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:54:34 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:e9:f5,bridge_name='br-int',has_traffic_filtering=True,id=068080a2-5847-4053-a463-9fc29cb64bb4,network=Network(844b3eab-57f3-4582-9fcc-04594e44081b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068080a2-58') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:54:34 user nova-compute[74994]: DEBUG nova.objects.instance [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f4b631a-46c8-4f9b-b5f9-6e2542484658 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:54:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] End _get_guest_xml xml=<domain type="kvm">
Nov 28 10:54:34 user nova-compute[74994]:   <uuid>2f4b631a-46c8-4f9b-b5f9-6e2542484658</uuid>
Nov 28 10:54:34 user nova-compute[74994]:   <name>instance-00000014</name>
Nov 28 10:54:34 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 10:54:34 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 10:54:34 user nova-compute[74994]:   <metadata>
Nov 28 10:54:34 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 10:54:34 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 10:54:34 user nova-compute[74994]:       <nova:name>tempest-AttachVolumeTestJSON-server-107367549</nova:name>
Nov 28 10:54:34 user nova-compute[74994]:       <nova:creationTime>2023-11-28 10:54:34</nova:creationTime>
Nov 28 10:54:34 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 10:54:34 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 10:54:34 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 10:54:34 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 10:54:34 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 10:54:34 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 10:54:34 user nova-compute[74994]:       </nova:flavor>
Nov 28 10:54:34 user nova-compute[74994]:       <nova:owner>
Nov 28 10:54:34 user nova-compute[74994]:         <nova:user uuid="44e7cead5a1a4ed09ee100e9b7a4968d">tempest-AttachVolumeTestJSON-565652019-project-member</nova:user>
Nov 28 10:54:34 user nova-compute[74994]:         <nova:project uuid="33727b28c7d94b7bbe8987c1301eec04">tempest-AttachVolumeTestJSON-565652019</nova:project>
Nov 28 10:54:34 user nova-compute[74994]:       </nova:owner>
Nov 28 10:54:34 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 10:54:34 user nova-compute[74994]:       <nova:ports>
Nov 28 10:54:34 user nova-compute[74994]:         <nova:port uuid="068080a2-5847-4053-a463-9fc29cb64bb4">
Nov 28 10:54:34 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 28 10:54:34 user nova-compute[74994]:         </nova:port>
Nov 28 10:54:34 user nova-compute[74994]:       </nova:ports>
Nov 28 10:54:34 user nova-compute[74994]:     </nova:instance>
Nov 28 10:54:34 user nova-compute[74994]:   </metadata>
Nov 28 10:54:34 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 10:54:34 user nova-compute[74994]:     <system>
Nov 28 10:54:34 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 10:54:34 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 10:54:34 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 10:54:34 user nova-compute[74994]:       <entry name="serial">2f4b631a-46c8-4f9b-b5f9-6e2542484658</entry>
Nov 28 10:54:34 user nova-compute[74994]:       <entry name="uuid">2f4b631a-46c8-4f9b-b5f9-6e2542484658</entry>
Nov 28 10:54:34 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 10:54:34 user nova-compute[74994]:     </system>
Nov 28 10:54:34 user nova-compute[74994]:   </sysinfo>
Nov 28 10:54:34 user nova-compute[74994]:   <os>
Nov 28 10:54:34 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 10:54:34 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 10:54:34 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 10:54:34 user nova-compute[74994]:   </os>
Nov 28 10:54:34 user nova-compute[74994]:   <features>
Nov 28 10:54:34 user nova-compute[74994]:     <acpi/>
Nov 28 10:54:34 user nova-compute[74994]:     <apic/>
Nov 28 10:54:34 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 10:54:34 user nova-compute[74994]:   </features>
Nov 28 10:54:34 user nova-compute[74994]:   <clock offset="utc">
Nov 28 10:54:34 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 10:54:34 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 10:54:34 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 10:54:34 user nova-compute[74994]:   </clock>
Nov 28 10:54:34 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 10:54:34 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 10:54:34 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 10:54:34 user nova-compute[74994]:   </cpu>
Nov 28 10:54:34 user nova-compute[74994]:   <devices>
Nov 28 10:54:34 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 10:54:34 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 10:54:34 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk"/>
Nov 28 10:54:34 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 10:54:34 user nova-compute[74994]:     </disk>
Nov 28 10:54:34 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 10:54:34 user nova-compute[74994]:       <mac address="fa:16:3e:21:e9:f5"/>
Nov 28 10:54:34 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:54:34 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 10:54:34 user nova-compute[74994]:       <target dev="tap068080a2-58"/>
Nov 28 10:54:34 user nova-compute[74994]:     </interface>
Nov 28 10:54:34 user nova-compute[74994]:     <serial type="pty">
Nov 28 10:54:34 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/console.log" append="off"/>
Nov 28 10:54:34 user nova-compute[74994]:     </serial>
Nov 28 10:54:34 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 10:54:34 user nova-compute[74994]:     <video>
Nov 28 10:54:34 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:54:34 user nova-compute[74994]:     </video>
Nov 28 10:54:34 user nova-compute[74994]:     <rng model="virtio">
Nov 28 10:54:34 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 10:54:34 user nova-compute[74994]:     </rng>
Nov 28 10:54:34 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 10:54:34 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 10:54:34 user nova-compute[74994]:       <stats period="10"/>
Nov 28 10:54:34 user nova-compute[74994]:     </memballoon>
Nov 28 10:54:34 user nova-compute[74994]:   </devices>
Nov 28 10:54:34 user nova-compute[74994]: </domain>
Nov 28 10:54:34 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 10:54:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:54:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-107367549',display_name='tempest-AttachVolumeTestJSON-server-107367549',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-107367549',id=20,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPaObEUIaQ+CDNwt47CPRXIZ7eFISJE/iAezjV3I0JL+MYNy2O/xy+BPGpqSlurI4jnHrFjLiC5c/eman9PMAcvN7snGFvVpuVRua1rqVAVoDQMEJZ1527ex29ZklUbnQ==',key_name='tempest-keypair-1250905933',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33727b28c7d94b7bbe8987c1301eec04',ramdisk_id='',reservation_id='r-5ou66u0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-565652019',owner_user_name='tempest-AttachVolumeTestJSON-565652019-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:54:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44e7cead5a1a4ed09ee100e9b7a4968d',uuid=2f4b631a-46c8-4f9b-b5f9-6e2542484658,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "068080a2-5847-4053-a463-9fc29cb64bb4", "address": "fa:16:3e:21:e9:f5", "network": {"id": "844b3eab-57f3-4582-9fcc-04594e44081b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-233988918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33727b28c7d94b7bbe8987c1301eec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068080a2-58", "ovs_interfaceid": "068080a2-5847-4053-a463-9fc29cb64bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 10:54:34 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Converting VIF {"id": "068080a2-5847-4053-a463-9fc29cb64bb4", "address": "fa:16:3e:21:e9:f5", "network": {"id": "844b3eab-57f3-4582-9fcc-04594e44081b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-233988918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33727b28c7d94b7bbe8987c1301eec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068080a2-58", "ovs_interfaceid": "068080a2-5847-4053-a463-9fc29cb64bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:54:34 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:e9:f5,bridge_name='br-int',has_traffic_filtering=True,id=068080a2-5847-4053-a463-9fc29cb64bb4,network=Network(844b3eab-57f3-4582-9fcc-04594e44081b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068080a2-58') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:54:34 user nova-compute[74994]: DEBUG os_vif [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:e9:f5,bridge_name='br-int',has_traffic_filtering=True,id=068080a2-5847-4053-a463-9fc29cb64bb4,network=Network(844b3eab-57f3-4582-9fcc-04594e44081b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068080a2-58') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 10:54:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:54:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 10:54:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5676dbdb-86ff-5262-ad33-dca06f2d9f0f', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:54:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap068080a2-58, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:54:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap068080a2-58, col_values=(('qos', UUID('6ba3411f-4075-4b45-b006-568a968ccdaa')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:54:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap068080a2-58, col_values=(('external_ids', {'iface-id': '068080a2-5847-4053-a463-9fc29cb64bb4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:e9:f5', 'vm-uuid': '2f4b631a-46c8-4f9b-b5f9-6e2542484658'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:54:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:54:34 user nova-compute[74994]: DEBUG nova.objects.instance [None req-e49324c4-e34b-4bb6-8395-93c5d42c2b17 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lazy-loading 'flavor' on Instance uuid cce813fa-bf97-41f8-8aee-c7a73354e24c {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:54:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:34 user nova-compute[74994]: INFO os_vif [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:e9:f5,bridge_name='br-int',has_traffic_filtering=True,id=068080a2-5847-4053-a463-9fc29cb64bb4,network=Network(844b3eab-57f3-4582-9fcc-04594e44081b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068080a2-58')
Nov 28 10:54:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e49324c4-e34b-4bb6-8395-93c5d42c2b17 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "cce813fa-bf97-41f8-8aee-c7a73354e24c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 27.021s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:54:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:54:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] No VIF found with MAC fa:16:3e:21:e9:f5, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:54:34 user nova-compute[74994]: DEBUG nova.network.neutron [req-6454408d-833e-4fba-b56b-4b9e94043ae5 req-ca2ad312-9d3b-487c-b784-bdbfb555c734 service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Updated VIF entry in instance network info cache for port 068080a2-5847-4053-a463-9fc29cb64bb4. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 10:54:34 user nova-compute[74994]: DEBUG nova.network.neutron [req-6454408d-833e-4fba-b56b-4b9e94043ae5 req-ca2ad312-9d3b-487c-b784-bdbfb555c734 service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Updating instance_info_cache with network_info: [{"id": "068080a2-5847-4053-a463-9fc29cb64bb4", "address": "fa:16:3e:21:e9:f5", "network": {"id": "844b3eab-57f3-4582-9fcc-04594e44081b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-233988918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33727b28c7d94b7bbe8987c1301eec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068080a2-58", "ovs_interfaceid": "068080a2-5847-4053-a463-9fc29cb64bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:54:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6454408d-833e-4fba-b56b-4b9e94043ae5 req-ca2ad312-9d3b-487c-b784-bdbfb555c734 service nova] Releasing lock "refresh_cache-2f4b631a-46c8-4f9b-b5f9-6e2542484658" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:54:34 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:54:34 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Took 1.03 seconds to deallocate network for instance.
Nov 28 10:54:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4b177fba-c22d-458a-9484-96faa06a49a2 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:54:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4b177fba-c22d-458a-9484-96faa06a49a2 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:54:35 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-4b177fba-c22d-458a-9484-96faa06a49a2 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:54:35 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-4b177fba-c22d-458a-9484-96faa06a49a2 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:54:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4b177fba-c22d-458a-9484-96faa06a49a2 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.464s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:54:35 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-4b177fba-c22d-458a-9484-96faa06a49a2 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Deleted allocations for instance 034bca55-d0dc-4d62-b95e-38bf26fee4a0
Nov 28 10:54:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4b177fba-c22d-458a-9484-96faa06a49a2 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lock "034bca55-d0dc-4d62-b95e-38bf26fee4a0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.692s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:54:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:35 user nova-compute[74994]: DEBUG nova.compute.manager [req-a0193dee-c948-4695-b1ff-804c978d49c0 req-7ebcbc07-2f91-440b-a238-57ad111ec581 service nova] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Received event network-vif-plugged-4630452f-98fd-475e-aac8-fc2a6fb6d82f {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:54:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a0193dee-c948-4695-b1ff-804c978d49c0 req-7ebcbc07-2f91-440b-a238-57ad111ec581 service nova] Acquiring lock "034bca55-d0dc-4d62-b95e-38bf26fee4a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:54:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a0193dee-c948-4695-b1ff-804c978d49c0 req-7ebcbc07-2f91-440b-a238-57ad111ec581 service nova] Lock "034bca55-d0dc-4d62-b95e-38bf26fee4a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:54:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a0193dee-c948-4695-b1ff-804c978d49c0 req-7ebcbc07-2f91-440b-a238-57ad111ec581 service nova] Lock "034bca55-d0dc-4d62-b95e-38bf26fee4a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:54:35 user nova-compute[74994]: DEBUG nova.compute.manager [req-a0193dee-c948-4695-b1ff-804c978d49c0 req-7ebcbc07-2f91-440b-a238-57ad111ec581 service nova] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] No waiting events found dispatching network-vif-plugged-4630452f-98fd-475e-aac8-fc2a6fb6d82f {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:54:35 user nova-compute[74994]: WARNING nova.compute.manager [req-a0193dee-c948-4695-b1ff-804c978d49c0 req-7ebcbc07-2f91-440b-a238-57ad111ec581 service nova] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Received unexpected event network-vif-plugged-4630452f-98fd-475e-aac8-fc2a6fb6d82f for instance with vm_state deleted and task_state None.
Nov 28 10:54:35 user nova-compute[74994]: DEBUG nova.compute.manager [req-a0193dee-c948-4695-b1ff-804c978d49c0 req-7ebcbc07-2f91-440b-a238-57ad111ec581 service nova] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Received event network-vif-plugged-4630452f-98fd-475e-aac8-fc2a6fb6d82f {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:54:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a0193dee-c948-4695-b1ff-804c978d49c0 req-7ebcbc07-2f91-440b-a238-57ad111ec581 service nova] Acquiring lock "034bca55-d0dc-4d62-b95e-38bf26fee4a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:54:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a0193dee-c948-4695-b1ff-804c978d49c0 req-7ebcbc07-2f91-440b-a238-57ad111ec581 service nova] Lock "034bca55-d0dc-4d62-b95e-38bf26fee4a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:54:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a0193dee-c948-4695-b1ff-804c978d49c0 req-7ebcbc07-2f91-440b-a238-57ad111ec581 service nova] Lock "034bca55-d0dc-4d62-b95e-38bf26fee4a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:54:35 user nova-compute[74994]: DEBUG nova.compute.manager [req-a0193dee-c948-4695-b1ff-804c978d49c0 req-7ebcbc07-2f91-440b-a238-57ad111ec581 service nova] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] No waiting events found dispatching network-vif-plugged-4630452f-98fd-475e-aac8-fc2a6fb6d82f {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:54:35 user nova-compute[74994]: WARNING nova.compute.manager [req-a0193dee-c948-4695-b1ff-804c978d49c0 req-7ebcbc07-2f91-440b-a238-57ad111ec581 service nova] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Received unexpected event network-vif-plugged-4630452f-98fd-475e-aac8-fc2a6fb6d82f for instance with vm_state deleted and task_state None.
Nov 28 10:54:35 user nova-compute[74994]: DEBUG nova.compute.manager [req-a0193dee-c948-4695-b1ff-804c978d49c0 req-7ebcbc07-2f91-440b-a238-57ad111ec581 service nova] [instance: 034bca55-d0dc-4d62-b95e-38bf26fee4a0] Received event network-vif-deleted-4630452f-98fd-475e-aac8-fc2a6fb6d82f {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:54:35 user nova-compute[74994]: DEBUG nova.compute.manager [req-bfc9131e-b831-4cce-bf67-8d319ee21da4 req-a1f60f1e-57ed-47f4-a723-afac4d920d48 service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Received event network-vif-plugged-068080a2-5847-4053-a463-9fc29cb64bb4 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:54:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bfc9131e-b831-4cce-bf67-8d319ee21da4 req-a1f60f1e-57ed-47f4-a723-afac4d920d48 service nova] Acquiring lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:54:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bfc9131e-b831-4cce-bf67-8d319ee21da4 req-a1f60f1e-57ed-47f4-a723-afac4d920d48 service nova] Lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:54:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bfc9131e-b831-4cce-bf67-8d319ee21da4 req-a1f60f1e-57ed-47f4-a723-afac4d920d48 service nova] Lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:54:35 user nova-compute[74994]: DEBUG nova.compute.manager [req-bfc9131e-b831-4cce-bf67-8d319ee21da4 req-a1f60f1e-57ed-47f4-a723-afac4d920d48 service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] No waiting events found dispatching network-vif-plugged-068080a2-5847-4053-a463-9fc29cb64bb4 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:54:35 user nova-compute[74994]: WARNING nova.compute.manager [req-bfc9131e-b831-4cce-bf67-8d319ee21da4 req-a1f60f1e-57ed-47f4-a723-afac4d920d48 service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Received unexpected event network-vif-plugged-068080a2-5847-4053-a463-9fc29cb64bb4 for instance with vm_state building and task_state spawning.
Nov 28 10:54:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:38 user nova-compute[74994]: DEBUG nova.compute.manager [req-51f43df0-961d-4c33-b85b-e42c6cc82623 req-3e5783f0-898c-4c7c-94e8-3e609ccbc3d8 service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Received event network-vif-plugged-068080a2-5847-4053-a463-9fc29cb64bb4 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:54:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-51f43df0-961d-4c33-b85b-e42c6cc82623 req-3e5783f0-898c-4c7c-94e8-3e609ccbc3d8 service nova] Acquiring lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:54:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-51f43df0-961d-4c33-b85b-e42c6cc82623 req-3e5783f0-898c-4c7c-94e8-3e609ccbc3d8 service nova] Lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:54:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-51f43df0-961d-4c33-b85b-e42c6cc82623 req-3e5783f0-898c-4c7c-94e8-3e609ccbc3d8 service nova] Lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:54:38 user nova-compute[74994]: DEBUG nova.compute.manager [req-51f43df0-961d-4c33-b85b-e42c6cc82623 req-3e5783f0-898c-4c7c-94e8-3e609ccbc3d8 service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] No waiting events found dispatching network-vif-plugged-068080a2-5847-4053-a463-9fc29cb64bb4 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:54:38 user nova-compute[74994]: WARNING nova.compute.manager [req-51f43df0-961d-4c33-b85b-e42c6cc82623 req-3e5783f0-898c-4c7c-94e8-3e609ccbc3d8 service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Received unexpected event network-vif-plugged-068080a2-5847-4053-a463-9fc29cb64bb4 for instance with vm_state building and task_state spawning.
Nov 28 10:54:38 user nova-compute[74994]: DEBUG nova.compute.manager [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 10:54:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 10:54:38 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Instance spawned successfully.
Nov 28 10:54:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 10:54:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:54:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:54:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:54:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:54:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:54:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:54:38 user nova-compute[74994]: INFO nova.compute.manager [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Took 6.26 seconds to spawn the instance on the hypervisor.
Nov 28 10:54:38 user nova-compute[74994]: DEBUG nova.compute.manager [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 10:54:38 user nova-compute[74994]: INFO nova.compute.manager [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Took 7.53 seconds to build instance.
Nov 28 10:54:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1f9fb8af-e57b-4fea-8207-2bbaf66bc995 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.647s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:54:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Acquiring lock "ab5b6240-0510-48fb-bbf5-104696eb52d7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:54:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:54:44 user nova-compute[74994]: DEBUG nova.compute.manager [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 10:54:44 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:44 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:54:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:54:44 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 10:54:44 user nova-compute[74994]: INFO nova.compute.claims [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Claim successful on node user
Nov 28 10:54:44 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:54:44 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:54:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.506s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:54:44 user nova-compute[74994]: DEBUG nova.compute.manager [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 10:54:44 user nova-compute[74994]: DEBUG nova.compute.manager [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 10:54:44 user nova-compute[74994]: DEBUG nova.network.neutron [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 10:54:44 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 10:54:44 user nova-compute[74994]: DEBUG nova.compute.manager [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 10:54:44 user nova-compute[74994]: INFO nova.virt.block_device [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Booting with volume 350ac8ea-49b5-4ae4-8301-7533add977de at /dev/vda
Nov 28 10:54:44 user nova-compute[74994]: DEBUG nova.policy [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '70bc9e7d86a3429e8c7bc10b3190f450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75aabbbe5d644d1a5752a68847017aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 10:54:44 user nova-compute[74994]: DEBUG os_brick.utils [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:54:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:44 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fae9f72-44b6-4925-a386-9c4744648fb1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:54:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:44 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b4ff06-1d30-4aad-95f7-4aca44c27cb9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:54:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:45 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ec686c-e9f2-455a-b20c-544f9bc3514c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:54:45 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9594ec1-9172-4962-9522-96dc0e4fb3f6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:54:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:54:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 10:54:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:54:45 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 10:54:45 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7ac2c1-9ff0-4252-b7fc-11debb3da687]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:54:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 10:54:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 10:54:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 10:54:45 user nova-compute[74994]: DEBUG os_brick.utils [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:54:45 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Updating existing volume attachment record: 684e16aa-c5cd-4399-9172-eb423c61055a {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 10:54:45 user nova-compute[74994]: DEBUG nova.network.neutron [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Successfully created port: 18e1fc8f-76a7-400e-bcde-5178f8b061bd {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 10:54:46 user nova-compute[74994]: DEBUG nova.network.neutron [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Successfully created port: df9a6a76-006b-4adc-9e84-ee61d037da31 {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 10:54:46 user nova-compute[74994]: DEBUG nova.network.neutron [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Successfully created port: 0c67dc60-232f-45b1-b637-48db3477ce20 {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 10:54:47 user nova-compute[74994]: DEBUG nova.network.neutron [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Successfully created port: 64313c64-2811-46b0-8953-8b80db3604a2 {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 10:54:47 user nova-compute[74994]: DEBUG nova.network.neutron [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Successfully created port: f27415ef-3b18-4406-8cc2-f5bd07325d95 {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 10:54:48 user nova-compute[74994]: DEBUG nova.network.neutron [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Successfully updated port: 18e1fc8f-76a7-400e-bcde-5178f8b061bd {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 10:54:48 user nova-compute[74994]: DEBUG nova.compute.manager [req-77d5c1d1-b7a3-42f2-8a93-cf4fa012a20b req-53370cc7-b497-49b9-bcb9-bcd307148bfc service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received event network-changed-18e1fc8f-76a7-400e-bcde-5178f8b061bd {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:54:48 user nova-compute[74994]: DEBUG nova.compute.manager [req-77d5c1d1-b7a3-42f2-8a93-cf4fa012a20b req-53370cc7-b497-49b9-bcb9-bcd307148bfc service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Refreshing instance network info cache due to event network-changed-18e1fc8f-76a7-400e-bcde-5178f8b061bd. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:54:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-77d5c1d1-b7a3-42f2-8a93-cf4fa012a20b req-53370cc7-b497-49b9-bcb9-bcd307148bfc service nova] Acquiring lock "refresh_cache-ab5b6240-0510-48fb-bbf5-104696eb52d7" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:54:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-77d5c1d1-b7a3-42f2-8a93-cf4fa012a20b req-53370cc7-b497-49b9-bcb9-bcd307148bfc service nova] Acquired lock "refresh_cache-ab5b6240-0510-48fb-bbf5-104696eb52d7" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:54:48 user nova-compute[74994]: DEBUG nova.network.neutron [req-77d5c1d1-b7a3-42f2-8a93-cf4fa012a20b req-53370cc7-b497-49b9-bcb9-bcd307148bfc service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Refreshing network info cache for port 18e1fc8f-76a7-400e-bcde-5178f8b061bd {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:54:48 user nova-compute[74994]: DEBUG nova.network.neutron [req-77d5c1d1-b7a3-42f2-8a93-cf4fa012a20b req-53370cc7-b497-49b9-bcb9-bcd307148bfc service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 10:54:48 user nova-compute[74994]: DEBUG nova.network.neutron [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Successfully updated port: 9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50 {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 10:54:49 user nova-compute[74994]: DEBUG nova.network.neutron [req-77d5c1d1-b7a3-42f2-8a93-cf4fa012a20b req-53370cc7-b497-49b9-bcb9-bcd307148bfc service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:54:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-77d5c1d1-b7a3-42f2-8a93-cf4fa012a20b req-53370cc7-b497-49b9-bcb9-bcd307148bfc service nova] Releasing lock "refresh_cache-ab5b6240-0510-48fb-bbf5-104696eb52d7" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:54:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:49 user nova-compute[74994]: DEBUG nova.network.neutron [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Successfully updated port: 3d8a5004-44ff-4247-b63e-9cc70b4c91e7 {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 10:54:50 user nova-compute[74994]: DEBUG nova.network.neutron [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Successfully updated port: df9a6a76-006b-4adc-9e84-ee61d037da31 {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 10:54:50 user nova-compute[74994]: DEBUG nova.compute.manager [req-f3932225-38c9-4f2d-a8bf-01114dc7dd2c req-3e73b93c-bd6a-4062-b48d-b3d9d243126c service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received event network-changed-9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:54:50 user nova-compute[74994]: DEBUG nova.compute.manager [req-f3932225-38c9-4f2d-a8bf-01114dc7dd2c req-3e73b93c-bd6a-4062-b48d-b3d9d243126c service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Refreshing instance network info cache due to event network-changed-9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:54:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f3932225-38c9-4f2d-a8bf-01114dc7dd2c req-3e73b93c-bd6a-4062-b48d-b3d9d243126c service nova] Acquiring lock "refresh_cache-ab5b6240-0510-48fb-bbf5-104696eb52d7" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:54:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f3932225-38c9-4f2d-a8bf-01114dc7dd2c req-3e73b93c-bd6a-4062-b48d-b3d9d243126c service nova] Acquired lock "refresh_cache-ab5b6240-0510-48fb-bbf5-104696eb52d7" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:54:50 user nova-compute[74994]: DEBUG nova.network.neutron [req-f3932225-38c9-4f2d-a8bf-01114dc7dd2c req-3e73b93c-bd6a-4062-b48d-b3d9d243126c service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Refreshing network info cache for port 9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:54:50 user nova-compute[74994]: DEBUG nova.network.neutron [req-f3932225-38c9-4f2d-a8bf-01114dc7dd2c req-3e73b93c-bd6a-4062-b48d-b3d9d243126c service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 10:54:50 user nova-compute[74994]: DEBUG nova.network.neutron [req-f3932225-38c9-4f2d-a8bf-01114dc7dd2c req-3e73b93c-bd6a-4062-b48d-b3d9d243126c service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:54:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f3932225-38c9-4f2d-a8bf-01114dc7dd2c req-3e73b93c-bd6a-4062-b48d-b3d9d243126c service nova] Releasing lock "refresh_cache-ab5b6240-0510-48fb-bbf5-104696eb52d7" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:54:50 user nova-compute[74994]: DEBUG nova.compute.manager [req-f3932225-38c9-4f2d-a8bf-01114dc7dd2c req-3e73b93c-bd6a-4062-b48d-b3d9d243126c service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received event network-changed-3d8a5004-44ff-4247-b63e-9cc70b4c91e7 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:54:50 user nova-compute[74994]: DEBUG nova.compute.manager [req-f3932225-38c9-4f2d-a8bf-01114dc7dd2c req-3e73b93c-bd6a-4062-b48d-b3d9d243126c service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Refreshing instance network info cache due to event network-changed-3d8a5004-44ff-4247-b63e-9cc70b4c91e7. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:54:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f3932225-38c9-4f2d-a8bf-01114dc7dd2c req-3e73b93c-bd6a-4062-b48d-b3d9d243126c service nova] Acquiring lock "refresh_cache-ab5b6240-0510-48fb-bbf5-104696eb52d7" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:54:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f3932225-38c9-4f2d-a8bf-01114dc7dd2c req-3e73b93c-bd6a-4062-b48d-b3d9d243126c service nova] Acquired lock "refresh_cache-ab5b6240-0510-48fb-bbf5-104696eb52d7" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:54:50 user nova-compute[74994]: DEBUG nova.network.neutron [req-f3932225-38c9-4f2d-a8bf-01114dc7dd2c req-3e73b93c-bd6a-4062-b48d-b3d9d243126c service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Refreshing network info cache for port 3d8a5004-44ff-4247-b63e-9cc70b4c91e7 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:54:50 user nova-compute[74994]: DEBUG nova.network.neutron [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Successfully updated port: 0c67dc60-232f-45b1-b637-48db3477ce20 {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 10:54:50 user nova-compute[74994]: DEBUG nova.network.neutron [req-f3932225-38c9-4f2d-a8bf-01114dc7dd2c req-3e73b93c-bd6a-4062-b48d-b3d9d243126c service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 10:54:50 user nova-compute[74994]: DEBUG nova.network.neutron [req-f3932225-38c9-4f2d-a8bf-01114dc7dd2c req-3e73b93c-bd6a-4062-b48d-b3d9d243126c service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:54:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f3932225-38c9-4f2d-a8bf-01114dc7dd2c req-3e73b93c-bd6a-4062-b48d-b3d9d243126c service nova] Releasing lock "refresh_cache-ab5b6240-0510-48fb-bbf5-104696eb52d7" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:54:50 user nova-compute[74994]: DEBUG nova.compute.manager [req-f3932225-38c9-4f2d-a8bf-01114dc7dd2c req-3e73b93c-bd6a-4062-b48d-b3d9d243126c service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received event network-changed-df9a6a76-006b-4adc-9e84-ee61d037da31 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:54:50 user nova-compute[74994]: DEBUG nova.compute.manager [req-f3932225-38c9-4f2d-a8bf-01114dc7dd2c req-3e73b93c-bd6a-4062-b48d-b3d9d243126c service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Refreshing instance network info cache due to event network-changed-df9a6a76-006b-4adc-9e84-ee61d037da31. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:54:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f3932225-38c9-4f2d-a8bf-01114dc7dd2c req-3e73b93c-bd6a-4062-b48d-b3d9d243126c service nova] Acquiring lock "refresh_cache-ab5b6240-0510-48fb-bbf5-104696eb52d7" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:54:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f3932225-38c9-4f2d-a8bf-01114dc7dd2c req-3e73b93c-bd6a-4062-b48d-b3d9d243126c service nova] Acquired lock "refresh_cache-ab5b6240-0510-48fb-bbf5-104696eb52d7" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:54:50 user nova-compute[74994]: DEBUG nova.network.neutron [req-f3932225-38c9-4f2d-a8bf-01114dc7dd2c req-3e73b93c-bd6a-4062-b48d-b3d9d243126c service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Refreshing network info cache for port df9a6a76-006b-4adc-9e84-ee61d037da31 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:54:51 user nova-compute[74994]: DEBUG nova.network.neutron [req-f3932225-38c9-4f2d-a8bf-01114dc7dd2c req-3e73b93c-bd6a-4062-b48d-b3d9d243126c service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 10:54:51 user nova-compute[74994]: DEBUG nova.network.neutron [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Successfully updated port: 64313c64-2811-46b0-8953-8b80db3604a2 {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 10:54:51 user nova-compute[74994]: DEBUG nova.network.neutron [req-f3932225-38c9-4f2d-a8bf-01114dc7dd2c req-3e73b93c-bd6a-4062-b48d-b3d9d243126c service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:54:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f3932225-38c9-4f2d-a8bf-01114dc7dd2c req-3e73b93c-bd6a-4062-b48d-b3d9d243126c service nova] Releasing lock "refresh_cache-ab5b6240-0510-48fb-bbf5-104696eb52d7" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:54:52 user nova-compute[74994]: INFO nova.virt.block_device [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Booting with volume 0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb at /dev/vdb
Nov 28 10:54:52 user nova-compute[74994]: DEBUG os_brick.utils [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:54:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:52 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[968cccdf-ca84-4f66-a4f1-2cc6cc747022]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:54:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:52 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[72913fac-4bf6-43fc-853b-799bfe304048]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:54:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:52 user nova-compute[74994]: DEBUG nova.network.neutron [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Successfully updated port: f27415ef-3b18-4406-8cc2-f5bd07325d95 {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 10:54:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:52 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa34937b-ce1d-4fe4-85ec-4b065e914ab7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:54:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Acquiring lock "refresh_cache-ab5b6240-0510-48fb-bbf5-104696eb52d7" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:54:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Acquired lock "refresh_cache-ab5b6240-0510-48fb-bbf5-104696eb52d7" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:54:52 user nova-compute[74994]: DEBUG nova.network.neutron [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 10:54:52 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e243619d-2e54-4e3f-ae1e-a435426880f5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:54:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:54:52 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 10:54:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:54:52 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 10:54:52 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da6f707-e8a8-472f-bcce-590398899870]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:54:52 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 10:54:52 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 10:54:52 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 10:54:52 user nova-compute[74994]: DEBUG os_brick.utils [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:54:52 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Updating existing volume attachment record: 92b0815a-ed94-45ef-ad7f-6584a519c2ba {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 10:54:52 user nova-compute[74994]: DEBUG nova.compute.manager [req-82bc1628-5845-4150-82f1-b81ccf1a3db1 req-57f1580d-29ed-4c7f-a1c6-f15c026c76bd service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received event network-changed-0c67dc60-232f-45b1-b637-48db3477ce20 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:54:52 user nova-compute[74994]: DEBUG nova.compute.manager [req-82bc1628-5845-4150-82f1-b81ccf1a3db1 req-57f1580d-29ed-4c7f-a1c6-f15c026c76bd service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Refreshing instance network info cache due to event network-changed-0c67dc60-232f-45b1-b637-48db3477ce20. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:54:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-82bc1628-5845-4150-82f1-b81ccf1a3db1 req-57f1580d-29ed-4c7f-a1c6-f15c026c76bd service nova] Acquiring lock "refresh_cache-ab5b6240-0510-48fb-bbf5-104696eb52d7" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:54:52 user nova-compute[74994]: DEBUG nova.network.neutron [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 10:54:54 user nova-compute[74994]: DEBUG nova.network.neutron [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Updating instance_info_cache with network_info: [{"id": "18e1fc8f-76a7-400e-bcde-5178f8b061bd", "address": "fa:16:3e:5f:2c:f1", "network": {"id": "c6d0db1d-6898-4ee2-bd5d-cc190c70128f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-510684947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18e1fc8f-76", "ovs_interfaceid": "18e1fc8f-76a7-400e-bcde-5178f8b061bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50", "address": "fa:16:3e:cb:7d:77", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cdf27ff-58", "ovs_interfaceid": "9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3d8a5004-44ff-4247-b63e-9cc70b4c91e7", "address": "fa:16:3e:15:89:0f", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8a5004-44", "ovs_interfaceid": "3d8a5004-44ff-4247-b63e-9cc70b4c91e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "df9a6a76-006b-4adc-9e84-ee61d037da31", "address": "fa:16:3e:78:52:33", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf9a6a76-00", "ovs_interfaceid": "df9a6a76-006b-4adc-9e84-ee61d037da31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0c67dc60-232f-45b1-b637-48db3477ce20", "address": "fa:16:3e:89:ae:7a", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c67dc60-23", "ovs_interfaceid": "0c67dc60-232f-45b1-b637-48db3477ce20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "64313c64-2811-46b0-8953-8b80db3604a2", "address": "fa:16:3e:95:6b:d7", "network": {"id": "12f2a6c7-ea1a-4a67-9b24-50b67341a827", "bridge": "br-int", "label": "tempest-device-tagging-net2-1808297123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64313c64-28", "ovs_interfaceid": "64313c64-2811-46b0-8953-8b80db3604a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f27415ef-3b18-4406-8cc2-f5bd07325d95", "address": "fa:16:3e:25:6c:cc", "network": {"id": "12f2a6c7-ea1a-4a67-9b24-50b67341a827", "bridge": "br-int", "label": "tempest-device-tagging-net2-1808297123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf27415ef-3b", "ovs_interfaceid": "f27415ef-3b18-4406-8cc2-f5bd07325d95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:54:54 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Releasing lock "refresh_cache-ab5b6240-0510-48fb-bbf5-104696eb52d7" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:54:54 user nova-compute[74994]: DEBUG nova.compute.manager [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Instance network_info: |[{"id": "18e1fc8f-76a7-400e-bcde-5178f8b061bd", "address": "fa:16:3e:5f:2c:f1", "network": {"id": "c6d0db1d-6898-4ee2-bd5d-cc190c70128f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-510684947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18e1fc8f-76", "ovs_interfaceid": "18e1fc8f-76a7-400e-bcde-5178f8b061bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50", "address": "fa:16:3e:cb:7d:77", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cdf27ff-58", "ovs_interfaceid": "9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3d8a5004-44ff-4247-b63e-9cc70b4c91e7", "address": "fa:16:3e:15:89:0f", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8a5004-44", "ovs_interfaceid": "3d8a5004-44ff-4247-b63e-9cc70b4c91e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "df9a6a76-006b-4adc-9e84-ee61d037da31", "address": "fa:16:3e:78:52:33", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf9a6a76-00", "ovs_interfaceid": "df9a6a76-006b-4adc-9e84-ee61d037da31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0c67dc60-232f-45b1-b637-48db3477ce20", "address": "fa:16:3e:89:ae:7a", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c67dc60-23", "ovs_interfaceid": "0c67dc60-232f-45b1-b637-48db3477ce20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "64313c64-2811-46b0-8953-8b80db3604a2", "address": "fa:16:3e:95:6b:d7", "network": {"id": "12f2a6c7-ea1a-4a67-9b24-50b67341a827", "bridge": "br-int", "label": "tempest-device-tagging-net2-1808297123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64313c64-28", "ovs_interfaceid": "64313c64-2811-46b0-8953-8b80db3604a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f27415ef-3b18-4406-8cc2-f5bd07325d95", "address": "fa:16:3e:25:6c:cc", "network": {"id": "12f2a6c7-ea1a-4a67-9b24-50b67341a827", "bridge": "br-int", "label": "tempest-device-tagging-net2-1808297123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf27415ef-3b", "ovs_interfaceid": "f27415ef-3b18-4406-8cc2-f5bd07325d95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 10:54:54 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-82bc1628-5845-4150-82f1-b81ccf1a3db1 req-57f1580d-29ed-4c7f-a1c6-f15c026c76bd service nova] Acquired lock "refresh_cache-ab5b6240-0510-48fb-bbf5-104696eb52d7" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:54:54 user nova-compute[74994]: DEBUG nova.network.neutron [req-82bc1628-5845-4150-82f1-b81ccf1a3db1 req-57f1580d-29ed-4c7f-a1c6-f15c026c76bd service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Refreshing network info cache for port 0c67dc60-232f-45b1-b637-48db3477ce20 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:54:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:54 user nova-compute[74994]: DEBUG nova.network.neutron [req-82bc1628-5845-4150-82f1-b81ccf1a3db1 req-57f1580d-29ed-4c7f-a1c6-f15c026c76bd service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Updated VIF entry in instance network info cache for port 0c67dc60-232f-45b1-b637-48db3477ce20. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 10:54:54 user nova-compute[74994]: DEBUG nova.network.neutron [req-82bc1628-5845-4150-82f1-b81ccf1a3db1 req-57f1580d-29ed-4c7f-a1c6-f15c026c76bd service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Updating instance_info_cache with network_info: [{"id": "18e1fc8f-76a7-400e-bcde-5178f8b061bd", "address": "fa:16:3e:5f:2c:f1", "network": {"id": "c6d0db1d-6898-4ee2-bd5d-cc190c70128f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-510684947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18e1fc8f-76", "ovs_interfaceid": "18e1fc8f-76a7-400e-bcde-5178f8b061bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50", "address": "fa:16:3e:cb:7d:77", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cdf27ff-58", "ovs_interfaceid": "9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3d8a5004-44ff-4247-b63e-9cc70b4c91e7", "address": "fa:16:3e:15:89:0f", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8a5004-44", "ovs_interfaceid": "3d8a5004-44ff-4247-b63e-9cc70b4c91e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "df9a6a76-006b-4adc-9e84-ee61d037da31", "address": "fa:16:3e:78:52:33", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf9a6a76-00", "ovs_interfaceid": "df9a6a76-006b-4adc-9e84-ee61d037da31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0c67dc60-232f-45b1-b637-48db3477ce20", "address": "fa:16:3e:89:ae:7a", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c67dc60-23", "ovs_interfaceid": "0c67dc60-232f-45b1-b637-48db3477ce20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "64313c64-2811-46b0-8953-8b80db3604a2", "address": "fa:16:3e:95:6b:d7", "network": {"id": "12f2a6c7-ea1a-4a67-9b24-50b67341a827", "bridge": "br-int", "label": "tempest-device-tagging-net2-1808297123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64313c64-28", "ovs_interfaceid": "64313c64-2811-46b0-8953-8b80db3604a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f27415ef-3b18-4406-8cc2-f5bd07325d95", "address": "fa:16:3e:25:6c:cc", "network": {"id": "12f2a6c7-ea1a-4a67-9b24-50b67341a827", "bridge": "br-int", "label": "tempest-device-tagging-net2-1808297123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf27415ef-3b", "ovs_interfaceid": "f27415ef-3b18-4406-8cc2-f5bd07325d95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:54:54 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-82bc1628-5845-4150-82f1-b81ccf1a3db1 req-57f1580d-29ed-4c7f-a1c6-f15c026c76bd service nova] Releasing lock "refresh_cache-ab5b6240-0510-48fb-bbf5-104696eb52d7" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:54:54 user nova-compute[74994]: DEBUG nova.compute.manager [req-82bc1628-5845-4150-82f1-b81ccf1a3db1 req-57f1580d-29ed-4c7f-a1c6-f15c026c76bd service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received event network-changed-64313c64-2811-46b0-8953-8b80db3604a2 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:54:54 user nova-compute[74994]: DEBUG nova.compute.manager [req-82bc1628-5845-4150-82f1-b81ccf1a3db1 req-57f1580d-29ed-4c7f-a1c6-f15c026c76bd service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Refreshing instance network info cache due to event network-changed-64313c64-2811-46b0-8953-8b80db3604a2. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:54:54 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-82bc1628-5845-4150-82f1-b81ccf1a3db1 req-57f1580d-29ed-4c7f-a1c6-f15c026c76bd service nova] Acquiring lock "refresh_cache-ab5b6240-0510-48fb-bbf5-104696eb52d7" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:54:54 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-82bc1628-5845-4150-82f1-b81ccf1a3db1 req-57f1580d-29ed-4c7f-a1c6-f15c026c76bd service nova] Acquired lock "refresh_cache-ab5b6240-0510-48fb-bbf5-104696eb52d7" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:54:54 user nova-compute[74994]: DEBUG nova.network.neutron [req-82bc1628-5845-4150-82f1-b81ccf1a3db1 req-57f1580d-29ed-4c7f-a1c6-f15c026c76bd service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Refreshing network info cache for port 64313c64-2811-46b0-8953-8b80db3604a2 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:54:54 user nova-compute[74994]: DEBUG nova.network.neutron [req-82bc1628-5845-4150-82f1-b81ccf1a3db1 req-57f1580d-29ed-4c7f-a1c6-f15c026c76bd service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Updated VIF entry in instance network info cache for port 64313c64-2811-46b0-8953-8b80db3604a2. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 10:54:54 user nova-compute[74994]: DEBUG nova.network.neutron [req-82bc1628-5845-4150-82f1-b81ccf1a3db1 req-57f1580d-29ed-4c7f-a1c6-f15c026c76bd service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Updating instance_info_cache with network_info: [{"id": "18e1fc8f-76a7-400e-bcde-5178f8b061bd", "address": "fa:16:3e:5f:2c:f1", "network": {"id": "c6d0db1d-6898-4ee2-bd5d-cc190c70128f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-510684947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18e1fc8f-76", "ovs_interfaceid": "18e1fc8f-76a7-400e-bcde-5178f8b061bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50", "address": "fa:16:3e:cb:7d:77", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cdf27ff-58", "ovs_interfaceid": "9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3d8a5004-44ff-4247-b63e-9cc70b4c91e7", "address": "fa:16:3e:15:89:0f", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8a5004-44", "ovs_interfaceid": "3d8a5004-44ff-4247-b63e-9cc70b4c91e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "df9a6a76-006b-4adc-9e84-ee61d037da31", "address": "fa:16:3e:78:52:33", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf9a6a76-00", "ovs_interfaceid": "df9a6a76-006b-4adc-9e84-ee61d037da31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0c67dc60-232f-45b1-b637-48db3477ce20", "address": "fa:16:3e:89:ae:7a", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c67dc60-23", "ovs_interfaceid": "0c67dc60-232f-45b1-b637-48db3477ce20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "64313c64-2811-46b0-8953-8b80db3604a2", "address": "fa:16:3e:95:6b:d7", "network": {"id": "12f2a6c7-ea1a-4a67-9b24-50b67341a827", "bridge": "br-int", "label": "tempest-device-tagging-net2-1808297123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64313c64-28", "ovs_interfaceid": "64313c64-2811-46b0-8953-8b80db3604a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f27415ef-3b18-4406-8cc2-f5bd07325d95", "address": "fa:16:3e:25:6c:cc", "network": {"id": "12f2a6c7-ea1a-4a67-9b24-50b67341a827", "bridge": "br-int", "label": "tempest-device-tagging-net2-1808297123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf27415ef-3b", "ovs_interfaceid": "f27415ef-3b18-4406-8cc2-f5bd07325d95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:54:54 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-82bc1628-5845-4150-82f1-b81ccf1a3db1 req-57f1580d-29ed-4c7f-a1c6-f15c026c76bd service nova] Releasing lock "refresh_cache-ab5b6240-0510-48fb-bbf5-104696eb52d7" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:54:54 user nova-compute[74994]: DEBUG nova.compute.manager [req-82bc1628-5845-4150-82f1-b81ccf1a3db1 req-57f1580d-29ed-4c7f-a1c6-f15c026c76bd service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received event network-changed-f27415ef-3b18-4406-8cc2-f5bd07325d95 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:54:54 user nova-compute[74994]: DEBUG nova.compute.manager [req-82bc1628-5845-4150-82f1-b81ccf1a3db1 req-57f1580d-29ed-4c7f-a1c6-f15c026c76bd service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Refreshing instance network info cache due to event network-changed-f27415ef-3b18-4406-8cc2-f5bd07325d95. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:54:54 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-82bc1628-5845-4150-82f1-b81ccf1a3db1 req-57f1580d-29ed-4c7f-a1c6-f15c026c76bd service nova] Acquiring lock "refresh_cache-ab5b6240-0510-48fb-bbf5-104696eb52d7" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:54:54 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-82bc1628-5845-4150-82f1-b81ccf1a3db1 req-57f1580d-29ed-4c7f-a1c6-f15c026c76bd service nova] Acquired lock "refresh_cache-ab5b6240-0510-48fb-bbf5-104696eb52d7" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:54:54 user nova-compute[74994]: DEBUG nova.network.neutron [req-82bc1628-5845-4150-82f1-b81ccf1a3db1 req-57f1580d-29ed-4c7f-a1c6-f15c026c76bd service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Refreshing network info cache for port f27415ef-3b18-4406-8cc2-f5bd07325d95 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:54:55 user nova-compute[74994]: DEBUG nova.network.neutron [req-82bc1628-5845-4150-82f1-b81ccf1a3db1 req-57f1580d-29ed-4c7f-a1c6-f15c026c76bd service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Updated VIF entry in instance network info cache for port f27415ef-3b18-4406-8cc2-f5bd07325d95. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 10:54:55 user nova-compute[74994]: DEBUG nova.network.neutron [req-82bc1628-5845-4150-82f1-b81ccf1a3db1 req-57f1580d-29ed-4c7f-a1c6-f15c026c76bd service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Updating instance_info_cache with network_info: [{"id": "18e1fc8f-76a7-400e-bcde-5178f8b061bd", "address": "fa:16:3e:5f:2c:f1", "network": {"id": "c6d0db1d-6898-4ee2-bd5d-cc190c70128f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-510684947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18e1fc8f-76", "ovs_interfaceid": "18e1fc8f-76a7-400e-bcde-5178f8b061bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50", "address": "fa:16:3e:cb:7d:77", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cdf27ff-58", "ovs_interfaceid": "9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3d8a5004-44ff-4247-b63e-9cc70b4c91e7", "address": "fa:16:3e:15:89:0f", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8a5004-44", "ovs_interfaceid": "3d8a5004-44ff-4247-b63e-9cc70b4c91e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "df9a6a76-006b-4adc-9e84-ee61d037da31", "address": "fa:16:3e:78:52:33", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf9a6a76-00", "ovs_interfaceid": "df9a6a76-006b-4adc-9e84-ee61d037da31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0c67dc60-232f-45b1-b637-48db3477ce20", "address": "fa:16:3e:89:ae:7a", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c67dc60-23", "ovs_interfaceid": "0c67dc60-232f-45b1-b637-48db3477ce20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "64313c64-2811-46b0-8953-8b80db3604a2", "address": "fa:16:3e:95:6b:d7", "network": {"id": "12f2a6c7-ea1a-4a67-9b24-50b67341a827", "bridge": "br-int", "label": "tempest-device-tagging-net2-1808297123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64313c64-28", "ovs_interfaceid": "64313c64-2811-46b0-8953-8b80db3604a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f27415ef-3b18-4406-8cc2-f5bd07325d95", "address": "fa:16:3e:25:6c:cc", "network": {"id": "12f2a6c7-ea1a-4a67-9b24-50b67341a827", "bridge": "br-int", "label": "tempest-device-tagging-net2-1808297123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf27415ef-3b", "ovs_interfaceid": "f27415ef-3b18-4406-8cc2-f5bd07325d95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:54:55 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-82bc1628-5845-4150-82f1-b81ccf1a3db1 req-57f1580d-29ed-4c7f-a1c6-f15c026c76bd service nova] Releasing lock "refresh_cache-ab5b6240-0510-48fb-bbf5-104696eb52d7" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:54:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-db348a48-4cc7-4692-8379-6872b4175968 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "cce813fa-bf97-41f8-8aee-c7a73354e24c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:54:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-db348a48-4cc7-4692-8379-6872b4175968 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "cce813fa-bf97-41f8-8aee-c7a73354e24c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:54:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-db348a48-4cc7-4692-8379-6872b4175968 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "cce813fa-bf97-41f8-8aee-c7a73354e24c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:54:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-db348a48-4cc7-4692-8379-6872b4175968 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "cce813fa-bf97-41f8-8aee-c7a73354e24c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:54:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-db348a48-4cc7-4692-8379-6872b4175968 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "cce813fa-bf97-41f8-8aee-c7a73354e24c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:54:57 user nova-compute[74994]: INFO nova.compute.manager [None req-db348a48-4cc7-4692-8379-6872b4175968 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Terminating instance
Nov 28 10:54:57 user nova-compute[74994]: DEBUG nova.compute.manager [None req-db348a48-4cc7-4692-8379-6872b4175968 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 10:54:57 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:57 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:57 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:57 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:57 user nova-compute[74994]: DEBUG nova.compute.manager [req-8e5b3469-c40e-4423-8e8a-9e3e86eaea03 req-30bc6141-ac0a-454e-b626-744751894b7e service nova] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Received event network-vif-unplugged-744c3452-d7cd-44a1-83d5-a60e6db5b8b5 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:54:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8e5b3469-c40e-4423-8e8a-9e3e86eaea03 req-30bc6141-ac0a-454e-b626-744751894b7e service nova] Acquiring lock "cce813fa-bf97-41f8-8aee-c7a73354e24c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:54:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8e5b3469-c40e-4423-8e8a-9e3e86eaea03 req-30bc6141-ac0a-454e-b626-744751894b7e service nova] Lock "cce813fa-bf97-41f8-8aee-c7a73354e24c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:54:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8e5b3469-c40e-4423-8e8a-9e3e86eaea03 req-30bc6141-ac0a-454e-b626-744751894b7e service nova] Lock "cce813fa-bf97-41f8-8aee-c7a73354e24c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:54:57 user nova-compute[74994]: DEBUG nova.compute.manager [req-8e5b3469-c40e-4423-8e8a-9e3e86eaea03 req-30bc6141-ac0a-454e-b626-744751894b7e service nova] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] No waiting events found dispatching network-vif-unplugged-744c3452-d7cd-44a1-83d5-a60e6db5b8b5 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:54:57 user nova-compute[74994]: DEBUG nova.compute.manager [req-8e5b3469-c40e-4423-8e8a-9e3e86eaea03 req-30bc6141-ac0a-454e-b626-744751894b7e service nova] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Received event network-vif-unplugged-744c3452-d7cd-44a1-83d5-a60e6db5b8b5 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 10:54:58 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Instance destroyed successfully.
Nov 28 10:54:58 user nova-compute[74994]: DEBUG nova.objects.instance [None req-db348a48-4cc7-4692-8379-6872b4175968 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lazy-loading 'resources' on Instance uuid cce813fa-bf97-41f8-8aee-c7a73354e24c {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:54:58 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-db348a48-4cc7-4692-8379-6872b4175968 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:49:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-277000810',display_name='tempest-AttachVolumeNegativeTest-server-277000810',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-277000810',id=6,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqyGoyqq5ybVPtbq9a8ErmsWpHQnEQKLnTRhnq7E2SRAkhGjN5czYMIqSRkI2mBZOGesl4H/Y2EWJXHNPRUARyU8uw6WzMpmGalPoMcIscidM19xIHw1dCacIRcTYXyxQ==',key_name='tempest-keypair-98588548',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:49:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='636fa9a1f046425e9332cc3807f8fb46',ramdisk_id='',reservation_id='r-yh7vzi5x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-3431122',owner_user_name='tempest-AttachVolumeNegativeTest-3431122-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T10:49:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa362c35530641a687a33182012c2332',uuid=cce813fa-bf97-41f8-8aee-c7a73354e24c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "744c3452-d7cd-44a1-83d5-a60e6db5b8b5", "address": "fa:16:3e:a0:b1:ed", "network": {"id": "d9bcdec6-69e0-4e65-8a26-1af1f8232365", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1227861580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "636fa9a1f046425e9332cc3807f8fb46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744c3452-d7", "ovs_interfaceid": "744c3452-d7cd-44a1-83d5-a60e6db5b8b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 10:54:58 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-db348a48-4cc7-4692-8379-6872b4175968 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Converting VIF {"id": "744c3452-d7cd-44a1-83d5-a60e6db5b8b5", "address": "fa:16:3e:a0:b1:ed", "network": {"id": "d9bcdec6-69e0-4e65-8a26-1af1f8232365", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1227861580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "636fa9a1f046425e9332cc3807f8fb46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744c3452-d7", "ovs_interfaceid": "744c3452-d7cd-44a1-83d5-a60e6db5b8b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:54:58 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-db348a48-4cc7-4692-8379-6872b4175968 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a0:b1:ed,bridge_name='br-int',has_traffic_filtering=True,id=744c3452-d7cd-44a1-83d5-a60e6db5b8b5,network=Network(d9bcdec6-69e0-4e65-8a26-1af1f8232365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap744c3452-d7') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:54:58 user nova-compute[74994]: DEBUG os_vif [None req-db348a48-4cc7-4692-8379-6872b4175968 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:b1:ed,bridge_name='br-int',has_traffic_filtering=True,id=744c3452-d7cd-44a1-83d5-a60e6db5b8b5,network=Network(d9bcdec6-69e0-4e65-8a26-1af1f8232365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap744c3452-d7') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 10:54:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap744c3452-d7, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:54:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a874cf9f-8724-428f-8ca1-ddcda3be07ff) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:54:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:58 user nova-compute[74994]: INFO os_vif [None req-db348a48-4cc7-4692-8379-6872b4175968 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:b1:ed,bridge_name='br-int',has_traffic_filtering=True,id=744c3452-d7cd-44a1-83d5-a60e6db5b8b5,network=Network(d9bcdec6-69e0-4e65-8a26-1af1f8232365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap744c3452-d7')
Nov 28 10:54:58 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-db348a48-4cc7-4692-8379-6872b4175968 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Deleting instance files /opt/stack/data/nova/instances/cce813fa-bf97-41f8-8aee-c7a73354e24c_del
Nov 28 10:54:58 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-db348a48-4cc7-4692-8379-6872b4175968 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Deletion of /opt/stack/data/nova/instances/cce813fa-bf97-41f8-8aee-c7a73354e24c_del complete
Nov 28 10:54:58 user nova-compute[74994]: INFO nova.compute.manager [None req-db348a48-4cc7-4692-8379-6872b4175968 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 28 10:54:58 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-db348a48-4cc7-4692-8379-6872b4175968 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 10:54:58 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 10:54:58 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 10:54:59 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:54:59 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:54:59 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Took 0.80 seconds to deallocate network for instance.
Nov 28 10:54:59 user nova-compute[74994]: DEBUG nova.compute.manager [req-4f60cbd6-6af5-46e0-8d35-67530c27b28d req-69b7403a-b54c-4335-b663-7ed1fce32e29 service nova] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Received event network-vif-deleted-744c3452-d7cd-44a1-83d5-a60e6db5b8b5 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:54:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-db348a48-4cc7-4692-8379-6872b4175968 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:54:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-db348a48-4cc7-4692-8379-6872b4175968 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:54:59 user nova-compute[74994]: INFO nova.virt.block_device [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Booting with volume d56b4123-7ab2-47c2-8f25-d4653a389f3f at /dev/vdc
Nov 28 10:54:59 user nova-compute[74994]: DEBUG os_brick.utils [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:54:59 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:59 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:59 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e343cb35-e263-4c5f-95ef-e06cb43bc63e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:54:59 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:59 user nova-compute[74994]: DEBUG nova.compute.manager [req-84c6b1b3-adfe-47b6-873d-be2047c7b7ae req-eeb0501b-3afd-4902-a1ce-4827c6532428 service nova] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Received event network-vif-plugged-744c3452-d7cd-44a1-83d5-a60e6db5b8b5 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:54:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-84c6b1b3-adfe-47b6-873d-be2047c7b7ae req-eeb0501b-3afd-4902-a1ce-4827c6532428 service nova] Acquiring lock "cce813fa-bf97-41f8-8aee-c7a73354e24c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:54:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-84c6b1b3-adfe-47b6-873d-be2047c7b7ae req-eeb0501b-3afd-4902-a1ce-4827c6532428 service nova] Lock "cce813fa-bf97-41f8-8aee-c7a73354e24c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:54:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-84c6b1b3-adfe-47b6-873d-be2047c7b7ae req-eeb0501b-3afd-4902-a1ce-4827c6532428 service nova] Lock "cce813fa-bf97-41f8-8aee-c7a73354e24c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:54:59 user nova-compute[74994]: DEBUG nova.compute.manager [req-84c6b1b3-adfe-47b6-873d-be2047c7b7ae req-eeb0501b-3afd-4902-a1ce-4827c6532428 service nova] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] No waiting events found dispatching network-vif-plugged-744c3452-d7cd-44a1-83d5-a60e6db5b8b5 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:54:59 user nova-compute[74994]: WARNING nova.compute.manager [req-84c6b1b3-adfe-47b6-873d-be2047c7b7ae req-eeb0501b-3afd-4902-a1ce-4827c6532428 service nova] [instance: cce813fa-bf97-41f8-8aee-c7a73354e24c] Received unexpected event network-vif-plugged-744c3452-d7cd-44a1-83d5-a60e6db5b8b5 for instance with vm_state deleted and task_state None.
Nov 28 10:54:59 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:59 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[163dd836-13dc-448d-9807-9e62a908a907]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:54:59 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:59 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:54:59 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[474584b8-b403-4471-ad0b-0db1a19efa46]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:54:59 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[03afbd39-fb68-448f-b2e6-3317b242e426]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:54:59 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:59 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:54:59 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 10:54:59 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:54:59 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:54:59 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 10:54:59 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1a380b-6d70-4444-9a78-424f66588ba0]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:54:59 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 10:54:59 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 10:54:59 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 10:54:59 user nova-compute[74994]: DEBUG os_brick.utils [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:54:59 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Updating existing volume attachment record: 0268cd48-ce28-41df-bfe2-136edfa2175c {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 10:54:59 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-db348a48-4cc7-4692-8379-6872b4175968 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:55:00 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-db348a48-4cc7-4692-8379-6872b4175968 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:55:00 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-db348a48-4cc7-4692-8379-6872b4175968 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.842s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:00 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-db348a48-4cc7-4692-8379-6872b4175968 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Deleted allocations for instance cce813fa-bf97-41f8-8aee-c7a73354e24c
Nov 28 10:55:00 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-db348a48-4cc7-4692-8379-6872b4175968 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "cce813fa-bf97-41f8-8aee-c7a73354e24c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.717s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:00 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:55:00 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74994) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 10:55:00 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:55:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:04 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:55:04 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:55:04 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Cleaning up deleted instances {{(pid=74994) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 10:55:04 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] There are 0 instances to clean {{(pid=74994) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 10:55:05 user nova-compute[74994]: DEBUG nova.compute.manager [req-5569bcc7-4844-41b2-bd20-42318a63b7eb req-85349568-2cec-4a03-9bdc-ce0414440a33 service nova] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Received event network-changed-4dfa3aa6-df94-4d84-ac44-2e0c807640bb {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:55:05 user nova-compute[74994]: DEBUG nova.compute.manager [req-5569bcc7-4844-41b2-bd20-42318a63b7eb req-85349568-2cec-4a03-9bdc-ce0414440a33 service nova] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Refreshing instance network info cache due to event network-changed-4dfa3aa6-df94-4d84-ac44-2e0c807640bb. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:55:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-5569bcc7-4844-41b2-bd20-42318a63b7eb req-85349568-2cec-4a03-9bdc-ce0414440a33 service nova] Acquiring lock "refresh_cache-b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:55:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-5569bcc7-4844-41b2-bd20-42318a63b7eb req-85349568-2cec-4a03-9bdc-ce0414440a33 service nova] Acquired lock "refresh_cache-b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:55:05 user nova-compute[74994]: DEBUG nova.network.neutron [req-5569bcc7-4844-41b2-bd20-42318a63b7eb req-85349568-2cec-4a03-9bdc-ce0414440a33 service nova] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Refreshing network info cache for port 4dfa3aa6-df94-4d84-ac44-2e0c807640bb {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:55:05 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:55:05 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 10:55:05 user nova-compute[74994]: DEBUG nova.network.neutron [req-5569bcc7-4844-41b2-bd20-42318a63b7eb req-85349568-2cec-4a03-9bdc-ce0414440a33 service nova] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Updated VIF entry in instance network info cache for port 4dfa3aa6-df94-4d84-ac44-2e0c807640bb. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 10:55:05 user nova-compute[74994]: DEBUG nova.network.neutron [req-5569bcc7-4844-41b2-bd20-42318a63b7eb req-85349568-2cec-4a03-9bdc-ce0414440a33 service nova] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Updating instance_info_cache with network_info: [{"id": "4dfa3aa6-df94-4d84-ac44-2e0c807640bb", "address": "fa:16:3e:ab:1e:fc", "network": {"id": "aeb89ffc-c2f3-4a19-b7cb-e273021f655a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-334414746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9120da612e254822a611672d14e37690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dfa3aa6-df", "ovs_interfaceid": "4dfa3aa6-df94-4d84-ac44-2e0c807640bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:55:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-5569bcc7-4844-41b2-bd20-42318a63b7eb req-85349568-2cec-4a03-9bdc-ce0414440a33 service nova] Releasing lock "refresh_cache-b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:55:07 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:55:07 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:55:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:07 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 10:55:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk.rescue --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk.rescue --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG nova.compute.manager [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 10:55:08 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Creating image(s)
Nov 28 10:55:08 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Did not create local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Ensure instance console log exists: /opt/stack/data/nova/instances/ab5b6240-0510-48fb-bbf5-104696eb52d7/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Start _get_guest_xml network_info=[{"id": "18e1fc8f-76a7-400e-bcde-5178f8b061bd", "address": "fa:16:3e:5f:2c:f1", "network": {"id": "c6d0db1d-6898-4ee2-bd5d-cc190c70128f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-510684947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18e1fc8f-76", "ovs_interfaceid": "18e1fc8f-76a7-400e-bcde-5178f8b061bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50", "address": "fa:16:3e:cb:7d:77", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cdf27ff-58", "ovs_interfaceid": "9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3d8a5004-44ff-4247-b63e-9cc70b4c91e7", "address": "fa:16:3e:15:89:0f", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8a5004-44", "ovs_interfaceid": "3d8a5004-44ff-4247-b63e-9cc70b4c91e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "df9a6a76-006b-4adc-9e84-ee61d037da31", "address": "fa:16:3e:78:52:33", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf9a6a76-00", "ovs_interfaceid": "df9a6a76-006b-4adc-9e84-ee61d037da31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0c67dc60-232f-45b1-b637-48db3477ce20", "address": "fa:16:3e:89:ae:7a", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c67dc60-23", "ovs_interfaceid": "0c67dc60-232f-45b1-b637-48db3477ce20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "64313c64-2811-46b0-8953-8b80db3604a2", "address": "fa:16:3e:95:6b:d7", "network": {"id": "12f2a6c7-ea1a-4a67-9b24-50b67341a827", "bridge": "br-int", "label": "tempest-device-tagging-net2-1808297123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64313c64-28", "ovs_interfaceid": "64313c64-2811-46b0-8953-8b80db3604a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f27415ef-3b18-4406-8cc2-f5bd07325d95", "address": "fa:16:3e:25:6c:cc", "network": {"id": "12f2a6c7-ea1a-4a67-9b24-50b67341a827", "bridge": "br-int", "label": "tempest-device-tagging-net2-1808297123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf27415ef-3b", "ovs_interfaceid": "f27415ef-3b18-4406-8cc2-f5bd07325d95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QWlmhogJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ab5b6240-0510-48fb-bbf5-104696eb52d7', 'attached_at': '', 'detached_at': '', 'volume_id': '350ac8ea-49b5-4ae4-8301-7533add977de', 'serial': '350ac8ea-49b5-4ae4-8301-7533add977de'}, 'attachment_id': '684e16aa-c5cd-4399-9172-eb423c61055a', 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None}, {'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DOxfJzyh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ab5b6240-0510-48fb-bbf5-104696eb52d7', 'attached_at': '', 'detached_at': '', 'volume_id': '0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb', 'serial': '0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb'}, 'attachment_id': '92b0815a-ed94-45ef-ad7f-6584a519c2ba', 'boot_index': 1, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'volume_type': None}, {'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MJkXDsto', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ab5b6240-0510-48fb-bbf5-104696eb52d7', 'attached_at': '', 'detached_at': '', 'volume_id': 'd56b4123-7ab2-47c2-8f25-d4653a389f3f', 'serial': 'd56b4123-7ab2-47c2-8f25-d4653a389f3f'}, 'attachment_id': '0268cd48-ce28-41df-bfe2-136edfa2175c', 'boot_index': 2, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Acquiring lock "b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Lock "b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:08 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:55:08 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:55:08 user nova-compute[74994]: DEBUG nova.objects.instance [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Lazy-loading 'flavor' on Instance uuid b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QWlmhogJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:55:08 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:55:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:55:08 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:55:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:55:08 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 10:55:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Lock "b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[df78caee-d22d-4eab-94fd-69c7532884d9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 10:55:08 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5f4513-1d2b-4627-9740-7e640c5897b4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de] added
Nov 28 10:55:08 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d922e995-dff2-4179-bbb0-19a0340f8cd7]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86a2ce4-f4bf-4dff-bd33-1d774bce60e8]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QWlmhogJ {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QWlmhogJ" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2fa02d1-03fc-489a-a66e-7bec94c46a0d]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QWlmhogJ'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b38e342-d07b-4eb8-9612-b1e40d452cbe]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Acquiring lock "b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Lock "b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:08 user nova-compute[74994]: INFO nova.compute.manager [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Attaching volume 52404138-8512-46a3-a2ab-483912367e31 to /dev/vdb
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ef9e1a-1b0e-4c8a-aea5-84e826b158ef]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:55:08 user nova-compute[74994]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)
Nov 28 10:55:08 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:55:08 user nova-compute[74994]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)
Nov 28 10:55:08 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6905577-65f7-4dd4-81f9-f7c008a2fcf6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de, portal: 172.16.0.220,3260]
Nov 28 10:55:08 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de, portal: 172.16.0.220,3260] successful.
Nov 28 10:55:08 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG os_brick.utils [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2413e9ee-a6e9-4523-8c34-2a7a2826da6c]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e223af-5e8e-4fbe-88d1-176a7019923b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2e0f93-8422-4335-b541-5447aa5d3166]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:55:08 user nova-compute[74994]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)
Nov 28 10:55:08 user nova-compute[74994]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)
Nov 28 10:55:08 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:55:08 user nova-compute[74994]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)
Nov 28 10:55:08 user nova-compute[74994]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)
Nov 28 10:55:08 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.382s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] HCTL ('35', '-', '-', 0) found on session 16 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7a6124-1021-43e6-9554-996462e0756f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa41fdf3-1c21-4cf9-afc9-5a16bc7bcd03]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f262fc-a316-4905-b498-4c52eba0981f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6c76ac-5635-43a4-ad72-431cbead377c]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QWlmhogJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:55:08 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed9d143-c9c2-4e95-b487-19dbf0944300]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG os_brick.utils [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Updating existing volume attachment record: 56a9d25b-df30-4b46-9983-e9010c196a99 {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG nova.network.neutron [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Port 7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a binding to destination host user is already ACTIVE {{(pid=74994) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Acquiring lock "refresh_cache-2535b6f2-2a4b-4ce1-bd47-0f97d15700fb" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Acquired lock "refresh_cache-2535b6f2-2a4b-4ce1-bd47-0f97d15700fb" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:55:08 user nova-compute[74994]: DEBUG nova.network.neutron [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 10:55:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:09 user nova-compute[74994]: DEBUG nova.network.neutron [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Updating instance_info_cache with network_info: [{"id": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "address": "fa:16:3e:5d:59:b1", "network": {"id": "670b5fe0-96f5-4414-9425-31ee24eda138", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1327797043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9bc007c45c84765bb2739844c7af055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcb29ac-ee", "ovs_interfaceid": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:55:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Releasing lock "refresh_cache-2535b6f2-2a4b-4ce1-bd47-0f97d15700fb" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:55:09 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Creating tmpfile /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/tmp08cvv13b to verify with other compute node that the instance is on the same shared storage. {{(pid=74994) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9625}}
Nov 28 10:55:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e30565c-9f8e-4a87-8054-6c260dac4f48/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:09 user nova-compute[74994]: DEBUG nova.compute.manager [req-613bc1fe-6192-416f-bbb8-01829f763592 req-86e10114-d0ae-48fe-8a80-cbea9502f162 service nova] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Received event network-vif-unplugged-7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:55:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-613bc1fe-6192-416f-bbb8-01829f763592 req-86e10114-d0ae-48fe-8a80-cbea9502f162 service nova] Acquiring lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-613bc1fe-6192-416f-bbb8-01829f763592 req-86e10114-d0ae-48fe-8a80-cbea9502f162 service nova] Lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-613bc1fe-6192-416f-bbb8-01829f763592 req-86e10114-d0ae-48fe-8a80-cbea9502f162 service nova] Lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:09 user nova-compute[74994]: DEBUG nova.compute.manager [req-613bc1fe-6192-416f-bbb8-01829f763592 req-86e10114-d0ae-48fe-8a80-cbea9502f162 service nova] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] No waiting events found dispatching network-vif-unplugged-7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:55:09 user nova-compute[74994]: WARNING nova.compute.manager [req-613bc1fe-6192-416f-bbb8-01829f763592 req-86e10114-d0ae-48fe-8a80-cbea9502f162 service nova] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Received unexpected event network-vif-unplugged-7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a for instance with vm_state resized and task_state resize_reverting.
Nov 28 10:55:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e30565c-9f8e-4a87-8054-6c260dac4f48/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e30565c-9f8e-4a87-8054-6c260dac4f48/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.478s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:55:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] <== connect_volume: return (1482ms) {'type': 'block', 'scsi_wwn': '23739376334323635', 'path': '/dev/sdd'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:55:09 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739376334323635', 'path': '/dev/sdd'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 10:55:09 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 10:55:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DOxfJzyh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:55:09 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:55:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:55:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:55:09 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:55:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:55:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:55:09 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 10:55:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:09 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4cb330-86ad-402b-8d26-cc2960d6722c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 10:55:09 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:55:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:09 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc0b83e-d420-4518-911b-6929f2228491]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb] added
Nov 28 10:55:09 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:55:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.213s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53b8bf7-a1ae-4f26-90b7-847d112998b3]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e30565c-9f8e-4a87-8054-6c260dac4f48/disk --force-share --output=json" returned: 0 in 0.393s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ad3963-73c1-4770-8069-2bdd39ce327c]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DOxfJzyh {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DOxfJzyh" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7986c13-cf65-4741-86dc-89e7e668d4d3]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DOxfJzyh'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0075f6-24b6-4250-8b9a-18138bd91118]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93cadf1-968a-4880-b550-397ab98397de]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:55:10 user nova-compute[74994]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)
Nov 28 10:55:10 user nova-compute[74994]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)
Nov 28 10:55:10 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:55:10 user nova-compute[74994]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)
Nov 28 10:55:10 user nova-compute[74994]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)
Nov 28 10:55:10 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[886130a3-8a9d-4e09-b03f-a1e37eaee1d6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:10 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Instance destroyed successfully.
Nov 28 10:55:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb, portal: 172.16.0.220,3260]
Nov 28 10:55:10 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb, portal: 172.16.0.220,3260] successful.
Nov 28 10:55:10 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG nova.objects.instance [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lazy-loading 'resources' on Instance uuid 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:49:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-502885888',display_name='tempest-ServerActionsTestOtherB-server-502885888',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-502885888',id=7,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAP2WYAYbmEHvo9gpy8E02p/bOJRkvsKNh1AOdzva6YpAs9spAOOEI0cMhVl9gL/EJuJSrtBF2pmysHal8/jsBIX9uFnmSQR89/cpFlQWiHlWT+1v4Gox5jUD1SpkJCj+g==',key_name='tempest-keypair-1209998822',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:53:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9bc007c45c84765bb2739844c7af055',ramdisk_id='',reservation_id='r-w4ylqmii',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-585983328',owner_user_name='tempest-ServerActionsTestOtherB-585983328-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T10:53:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d4253b9511f408a9c62c79cff8fc0d7',uuid=2535b6f2-2a4b-4ce1-bd47-0f97d15700fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "address": "fa:16:3e:5d:59:b1", "network": {"id": "670b5fe0-96f5-4414-9425-31ee24eda138", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1327797043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9bc007c45c84765bb2739844c7af055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcb29ac-ee", "ovs_interfaceid": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Converting VIF {"id": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "address": "fa:16:3e:5d:59:b1", "network": {"id": "670b5fe0-96f5-4414-9425-31ee24eda138", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1327797043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9bc007c45c84765bb2739844c7af055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcb29ac-ee", "ovs_interfaceid": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:59:b1,bridge_name='br-int',has_traffic_filtering=True,id=7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a,network=Network(670b5fe0-96f5-4414-9425-31ee24eda138),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bcb29ac-ee') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG os_vif [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:59:b1,bridge_name='br-int',has_traffic_filtering=True,id=7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a,network=Network(670b5fe0-96f5-4414-9425-31ee24eda138),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bcb29ac-ee') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7bcb29ac-ee, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[707f494b-2442-4178-b7c0-0ca5d2cdbe50]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d43ba8ba-1313-4244-9264-7cb7edc1be16) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:55:10 user nova-compute[74994]: INFO os_vif [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:59:b1,bridge_name='br-int',has_traffic_filtering=True,id=7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a,network=Network(670b5fe0-96f5-4414-9425-31ee24eda138),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bcb29ac-ee')
Nov 28 10:55:10 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QFVecHNB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:55:10 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:55:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f1fd96-0bc3-41c2-a5c2-0116e83944a0]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:55:10 user nova-compute[74994]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)
Nov 28 10:55:10 user nova-compute[74994]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)
Nov 28 10:55:10 user nova-compute[74994]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb (non-flash)
Nov 28 10:55:10 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:55:10 user nova-compute[74994]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)
Nov 28 10:55:10 user nova-compute[74994]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)
Nov 28 10:55:10 user nova-compute[74994]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb (non-flash)
Nov 28 10:55:10 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.530s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] HCTL ('36', '-', '-', 0) found on session 17 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.037s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87fa071-d534-4ce6-a26d-e3e36a52bbba]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Searching for a device in session 17 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DOxfJzyh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/857e3cbc-af52-46f6-9b59-87bae405f009/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/857e3cbc-af52-46f6-9b59-87bae405f009/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/857e3cbc-af52-46f6-9b59-87bae405f009/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.585s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] <== connect_volume: return (1589ms) {'type': 'block', 'scsi_wwn': '23666303637386364', 'path': '/dev/sde'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666303637386364', 'path': '/dev/sde'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.070s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/857e3cbc-af52-46f6-9b59-87bae405f009/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b51d690-8198-4748-807d-1902e75564b9/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5bfd39-b7ed-48cb-9ffd-4e38054f0de0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 10:55:11 user nova-compute[74994]: No targets found.
Nov 28 10:55:11 user nova-compute[74994]: iSNS:
Nov 28 10:55:11 user nova-compute[74994]: No targets found.
Nov 28 10:55:11 user nova-compute[74994]: STATIC:
Nov 28 10:55:11 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77
Nov 28 10:55:11 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:55:11 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:55:11 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de
Nov 28 10:55:11 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:55:11 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:55:11 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb
Nov 28 10:55:11 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:55:11 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:55:11 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de
Nov 28 10:55:11 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:55:11 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:55:11 user nova-compute[74994]: FIRMWARE:
Nov 28 10:55:11 user nova-compute[74994]: No targets found.
Nov 28 10:55:11 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 10:55:11 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 10:55:11 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MJkXDsto', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:55:11 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:55:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[125059de-3331-4db9-bf2a-fcaf638c85e4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b685c9-7498-4789-bb64-61e9729cf673]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:55:11 user nova-compute[74994]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)
Nov 28 10:55:11 user nova-compute[74994]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)
Nov 28 10:55:11 user nova-compute[74994]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb (non-flash)
Nov 28 10:55:11 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:55:11 user nova-compute[74994]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)
Nov 28 10:55:11 user nova-compute[74994]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)
Nov 28 10:55:11 user nova-compute[74994]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb (non-flash)
Nov 28 10:55:11 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9205c7370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77'): ({'sdc'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Removing single pathed devices sdc {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc3b4b3-b0c8-4c74-9c93-2751871ef969]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab47e37-8b06-40ff-b449-04b9b0933f6e]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Flushing IO for device /dev/sdc {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a325196-7c7c-4048-b430-17312bfbc59e]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b51d690-8198-4748-807d-1902e75564b9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b51d690-8198-4748-807d-1902e75564b9/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8b3d75-4873-405a-a16b-d2660030b325]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] SCSI volumes sdc have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad233b7b-6854-4e75-be41-cc9fb5f4ef29]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7bb080-e52f-4334-b8d2-71c57120f89d]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77, portal: 172.16.0.220,3260]
Nov 28 10:55:11 user nova-compute[74994]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77, portal: 172.16.0.220,3260] successful.
Nov 28 10:55:11 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG nova.compute.manager [req-24492ed7-dd7b-42be-9cfe-9fa6ba0600fa req-642e7d67-d87a-42ae-bdea-77b3efa38d73 service nova] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Received event network-vif-plugged-7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-24492ed7-dd7b-42be-9cfe-9fa6ba0600fa req-642e7d67-d87a-42ae-bdea-77b3efa38d73 service nova] Acquiring lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-24492ed7-dd7b-42be-9cfe-9fa6ba0600fa req-642e7d67-d87a-42ae-bdea-77b3efa38d73 service nova] Lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-24492ed7-dd7b-42be-9cfe-9fa6ba0600fa req-642e7d67-d87a-42ae-bdea-77b3efa38d73 service nova] Lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG nova.compute.manager [req-24492ed7-dd7b-42be-9cfe-9fa6ba0600fa req-642e7d67-d87a-42ae-bdea-77b3efa38d73 service nova] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] No waiting events found dispatching network-vif-plugged-7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:55:11 user nova-compute[74994]: WARNING nova.compute.manager [req-24492ed7-dd7b-42be-9cfe-9fa6ba0600fa req-642e7d67-d87a-42ae-bdea-77b3efa38d73 service nova] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Received unexpected event network-vif-plugged-7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a for instance with vm_state resized and task_state resize_reverting.
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d41044-9799-462d-91d7-39c02385e014]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] <== disconnect_volume: return (1424ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.289s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:55:11 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:55:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:55:11 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ed73d7-7c57-4b3e-a03f-f890d761ce09]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 10:55:11 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b51d690-8198-4748-807d-1902e75564b9/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[29632f0e-4cf5-43db-9742-1786de4e2170]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f] added
Nov 28 10:55:11 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a74831-6fde-4da2-9a71-8f78229af447]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2116f836-a9b8-42e4-aa9f-d5b9a055a088]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MJkXDsto {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MJkXDsto" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea55732-3c69-4d63-8d2b-b776d24feffd]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MJkXDsto'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25aa5ec-e5bf-4baa-863b-715105c4263e]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:55:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:12 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d47624-07c0-4842-a182-cdabda1a9c7c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:12 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:55:12 user nova-compute[74994]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)
Nov 28 10:55:12 user nova-compute[74994]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb (non-flash)
Nov 28 10:55:12 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:55:12 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:55:12 user nova-compute[74994]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)
Nov 28 10:55:12 user nova-compute[74994]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb (non-flash)
Nov 28 10:55:12 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:55:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:12 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[76727db9-a757-459b-b247-5ee5dd45ee4b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:12 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f, portal: 172.16.0.220,3260]
Nov 28 10:55:12 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f, portal: 172.16.0.220,3260] successful.
Nov 28 10:55:12 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:55:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:12 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b99536-6881-409d-a011-fa70d1cd3eb4]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:12 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:55:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:12 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f493ea-6048-47ef-ba38-d0e6bb815508]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:12 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:55:12 user nova-compute[74994]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)
Nov 28 10:55:12 user nova-compute[74994]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb (non-flash)
Nov 28 10:55:12 user nova-compute[74994]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f (non-flash)
Nov 28 10:55:12 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:55:12 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:55:12 user nova-compute[74994]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)
Nov 28 10:55:12 user nova-compute[74994]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb (non-flash)
Nov 28 10:55:12 user nova-compute[74994]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f (non-flash)
Nov 28 10:55:12 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:55:12 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:55:12 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 10:55:12 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 10:55:12 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 10:55:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:12 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2737fc6d-7ef4-43b0-94bf-54b3416cf1dc]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:12 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 10:55:12 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MJkXDsto', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 10:55:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:12 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 10:55:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/759fbcfd-ab13-438f-b860-6393a97d1205/disk.rescue --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/759fbcfd-ab13-438f-b860-6393a97d1205/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/759fbcfd-ab13-438f-b860-6393a97d1205/disk.rescue --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/759fbcfd-ab13-438f-b860-6393a97d1205/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.530s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] <== connect_volume: return (1820ms) {'type': 'block', 'scsi_wwn': '26664373133326566', 'path': '/dev/sdc'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664373133326566', 'path': '/dev/sdc'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 10:55:13 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:55:13 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=7202MB free_disk=25.20355987548828GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:54:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-537495686',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-537495686',id=21,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqHrRyRg6I8eTYdqY68nxH49PM4ovXVY9WTRn5Yi13IOjr3kGi2fsLAAdzHm0npqM4El3WRdX3N2yVoZzavfQhY9WIuL5YyK4/Ma9dvX+uAy+stjWneVfr/h/UrvxggqA==',key_name='tempest-keypair-117466054',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f75aabbbe5d644d1a5752a68847017aa',ramdisk_id='',reservation_id='r-2nksu579',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-724507959',owner_user_name='tempest-TaggedBootDevicesTest-724507959-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:54:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70bc9e7d86a3429e8c7bc10b3190f450',uuid=ab5b6240-0510-48fb-bbf5-104696eb52d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18e1fc8f-76a7-400e-bcde-5178f8b061bd", "address": "fa:16:3e:5f:2c:f1", "network": {"id": "c6d0db1d-6898-4ee2-bd5d-cc190c70128f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-510684947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18e1fc8f-76", "ovs_interfaceid": "18e1fc8f-76a7-400e-bcde-5178f8b061bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Converting VIF {"id": "18e1fc8f-76a7-400e-bcde-5178f8b061bd", "address": "fa:16:3e:5f:2c:f1", "network": {"id": "c6d0db1d-6898-4ee2-bd5d-cc190c70128f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-510684947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18e1fc8f-76", "ovs_interfaceid": "18e1fc8f-76a7-400e-bcde-5178f8b061bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:2c:f1,bridge_name='br-int',has_traffic_filtering=True,id=18e1fc8f-76a7-400e-bcde-5178f8b061bd,network=Network(c6d0db1d-6898-4ee2-bd5d-cc190c70128f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18e1fc8f-76') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:54:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-537495686',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-537495686',id=21,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqHrRyRg6I8eTYdqY68nxH49PM4ovXVY9WTRn5Yi13IOjr3kGi2fsLAAdzHm0npqM4El3WRdX3N2yVoZzavfQhY9WIuL5YyK4/Ma9dvX+uAy+stjWneVfr/h/UrvxggqA==',key_name='tempest-keypair-117466054',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f75aabbbe5d644d1a5752a68847017aa',ramdisk_id='',reservation_id='r-2nksu579',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-724507959',owner_user_name='tempest-TaggedBootDevicesTest-724507959-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:54:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70bc9e7d86a3429e8c7bc10b3190f450',uuid=ab5b6240-0510-48fb-bbf5-104696eb52d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50", "address": "fa:16:3e:cb:7d:77", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cdf27ff-58", "ovs_interfaceid": "9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Converting VIF {"id": "9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50", "address": "fa:16:3e:cb:7d:77", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cdf27ff-58", "ovs_interfaceid": "9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:7d:77,bridge_name='br-int',has_traffic_filtering=True,id=9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50,network=Network(d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9cdf27ff-58') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:54:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-537495686',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-537495686',id=21,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqHrRyRg6I8eTYdqY68nxH49PM4ovXVY9WTRn5Yi13IOjr3kGi2fsLAAdzHm0npqM4El3WRdX3N2yVoZzavfQhY9WIuL5YyK4/Ma9dvX+uAy+stjWneVfr/h/UrvxggqA==',key_name='tempest-keypair-117466054',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f75aabbbe5d644d1a5752a68847017aa',ramdisk_id='',reservation_id='r-2nksu579',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-724507959',owner_user_name='tempest-TaggedBootDevicesTest-724507959-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:54:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70bc9e7d86a3429e8c7bc10b3190f450',uuid=ab5b6240-0510-48fb-bbf5-104696eb52d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d8a5004-44ff-4247-b63e-9cc70b4c91e7", "address": "fa:16:3e:15:89:0f", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8a5004-44", "ovs_interfaceid": "3d8a5004-44ff-4247-b63e-9cc70b4c91e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Converting VIF {"id": "3d8a5004-44ff-4247-b63e-9cc70b4c91e7", "address": "fa:16:3e:15:89:0f", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8a5004-44", "ovs_interfaceid": "3d8a5004-44ff-4247-b63e-9cc70b4c91e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:89:0f,bridge_name='br-int',has_traffic_filtering=True,id=3d8a5004-44ff-4247-b63e-9cc70b4c91e7,network=Network(d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3d8a5004-44') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:54:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-537495686',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-537495686',id=21,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqHrRyRg6I8eTYdqY68nxH49PM4ovXVY9WTRn5Yi13IOjr3kGi2fsLAAdzHm0npqM4El3WRdX3N2yVoZzavfQhY9WIuL5YyK4/Ma9dvX+uAy+stjWneVfr/h/UrvxggqA==',key_name='tempest-keypair-117466054',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f75aabbbe5d644d1a5752a68847017aa',ramdisk_id='',reservation_id='r-2nksu579',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-724507959',owner_user_name='tempest-TaggedBootDevicesTest-724507959-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:54:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70bc9e7d86a3429e8c7bc10b3190f450',uuid=ab5b6240-0510-48fb-bbf5-104696eb52d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df9a6a76-006b-4adc-9e84-ee61d037da31", "address": "fa:16:3e:78:52:33", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf9a6a76-00", "ovs_interfaceid": "df9a6a76-006b-4adc-9e84-ee61d037da31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Converting VIF {"id": "df9a6a76-006b-4adc-9e84-ee61d037da31", "address": "fa:16:3e:78:52:33", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf9a6a76-00", "ovs_interfaceid": "df9a6a76-006b-4adc-9e84-ee61d037da31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:52:33,bridge_name='br-int',has_traffic_filtering=True,id=df9a6a76-006b-4adc-9e84-ee61d037da31,network=Network(d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf9a6a76-00') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:54:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-537495686',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-537495686',id=21,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqHrRyRg6I8eTYdqY68nxH49PM4ovXVY9WTRn5Yi13IOjr3kGi2fsLAAdzHm0npqM4El3WRdX3N2yVoZzavfQhY9WIuL5YyK4/Ma9dvX+uAy+stjWneVfr/h/UrvxggqA==',key_name='tempest-keypair-117466054',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f75aabbbe5d644d1a5752a68847017aa',ramdisk_id='',reservation_id='r-2nksu579',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-724507959',owner_user_name='tempest-TaggedBootDevicesTest-724507959-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:54:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70bc9e7d86a3429e8c7bc10b3190f450',uuid=ab5b6240-0510-48fb-bbf5-104696eb52d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c67dc60-232f-45b1-b637-48db3477ce20", "address": "fa:16:3e:89:ae:7a", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c67dc60-23", "ovs_interfaceid": "0c67dc60-232f-45b1-b637-48db3477ce20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Converting VIF {"id": "0c67dc60-232f-45b1-b637-48db3477ce20", "address": "fa:16:3e:89:ae:7a", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c67dc60-23", "ovs_interfaceid": "0c67dc60-232f-45b1-b637-48db3477ce20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:ae:7a,bridge_name='br-int',has_traffic_filtering=True,id=0c67dc60-232f-45b1-b637-48db3477ce20,network=Network(d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c67dc60-23') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:54:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-537495686',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-537495686',id=21,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqHrRyRg6I8eTYdqY68nxH49PM4ovXVY9WTRn5Yi13IOjr3kGi2fsLAAdzHm0npqM4El3WRdX3N2yVoZzavfQhY9WIuL5YyK4/Ma9dvX+uAy+stjWneVfr/h/UrvxggqA==',key_name='tempest-keypair-117466054',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f75aabbbe5d644d1a5752a68847017aa',ramdisk_id='',reservation_id='r-2nksu579',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-724507959',owner_user_name='tempest-TaggedBootDevicesTest-724507959-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:54:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70bc9e7d86a3429e8c7bc10b3190f450',uuid=ab5b6240-0510-48fb-bbf5-104696eb52d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64313c64-2811-46b0-8953-8b80db3604a2", "address": "fa:16:3e:95:6b:d7", "network": {"id": "12f2a6c7-ea1a-4a67-9b24-50b67341a827", "bridge": "br-int", "label": "tempest-device-tagging-net2-1808297123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64313c64-28", "ovs_interfaceid": "64313c64-2811-46b0-8953-8b80db3604a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Converting VIF {"id": "64313c64-2811-46b0-8953-8b80db3604a2", "address": "fa:16:3e:95:6b:d7", "network": {"id": "12f2a6c7-ea1a-4a67-9b24-50b67341a827", "bridge": "br-int", "label": "tempest-device-tagging-net2-1808297123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64313c64-28", "ovs_interfaceid": "64313c64-2811-46b0-8953-8b80db3604a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:6b:d7,bridge_name='br-int',has_traffic_filtering=True,id=64313c64-2811-46b0-8953-8b80db3604a2,network=Network(12f2a6c7-ea1a-4a67-9b24-50b67341a827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64313c64-28') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:54:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-537495686',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-537495686',id=21,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqHrRyRg6I8eTYdqY68nxH49PM4ovXVY9WTRn5Yi13IOjr3kGi2fsLAAdzHm0npqM4El3WRdX3N2yVoZzavfQhY9WIuL5YyK4/Ma9dvX+uAy+stjWneVfr/h/UrvxggqA==',key_name='tempest-keypair-117466054',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f75aabbbe5d644d1a5752a68847017aa',ramdisk_id='',reservation_id='r-2nksu579',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-724507959',owner_user_name='tempest-TaggedBootDevicesTest-724507959-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:54:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70bc9e7d86a3429e8c7bc10b3190f450',uuid=ab5b6240-0510-48fb-bbf5-104696eb52d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f27415ef-3b18-4406-8cc2-f5bd07325d95", "address": "fa:16:3e:25:6c:cc", "network": {"id": "12f2a6c7-ea1a-4a67-9b24-50b67341a827", "bridge": "br-int", "label": "tempest-device-tagging-net2-1808297123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf27415ef-3b", "ovs_interfaceid": "f27415ef-3b18-4406-8cc2-f5bd07325d95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Converting VIF {"id": "f27415ef-3b18-4406-8cc2-f5bd07325d95", "address": "fa:16:3e:25:6c:cc", "network": {"id": "12f2a6c7-ea1a-4a67-9b24-50b67341a827", "bridge": "br-int", "label": "tempest-device-tagging-net2-1808297123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf27415ef-3b", "ovs_interfaceid": "f27415ef-3b18-4406-8cc2-f5bd07325d95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:6c:cc,bridge_name='br-int',has_traffic_filtering=True,id=f27415ef-3b18-4406-8cc2-f5bd07325d95,network=Network(12f2a6c7-ea1a-4a67-9b24-50b67341a827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf27415ef-3b') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.objects.instance [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Lazy-loading 'pci_devices' on Instance uuid ab5b6240-0510-48fb-bbf5-104696eb52d7 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] End _get_guest_xml xml=<domain type="kvm">
Nov 28 10:55:13 user nova-compute[74994]:   <uuid>ab5b6240-0510-48fb-bbf5-104696eb52d7</uuid>
Nov 28 10:55:13 user nova-compute[74994]:   <name>instance-00000015</name>
Nov 28 10:55:13 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 10:55:13 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 10:55:13 user nova-compute[74994]:   <metadata>
Nov 28 10:55:13 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 10:55:13 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 10:55:13 user nova-compute[74994]:       <nova:name>tempest-device-tagging-server-537495686</nova:name>
Nov 28 10:55:13 user nova-compute[74994]:       <nova:creationTime>2023-11-28 10:55:08</nova:creationTime>
Nov 28 10:55:13 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 10:55:13 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 10:55:13 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 10:55:13 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 10:55:13 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 10:55:13 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 10:55:13 user nova-compute[74994]:       </nova:flavor>
Nov 28 10:55:13 user nova-compute[74994]:       <nova:owner>
Nov 28 10:55:13 user nova-compute[74994]:         <nova:user uuid="70bc9e7d86a3429e8c7bc10b3190f450">tempest-TaggedBootDevicesTest-724507959-project-member</nova:user>
Nov 28 10:55:13 user nova-compute[74994]:         <nova:project uuid="f75aabbbe5d644d1a5752a68847017aa">tempest-TaggedBootDevicesTest-724507959</nova:project>
Nov 28 10:55:13 user nova-compute[74994]:       </nova:owner>
Nov 28 10:55:13 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 10:55:13 user nova-compute[74994]:       <nova:ports>
Nov 28 10:55:13 user nova-compute[74994]:         <nova:port uuid="18e1fc8f-76a7-400e-bcde-5178f8b061bd">
Nov 28 10:55:13 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 10:55:13 user nova-compute[74994]:         </nova:port>
Nov 28 10:55:13 user nova-compute[74994]:         <nova:port uuid="9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50">
Nov 28 10:55:13 user nova-compute[74994]:           <nova:ip type="fixed" address="10.1.1.120" ipVersion="4"/>
Nov 28 10:55:13 user nova-compute[74994]:         </nova:port>
Nov 28 10:55:13 user nova-compute[74994]:         <nova:port uuid="3d8a5004-44ff-4247-b63e-9cc70b4c91e7">
Nov 28 10:55:13 user nova-compute[74994]:           <nova:ip type="fixed" address="10.1.1.162" ipVersion="4"/>
Nov 28 10:55:13 user nova-compute[74994]:         </nova:port>
Nov 28 10:55:13 user nova-compute[74994]:         <nova:port uuid="df9a6a76-006b-4adc-9e84-ee61d037da31">
Nov 28 10:55:13 user nova-compute[74994]:           <nova:ip type="fixed" address="10.1.1.16" ipVersion="4"/>
Nov 28 10:55:13 user nova-compute[74994]:         </nova:port>
Nov 28 10:55:13 user nova-compute[74994]:         <nova:port uuid="0c67dc60-232f-45b1-b637-48db3477ce20">
Nov 28 10:55:13 user nova-compute[74994]:           <nova:ip type="fixed" address="10.1.1.240" ipVersion="4"/>
Nov 28 10:55:13 user nova-compute[74994]:         </nova:port>
Nov 28 10:55:13 user nova-compute[74994]:         <nova:port uuid="64313c64-2811-46b0-8953-8b80db3604a2">
Nov 28 10:55:13 user nova-compute[74994]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 28 10:55:13 user nova-compute[74994]:         </nova:port>
Nov 28 10:55:13 user nova-compute[74994]:         <nova:port uuid="f27415ef-3b18-4406-8cc2-f5bd07325d95">
Nov 28 10:55:13 user nova-compute[74994]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 28 10:55:13 user nova-compute[74994]:         </nova:port>
Nov 28 10:55:13 user nova-compute[74994]:       </nova:ports>
Nov 28 10:55:13 user nova-compute[74994]:     </nova:instance>
Nov 28 10:55:13 user nova-compute[74994]:   </metadata>
Nov 28 10:55:13 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 10:55:13 user nova-compute[74994]:     <system>
Nov 28 10:55:13 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 10:55:13 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 10:55:13 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 10:55:13 user nova-compute[74994]:       <entry name="serial">ab5b6240-0510-48fb-bbf5-104696eb52d7</entry>
Nov 28 10:55:13 user nova-compute[74994]:       <entry name="uuid">ab5b6240-0510-48fb-bbf5-104696eb52d7</entry>
Nov 28 10:55:13 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 10:55:13 user nova-compute[74994]:     </system>
Nov 28 10:55:13 user nova-compute[74994]:   </sysinfo>
Nov 28 10:55:13 user nova-compute[74994]:   <os>
Nov 28 10:55:13 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 10:55:13 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 10:55:13 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 10:55:13 user nova-compute[74994]:   </os>
Nov 28 10:55:13 user nova-compute[74994]:   <features>
Nov 28 10:55:13 user nova-compute[74994]:     <acpi/>
Nov 28 10:55:13 user nova-compute[74994]:     <apic/>
Nov 28 10:55:13 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 10:55:13 user nova-compute[74994]:   </features>
Nov 28 10:55:13 user nova-compute[74994]:   <clock offset="utc">
Nov 28 10:55:13 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 10:55:13 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 10:55:13 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 10:55:13 user nova-compute[74994]:   </clock>
Nov 28 10:55:13 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 10:55:13 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 10:55:13 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 10:55:13 user nova-compute[74994]:   </cpu>
Nov 28 10:55:13 user nova-compute[74994]:   <devices>
Nov 28 10:55:13 user nova-compute[74994]:     <disk type="file" device="cdrom">
Nov 28 10:55:13 user nova-compute[74994]:       <driver name="qemu" type="raw" cache="none"/>
Nov 28 10:55:13 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/ab5b6240-0510-48fb-bbf5-104696eb52d7/disk.config"/>
Nov 28 10:55:13 user nova-compute[74994]:       <target dev="hda" bus="ide"/>
Nov 28 10:55:13 user nova-compute[74994]:     </disk>
Nov 28 10:55:13 user nova-compute[74994]:     <disk type="block" device="disk">
Nov 28 10:55:13 user nova-compute[74994]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 10:55:13 user nova-compute[74994]:       <source dev="/dev/sdd"/>
Nov 28 10:55:13 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 10:55:13 user nova-compute[74994]:       <serial>350ac8ea-49b5-4ae4-8301-7533add977de</serial>
Nov 28 10:55:13 user nova-compute[74994]:     </disk>
Nov 28 10:55:13 user nova-compute[74994]:     <disk type="block" device="disk">
Nov 28 10:55:13 user nova-compute[74994]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 10:55:13 user nova-compute[74994]:       <source dev="/dev/sde"/>
Nov 28 10:55:13 user nova-compute[74994]:       <target dev="vdb" bus="virtio"/>
Nov 28 10:55:13 user nova-compute[74994]:       <serial>0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb</serial>
Nov 28 10:55:13 user nova-compute[74994]:     </disk>
Nov 28 10:55:13 user nova-compute[74994]:     <disk type="block" device="disk">
Nov 28 10:55:13 user nova-compute[74994]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 10:55:13 user nova-compute[74994]:       <source dev="/dev/sdc"/>
Nov 28 10:55:13 user nova-compute[74994]:       <target dev="vdc" bus="virtio"/>
Nov 28 10:55:13 user nova-compute[74994]:       <serial>d56b4123-7ab2-47c2-8f25-d4653a389f3f</serial>
Nov 28 10:55:13 user nova-compute[74994]:     </disk>
Nov 28 10:55:13 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 10:55:13 user nova-compute[74994]:       <mac address="fa:16:3e:5f:2c:f1"/>
Nov 28 10:55:13 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:55:13 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 10:55:13 user nova-compute[74994]:       <target dev="tap18e1fc8f-76"/>
Nov 28 10:55:13 user nova-compute[74994]:     </interface>
Nov 28 10:55:13 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 10:55:13 user nova-compute[74994]:       <mac address="fa:16:3e:cb:7d:77"/>
Nov 28 10:55:13 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:55:13 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 10:55:13 user nova-compute[74994]:       <target dev="tap9cdf27ff-58"/>
Nov 28 10:55:13 user nova-compute[74994]:     </interface>
Nov 28 10:55:13 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 10:55:13 user nova-compute[74994]:       <mac address="fa:16:3e:15:89:0f"/>
Nov 28 10:55:13 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:55:13 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 10:55:13 user nova-compute[74994]:       <target dev="tap3d8a5004-44"/>
Nov 28 10:55:13 user nova-compute[74994]:     </interface>
Nov 28 10:55:13 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 10:55:13 user nova-compute[74994]:       <mac address="fa:16:3e:78:52:33"/>
Nov 28 10:55:13 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:55:13 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 10:55:13 user nova-compute[74994]:       <target dev="tapdf9a6a76-00"/>
Nov 28 10:55:13 user nova-compute[74994]:     </interface>
Nov 28 10:55:13 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 10:55:13 user nova-compute[74994]:       <mac address="fa:16:3e:89:ae:7a"/>
Nov 28 10:55:13 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:55:13 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 10:55:13 user nova-compute[74994]:       <target dev="tap0c67dc60-23"/>
Nov 28 10:55:13 user nova-compute[74994]:     </interface>
Nov 28 10:55:13 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 10:55:13 user nova-compute[74994]:       <mac address="fa:16:3e:95:6b:d7"/>
Nov 28 10:55:13 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:55:13 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 10:55:13 user nova-compute[74994]:       <target dev="tap64313c64-28"/>
Nov 28 10:55:13 user nova-compute[74994]:     </interface>
Nov 28 10:55:13 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 10:55:13 user nova-compute[74994]:       <mac address="fa:16:3e:25:6c:cc"/>
Nov 28 10:55:13 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:55:13 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 10:55:13 user nova-compute[74994]:       <target dev="tapf27415ef-3b"/>
Nov 28 10:55:13 user nova-compute[74994]:     </interface>
Nov 28 10:55:13 user nova-compute[74994]:     <serial type="pty">
Nov 28 10:55:13 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/ab5b6240-0510-48fb-bbf5-104696eb52d7/console.log" append="off"/>
Nov 28 10:55:13 user nova-compute[74994]:     </serial>
Nov 28 10:55:13 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 10:55:13 user nova-compute[74994]:     <video>
Nov 28 10:55:13 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:55:13 user nova-compute[74994]:     </video>
Nov 28 10:55:13 user nova-compute[74994]:     <rng model="virtio">
Nov 28 10:55:13 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 10:55:13 user nova-compute[74994]:     </rng>
Nov 28 10:55:13 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 10:55:13 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 10:55:13 user nova-compute[74994]:       <stats period="10"/>
Nov 28 10:55:13 user nova-compute[74994]:     </memballoon>
Nov 28 10:55:13 user nova-compute[74994]:   </devices>
Nov 28 10:55:13 user nova-compute[74994]: </domain>
Nov 28 10:55:13 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:54:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-537495686',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-537495686',id=21,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqHrRyRg6I8eTYdqY68nxH49PM4ovXVY9WTRn5Yi13IOjr3kGi2fsLAAdzHm0npqM4El3WRdX3N2yVoZzavfQhY9WIuL5YyK4/Ma9dvX+uAy+stjWneVfr/h/UrvxggqA==',key_name='tempest-keypair-117466054',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f75aabbbe5d644d1a5752a68847017aa',ramdisk_id='',reservation_id='r-2nksu579',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-724507959',owner_user_name='tempest-TaggedBootDevicesTest-724507959-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:54:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70bc9e7d86a3429e8c7bc10b3190f450',uuid=ab5b6240-0510-48fb-bbf5-104696eb52d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18e1fc8f-76a7-400e-bcde-5178f8b061bd", "address": "fa:16:3e:5f:2c:f1", "network": {"id": "c6d0db1d-6898-4ee2-bd5d-cc190c70128f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-510684947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18e1fc8f-76", "ovs_interfaceid": "18e1fc8f-76a7-400e-bcde-5178f8b061bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Converting VIF {"id": "18e1fc8f-76a7-400e-bcde-5178f8b061bd", "address": "fa:16:3e:5f:2c:f1", "network": {"id": "c6d0db1d-6898-4ee2-bd5d-cc190c70128f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-510684947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18e1fc8f-76", "ovs_interfaceid": "18e1fc8f-76a7-400e-bcde-5178f8b061bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:2c:f1,bridge_name='br-int',has_traffic_filtering=True,id=18e1fc8f-76a7-400e-bcde-5178f8b061bd,network=Network(c6d0db1d-6898-4ee2-bd5d-cc190c70128f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18e1fc8f-76') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG os_vif [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:2c:f1,bridge_name='br-int',has_traffic_filtering=True,id=18e1fc8f-76a7-400e-bcde-5178f8b061bd,network=Network(c6d0db1d-6898-4ee2-bd5d-cc190c70128f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18e1fc8f-76') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '87d8d303-f809-5955-87d5-db013a67c9b6', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18e1fc8f-76, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap18e1fc8f-76, col_values=(('qos', UUID('c0e38afd-9287-44e9-beff-d9823a7414b3')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap18e1fc8f-76, col_values=(('external_ids', {'iface-id': '18e1fc8f-76a7-400e-bcde-5178f8b061bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:2c:f1', 'vm-uuid': 'ab5b6240-0510-48fb-bbf5-104696eb52d7'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:13 user nova-compute[74994]: INFO os_vif [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:2c:f1,bridge_name='br-int',has_traffic_filtering=True,id=18e1fc8f-76a7-400e-bcde-5178f8b061bd,network=Network(c6d0db1d-6898-4ee2-bd5d-cc190c70128f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18e1fc8f-76')
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:54:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-537495686',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-537495686',id=21,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqHrRyRg6I8eTYdqY68nxH49PM4ovXVY9WTRn5Yi13IOjr3kGi2fsLAAdzHm0npqM4El3WRdX3N2yVoZzavfQhY9WIuL5YyK4/Ma9dvX+uAy+stjWneVfr/h/UrvxggqA==',key_name='tempest-keypair-117466054',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f75aabbbe5d644d1a5752a68847017aa',ramdisk_id='',reservation_id='r-2nksu579',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-724507959',owner_user_name='tempest-TaggedBootDevicesTest-724507959-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:54:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70bc9e7d86a3429e8c7bc10b3190f450',uuid=ab5b6240-0510-48fb-bbf5-104696eb52d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50", "address": "fa:16:3e:cb:7d:77", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cdf27ff-58", "ovs_interfaceid": "9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Converting VIF {"id": "9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50", "address": "fa:16:3e:cb:7d:77", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cdf27ff-58", "ovs_interfaceid": "9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:7d:77,bridge_name='br-int',has_traffic_filtering=True,id=9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50,network=Network(d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9cdf27ff-58') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG os_vif [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:7d:77,bridge_name='br-int',has_traffic_filtering=True,id=9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50,network=Network(d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9cdf27ff-58') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Applying migration context for instance 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb as it has an incoming, in-progress migration fc984819-af57-4b88-9e1c-f21db2a5d0cf. Migration status is reverting {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 28 10:55:13 user nova-compute[74994]: INFO nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Updating resource usage from migration fc984819-af57-4b88-9e1c-f21db2a5d0cf
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '256a989b-85d5-532f-89ed-cd59c22a7da9', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9cdf27ff-58, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9cdf27ff-58, col_values=(('qos', UUID('c4d057fe-89af-4bd6-9820-d2222a3e7426')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9cdf27ff-58, col_values=(('external_ids', {'iface-id': '9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:7d:77', 'vm-uuid': 'ab5b6240-0510-48fb-bbf5-104696eb52d7'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:13 user nova-compute[74994]: INFO os_vif [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:7d:77,bridge_name='br-int',has_traffic_filtering=True,id=9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50,network=Network(d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9cdf27ff-58')
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:54:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-537495686',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-537495686',id=21,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqHrRyRg6I8eTYdqY68nxH49PM4ovXVY9WTRn5Yi13IOjr3kGi2fsLAAdzHm0npqM4El3WRdX3N2yVoZzavfQhY9WIuL5YyK4/Ma9dvX+uAy+stjWneVfr/h/UrvxggqA==',key_name='tempest-keypair-117466054',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f75aabbbe5d644d1a5752a68847017aa',ramdisk_id='',reservation_id='r-2nksu579',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-724507959',owner_user_name='tempest-TaggedBootDevicesTest-724507959-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:54:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70bc9e7d86a3429e8c7bc10b3190f450',uuid=ab5b6240-0510-48fb-bbf5-104696eb52d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d8a5004-44ff-4247-b63e-9cc70b4c91e7", "address": "fa:16:3e:15:89:0f", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8a5004-44", "ovs_interfaceid": "3d8a5004-44ff-4247-b63e-9cc70b4c91e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Converting VIF {"id": "3d8a5004-44ff-4247-b63e-9cc70b4c91e7", "address": "fa:16:3e:15:89:0f", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8a5004-44", "ovs_interfaceid": "3d8a5004-44ff-4247-b63e-9cc70b4c91e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:89:0f,bridge_name='br-int',has_traffic_filtering=True,id=3d8a5004-44ff-4247-b63e-9cc70b4c91e7,network=Network(d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3d8a5004-44') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG os_vif [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:89:0f,bridge_name='br-int',has_traffic_filtering=True,id=3d8a5004-44ff-4247-b63e-9cc70b4c91e7,network=Network(d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3d8a5004-44') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9a5ab227-62ce-5607-b560-3fdf451a0e9b', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d8a5004-44, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3d8a5004-44, col_values=(('qos', UUID('26396ccb-d8d4-489c-a621-0db51167db33')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3d8a5004-44, col_values=(('external_ids', {'iface-id': '3d8a5004-44ff-4247-b63e-9cc70b4c91e7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:89:0f', 'vm-uuid': 'ab5b6240-0510-48fb-bbf5-104696eb52d7'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:13 user nova-compute[74994]: INFO os_vif [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:89:0f,bridge_name='br-int',has_traffic_filtering=True,id=3d8a5004-44ff-4247-b63e-9cc70b4c91e7,network=Network(d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3d8a5004-44')
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:54:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-537495686',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-537495686',id=21,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqHrRyRg6I8eTYdqY68nxH49PM4ovXVY9WTRn5Yi13IOjr3kGi2fsLAAdzHm0npqM4El3WRdX3N2yVoZzavfQhY9WIuL5YyK4/Ma9dvX+uAy+stjWneVfr/h/UrvxggqA==',key_name='tempest-keypair-117466054',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f75aabbbe5d644d1a5752a68847017aa',ramdisk_id='',reservation_id='r-2nksu579',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-724507959',owner_user_name='tempest-TaggedBootDevicesTest-724507959-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:54:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70bc9e7d86a3429e8c7bc10b3190f450',uuid=ab5b6240-0510-48fb-bbf5-104696eb52d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df9a6a76-006b-4adc-9e84-ee61d037da31", "address": "fa:16:3e:78:52:33", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf9a6a76-00", "ovs_interfaceid": "df9a6a76-006b-4adc-9e84-ee61d037da31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Converting VIF {"id": "df9a6a76-006b-4adc-9e84-ee61d037da31", "address": "fa:16:3e:78:52:33", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf9a6a76-00", "ovs_interfaceid": "df9a6a76-006b-4adc-9e84-ee61d037da31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:52:33,bridge_name='br-int',has_traffic_filtering=True,id=df9a6a76-006b-4adc-9e84-ee61d037da31,network=Network(d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf9a6a76-00') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG os_vif [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:52:33,bridge_name='br-int',has_traffic_filtering=True,id=df9a6a76-006b-4adc-9e84-ee61d037da31,network=Network(d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf9a6a76-00') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cac09b1b-eb33-5298-aaa1-162bf5c1dd18', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf9a6a76-00, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdf9a6a76-00, col_values=(('qos', UUID('b9f300c6-9bff-4ce9-9ef9-0cd4fd1a4cc6')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdf9a6a76-00, col_values=(('external_ids', {'iface-id': 'df9a6a76-006b-4adc-9e84-ee61d037da31', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:52:33', 'vm-uuid': 'ab5b6240-0510-48fb-bbf5-104696eb52d7'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:13 user nova-compute[74994]: INFO os_vif [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:52:33,bridge_name='br-int',has_traffic_filtering=True,id=df9a6a76-006b-4adc-9e84-ee61d037da31,network=Network(d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf9a6a76-00')
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:54:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-537495686',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-537495686',id=21,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqHrRyRg6I8eTYdqY68nxH49PM4ovXVY9WTRn5Yi13IOjr3kGi2fsLAAdzHm0npqM4El3WRdX3N2yVoZzavfQhY9WIuL5YyK4/Ma9dvX+uAy+stjWneVfr/h/UrvxggqA==',key_name='tempest-keypair-117466054',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f75aabbbe5d644d1a5752a68847017aa',ramdisk_id='',reservation_id='r-2nksu579',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-724507959',owner_user_name='tempest-TaggedBootDevicesTest-724507959-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:54:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70bc9e7d86a3429e8c7bc10b3190f450',uuid=ab5b6240-0510-48fb-bbf5-104696eb52d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c67dc60-232f-45b1-b637-48db3477ce20", "address": "fa:16:3e:89:ae:7a", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c67dc60-23", "ovs_interfaceid": "0c67dc60-232f-45b1-b637-48db3477ce20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Converting VIF {"id": "0c67dc60-232f-45b1-b637-48db3477ce20", "address": "fa:16:3e:89:ae:7a", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c67dc60-23", "ovs_interfaceid": "0c67dc60-232f-45b1-b637-48db3477ce20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:ae:7a,bridge_name='br-int',has_traffic_filtering=True,id=0c67dc60-232f-45b1-b637-48db3477ce20,network=Network(d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c67dc60-23') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG os_vif [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:ae:7a,bridge_name='br-int',has_traffic_filtering=True,id=0c67dc60-232f-45b1-b637-48db3477ce20,network=Network(d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c67dc60-23') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a3103128-8263-5f6c-8eca-e2d5c1636bb5', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance bf357856-2d97-42e8-928d-71d0378f48c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 279e1c4c-36f9-492f-ab3f-1b587347eadd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 5b51d690-8198-4748-807d-1902e75564b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 2e30565c-9f8e-4a87-8054-6c260dac4f48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 759fbcfd-ab13-438f-b860-6393a97d1205 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Migration fc984819-af57-4b88-9e1c-f21db2a5d0cf is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 20716905-c56a-4729-8c5b-9188502dc477 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 857e3cbc-af52-46f6-9b59-87bae405f009 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 2f4b631a-46c8-4f9b-b5f9-6e2542484658 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance ab5b6240-0510-48fb-bbf5-104696eb52d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c67dc60-23, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0c67dc60-23, col_values=(('qos', UUID('2f383153-997b-4577-9098-4bcf4eb753ee')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0c67dc60-23, col_values=(('external_ids', {'iface-id': '0c67dc60-232f-45b1-b637-48db3477ce20', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:ae:7a', 'vm-uuid': 'ab5b6240-0510-48fb-bbf5-104696eb52d7'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Refreshing inventories for resource provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Updating ProviderTree inventory for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Updating inventory in ProviderTree for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:13 user nova-compute[74994]: INFO os_vif [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:ae:7a,bridge_name='br-int',has_traffic_filtering=True,id=0c67dc60-232f-45b1-b637-48db3477ce20,network=Network(d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c67dc60-23')
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:54:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-537495686',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-537495686',id=21,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqHrRyRg6I8eTYdqY68nxH49PM4ovXVY9WTRn5Yi13IOjr3kGi2fsLAAdzHm0npqM4El3WRdX3N2yVoZzavfQhY9WIuL5YyK4/Ma9dvX+uAy+stjWneVfr/h/UrvxggqA==',key_name='tempest-keypair-117466054',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f75aabbbe5d644d1a5752a68847017aa',ramdisk_id='',reservation_id='r-2nksu579',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-724507959',owner_user_name='tempest-TaggedBootDevicesTest-724507959-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:54:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70bc9e7d86a3429e8c7bc10b3190f450',uuid=ab5b6240-0510-48fb-bbf5-104696eb52d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64313c64-2811-46b0-8953-8b80db3604a2", "address": "fa:16:3e:95:6b:d7", "network": {"id": "12f2a6c7-ea1a-4a67-9b24-50b67341a827", "bridge": "br-int", "label": "tempest-device-tagging-net2-1808297123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64313c64-28", "ovs_interfaceid": "64313c64-2811-46b0-8953-8b80db3604a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Converting VIF {"id": "64313c64-2811-46b0-8953-8b80db3604a2", "address": "fa:16:3e:95:6b:d7", "network": {"id": "12f2a6c7-ea1a-4a67-9b24-50b67341a827", "bridge": "br-int", "label": "tempest-device-tagging-net2-1808297123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64313c64-28", "ovs_interfaceid": "64313c64-2811-46b0-8953-8b80db3604a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:6b:d7,bridge_name='br-int',has_traffic_filtering=True,id=64313c64-2811-46b0-8953-8b80db3604a2,network=Network(12f2a6c7-ea1a-4a67-9b24-50b67341a827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64313c64-28') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG os_vif [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:6b:d7,bridge_name='br-int',has_traffic_filtering=True,id=64313c64-2811-46b0-8953-8b80db3604a2,network=Network(12f2a6c7-ea1a-4a67-9b24-50b67341a827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64313c64-28') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8815a14a-2608-5bba-881c-42e4e41a8416', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Refreshing aggregate associations for resource provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a, aggregates: None {{(pid=74994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64313c64-28, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap64313c64-28, col_values=(('qos', UUID('00b63e3e-35b8-440c-8d88-f3d505b2e1f7')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap64313c64-28, col_values=(('external_ids', {'iface-id': '64313c64-2811-46b0-8953-8b80db3604a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:6b:d7', 'vm-uuid': 'ab5b6240-0510-48fb-bbf5-104696eb52d7'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Refreshing trait associations for resource provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=74994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:13 user nova-compute[74994]: INFO os_vif [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:6b:d7,bridge_name='br-int',has_traffic_filtering=True,id=64313c64-2811-46b0-8953-8b80db3604a2,network=Network(12f2a6c7-ea1a-4a67-9b24-50b67341a827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64313c64-28')
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:54:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-537495686',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-537495686',id=21,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqHrRyRg6I8eTYdqY68nxH49PM4ovXVY9WTRn5Yi13IOjr3kGi2fsLAAdzHm0npqM4El3WRdX3N2yVoZzavfQhY9WIuL5YyK4/Ma9dvX+uAy+stjWneVfr/h/UrvxggqA==',key_name='tempest-keypair-117466054',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f75aabbbe5d644d1a5752a68847017aa',ramdisk_id='',reservation_id='r-2nksu579',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-724507959',owner_user_name='tempest-TaggedBootDevicesTest-724507959-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:54:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70bc9e7d86a3429e8c7bc10b3190f450',uuid=ab5b6240-0510-48fb-bbf5-104696eb52d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f27415ef-3b18-4406-8cc2-f5bd07325d95", "address": "fa:16:3e:25:6c:cc", "network": {"id": "12f2a6c7-ea1a-4a67-9b24-50b67341a827", "bridge": "br-int", "label": "tempest-device-tagging-net2-1808297123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf27415ef-3b", "ovs_interfaceid": "f27415ef-3b18-4406-8cc2-f5bd07325d95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Converting VIF {"id": "f27415ef-3b18-4406-8cc2-f5bd07325d95", "address": "fa:16:3e:25:6c:cc", "network": {"id": "12f2a6c7-ea1a-4a67-9b24-50b67341a827", "bridge": "br-int", "label": "tempest-device-tagging-net2-1808297123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf27415ef-3b", "ovs_interfaceid": "f27415ef-3b18-4406-8cc2-f5bd07325d95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:6c:cc,bridge_name='br-int',has_traffic_filtering=True,id=f27415ef-3b18-4406-8cc2-f5bd07325d95,network=Network(12f2a6c7-ea1a-4a67-9b24-50b67341a827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf27415ef-3b') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG os_vif [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:6c:cc,bridge_name='br-int',has_traffic_filtering=True,id=f27415ef-3b18-4406-8cc2-f5bd07325d95,network=Network(12f2a6c7-ea1a-4a67-9b24-50b67341a827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf27415ef-3b') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3be9c819-1eab-5a39-b671-4141a84c916e', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:55:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf27415ef-3b, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:55:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf27415ef-3b, col_values=(('qos', UUID('3f7386f5-ed63-44d4-b901-a40a1dfa3406')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:55:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf27415ef-3b, col_values=(('external_ids', {'iface-id': 'f27415ef-3b18-4406-8cc2-f5bd07325d95', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:6c:cc', 'vm-uuid': 'ab5b6240-0510-48fb-bbf5-104696eb52d7'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:55:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:55:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:14 user nova-compute[74994]: INFO os_vif [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:6c:cc,bridge_name='br-int',has_traffic_filtering=True,id=f27415ef-3b18-4406-8cc2-f5bd07325d95,network=Network(12f2a6c7-ea1a-4a67-9b24-50b67341a827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf27415ef-3b')
Nov 28 10:55:14 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] No BDM found with device name hda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:55:14 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:55:14 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] No VIF found with MAC fa:16:3e:5f:2c:f1, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:55:14 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] No VIF found with MAC fa:16:3e:89:ae:7a, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:55:14 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Using config drive
Nov 28 10:55:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:14 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:55:14 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:55:14 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 10:55:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.944s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:14 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Creating config drive at /opt/stack/data/nova/instances/ab5b6240-0510-48fb-bbf5-104696eb52d7/disk.config
Nov 28 10:55:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ab5b6240-0510-48fb-bbf5-104696eb52d7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpu_4duycz {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ab5b6240-0510-48fb-bbf5-104696eb52d7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpu_4duycz" returned: 0 in 0.056s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:15 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:55:15 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:55:15 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 10:55:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "refresh_cache-2535b6f2-2a4b-4ce1-bd47-0f97d15700fb" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:55:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquired lock "refresh_cache-2535b6f2-2a4b-4ce1-bd47-0f97d15700fb" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:55:15 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Forcefully refreshing network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 10:55:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:15 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Updating instance_info_cache with network_info: [{"id": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "address": "fa:16:3e:5d:59:b1", "network": {"id": "670b5fe0-96f5-4414-9425-31ee24eda138", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1327797043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9bc007c45c84765bb2739844c7af055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcb29ac-ee", "ovs_interfaceid": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:55:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Releasing lock "refresh_cache-2535b6f2-2a4b-4ce1-bd47-0f97d15700fb" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:55:15 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Updated the network info_cache for instance {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 10:55:15 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:55:15 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:55:15 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:55:15 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:55:16 user nova-compute[74994]: DEBUG nova.compute.manager [req-2af95746-5a5b-41f8-a244-bd84308c5e1e req-eb12a983-9e41-4ed4-8068-f23e1acc8e53 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received event network-vif-plugged-18e1fc8f-76a7-400e-bcde-5178f8b061bd {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:55:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-2af95746-5a5b-41f8-a244-bd84308c5e1e req-eb12a983-9e41-4ed4-8068-f23e1acc8e53 service nova] Acquiring lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-2af95746-5a5b-41f8-a244-bd84308c5e1e req-eb12a983-9e41-4ed4-8068-f23e1acc8e53 service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-2af95746-5a5b-41f8-a244-bd84308c5e1e req-eb12a983-9e41-4ed4-8068-f23e1acc8e53 service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:16 user nova-compute[74994]: DEBUG nova.compute.manager [req-2af95746-5a5b-41f8-a244-bd84308c5e1e req-eb12a983-9e41-4ed4-8068-f23e1acc8e53 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] No waiting events found dispatching network-vif-plugged-18e1fc8f-76a7-400e-bcde-5178f8b061bd {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:55:16 user nova-compute[74994]: WARNING nova.compute.manager [req-2af95746-5a5b-41f8-a244-bd84308c5e1e req-eb12a983-9e41-4ed4-8068-f23e1acc8e53 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received unexpected event network-vif-plugged-18e1fc8f-76a7-400e-bcde-5178f8b061bd for instance with vm_state building and task_state spawning.
Nov 28 10:55:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:16 user nova-compute[74994]: DEBUG nova.compute.manager [req-d531049d-3d78-4b26-84fa-67ea4b143f77 req-bf08e895-38ab-4847-8ba0-737fbda0348f service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received event network-vif-plugged-9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:55:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d531049d-3d78-4b26-84fa-67ea4b143f77 req-bf08e895-38ab-4847-8ba0-737fbda0348f service nova] Acquiring lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d531049d-3d78-4b26-84fa-67ea4b143f77 req-bf08e895-38ab-4847-8ba0-737fbda0348f service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d531049d-3d78-4b26-84fa-67ea4b143f77 req-bf08e895-38ab-4847-8ba0-737fbda0348f service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:16 user nova-compute[74994]: DEBUG nova.compute.manager [req-d531049d-3d78-4b26-84fa-67ea4b143f77 req-bf08e895-38ab-4847-8ba0-737fbda0348f service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] No waiting events found dispatching network-vif-plugged-9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:55:16 user nova-compute[74994]: WARNING nova.compute.manager [req-d531049d-3d78-4b26-84fa-67ea4b143f77 req-bf08e895-38ab-4847-8ba0-737fbda0348f service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received unexpected event network-vif-plugged-9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50 for instance with vm_state building and task_state spawning.
Nov 28 10:55:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG nova.objects.instance [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lazy-loading 'migration_context' on Instance uuid 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG nova.objects.base [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Object Instance<2535b6f2-2a4b-4ce1-bd47-0f97d15700fb> lazy-loaded attributes: resources,migration_context {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'naBvFlqe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:55:17 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:55:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:55:17 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:55:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:55:17 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 10:55:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31 -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b8218d-06c7-43be-a674-c0ec3071adfe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 10:55:17 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31 -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc74d87-43fe-4781-a38a-b21a58a95d9a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31] added
Nov 28 10:55:17 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c15a3a-3aec-4ea4-a78e-71e30365c34d]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9af03d-0644-4d99-94a1-367f134bc0c7]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v naBvFlqe {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v naBvFlqe" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2a869d-a657-4b86-884e-854f578cf073]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'naBvFlqe'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[58301647-7252-4733-86d3-5eacfb865421]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b886547-2e85-46bc-b009-be43bc070f52]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:55:17 user nova-compute[74994]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)
Nov 28 10:55:17 user nova-compute[74994]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb (non-flash)
Nov 28 10:55:17 user nova-compute[74994]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f (non-flash)
Nov 28 10:55:17 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:55:17 user nova-compute[74994]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)
Nov 28 10:55:17 user nova-compute[74994]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb (non-flash)
Nov 28 10:55:17 user nova-compute[74994]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f (non-flash)
Nov 28 10:55:17 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31 -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3a9224-e8df-44cf-bde7-1cb220c1dde7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31, portal: 172.16.0.220,3260]
Nov 28 10:55:17 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31, portal: 172.16.0.220,3260] successful.
Nov 28 10:55:17 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[850f2498-5e24-4fc6-8eb0-6de236e6f064]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ba415d-4909-4e55-b721-1d153c5a63e5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:55:17 user nova-compute[74994]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)
Nov 28 10:55:17 user nova-compute[74994]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb (non-flash)
Nov 28 10:55:17 user nova-compute[74994]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f (non-flash)
Nov 28 10:55:17 user nova-compute[74994]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31 (non-flash)
Nov 28 10:55:17 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:55:17 user nova-compute[74994]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)
Nov 28 10:55:17 user nova-compute[74994]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb (non-flash)
Nov 28 10:55:17 user nova-compute[74994]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f (non-flash)
Nov 28 10:55:17 user nova-compute[74994]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31 (non-flash)
Nov 28 10:55:17 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] HCTL ('37', '-', '-', 0) found on session 19 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.034s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[135d7266-016b-4f90-9e05-37a81b179173]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Searching for a device in session 19 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'naBvFlqe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.627s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:17 user nova-compute[74994]: INFO nova.compute.manager [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Swapping old allocation on dict_keys(['fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a']) held by migration fc984819-af57-4b88-9e1c-f21db2a5d0cf for instance
Nov 28 10:55:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:17 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Overwriting current allocation {'allocations': {'fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 25}}, 'project_id': 'b9bc007c45c84765bb2739844c7af055', 'user_id': '0d4253b9511f408a9c62c79cff8fc0d7', 'consumer_generation': 1} on consumer 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb {{(pid=74994) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG nova.compute.manager [req-8be97386-2694-4906-8181-1c2bd42546f0 req-4c7e3547-3972-4258-b621-31a5ad7c6c7c service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received event network-vif-plugged-18e1fc8f-76a7-400e-bcde-5178f8b061bd {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8be97386-2694-4906-8181-1c2bd42546f0 req-4c7e3547-3972-4258-b621-31a5ad7c6c7c service nova] Acquiring lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8be97386-2694-4906-8181-1c2bd42546f0 req-4c7e3547-3972-4258-b621-31a5ad7c6c7c service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8be97386-2694-4906-8181-1c2bd42546f0 req-4c7e3547-3972-4258-b621-31a5ad7c6c7c service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG nova.compute.manager [req-8be97386-2694-4906-8181-1c2bd42546f0 req-4c7e3547-3972-4258-b621-31a5ad7c6c7c service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] No waiting events found dispatching network-vif-plugged-18e1fc8f-76a7-400e-bcde-5178f8b061bd {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:55:18 user nova-compute[74994]: WARNING nova.compute.manager [req-8be97386-2694-4906-8181-1c2bd42546f0 req-4c7e3547-3972-4258-b621-31a5ad7c6c7c service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received unexpected event network-vif-plugged-18e1fc8f-76a7-400e-bcde-5178f8b061bd for instance with vm_state building and task_state spawning.
Nov 28 10:55:18 user nova-compute[74994]: DEBUG nova.compute.manager [req-8be97386-2694-4906-8181-1c2bd42546f0 req-4c7e3547-3972-4258-b621-31a5ad7c6c7c service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received event network-vif-plugged-3d8a5004-44ff-4247-b63e-9cc70b4c91e7 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8be97386-2694-4906-8181-1c2bd42546f0 req-4c7e3547-3972-4258-b621-31a5ad7c6c7c service nova] Acquiring lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8be97386-2694-4906-8181-1c2bd42546f0 req-4c7e3547-3972-4258-b621-31a5ad7c6c7c service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8be97386-2694-4906-8181-1c2bd42546f0 req-4c7e3547-3972-4258-b621-31a5ad7c6c7c service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG nova.compute.manager [req-8be97386-2694-4906-8181-1c2bd42546f0 req-4c7e3547-3972-4258-b621-31a5ad7c6c7c service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] No waiting events found dispatching network-vif-plugged-3d8a5004-44ff-4247-b63e-9cc70b4c91e7 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:55:18 user nova-compute[74994]: WARNING nova.compute.manager [req-8be97386-2694-4906-8181-1c2bd42546f0 req-4c7e3547-3972-4258-b621-31a5ad7c6c7c service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received unexpected event network-vif-plugged-3d8a5004-44ff-4247-b63e-9cc70b4c91e7 for instance with vm_state building and task_state spawning.
Nov 28 10:55:18 user nova-compute[74994]: DEBUG nova.compute.manager [req-8be97386-2694-4906-8181-1c2bd42546f0 req-4c7e3547-3972-4258-b621-31a5ad7c6c7c service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received event network-vif-plugged-3d8a5004-44ff-4247-b63e-9cc70b4c91e7 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8be97386-2694-4906-8181-1c2bd42546f0 req-4c7e3547-3972-4258-b621-31a5ad7c6c7c service nova] Acquiring lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8be97386-2694-4906-8181-1c2bd42546f0 req-4c7e3547-3972-4258-b621-31a5ad7c6c7c service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8be97386-2694-4906-8181-1c2bd42546f0 req-4c7e3547-3972-4258-b621-31a5ad7c6c7c service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG nova.compute.manager [req-8be97386-2694-4906-8181-1c2bd42546f0 req-4c7e3547-3972-4258-b621-31a5ad7c6c7c service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] No waiting events found dispatching network-vif-plugged-3d8a5004-44ff-4247-b63e-9cc70b4c91e7 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:55:18 user nova-compute[74994]: WARNING nova.compute.manager [req-8be97386-2694-4906-8181-1c2bd42546f0 req-4c7e3547-3972-4258-b621-31a5ad7c6c7c service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received unexpected event network-vif-plugged-3d8a5004-44ff-4247-b63e-9cc70b4c91e7 for instance with vm_state building and task_state spawning.
Nov 28 10:55:18 user nova-compute[74994]: DEBUG nova.compute.manager [req-8be97386-2694-4906-8181-1c2bd42546f0 req-4c7e3547-3972-4258-b621-31a5ad7c6c7c service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received event network-vif-plugged-df9a6a76-006b-4adc-9e84-ee61d037da31 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8be97386-2694-4906-8181-1c2bd42546f0 req-4c7e3547-3972-4258-b621-31a5ad7c6c7c service nova] Acquiring lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8be97386-2694-4906-8181-1c2bd42546f0 req-4c7e3547-3972-4258-b621-31a5ad7c6c7c service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8be97386-2694-4906-8181-1c2bd42546f0 req-4c7e3547-3972-4258-b621-31a5ad7c6c7c service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG nova.compute.manager [req-8be97386-2694-4906-8181-1c2bd42546f0 req-4c7e3547-3972-4258-b621-31a5ad7c6c7c service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] No waiting events found dispatching network-vif-plugged-df9a6a76-006b-4adc-9e84-ee61d037da31 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:55:18 user nova-compute[74994]: WARNING nova.compute.manager [req-8be97386-2694-4906-8181-1c2bd42546f0 req-4c7e3547-3972-4258-b621-31a5ad7c6c7c service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received unexpected event network-vif-plugged-df9a6a76-006b-4adc-9e84-ee61d037da31 for instance with vm_state building and task_state spawning.
Nov 28 10:55:18 user nova-compute[74994]: DEBUG nova.compute.manager [req-8be97386-2694-4906-8181-1c2bd42546f0 req-4c7e3547-3972-4258-b621-31a5ad7c6c7c service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received event network-vif-plugged-df9a6a76-006b-4adc-9e84-ee61d037da31 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8be97386-2694-4906-8181-1c2bd42546f0 req-4c7e3547-3972-4258-b621-31a5ad7c6c7c service nova] Acquiring lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8be97386-2694-4906-8181-1c2bd42546f0 req-4c7e3547-3972-4258-b621-31a5ad7c6c7c service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8be97386-2694-4906-8181-1c2bd42546f0 req-4c7e3547-3972-4258-b621-31a5ad7c6c7c service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG nova.compute.manager [req-8be97386-2694-4906-8181-1c2bd42546f0 req-4c7e3547-3972-4258-b621-31a5ad7c6c7c service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] No waiting events found dispatching network-vif-plugged-df9a6a76-006b-4adc-9e84-ee61d037da31 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:55:18 user nova-compute[74994]: WARNING nova.compute.manager [req-8be97386-2694-4906-8181-1c2bd42546f0 req-4c7e3547-3972-4258-b621-31a5ad7c6c7c service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received unexpected event network-vif-plugged-df9a6a76-006b-4adc-9e84-ee61d037da31 for instance with vm_state building and task_state spawning.
Nov 28 10:55:18 user nova-compute[74994]: DEBUG nova.compute.manager [req-8be97386-2694-4906-8181-1c2bd42546f0 req-4c7e3547-3972-4258-b621-31a5ad7c6c7c service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received event network-vif-plugged-0c67dc60-232f-45b1-b637-48db3477ce20 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8be97386-2694-4906-8181-1c2bd42546f0 req-4c7e3547-3972-4258-b621-31a5ad7c6c7c service nova] Acquiring lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8be97386-2694-4906-8181-1c2bd42546f0 req-4c7e3547-3972-4258-b621-31a5ad7c6c7c service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8be97386-2694-4906-8181-1c2bd42546f0 req-4c7e3547-3972-4258-b621-31a5ad7c6c7c service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG nova.compute.manager [req-8be97386-2694-4906-8181-1c2bd42546f0 req-4c7e3547-3972-4258-b621-31a5ad7c6c7c service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] No waiting events found dispatching network-vif-plugged-0c67dc60-232f-45b1-b637-48db3477ce20 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:55:18 user nova-compute[74994]: WARNING nova.compute.manager [req-8be97386-2694-4906-8181-1c2bd42546f0 req-4c7e3547-3972-4258-b621-31a5ad7c6c7c service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received unexpected event network-vif-plugged-0c67dc60-232f-45b1-b637-48db3477ce20 for instance with vm_state building and task_state spawning.
Nov 28 10:55:18 user nova-compute[74994]: DEBUG nova.compute.manager [req-8be97386-2694-4906-8181-1c2bd42546f0 req-4c7e3547-3972-4258-b621-31a5ad7c6c7c service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received event network-vif-plugged-0c67dc60-232f-45b1-b637-48db3477ce20 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8be97386-2694-4906-8181-1c2bd42546f0 req-4c7e3547-3972-4258-b621-31a5ad7c6c7c service nova] Acquiring lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8be97386-2694-4906-8181-1c2bd42546f0 req-4c7e3547-3972-4258-b621-31a5ad7c6c7c service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8be97386-2694-4906-8181-1c2bd42546f0 req-4c7e3547-3972-4258-b621-31a5ad7c6c7c service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG nova.compute.manager [req-8be97386-2694-4906-8181-1c2bd42546f0 req-4c7e3547-3972-4258-b621-31a5ad7c6c7c service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] No waiting events found dispatching network-vif-plugged-0c67dc60-232f-45b1-b637-48db3477ce20 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:55:18 user nova-compute[74994]: WARNING nova.compute.manager [req-8be97386-2694-4906-8181-1c2bd42546f0 req-4c7e3547-3972-4258-b621-31a5ad7c6c7c service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received unexpected event network-vif-plugged-0c67dc60-232f-45b1-b637-48db3477ce20 for instance with vm_state building and task_state spawning.
Nov 28 10:55:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG nova.compute.manager [req-2562efbc-43d7-4efe-87d2-3aacb10b9d9f req-9490e06f-0f72-4d04-b877-d5958b27cf48 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received event network-vif-plugged-9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-2562efbc-43d7-4efe-87d2-3aacb10b9d9f req-9490e06f-0f72-4d04-b877-d5958b27cf48 service nova] Acquiring lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-2562efbc-43d7-4efe-87d2-3aacb10b9d9f req-9490e06f-0f72-4d04-b877-d5958b27cf48 service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-2562efbc-43d7-4efe-87d2-3aacb10b9d9f req-9490e06f-0f72-4d04-b877-d5958b27cf48 service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG nova.compute.manager [req-2562efbc-43d7-4efe-87d2-3aacb10b9d9f req-9490e06f-0f72-4d04-b877-d5958b27cf48 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] No waiting events found dispatching network-vif-plugged-9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:55:18 user nova-compute[74994]: WARNING nova.compute.manager [req-2562efbc-43d7-4efe-87d2-3aacb10b9d9f req-9490e06f-0f72-4d04-b877-d5958b27cf48 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received unexpected event network-vif-plugged-9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50 for instance with vm_state building and task_state spawning.
Nov 28 10:55:18 user nova-compute[74994]: DEBUG nova.compute.manager [req-2562efbc-43d7-4efe-87d2-3aacb10b9d9f req-9490e06f-0f72-4d04-b877-d5958b27cf48 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received event network-vif-plugged-f27415ef-3b18-4406-8cc2-f5bd07325d95 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-2562efbc-43d7-4efe-87d2-3aacb10b9d9f req-9490e06f-0f72-4d04-b877-d5958b27cf48 service nova] Acquiring lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-2562efbc-43d7-4efe-87d2-3aacb10b9d9f req-9490e06f-0f72-4d04-b877-d5958b27cf48 service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-2562efbc-43d7-4efe-87d2-3aacb10b9d9f req-9490e06f-0f72-4d04-b877-d5958b27cf48 service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG nova.compute.manager [req-2562efbc-43d7-4efe-87d2-3aacb10b9d9f req-9490e06f-0f72-4d04-b877-d5958b27cf48 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] No waiting events found dispatching network-vif-plugged-f27415ef-3b18-4406-8cc2-f5bd07325d95 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:55:18 user nova-compute[74994]: WARNING nova.compute.manager [req-2562efbc-43d7-4efe-87d2-3aacb10b9d9f req-9490e06f-0f72-4d04-b877-d5958b27cf48 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received unexpected event network-vif-plugged-f27415ef-3b18-4406-8cc2-f5bd07325d95 for instance with vm_state building and task_state spawning.
Nov 28 10:55:18 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '23366323865323966', 'path': '/dev/sdf'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366323865323966', 'path': '/dev/sdf'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG nova.objects.instance [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Lazy-loading 'flavor' on Instance uuid b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 10:55:18 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 10:55:18 user nova-compute[74994]:   <source dev="/dev/sdf"/>
Nov 28 10:55:18 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 10:55:18 user nova-compute[74994]:   <serial>52404138-8512-46a3-a2ab-483912367e31</serial>
Nov 28 10:55:18 user nova-compute[74994]: </disk>
Nov 28 10:55:18 user nova-compute[74994]:  {{(pid=74994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Acquiring lock "refresh_cache-2535b6f2-2a4b-4ce1-bd47-0f97d15700fb" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Acquired lock "refresh_cache-2535b6f2-2a4b-4ce1-bd47-0f97d15700fb" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG nova.network.neutron [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:55:18 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] No VIF found with MAC fa:16:3e:ab:1e:fc, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:55:19 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:19 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:19 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:19 user nova-compute[74994]: DEBUG nova.network.neutron [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Updating instance_info_cache with network_info: [{"id": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "address": "fa:16:3e:5d:59:b1", "network": {"id": "670b5fe0-96f5-4414-9425-31ee24eda138", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1327797043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9bc007c45c84765bb2739844c7af055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcb29ac-ee", "ovs_interfaceid": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:55:19 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Releasing lock "refresh_cache-2535b6f2-2a4b-4ce1-bd47-0f97d15700fb" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:55:19 user nova-compute[74994]: DEBUG os_brick.utils [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:55:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:19 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[22dccb7f-8424-469b-a1e1-aa515cf694ad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:19 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9f0e12e0-97a7-4fd5-ba8a-53b071c66bbd tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Lock "b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.653s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:19 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0369a3-8502-4376-8226-740c5e2e6c0a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:19 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fee4f9c-781b-442e-996e-8ab09f8a9448]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:19 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de9231f-5fe8-4781-8461-8d8ef5ff2e69]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:55:19 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 10:55:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:55:19 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 10:55:19 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2caa3e7d-bfce-4e0d-ac43-37c007c47170]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:19 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 10:55:19 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 10:55:19 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 10:55:19 user nova-compute[74994]: DEBUG os_brick.utils [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:55:20 user nova-compute[74994]: DEBUG nova.compute.manager [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 10:55:20 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 10:55:20 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Instance spawned successfully.
Nov 28 10:55:20 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 10:55:20 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:55:20 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:55:20 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:55:20 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:55:20 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:55:20 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:55:20 user nova-compute[74994]: INFO nova.compute.manager [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Took 11.92 seconds to spawn the instance on the hypervisor.
Nov 28 10:55:20 user nova-compute[74994]: DEBUG nova.compute.manager [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 10:55:20 user nova-compute[74994]: DEBUG nova.compute.manager [req-d74d78bb-738a-48fc-9656-4c4e7f15890d req-47a6a59e-156c-4bb8-a6c2-35244821e882 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received event network-vif-plugged-64313c64-2811-46b0-8953-8b80db3604a2 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:55:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d74d78bb-738a-48fc-9656-4c4e7f15890d req-47a6a59e-156c-4bb8-a6c2-35244821e882 service nova] Acquiring lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d74d78bb-738a-48fc-9656-4c4e7f15890d req-47a6a59e-156c-4bb8-a6c2-35244821e882 service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d74d78bb-738a-48fc-9656-4c4e7f15890d req-47a6a59e-156c-4bb8-a6c2-35244821e882 service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:20 user nova-compute[74994]: DEBUG nova.compute.manager [req-d74d78bb-738a-48fc-9656-4c4e7f15890d req-47a6a59e-156c-4bb8-a6c2-35244821e882 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] No waiting events found dispatching network-vif-plugged-64313c64-2811-46b0-8953-8b80db3604a2 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:55:20 user nova-compute[74994]: WARNING nova.compute.manager [req-d74d78bb-738a-48fc-9656-4c4e7f15890d req-47a6a59e-156c-4bb8-a6c2-35244821e882 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received unexpected event network-vif-plugged-64313c64-2811-46b0-8953-8b80db3604a2 for instance with vm_state building and task_state spawning.
Nov 28 10:55:20 user nova-compute[74994]: DEBUG nova.compute.manager [req-d74d78bb-738a-48fc-9656-4c4e7f15890d req-47a6a59e-156c-4bb8-a6c2-35244821e882 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received event network-vif-plugged-64313c64-2811-46b0-8953-8b80db3604a2 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:55:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d74d78bb-738a-48fc-9656-4c4e7f15890d req-47a6a59e-156c-4bb8-a6c2-35244821e882 service nova] Acquiring lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d74d78bb-738a-48fc-9656-4c4e7f15890d req-47a6a59e-156c-4bb8-a6c2-35244821e882 service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d74d78bb-738a-48fc-9656-4c4e7f15890d req-47a6a59e-156c-4bb8-a6c2-35244821e882 service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:20 user nova-compute[74994]: DEBUG nova.compute.manager [req-d74d78bb-738a-48fc-9656-4c4e7f15890d req-47a6a59e-156c-4bb8-a6c2-35244821e882 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] No waiting events found dispatching network-vif-plugged-64313c64-2811-46b0-8953-8b80db3604a2 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:55:20 user nova-compute[74994]: WARNING nova.compute.manager [req-d74d78bb-738a-48fc-9656-4c4e7f15890d req-47a6a59e-156c-4bb8-a6c2-35244821e882 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received unexpected event network-vif-plugged-64313c64-2811-46b0-8953-8b80db3604a2 for instance with vm_state building and task_state spawning.
Nov 28 10:55:20 user nova-compute[74994]: INFO nova.compute.manager [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Took 36.11 seconds to build instance.
Nov 28 10:55:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-27055320-2970-454b-b350-a581a1fcc970 tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 36.207s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:20 user nova-compute[74994]: DEBUG nova.compute.manager [req-f2f83914-0082-4c64-8688-c794bc5fed23 req-ab9c594e-ac87-4853-b684-68658d337a15 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received event network-vif-plugged-f27415ef-3b18-4406-8cc2-f5bd07325d95 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:55:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f2f83914-0082-4c64-8688-c794bc5fed23 req-ab9c594e-ac87-4853-b684-68658d337a15 service nova] Acquiring lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f2f83914-0082-4c64-8688-c794bc5fed23 req-ab9c594e-ac87-4853-b684-68658d337a15 service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f2f83914-0082-4c64-8688-c794bc5fed23 req-ab9c594e-ac87-4853-b684-68658d337a15 service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:20 user nova-compute[74994]: DEBUG nova.compute.manager [req-f2f83914-0082-4c64-8688-c794bc5fed23 req-ab9c594e-ac87-4853-b684-68658d337a15 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] No waiting events found dispatching network-vif-plugged-f27415ef-3b18-4406-8cc2-f5bd07325d95 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:55:20 user nova-compute[74994]: WARNING nova.compute.manager [req-f2f83914-0082-4c64-8688-c794bc5fed23 req-ab9c594e-ac87-4853-b684-68658d337a15 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received unexpected event network-vif-plugged-f27415ef-3b18-4406-8cc2-f5bd07325d95 for instance with vm_state active and task_state None.
Nov 28 10:55:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-00e1b7f1-37b6-4e69-b64f-fd92f441207a tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Acquiring lock "b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-00e1b7f1-37b6-4e69-b64f-fd92f441207a tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Lock "b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:20 user nova-compute[74994]: INFO nova.compute.manager [None req-00e1b7f1-37b6-4e69-b64f-fd92f441207a tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Detaching volume 52404138-8512-46a3-a2ab-483912367e31
Nov 28 10:55:21 user nova-compute[74994]: INFO nova.virt.block_device [None req-00e1b7f1-37b6-4e69-b64f-fd92f441207a tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Attempting to driver detach volume 52404138-8512-46a3-a2ab-483912367e31 from mountpoint /dev/vdb
Nov 28 10:55:21 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-00e1b7f1-37b6-4e69-b64f-fd92f441207a tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Attempting to detach device vdb from instance b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6 from the persistent domain config. {{(pid=74994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 10:55:21 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-00e1b7f1-37b6-4e69-b64f-fd92f441207a tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 10:55:21 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 10:55:21 user nova-compute[74994]:   <source dev="/dev/sdf"/>
Nov 28 10:55:21 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 10:55:21 user nova-compute[74994]:   <serial>52404138-8512-46a3-a2ab-483912367e31</serial>
Nov 28 10:55:21 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 10:55:21 user nova-compute[74994]: </disk>
Nov 28 10:55:21 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 10:55:21 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-00e1b7f1-37b6-4e69-b64f-fd92f441207a tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Successfully detached device vdb from instance b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6 from the persistent domain config.
Nov 28 10:55:21 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-00e1b7f1-37b6-4e69-b64f-fd92f441207a tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6 from the live domain config. {{(pid=74994) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 10:55:21 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-00e1b7f1-37b6-4e69-b64f-fd92f441207a tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 10:55:21 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 10:55:21 user nova-compute[74994]:   <source dev="/dev/sdf"/>
Nov 28 10:55:21 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 10:55:21 user nova-compute[74994]:   <serial>52404138-8512-46a3-a2ab-483912367e31</serial>
Nov 28 10:55:21 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 10:55:21 user nova-compute[74994]: </disk>
Nov 28 10:55:21 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 10:55:21 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-00e1b7f1-37b6-4e69-b64f-fd92f441207a tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6 {{(pid=74994) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 10:55:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:55:26 user nova-compute[74994]: WARNING nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] While synchronizing instance power states, found 12 instances in the database and 11 instances on the hypervisor.
Nov 28 10:55:26 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Triggering sync for uuid 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c {{(pid=74994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Triggering sync for uuid bf357856-2d97-42e8-928d-71d0378f48c8 {{(pid=74994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Triggering sync for uuid 279e1c4c-36f9-492f-ab3f-1b587347eadd {{(pid=74994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Triggering sync for uuid 5b51d690-8198-4748-807d-1902e75564b9 {{(pid=74994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Triggering sync for uuid 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb {{(pid=74994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Triggering sync for uuid 2e30565c-9f8e-4a87-8054-6c260dac4f48 {{(pid=74994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Triggering sync for uuid 759fbcfd-ab13-438f-b860-6393a97d1205 {{(pid=74994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Triggering sync for uuid b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6 {{(pid=74994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Triggering sync for uuid 20716905-c56a-4729-8c5b-9188502dc477 {{(pid=74994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Triggering sync for uuid 857e3cbc-af52-46f6-9b59-87bae405f009 {{(pid=74994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Triggering sync for uuid 2f4b631a-46c8-4f9b-b5f9-6e2542484658 {{(pid=74994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Triggering sync for uuid ab5b6240-0510-48fb-bbf5-104696eb52d7 {{(pid=74994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "bf357856-2d97-42e8-928d-71d0378f48c8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "bf357856-2d97-42e8-928d-71d0378f48c8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "279e1c4c-36f9-492f-ab3f-1b587347eadd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "279e1c4c-36f9-492f-ab3f-1b587347eadd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "5b51d690-8198-4748-807d-1902e75564b9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "5b51d690-8198-4748-807d-1902e75564b9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:26 user nova-compute[74994]: INFO nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Nov 28 10:55:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "2e30565c-9f8e-4a87-8054-6c260dac4f48" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "2e30565c-9f8e-4a87-8054-6c260dac4f48" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "759fbcfd-ab13-438f-b860-6393a97d1205" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "759fbcfd-ab13-438f-b860-6393a97d1205" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "20716905-c56a-4729-8c5b-9188502dc477" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "20716905-c56a-4729-8c5b-9188502dc477" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "857e3cbc-af52-46f6-9b59-87bae405f009" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "857e3cbc-af52-46f6-9b59-87bae405f009" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "ab5b6240-0510-48fb-bbf5-104696eb52d7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ac914fe3-7585-4ab0-adcf-b955a2ddbf87 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Acquiring lock "2e30565c-9f8e-4a87-8054-6c260dac4f48" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "5b51d690-8198-4748-807d-1902e75564b9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "bf357856-2d97-42e8-928d-71d0378f48c8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.108s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "20716905-c56a-4729-8c5b-9188502dc477" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.101s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "279e1c4c-36f9-492f-ab3f-1b587347eadd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.117s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.105s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "759fbcfd-ab13-438f-b860-6393a97d1205" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.121s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "857e3cbc-af52-46f6-9b59-87bae405f009" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.119s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:26 user nova-compute[74994]: INFO nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] During sync_power_state the instance has a pending task (deleting). Skip.
Nov 28 10:55:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "2e30565c-9f8e-4a87-8054-6c260dac4f48" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.126s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.121s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ac914fe3-7585-4ab0-adcf-b955a2ddbf87 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lock "2e30565c-9f8e-4a87-8054-6c260dac4f48" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.088s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ac914fe3-7585-4ab0-adcf-b955a2ddbf87 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Acquiring lock "2e30565c-9f8e-4a87-8054-6c260dac4f48-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ac914fe3-7585-4ab0-adcf-b955a2ddbf87 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lock "2e30565c-9f8e-4a87-8054-6c260dac4f48-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ac914fe3-7585-4ab0-adcf-b955a2ddbf87 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lock "2e30565c-9f8e-4a87-8054-6c260dac4f48-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:26 user nova-compute[74994]: INFO nova.compute.manager [None req-ac914fe3-7585-4ab0-adcf-b955a2ddbf87 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Terminating instance
Nov 28 10:55:26 user nova-compute[74994]: DEBUG nova.compute.manager [None req-ac914fe3-7585-4ab0-adcf-b955a2ddbf87 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Starting finish_revert_migration {{(pid=74994) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11816}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Start _get_guest_xml network_info=[{"id": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "address": "fa:16:3e:5d:59:b1", "network": {"id": "670b5fe0-96f5-4414-9425-31ee24eda138", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1327797043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9bc007c45c84765bb2739844c7af055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcb29ac-ee", "ovs_interfaceid": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'aa939d1b-b8a6-4391-935b-0191bf5ccd0a'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QFVecHNB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '2535b6f2-2a4b-4ce1-bd47-0f97d15700fb', 'attached_at': '2023-11-28T10:55:27.000000', 'detached_at': '', 'volume_id': '35aee3f6-cd85-4e5a-9b2e-f9646455aa77', 'serial': '35aee3f6-cd85-4e5a-9b2e-f9646455aa77'}, 'attachment_id': '33d4f504-61b4-4ed6-b033-55b4c32b4571', 'boot_index': None, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 10:55:26 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:55:26 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:55:26 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG nova.objects.instance [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG nova.compute.manager [req-f197a6f1-7cc4-458d-bc6a-0ff2bce44ce5 req-b057baa4-f358-4799-9bc5-b4436fae44d0 service nova] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Received event network-vif-unplugged-11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f197a6f1-7cc4-458d-bc6a-0ff2bce44ce5 req-b057baa4-f358-4799-9bc5-b4436fae44d0 service nova] Acquiring lock "2e30565c-9f8e-4a87-8054-6c260dac4f48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f197a6f1-7cc4-458d-bc6a-0ff2bce44ce5 req-b057baa4-f358-4799-9bc5-b4436fae44d0 service nova] Lock "2e30565c-9f8e-4a87-8054-6c260dac4f48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f197a6f1-7cc4-458d-bc6a-0ff2bce44ce5 req-b057baa4-f358-4799-9bc5-b4436fae44d0 service nova] Lock "2e30565c-9f8e-4a87-8054-6c260dac4f48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG nova.compute.manager [req-f197a6f1-7cc4-458d-bc6a-0ff2bce44ce5 req-b057baa4-f358-4799-9bc5-b4436fae44d0 service nova] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] No waiting events found dispatching network-vif-unplugged-11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG nova.compute.manager [req-f197a6f1-7cc4-458d-bc6a-0ff2bce44ce5 req-b057baa4-f358-4799-9bc5-b4436fae44d0 service nova] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Received event network-vif-unplugged-11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QFVecHNB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:55:26 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:55:26 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:55:26 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:55:26 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:55:26 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 10:55:26 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260" returned: 21 in 0.037s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d0eff9-ac39-475f-8791-aba74607afd5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 10:55:26 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:55:26 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb0533e-9ec4-48db-851f-280ff951ab29]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77] added
Nov 28 10:55:27 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ab181c-daaa-42b2-bbc1-f2d3caf15742]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1d32fe-e5dc-412e-b5bf-7267877c3889]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QFVecHNB {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QFVecHNB" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[443bb642-ca3b-4c7e-9f7b-68f31a57c89c]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QFVecHNB'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[41978ae7-e4ae-477c-a8d5-97afd879bf87]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[30fd1fee-9d83-4fe9-b60d-6576fa6263c4]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:55:27 user nova-compute[74994]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)
Nov 28 10:55:27 user nova-compute[74994]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb (non-flash)
Nov 28 10:55:27 user nova-compute[74994]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f (non-flash)
Nov 28 10:55:27 user nova-compute[74994]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31 (non-flash)
Nov 28 10:55:27 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:55:27 user nova-compute[74994]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)
Nov 28 10:55:27 user nova-compute[74994]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb (non-flash)
Nov 28 10:55:27 user nova-compute[74994]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f (non-flash)
Nov 28 10:55:27 user nova-compute[74994]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31 (non-flash)
Nov 28 10:55:27 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --login" returned: 0 in 0.107s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8c3191-a6bf-43c3-9d5f-185bca6bdbd0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77, portal: 172.16.0.220,3260]
Nov 28 10:55:27 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77, portal: 172.16.0.220,3260] successful.
Nov 28 10:55:27 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:27 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Instance destroyed successfully.
Nov 28 10:55:27 user nova-compute[74994]: DEBUG nova.objects.instance [None req-ac914fe3-7585-4ab0-adcf-b955a2ddbf87 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lazy-loading 'resources' on Instance uuid 2e30565c-9f8e-4a87-8054-6c260dac4f48 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-ac914fe3-7585-4ab0-adcf-b955a2ddbf87 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:49:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1305080845',display_name='tempest-VolumesAdminNegativeTest-server-1305080845',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1305080845',id=8,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVpA8rTFjRvnifCkdi8yrmc9eyfPkW2cNZ8tsZ/SaqGCfkVG0g7QzCiZLnpgRBFH3by6Hm22ghShqtT5eEtkDfOKezdC35wwsjX0mermeu/CKAMjc9gEB96fZ8LRCr0+w==',key_name='tempest-keypair-735144918',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:49:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5cf57a964f98428c95cf169927522860',ramdisk_id='',reservation_id='r-ubvw8xia',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-230929412',owner_user_name='tempest-VolumesAdminNegativeTest-230929412-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T10:49:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bb3c1cbcd954e789f4a462aca3cf25d',uuid=2e30565c-9f8e-4a87-8054-6c260dac4f48,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3", "address": "fa:16:3e:f3:12:45", "network": {"id": "fcf8118a-9224-4f12-b8cc-2936753d9e61", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1394689629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf57a964f98428c95cf169927522860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a544cf-6a", "ovs_interfaceid": "11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-ac914fe3-7585-4ab0-adcf-b955a2ddbf87 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Converting VIF {"id": "11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3", "address": "fa:16:3e:f3:12:45", "network": {"id": "fcf8118a-9224-4f12-b8cc-2936753d9e61", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1394689629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf57a964f98428c95cf169927522860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a544cf-6a", "ovs_interfaceid": "11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-ac914fe3-7585-4ab0-adcf-b955a2ddbf87 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:12:45,bridge_name='br-int',has_traffic_filtering=True,id=11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3,network=Network(fcf8118a-9224-4f12-b8cc-2936753d9e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a544cf-6a') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG os_vif [None req-ac914fe3-7585-4ab0-adcf-b955a2ddbf87 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:12:45,bridge_name='br-int',has_traffic_filtering=True,id=11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3,network=Network(fcf8118a-9224-4f12-b8cc-2936753d9e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a544cf-6a') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[016f33cc-7739-4ca1-ba4d-c17da1952650]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11a544cf-6a, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6391127b-5851-4ef6-9540-6d53f83fd9a9) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:55:27 user nova-compute[74994]: INFO os_vif [None req-ac914fe3-7585-4ab0-adcf-b955a2ddbf87 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:12:45,bridge_name='br-int',has_traffic_filtering=True,id=11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3,network=Network(fcf8118a-9224-4f12-b8cc-2936753d9e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a544cf-6a')
Nov 28 10:55:27 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-ac914fe3-7585-4ab0-adcf-b955a2ddbf87 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Deleting instance files /opt/stack/data/nova/instances/2e30565c-9f8e-4a87-8054-6c260dac4f48_del
Nov 28 10:55:27 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-ac914fe3-7585-4ab0-adcf-b955a2ddbf87 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Deletion of /opt/stack/data/nova/instances/2e30565c-9f8e-4a87-8054-6c260dac4f48_del complete
Nov 28 10:55:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1590e765-c304-4026-ba75-6589f871f991]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:55:27 user nova-compute[74994]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)
Nov 28 10:55:27 user nova-compute[74994]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb (non-flash)
Nov 28 10:55:27 user nova-compute[74994]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f (non-flash)
Nov 28 10:55:27 user nova-compute[74994]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31 (non-flash)
Nov 28 10:55:27 user nova-compute[74994]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)
Nov 28 10:55:27 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:55:27 user nova-compute[74994]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)
Nov 28 10:55:27 user nova-compute[74994]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb (non-flash)
Nov 28 10:55:27 user nova-compute[74994]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f (non-flash)
Nov 28 10:55:27 user nova-compute[74994]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31 (non-flash)
Nov 28 10:55:27 user nova-compute[74994]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)
Nov 28 10:55:27 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.403s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] HCTL ('38', '-', '-', 0) found on session 20 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c4a026-d2c8-4d9b-b5c5-89811f916826]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Searching for a device in session 20 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QFVecHNB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 10:55:27 user nova-compute[74994]: INFO nova.compute.manager [None req-ac914fe3-7585-4ab0-adcf-b955a2ddbf87 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 28 10:55:27 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-ac914fe3-7585-4ab0-adcf-b955a2ddbf87 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 10:55:27 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 10:55:28 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:55:28 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Took 0.78 seconds to deallocate network for instance.
Nov 28 10:55:28 user nova-compute[74994]: DEBUG nova.compute.manager [req-2fedf9ce-2cd3-47e1-9dca-bbcb35c52279 req-52599002-2188-488a-a0ed-3c405711e7df service nova] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Received event network-vif-deleted-11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:55:28 user nova-compute[74994]: INFO nova.compute.manager [req-2fedf9ce-2cd3-47e1-9dca-bbcb35c52279 req-52599002-2188-488a-a0ed-3c405711e7df service nova] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Neutron deleted interface 11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3; detaching it from the instance and deleting it from the info cache
Nov 28 10:55:28 user nova-compute[74994]: DEBUG nova.network.neutron [req-2fedf9ce-2cd3-47e1-9dca-bbcb35c52279 req-52599002-2188-488a-a0ed-3c405711e7df service nova] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:55:28 user nova-compute[74994]: DEBUG nova.compute.manager [req-2fedf9ce-2cd3-47e1-9dca-bbcb35c52279 req-52599002-2188-488a-a0ed-3c405711e7df service nova] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Detach interface failed, port_id=11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3, reason: Instance 2e30565c-9f8e-4a87-8054-6c260dac4f48 could not be found. {{(pid=74994) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 10:55:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ac914fe3-7585-4ab0-adcf-b955a2ddbf87 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ac914fe3-7585-4ab0-adcf-b955a2ddbf87 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:28 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.446s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:55:28 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] <== connect_volume: return (1448ms) {'type': 'block', 'scsi_wwn': '26365386661363434', 'path': '/dev/sdg'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:55:28 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365386661363434', 'path': '/dev/sdg'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 10:55:28 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:49:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-502885888',display_name='tempest-ServerActionsTestOtherB-server-502885888',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-502885888',id=7,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAP2WYAYbmEHvo9gpy8E02p/bOJRkvsKNh1AOdzva6YpAs9spAOOEI0cMhVl9gL/EJuJSrtBF2pmysHal8/jsBIX9uFnmSQR89/cpFlQWiHlWT+1v4Gox5jUD1SpkJCj+g==',key_name='tempest-keypair-1209998822',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:53:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b9bc007c45c84765bb2739844c7af055',ramdisk_id='',reservation_id='r-w4ylqmii',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-585983328',owner_user_name='tempest-ServerActionsTestOtherB-585983328-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T10:55:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d4253b9511f408a9c62c79cff8fc0d7',uuid=2535b6f2-2a4b-4ce1-bd47-0f97d15700fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "address": "fa:16:3e:5d:59:b1", "network": {"id": "670b5fe0-96f5-4414-9425-31ee24eda138", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1327797043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9bc007c45c84765bb2739844c7af055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcb29ac-ee", "ovs_interfaceid": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:55:28 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Converting VIF {"id": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "address": "fa:16:3e:5d:59:b1", "network": {"id": "670b5fe0-96f5-4414-9425-31ee24eda138", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1327797043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9bc007c45c84765bb2739844c7af055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcb29ac-ee", "ovs_interfaceid": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:55:28 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:59:b1,bridge_name='br-int',has_traffic_filtering=True,id=7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a,network=Network(670b5fe0-96f5-4414-9425-31ee24eda138),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bcb29ac-ee') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:55:28 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] End _get_guest_xml xml=<domain type="kvm">
Nov 28 10:55:28 user nova-compute[74994]:   <uuid>2535b6f2-2a4b-4ce1-bd47-0f97d15700fb</uuid>
Nov 28 10:55:28 user nova-compute[74994]:   <name>instance-00000007</name>
Nov 28 10:55:28 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 10:55:28 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 10:55:28 user nova-compute[74994]:   <metadata>
Nov 28 10:55:28 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 10:55:28 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 10:55:28 user nova-compute[74994]:       <nova:name>tempest-ServerActionsTestOtherB-server-502885888</nova:name>
Nov 28 10:55:28 user nova-compute[74994]:       <nova:creationTime>2023-11-28 10:55:26</nova:creationTime>
Nov 28 10:55:28 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 10:55:28 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 10:55:28 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 10:55:28 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 10:55:28 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 10:55:28 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 10:55:28 user nova-compute[74994]:       </nova:flavor>
Nov 28 10:55:28 user nova-compute[74994]:       <nova:owner>
Nov 28 10:55:28 user nova-compute[74994]:         <nova:user uuid="0d4253b9511f408a9c62c79cff8fc0d7">tempest-ServerActionsTestOtherB-585983328-project-member</nova:user>
Nov 28 10:55:28 user nova-compute[74994]:         <nova:project uuid="b9bc007c45c84765bb2739844c7af055">tempest-ServerActionsTestOtherB-585983328</nova:project>
Nov 28 10:55:28 user nova-compute[74994]:       </nova:owner>
Nov 28 10:55:28 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 10:55:28 user nova-compute[74994]:       <nova:ports>
Nov 28 10:55:28 user nova-compute[74994]:         <nova:port uuid="7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a">
Nov 28 10:55:28 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 28 10:55:28 user nova-compute[74994]:         </nova:port>
Nov 28 10:55:28 user nova-compute[74994]:       </nova:ports>
Nov 28 10:55:28 user nova-compute[74994]:     </nova:instance>
Nov 28 10:55:28 user nova-compute[74994]:   </metadata>
Nov 28 10:55:28 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 10:55:28 user nova-compute[74994]:     <system>
Nov 28 10:55:28 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 10:55:28 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 10:55:28 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 10:55:28 user nova-compute[74994]:       <entry name="serial">2535b6f2-2a4b-4ce1-bd47-0f97d15700fb</entry>
Nov 28 10:55:28 user nova-compute[74994]:       <entry name="uuid">2535b6f2-2a4b-4ce1-bd47-0f97d15700fb</entry>
Nov 28 10:55:28 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 10:55:28 user nova-compute[74994]:     </system>
Nov 28 10:55:28 user nova-compute[74994]:   </sysinfo>
Nov 28 10:55:28 user nova-compute[74994]:   <os>
Nov 28 10:55:28 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 10:55:28 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 10:55:28 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 10:55:28 user nova-compute[74994]:   </os>
Nov 28 10:55:28 user nova-compute[74994]:   <features>
Nov 28 10:55:28 user nova-compute[74994]:     <acpi/>
Nov 28 10:55:28 user nova-compute[74994]:     <apic/>
Nov 28 10:55:28 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 10:55:28 user nova-compute[74994]:   </features>
Nov 28 10:55:28 user nova-compute[74994]:   <clock offset="utc">
Nov 28 10:55:28 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 10:55:28 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 10:55:28 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 10:55:28 user nova-compute[74994]:   </clock>
Nov 28 10:55:28 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 10:55:28 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 10:55:28 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 10:55:28 user nova-compute[74994]:   </cpu>
Nov 28 10:55:28 user nova-compute[74994]:   <devices>
Nov 28 10:55:28 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 10:55:28 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 10:55:28 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk"/>
Nov 28 10:55:28 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 10:55:28 user nova-compute[74994]:     </disk>
Nov 28 10:55:28 user nova-compute[74994]:     <disk type="block" device="disk">
Nov 28 10:55:28 user nova-compute[74994]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 10:55:28 user nova-compute[74994]:       <source dev="/dev/sdg"/>
Nov 28 10:55:28 user nova-compute[74994]:       <target dev="vdb" bus="virtio"/>
Nov 28 10:55:28 user nova-compute[74994]:       <serial>35aee3f6-cd85-4e5a-9b2e-f9646455aa77</serial>
Nov 28 10:55:28 user nova-compute[74994]:     </disk>
Nov 28 10:55:28 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 10:55:28 user nova-compute[74994]:       <mac address="fa:16:3e:5d:59:b1"/>
Nov 28 10:55:28 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:55:28 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 10:55:28 user nova-compute[74994]:       <target dev="tap7bcb29ac-ee"/>
Nov 28 10:55:28 user nova-compute[74994]:     </interface>
Nov 28 10:55:28 user nova-compute[74994]:     <serial type="pty">
Nov 28 10:55:28 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/console.log" append="off"/>
Nov 28 10:55:28 user nova-compute[74994]:     </serial>
Nov 28 10:55:28 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 10:55:28 user nova-compute[74994]:     <video>
Nov 28 10:55:28 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:55:28 user nova-compute[74994]:     </video>
Nov 28 10:55:28 user nova-compute[74994]:     <rng model="virtio">
Nov 28 10:55:28 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 10:55:28 user nova-compute[74994]:     </rng>
Nov 28 10:55:28 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 10:55:28 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 10:55:28 user nova-compute[74994]:       <stats period="10"/>
Nov 28 10:55:28 user nova-compute[74994]:     </memballoon>
Nov 28 10:55:28 user nova-compute[74994]:   </devices>
Nov 28 10:55:28 user nova-compute[74994]: </domain>
Nov 28 10:55:28 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 10:55:28 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:49:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-502885888',display_name='tempest-ServerActionsTestOtherB-server-502885888',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-502885888',id=7,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAP2WYAYbmEHvo9gpy8E02p/bOJRkvsKNh1AOdzva6YpAs9spAOOEI0cMhVl9gL/EJuJSrtBF2pmysHal8/jsBIX9uFnmSQR89/cpFlQWiHlWT+1v4Gox5jUD1SpkJCj+g==',key_name='tempest-keypair-1209998822',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:53:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b9bc007c45c84765bb2739844c7af055',ramdisk_id='',reservation_id='r-w4ylqmii',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-585983328',owner_user_name='tempest-ServerActionsTestOtherB-585983328-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T10:55:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d4253b9511f408a9c62c79cff8fc0d7',uuid=2535b6f2-2a4b-4ce1-bd47-0f97d15700fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "address": "fa:16:3e:5d:59:b1", "network": {"id": "670b5fe0-96f5-4414-9425-31ee24eda138", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1327797043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9bc007c45c84765bb2739844c7af055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcb29ac-ee", "ovs_interfaceid": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 10:55:28 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Converting VIF {"id": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "address": "fa:16:3e:5d:59:b1", "network": {"id": "670b5fe0-96f5-4414-9425-31ee24eda138", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1327797043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9bc007c45c84765bb2739844c7af055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcb29ac-ee", "ovs_interfaceid": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:55:28 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:59:b1,bridge_name='br-int',has_traffic_filtering=True,id=7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a,network=Network(670b5fe0-96f5-4414-9425-31ee24eda138),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bcb29ac-ee') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:55:28 user nova-compute[74994]: DEBUG os_vif [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:59:b1,bridge_name='br-int',has_traffic_filtering=True,id=7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a,network=Network(670b5fe0-96f5-4414-9425-31ee24eda138),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bcb29ac-ee') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 10:55:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:55:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 10:55:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7f9fa96b-511c-51dd-a4c6-ed21b3371ab7', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:55:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:55:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7bcb29ac-ee, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:55:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7bcb29ac-ee, col_values=(('qos', UUID('8ce108a1-a6a3-440a-8e56-42f83dc7a1c9')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:55:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7bcb29ac-ee, col_values=(('external_ids', {'iface-id': '7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:59:b1', 'vm-uuid': '2535b6f2-2a4b-4ce1-bd47-0f97d15700fb'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:55:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:55:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:28 user nova-compute[74994]: INFO os_vif [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:59:b1,bridge_name='br-int',has_traffic_filtering=True,id=7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a,network=Network(670b5fe0-96f5-4414-9425-31ee24eda138),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bcb29ac-ee')
Nov 28 10:55:28 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-ac914fe3-7585-4ab0-adcf-b955a2ddbf87 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:55:28 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-ac914fe3-7585-4ab0-adcf-b955a2ddbf87 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:55:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ac914fe3-7585-4ab0-adcf-b955a2ddbf87 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:28 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-ac914fe3-7585-4ab0-adcf-b955a2ddbf87 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Deleted allocations for instance 2e30565c-9f8e-4a87-8054-6c260dac4f48
Nov 28 10:55:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ac914fe3-7585-4ab0-adcf-b955a2ddbf87 tempest-VolumesAdminNegativeTest-230929412 tempest-VolumesAdminNegativeTest-230929412-project-member] Lock "2e30565c-9f8e-4a87-8054-6c260dac4f48" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.281s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:28 user nova-compute[74994]: DEBUG nova.compute.manager [req-71603d9f-b9cf-46ab-a36c-d8b96f9cba20 req-cff323b0-39fa-4010-802c-622167c03801 service nova] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Received event network-vif-plugged-11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:55:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-71603d9f-b9cf-46ab-a36c-d8b96f9cba20 req-cff323b0-39fa-4010-802c-622167c03801 service nova] Acquiring lock "2e30565c-9f8e-4a87-8054-6c260dac4f48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-71603d9f-b9cf-46ab-a36c-d8b96f9cba20 req-cff323b0-39fa-4010-802c-622167c03801 service nova] Lock "2e30565c-9f8e-4a87-8054-6c260dac4f48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-71603d9f-b9cf-46ab-a36c-d8b96f9cba20 req-cff323b0-39fa-4010-802c-622167c03801 service nova] Lock "2e30565c-9f8e-4a87-8054-6c260dac4f48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:28 user nova-compute[74994]: DEBUG nova.compute.manager [req-71603d9f-b9cf-46ab-a36c-d8b96f9cba20 req-cff323b0-39fa-4010-802c-622167c03801 service nova] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] No waiting events found dispatching network-vif-plugged-11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:55:28 user nova-compute[74994]: WARNING nova.compute.manager [req-71603d9f-b9cf-46ab-a36c-d8b96f9cba20 req-cff323b0-39fa-4010-802c-622167c03801 service nova] [instance: 2e30565c-9f8e-4a87-8054-6c260dac4f48] Received unexpected event network-vif-plugged-11a544cf-6ae4-43f0-ab7e-d2fa9acbd6f3 for instance with vm_state deleted and task_state None.
Nov 28 10:55:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:30 user nova-compute[74994]: DEBUG nova.compute.manager [req-b535bfb0-99ad-460d-87de-f362e42d7d22 req-fbbada27-fcea-4eaa-b322-ff75c480ac35 service nova] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Received event network-vif-plugged-7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:55:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-b535bfb0-99ad-460d-87de-f362e42d7d22 req-fbbada27-fcea-4eaa-b322-ff75c480ac35 service nova] Acquiring lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-b535bfb0-99ad-460d-87de-f362e42d7d22 req-fbbada27-fcea-4eaa-b322-ff75c480ac35 service nova] Lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-b535bfb0-99ad-460d-87de-f362e42d7d22 req-fbbada27-fcea-4eaa-b322-ff75c480ac35 service nova] Lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:30 user nova-compute[74994]: DEBUG nova.compute.manager [req-b535bfb0-99ad-460d-87de-f362e42d7d22 req-fbbada27-fcea-4eaa-b322-ff75c480ac35 service nova] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] No waiting events found dispatching network-vif-plugged-7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:55:30 user nova-compute[74994]: WARNING nova.compute.manager [req-b535bfb0-99ad-460d-87de-f362e42d7d22 req-fbbada27-fcea-4eaa-b322-ff75c480ac35 service nova] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Received unexpected event network-vif-plugged-7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a for instance with vm_state resized and task_state resize_reverting.
Nov 28 10:55:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:32 user nova-compute[74994]: DEBUG nova.compute.manager [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 10:55:32 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Instance running successfully.
Nov 28 10:55:32 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] finish_revert_migration finished successfully. {{(pid=74994) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11860}}
Nov 28 10:55:32 user nova-compute[74994]: DEBUG nova.compute.manager [req-5de2f394-e9fa-4641-9585-6950e9240e50 req-c304a28b-7c0c-4244-997f-4a3f730426a6 service nova] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Received event network-vif-plugged-7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:55:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-5de2f394-e9fa-4641-9585-6950e9240e50 req-c304a28b-7c0c-4244-997f-4a3f730426a6 service nova] Acquiring lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-5de2f394-e9fa-4641-9585-6950e9240e50 req-c304a28b-7c0c-4244-997f-4a3f730426a6 service nova] Lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-5de2f394-e9fa-4641-9585-6950e9240e50 req-c304a28b-7c0c-4244-997f-4a3f730426a6 service nova] Lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:32 user nova-compute[74994]: DEBUG nova.compute.manager [req-5de2f394-e9fa-4641-9585-6950e9240e50 req-c304a28b-7c0c-4244-997f-4a3f730426a6 service nova] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] No waiting events found dispatching network-vif-plugged-7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:55:32 user nova-compute[74994]: WARNING nova.compute.manager [req-5de2f394-e9fa-4641-9585-6950e9240e50 req-c304a28b-7c0c-4244-997f-4a3f730426a6 service nova] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Received unexpected event network-vif-plugged-7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a for instance with vm_state resized and task_state resize_reverting.
Nov 28 10:55:32 user nova-compute[74994]: INFO nova.compute.manager [None req-d9f8d9a2-6624-4b62-9ff8-4c48bbab4e90 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Updating instance to original state: 'active'
Nov 28 10:55:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:36 user nova-compute[74994]: DEBUG nova.compute.manager [req-a909c147-2238-49f1-a71f-c873b5b8536b req-5eda228b-5eeb-4590-b6da-9a34cccf3941 service nova] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Received event network-changed-10b84648-2b56-4451-b4f3-3ec4ad7b7771 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:55:36 user nova-compute[74994]: DEBUG nova.compute.manager [req-a909c147-2238-49f1-a71f-c873b5b8536b req-5eda228b-5eeb-4590-b6da-9a34cccf3941 service nova] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Refreshing instance network info cache due to event network-changed-10b84648-2b56-4451-b4f3-3ec4ad7b7771. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:55:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a909c147-2238-49f1-a71f-c873b5b8536b req-5eda228b-5eeb-4590-b6da-9a34cccf3941 service nova] Acquiring lock "refresh_cache-20716905-c56a-4729-8c5b-9188502dc477" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:55:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a909c147-2238-49f1-a71f-c873b5b8536b req-5eda228b-5eeb-4590-b6da-9a34cccf3941 service nova] Acquired lock "refresh_cache-20716905-c56a-4729-8c5b-9188502dc477" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:55:36 user nova-compute[74994]: DEBUG nova.network.neutron [req-a909c147-2238-49f1-a71f-c873b5b8536b req-5eda228b-5eeb-4590-b6da-9a34cccf3941 service nova] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Refreshing network info cache for port 10b84648-2b56-4451-b4f3-3ec4ad7b7771 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:55:36 user nova-compute[74994]: DEBUG nova.network.neutron [req-a909c147-2238-49f1-a71f-c873b5b8536b req-5eda228b-5eeb-4590-b6da-9a34cccf3941 service nova] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Updated VIF entry in instance network info cache for port 10b84648-2b56-4451-b4f3-3ec4ad7b7771. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 10:55:36 user nova-compute[74994]: DEBUG nova.network.neutron [req-a909c147-2238-49f1-a71f-c873b5b8536b req-5eda228b-5eeb-4590-b6da-9a34cccf3941 service nova] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Updating instance_info_cache with network_info: [{"id": "10b84648-2b56-4451-b4f3-3ec4ad7b7771", "address": "fa:16:3e:96:e0:ac", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b84648-2b", "ovs_interfaceid": "10b84648-2b56-4451-b4f3-3ec4ad7b7771", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:55:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a909c147-2238-49f1-a71f-c873b5b8536b req-5eda228b-5eeb-4590-b6da-9a34cccf3941 service nova] Releasing lock "refresh_cache-20716905-c56a-4729-8c5b-9188502dc477" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:55:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:41 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-00e1b7f1-37b6-4e69-b64f-fd92f441207a tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6 is timed out.
Nov 28 10:55:41 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-00e1b7f1-37b6-4e69-b64f-fd92f441207a tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Successfully detached device vdb from instance b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6 from the live domain config.
Nov 28 10:55:41 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00e1b7f1-37b6-4e69-b64f-fd92f441207a tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e1b7f1-37b6-4e69-b64f-fd92f441207a tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'naBvFlqe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:55:41 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-00e1b7f1-37b6-4e69-b64f-fd92f441207a tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:55:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-00e1b7f1-37b6-4e69-b64f-fd92f441207a tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-00e1b7f1-37b6-4e69-b64f-fd92f441207a tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d755809-0fee-435f-b7df-2fb10b88a482]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e1b7f1-37b6-4e69-b64f-fd92f441207a tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 10:55:41 user nova-compute[74994]: No targets found.
Nov 28 10:55:41 user nova-compute[74994]: iSNS:
Nov 28 10:55:41 user nova-compute[74994]: No targets found.
Nov 28 10:55:41 user nova-compute[74994]: STATIC:
Nov 28 10:55:41 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77
Nov 28 10:55:41 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:55:41 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:55:41 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31
Nov 28 10:55:41 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:55:41 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:55:41 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de
Nov 28 10:55:41 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:55:41 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:55:41 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb
Nov 28 10:55:41 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:55:41 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:55:41 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f
Nov 28 10:55:41 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:55:41 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:55:41 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de
Nov 28 10:55:41 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:55:41 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:55:41 user nova-compute[74994]: FIRMWARE:
Nov 28 10:55:41 user nova-compute[74994]: No targets found.
Nov 28 10:55:41 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e1b7f1-37b6-4e69-b64f-fd92f441207a tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 10:55:41 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 10:55:41 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e1b7f1-37b6-4e69-b64f-fd92f441207a tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eec7364-8a30-408c-ae36-f9e2fe75df49]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc56eb6b-a96b-4fcf-9edd-cd8bf57b742c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e1b7f1-37b6-4e69-b64f-fd92f441207a tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:55:41 user nova-compute[74994]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)
Nov 28 10:55:41 user nova-compute[74994]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb (non-flash)
Nov 28 10:55:41 user nova-compute[74994]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f (non-flash)
Nov 28 10:55:41 user nova-compute[74994]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31 (non-flash)
Nov 28 10:55:41 user nova-compute[74994]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)
Nov 28 10:55:41 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e1b7f1-37b6-4e69-b64f-fd92f441207a tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:55:41 user nova-compute[74994]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)
Nov 28 10:55:41 user nova-compute[74994]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb (non-flash)
Nov 28 10:55:41 user nova-compute[74994]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f (non-flash)
Nov 28 10:55:41 user nova-compute[74994]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31 (non-flash)
Nov 28 10:55:41 user nova-compute[74994]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)
Nov 28 10:55:41 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e1b7f1-37b6-4e69-b64f-fd92f441207a tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9446f03a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31'): ({'sdf'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-00e1b7f1-37b6-4e69-b64f-fd92f441207a tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Removing single pathed devices sdf {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3f4c10-5b67-46db-9479-e031796c89f1]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b6f663-3bea-4e35-b75f-4cb9e8d05235]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-00e1b7f1-37b6-4e69-b64f-fd92f441207a tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Flushing IO for device /dev/sdf {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7548c2e2-2f29-4434-8429-2c5be277e7c8]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-00e1b7f1-37b6-4e69-b64f-fd92f441207a tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.053s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[47497492-0d5b-4ba9-84f5-ec7b13345da5]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-00e1b7f1-37b6-4e69-b64f-fd92f441207a tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-00e1b7f1-37b6-4e69-b64f-fd92f441207a tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] SCSI volumes sdf have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e1b7f1-37b6-4e69-b64f-fd92f441207a tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df9c493-26c6-40db-a8cc-481533bc908c]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e1b7f1-37b6-4e69-b64f-fd92f441207a tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31 -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:41 user nova-compute[74994]: INFO nova.compute.manager [None req-42fef18e-ab07-4a12-838f-27ddebeaa027 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Unrescuing
Nov 28 10:55:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-42fef18e-ab07-4a12-838f-27ddebeaa027 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquiring lock "refresh_cache-bf357856-2d97-42e8-928d-71d0378f48c8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-42fef18e-ab07-4a12-838f-27ddebeaa027 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquired lock "refresh_cache-bf357856-2d97-42e8-928d-71d0378f48c8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG nova.network.neutron [None req-42fef18e-ab07-4a12-838f-27ddebeaa027 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc33a9ec-872f-451e-88da-be2ec29d697c]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e1b7f1-37b6-4e69-b64f-fd92f441207a tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31, portal: 172.16.0.220,3260]
Nov 28 10:55:41 user nova-compute[74994]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31, portal: 172.16.0.220,3260] successful.
Nov 28 10:55:41 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31 -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52404138-8512-46a3-a2ab-483912367e31 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c66cba-30df-4253-b86a-ca35c134d085]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e1b7f1-37b6-4e69-b64f-fd92f441207a tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-00e1b7f1-37b6-4e69-b64f-fd92f441207a tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e1b7f1-37b6-4e69-b64f-fd92f441207a tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] <== disconnect_volume: return (358ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:55:41 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00e1b7f1-37b6-4e69-b64f-fd92f441207a tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 10:55:42 user nova-compute[74994]: DEBUG nova.network.neutron [None req-42fef18e-ab07-4a12-838f-27ddebeaa027 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Updating instance_info_cache with network_info: [{"id": "6a884296-8f6f-4647-b4c6-09d7f4e92887", "address": "fa:16:3e:a2:e1:5b", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a884296-8f", "ovs_interfaceid": "6a884296-8f6f-4647-b4c6-09d7f4e92887", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:55:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-42fef18e-ab07-4a12-838f-27ddebeaa027 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Releasing lock "refresh_cache-bf357856-2d97-42e8-928d-71d0378f48c8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:55:42 user nova-compute[74994]: DEBUG nova.objects.instance [None req-42fef18e-ab07-4a12-838f-27ddebeaa027 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lazy-loading 'flavor' on Instance uuid bf357856-2d97-42e8-928d-71d0378f48c8 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:55:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:42 user nova-compute[74994]: DEBUG nova.compute.manager [req-9d4fcbcc-54e7-436a-a135-20766c8b8c50 req-b7f5b8b9-f729-4929-a293-2a6e6ce0b783 service nova] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Received event network-vif-unplugged-6a884296-8f6f-4647-b4c6-09d7f4e92887 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:55:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9d4fcbcc-54e7-436a-a135-20766c8b8c50 req-b7f5b8b9-f729-4929-a293-2a6e6ce0b783 service nova] Acquiring lock "bf357856-2d97-42e8-928d-71d0378f48c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9d4fcbcc-54e7-436a-a135-20766c8b8c50 req-b7f5b8b9-f729-4929-a293-2a6e6ce0b783 service nova] Lock "bf357856-2d97-42e8-928d-71d0378f48c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9d4fcbcc-54e7-436a-a135-20766c8b8c50 req-b7f5b8b9-f729-4929-a293-2a6e6ce0b783 service nova] Lock "bf357856-2d97-42e8-928d-71d0378f48c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:42 user nova-compute[74994]: DEBUG nova.compute.manager [req-9d4fcbcc-54e7-436a-a135-20766c8b8c50 req-b7f5b8b9-f729-4929-a293-2a6e6ce0b783 service nova] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] No waiting events found dispatching network-vif-unplugged-6a884296-8f6f-4647-b4c6-09d7f4e92887 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:55:42 user nova-compute[74994]: WARNING nova.compute.manager [req-9d4fcbcc-54e7-436a-a135-20766c8b8c50 req-b7f5b8b9-f729-4929-a293-2a6e6ce0b783 service nova] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Received unexpected event network-vif-unplugged-6a884296-8f6f-4647-b4c6-09d7f4e92887 for instance with vm_state rescued and task_state unrescuing.
Nov 28 10:55:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:43 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Instance destroyed successfully.
Nov 28 10:55:43 user nova-compute[74994]: DEBUG nova.objects.instance [None req-00e1b7f1-37b6-4e69-b64f-fd92f441207a tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Lazy-loading 'flavor' on Instance uuid b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:55:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-00e1b7f1-37b6-4e69-b64f-fd92f441207a tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Lock "b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.176s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 16.726s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:44 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:44 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:44 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:44 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:44 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:44 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:44 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:44 user nova-compute[74994]: DEBUG nova.compute.manager [req-a8c9ea0f-4a5c-4bd8-b139-1cc119f01dc9 req-4991fd58-c044-4fe6-85a2-6321531c9bda service nova] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Received event network-vif-plugged-6a884296-8f6f-4647-b4c6-09d7f4e92887 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:55:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a8c9ea0f-4a5c-4bd8-b139-1cc119f01dc9 req-4991fd58-c044-4fe6-85a2-6321531c9bda service nova] Acquiring lock "bf357856-2d97-42e8-928d-71d0378f48c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a8c9ea0f-4a5c-4bd8-b139-1cc119f01dc9 req-4991fd58-c044-4fe6-85a2-6321531c9bda service nova] Lock "bf357856-2d97-42e8-928d-71d0378f48c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a8c9ea0f-4a5c-4bd8-b139-1cc119f01dc9 req-4991fd58-c044-4fe6-85a2-6321531c9bda service nova] Lock "bf357856-2d97-42e8-928d-71d0378f48c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:44 user nova-compute[74994]: DEBUG nova.compute.manager [req-a8c9ea0f-4a5c-4bd8-b139-1cc119f01dc9 req-4991fd58-c044-4fe6-85a2-6321531c9bda service nova] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] No waiting events found dispatching network-vif-plugged-6a884296-8f6f-4647-b4c6-09d7f4e92887 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:55:44 user nova-compute[74994]: WARNING nova.compute.manager [req-a8c9ea0f-4a5c-4bd8-b139-1cc119f01dc9 req-4991fd58-c044-4fe6-85a2-6321531c9bda service nova] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Received unexpected event network-vif-plugged-6a884296-8f6f-4647-b4c6-09d7f4e92887 for instance with vm_state rescued and task_state unrescuing.
Nov 28 10:55:44 user nova-compute[74994]: DEBUG nova.compute.manager [req-a8c9ea0f-4a5c-4bd8-b139-1cc119f01dc9 req-4991fd58-c044-4fe6-85a2-6321531c9bda service nova] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Received event network-vif-plugged-6a884296-8f6f-4647-b4c6-09d7f4e92887 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:55:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a8c9ea0f-4a5c-4bd8-b139-1cc119f01dc9 req-4991fd58-c044-4fe6-85a2-6321531c9bda service nova] Acquiring lock "bf357856-2d97-42e8-928d-71d0378f48c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a8c9ea0f-4a5c-4bd8-b139-1cc119f01dc9 req-4991fd58-c044-4fe6-85a2-6321531c9bda service nova] Lock "bf357856-2d97-42e8-928d-71d0378f48c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a8c9ea0f-4a5c-4bd8-b139-1cc119f01dc9 req-4991fd58-c044-4fe6-85a2-6321531c9bda service nova] Lock "bf357856-2d97-42e8-928d-71d0378f48c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:44 user nova-compute[74994]: DEBUG nova.compute.manager [req-a8c9ea0f-4a5c-4bd8-b139-1cc119f01dc9 req-4991fd58-c044-4fe6-85a2-6321531c9bda service nova] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] No waiting events found dispatching network-vif-plugged-6a884296-8f6f-4647-b4c6-09d7f4e92887 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:55:44 user nova-compute[74994]: WARNING nova.compute.manager [req-a8c9ea0f-4a5c-4bd8-b139-1cc119f01dc9 req-4991fd58-c044-4fe6-85a2-6321531c9bda service nova] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Received unexpected event network-vif-plugged-6a884296-8f6f-4647-b4c6-09d7f4e92887 for instance with vm_state rescued and task_state unrescuing.
Nov 28 10:55:45 user nova-compute[74994]: INFO nova.compute.manager [None req-98e4db2d-5639-47f5-bfaa-8d9ae546ba60 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Unrescuing
Nov 28 10:55:45 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-98e4db2d-5639-47f5-bfaa-8d9ae546ba60 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "refresh_cache-759fbcfd-ab13-438f-b860-6393a97d1205" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:55:45 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-98e4db2d-5639-47f5-bfaa-8d9ae546ba60 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquired lock "refresh_cache-759fbcfd-ab13-438f-b860-6393a97d1205" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:55:45 user nova-compute[74994]: DEBUG nova.network.neutron [None req-98e4db2d-5639-47f5-bfaa-8d9ae546ba60 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 10:55:45 user nova-compute[74994]: DEBUG nova.network.neutron [None req-98e4db2d-5639-47f5-bfaa-8d9ae546ba60 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Updating instance_info_cache with network_info: [{"id": "7d4a82ba-d222-44bb-baac-6642f24b9528", "address": "fa:16:3e:4f:75:25", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d4a82ba-d2", "ovs_interfaceid": "7d4a82ba-d222-44bb-baac-6642f24b9528", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:55:45 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-98e4db2d-5639-47f5-bfaa-8d9ae546ba60 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Releasing lock "refresh_cache-759fbcfd-ab13-438f-b860-6393a97d1205" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:55:45 user nova-compute[74994]: DEBUG nova.objects.instance [None req-98e4db2d-5639-47f5-bfaa-8d9ae546ba60 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lazy-loading 'flavor' on Instance uuid 759fbcfd-ab13-438f-b860-6393a97d1205 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:55:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:46 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Instance destroyed successfully.
Nov 28 10:55:46 user nova-compute[74994]: DEBUG nova.compute.manager [None req-42fef18e-ab07-4a12-838f-27ddebeaa027 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 10:55:46 user nova-compute[74994]: DEBUG nova.compute.manager [req-f8ff6f99-f230-479d-a905-addfd4a965cd req-1d84079e-22df-4f8f-bbbe-eb5f9c36d55d service nova] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Received event network-vif-plugged-6a884296-8f6f-4647-b4c6-09d7f4e92887 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:55:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f8ff6f99-f230-479d-a905-addfd4a965cd req-1d84079e-22df-4f8f-bbbe-eb5f9c36d55d service nova] Acquiring lock "bf357856-2d97-42e8-928d-71d0378f48c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f8ff6f99-f230-479d-a905-addfd4a965cd req-1d84079e-22df-4f8f-bbbe-eb5f9c36d55d service nova] Lock "bf357856-2d97-42e8-928d-71d0378f48c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f8ff6f99-f230-479d-a905-addfd4a965cd req-1d84079e-22df-4f8f-bbbe-eb5f9c36d55d service nova] Lock "bf357856-2d97-42e8-928d-71d0378f48c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:46 user nova-compute[74994]: DEBUG nova.compute.manager [req-f8ff6f99-f230-479d-a905-addfd4a965cd req-1d84079e-22df-4f8f-bbbe-eb5f9c36d55d service nova] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] No waiting events found dispatching network-vif-plugged-6a884296-8f6f-4647-b4c6-09d7f4e92887 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:55:46 user nova-compute[74994]: WARNING nova.compute.manager [req-f8ff6f99-f230-479d-a905-addfd4a965cd req-1d84079e-22df-4f8f-bbbe-eb5f9c36d55d service nova] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Received unexpected event network-vif-plugged-6a884296-8f6f-4647-b4c6-09d7f4e92887 for instance with vm_state rescued and task_state unrescuing.
Nov 28 10:55:46 user nova-compute[74994]: DEBUG nova.compute.manager [req-f8ff6f99-f230-479d-a905-addfd4a965cd req-1d84079e-22df-4f8f-bbbe-eb5f9c36d55d service nova] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Received event network-vif-unplugged-7d4a82ba-d222-44bb-baac-6642f24b9528 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:55:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f8ff6f99-f230-479d-a905-addfd4a965cd req-1d84079e-22df-4f8f-bbbe-eb5f9c36d55d service nova] Acquiring lock "759fbcfd-ab13-438f-b860-6393a97d1205-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f8ff6f99-f230-479d-a905-addfd4a965cd req-1d84079e-22df-4f8f-bbbe-eb5f9c36d55d service nova] Lock "759fbcfd-ab13-438f-b860-6393a97d1205-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f8ff6f99-f230-479d-a905-addfd4a965cd req-1d84079e-22df-4f8f-bbbe-eb5f9c36d55d service nova] Lock "759fbcfd-ab13-438f-b860-6393a97d1205-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:46 user nova-compute[74994]: DEBUG nova.compute.manager [req-f8ff6f99-f230-479d-a905-addfd4a965cd req-1d84079e-22df-4f8f-bbbe-eb5f9c36d55d service nova] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] No waiting events found dispatching network-vif-unplugged-7d4a82ba-d222-44bb-baac-6642f24b9528 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:55:46 user nova-compute[74994]: WARNING nova.compute.manager [req-f8ff6f99-f230-479d-a905-addfd4a965cd req-1d84079e-22df-4f8f-bbbe-eb5f9c36d55d service nova] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Received unexpected event network-vif-unplugged-7d4a82ba-d222-44bb-baac-6642f24b9528 for instance with vm_state rescued and task_state unrescuing.
Nov 28 10:55:46 user nova-compute[74994]: DEBUG nova.compute.manager [req-f8ff6f99-f230-479d-a905-addfd4a965cd req-1d84079e-22df-4f8f-bbbe-eb5f9c36d55d service nova] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Received event network-vif-plugged-7d4a82ba-d222-44bb-baac-6642f24b9528 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:55:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f8ff6f99-f230-479d-a905-addfd4a965cd req-1d84079e-22df-4f8f-bbbe-eb5f9c36d55d service nova] Acquiring lock "759fbcfd-ab13-438f-b860-6393a97d1205-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f8ff6f99-f230-479d-a905-addfd4a965cd req-1d84079e-22df-4f8f-bbbe-eb5f9c36d55d service nova] Lock "759fbcfd-ab13-438f-b860-6393a97d1205-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f8ff6f99-f230-479d-a905-addfd4a965cd req-1d84079e-22df-4f8f-bbbe-eb5f9c36d55d service nova] Lock "759fbcfd-ab13-438f-b860-6393a97d1205-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:46 user nova-compute[74994]: DEBUG nova.compute.manager [req-f8ff6f99-f230-479d-a905-addfd4a965cd req-1d84079e-22df-4f8f-bbbe-eb5f9c36d55d service nova] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] No waiting events found dispatching network-vif-plugged-7d4a82ba-d222-44bb-baac-6642f24b9528 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:55:46 user nova-compute[74994]: WARNING nova.compute.manager [req-f8ff6f99-f230-479d-a905-addfd4a965cd req-1d84079e-22df-4f8f-bbbe-eb5f9c36d55d service nova] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Received unexpected event network-vif-plugged-7d4a82ba-d222-44bb-baac-6642f24b9528 for instance with vm_state rescued and task_state unrescuing.
Nov 28 10:55:47 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:47 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:47 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:48 user nova-compute[74994]: DEBUG nova.compute.manager [req-499a625e-3f35-4c91-b6a4-f02708641000 req-72f9add7-094f-4789-8761-c33bfffab991 service nova] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Received event network-vif-plugged-7d4a82ba-d222-44bb-baac-6642f24b9528 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:55:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-499a625e-3f35-4c91-b6a4-f02708641000 req-72f9add7-094f-4789-8761-c33bfffab991 service nova] Acquiring lock "759fbcfd-ab13-438f-b860-6393a97d1205-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-499a625e-3f35-4c91-b6a4-f02708641000 req-72f9add7-094f-4789-8761-c33bfffab991 service nova] Lock "759fbcfd-ab13-438f-b860-6393a97d1205-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-499a625e-3f35-4c91-b6a4-f02708641000 req-72f9add7-094f-4789-8761-c33bfffab991 service nova] Lock "759fbcfd-ab13-438f-b860-6393a97d1205-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:48 user nova-compute[74994]: DEBUG nova.compute.manager [req-499a625e-3f35-4c91-b6a4-f02708641000 req-72f9add7-094f-4789-8761-c33bfffab991 service nova] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] No waiting events found dispatching network-vif-plugged-7d4a82ba-d222-44bb-baac-6642f24b9528 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:55:48 user nova-compute[74994]: WARNING nova.compute.manager [req-499a625e-3f35-4c91-b6a4-f02708641000 req-72f9add7-094f-4789-8761-c33bfffab991 service nova] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Received unexpected event network-vif-plugged-7d4a82ba-d222-44bb-baac-6642f24b9528 for instance with vm_state rescued and task_state unrescuing.
Nov 28 10:55:48 user nova-compute[74994]: DEBUG nova.compute.manager [req-499a625e-3f35-4c91-b6a4-f02708641000 req-72f9add7-094f-4789-8761-c33bfffab991 service nova] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Received event network-vif-plugged-7d4a82ba-d222-44bb-baac-6642f24b9528 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:55:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-499a625e-3f35-4c91-b6a4-f02708641000 req-72f9add7-094f-4789-8761-c33bfffab991 service nova] Acquiring lock "759fbcfd-ab13-438f-b860-6393a97d1205-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-499a625e-3f35-4c91-b6a4-f02708641000 req-72f9add7-094f-4789-8761-c33bfffab991 service nova] Lock "759fbcfd-ab13-438f-b860-6393a97d1205-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-499a625e-3f35-4c91-b6a4-f02708641000 req-72f9add7-094f-4789-8761-c33bfffab991 service nova] Lock "759fbcfd-ab13-438f-b860-6393a97d1205-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:48 user nova-compute[74994]: DEBUG nova.compute.manager [req-499a625e-3f35-4c91-b6a4-f02708641000 req-72f9add7-094f-4789-8761-c33bfffab991 service nova] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] No waiting events found dispatching network-vif-plugged-7d4a82ba-d222-44bb-baac-6642f24b9528 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:55:48 user nova-compute[74994]: WARNING nova.compute.manager [req-499a625e-3f35-4c91-b6a4-f02708641000 req-72f9add7-094f-4789-8761-c33bfffab991 service nova] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Received unexpected event network-vif-plugged-7d4a82ba-d222-44bb-baac-6642f24b9528 for instance with vm_state rescued and task_state unrescuing.
Nov 28 10:55:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:50 user nova-compute[74994]: DEBUG nova.compute.manager [None req-98e4db2d-5639-47f5-bfaa-8d9ae546ba60 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 10:55:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "8bce88d5-64b3-450b-b7e0-26a1c5d299c6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "8bce88d5-64b3-450b-b7e0-26a1c5d299c6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:51 user nova-compute[74994]: DEBUG nova.compute.manager [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 10:55:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:51 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 10:55:51 user nova-compute[74994]: INFO nova.compute.claims [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Claim successful on node user
Nov 28 10:55:51 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:55:51 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:55:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.504s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:51 user nova-compute[74994]: DEBUG nova.compute.manager [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 10:55:51 user nova-compute[74994]: DEBUG nova.compute.manager [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 10:55:51 user nova-compute[74994]: DEBUG nova.network.neutron [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 10:55:51 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 10:55:51 user nova-compute[74994]: DEBUG nova.compute.manager [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 10:55:51 user nova-compute[74994]: DEBUG nova.policy [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa362c35530641a687a33182012c2332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636fa9a1f046425e9332cc3807f8fb46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 10:55:52 user nova-compute[74994]: DEBUG nova.compute.manager [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 10:55:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 10:55:52 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Creating image(s)
Nov 28 10:55:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "/opt/stack/data/nova/instances/8bce88d5-64b3-450b-b7e0-26a1c5d299c6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "/opt/stack/data/nova/instances/8bce88d5-64b3-450b-b7e0-26a1c5d299c6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "/opt/stack/data/nova/instances/8bce88d5-64b3-450b-b7e0-26a1c5d299c6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.191s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.190s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/8bce88d5-64b3-450b-b7e0-26a1c5d299c6/disk 1073741824 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/8bce88d5-64b3-450b-b7e0-26a1c5d299c6/disk 1073741824" returned: 0 in 0.053s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.181s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:52 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8bce88d5-64b3-450b-b7e0-26a1c5d299c6/disk. size=1073741824 {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 10:55:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bce88d5-64b3-450b-b7e0-26a1c5d299c6/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:55:52 user nova-compute[74994]: DEBUG nova.network.neutron [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Successfully created port: 6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 10:55:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bce88d5-64b3-450b-b7e0-26a1c5d299c6/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:55:52 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Cannot resize image /opt/stack/data/nova/instances/8bce88d5-64b3-450b-b7e0-26a1c5d299c6/disk to a smaller size. {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 10:55:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Created local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 10:55:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Ensure instance console log exists: /opt/stack/data/nova/instances/8bce88d5-64b3-450b-b7e0-26a1c5d299c6/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 10:55:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG nova.network.neutron [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Successfully updated port: 6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "refresh_cache-8bce88d5-64b3-450b-b7e0-26a1c5d299c6" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquired lock "refresh_cache-8bce88d5-64b3-450b-b7e0-26a1c5d299c6" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG nova.network.neutron [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG nova.compute.manager [req-3507a08e-8ccc-429a-92ea-0fb187182ba4 req-4ac3881c-9c0d-4a19-b02a-a5ee33391b0c service nova] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Received event network-changed-6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG nova.compute.manager [req-3507a08e-8ccc-429a-92ea-0fb187182ba4 req-4ac3881c-9c0d-4a19-b02a-a5ee33391b0c service nova] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Refreshing instance network info cache due to event network-changed-6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-3507a08e-8ccc-429a-92ea-0fb187182ba4 req-4ac3881c-9c0d-4a19-b02a-a5ee33391b0c service nova] Acquiring lock "refresh_cache-8bce88d5-64b3-450b-b7e0-26a1c5d299c6" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG nova.network.neutron [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG nova.network.neutron [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Updating instance_info_cache with network_info: [{"id": "6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a", "address": "fa:16:3e:17:ec:a3", "network": {"id": "d9bcdec6-69e0-4e65-8a26-1af1f8232365", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1227861580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "636fa9a1f046425e9332cc3807f8fb46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bb0f5b6-4a", "ovs_interfaceid": "6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Releasing lock "refresh_cache-8bce88d5-64b3-450b-b7e0-26a1c5d299c6" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG nova.compute.manager [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Instance network_info: |[{"id": "6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a", "address": "fa:16:3e:17:ec:a3", "network": {"id": "d9bcdec6-69e0-4e65-8a26-1af1f8232365", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1227861580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "636fa9a1f046425e9332cc3807f8fb46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bb0f5b6-4a", "ovs_interfaceid": "6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-3507a08e-8ccc-429a-92ea-0fb187182ba4 req-4ac3881c-9c0d-4a19-b02a-a5ee33391b0c service nova] Acquired lock "refresh_cache-8bce88d5-64b3-450b-b7e0-26a1c5d299c6" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG nova.network.neutron [req-3507a08e-8ccc-429a-92ea-0fb187182ba4 req-4ac3881c-9c0d-4a19-b02a-a5ee33391b0c service nova] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Refreshing network info cache for port 6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Start _get_guest_xml network_info=[{"id": "6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a", "address": "fa:16:3e:17:ec:a3", "network": {"id": "d9bcdec6-69e0-4e65-8a26-1af1f8232365", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1227861580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "636fa9a1f046425e9332cc3807f8fb46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bb0f5b6-4a", "ovs_interfaceid": "6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'aa939d1b-b8a6-4391-935b-0191bf5ccd0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 10:55:53 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:55:53 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:55:53 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:55:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-715704735',display_name='tempest-AttachVolumeNegativeTest-server-715704735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-715704735',id=22,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIqUYdv2qX864mCPJ62mRiaUG7GDM8sZKHfXSu+vrSnal0ef3yMg4dhy3vADiPcUNp5z1zQcHoyl9neZkyygAieKrM6/IqE0q5QluSzjkDcv2GyzIt97If/c7559KWk6MA==',key_name='tempest-keypair-159042515',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='636fa9a1f046425e9332cc3807f8fb46',ramdisk_id='',reservation_id='r-9e3z5f7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-3431122',owner_user_name='tempest-AttachVolumeNegativeTest-3431122-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:55:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa362c35530641a687a33182012c2332',uuid=8bce88d5-64b3-450b-b7e0-26a1c5d299c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a", "address": "fa:16:3e:17:ec:a3", "network": {"id": "d9bcdec6-69e0-4e65-8a26-1af1f8232365", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1227861580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "636fa9a1f046425e9332cc3807f8fb46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bb0f5b6-4a", "ovs_interfaceid": "6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Converting VIF {"id": "6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a", "address": "fa:16:3e:17:ec:a3", "network": {"id": "d9bcdec6-69e0-4e65-8a26-1af1f8232365", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1227861580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "636fa9a1f046425e9332cc3807f8fb46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bb0f5b6-4a", "ovs_interfaceid": "6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:ec:a3,bridge_name='br-int',has_traffic_filtering=True,id=6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a,network=Network(d9bcdec6-69e0-4e65-8a26-1af1f8232365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bb0f5b6-4a') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG nova.objects.instance [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lazy-loading 'pci_devices' on Instance uuid 8bce88d5-64b3-450b-b7e0-26a1c5d299c6 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] End _get_guest_xml xml=<domain type="kvm">
Nov 28 10:55:53 user nova-compute[74994]:   <uuid>8bce88d5-64b3-450b-b7e0-26a1c5d299c6</uuid>
Nov 28 10:55:53 user nova-compute[74994]:   <name>instance-00000016</name>
Nov 28 10:55:53 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 10:55:53 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 10:55:53 user nova-compute[74994]:   <metadata>
Nov 28 10:55:53 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 10:55:53 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 10:55:53 user nova-compute[74994]:       <nova:name>tempest-AttachVolumeNegativeTest-server-715704735</nova:name>
Nov 28 10:55:53 user nova-compute[74994]:       <nova:creationTime>2023-11-28 10:55:53</nova:creationTime>
Nov 28 10:55:53 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 10:55:53 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 10:55:53 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 10:55:53 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 10:55:53 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 10:55:53 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 10:55:53 user nova-compute[74994]:       </nova:flavor>
Nov 28 10:55:53 user nova-compute[74994]:       <nova:owner>
Nov 28 10:55:53 user nova-compute[74994]:         <nova:user uuid="aa362c35530641a687a33182012c2332">tempest-AttachVolumeNegativeTest-3431122-project-member</nova:user>
Nov 28 10:55:53 user nova-compute[74994]:         <nova:project uuid="636fa9a1f046425e9332cc3807f8fb46">tempest-AttachVolumeNegativeTest-3431122</nova:project>
Nov 28 10:55:53 user nova-compute[74994]:       </nova:owner>
Nov 28 10:55:53 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 10:55:53 user nova-compute[74994]:       <nova:ports>
Nov 28 10:55:53 user nova-compute[74994]:         <nova:port uuid="6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a">
Nov 28 10:55:53 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 28 10:55:53 user nova-compute[74994]:         </nova:port>
Nov 28 10:55:53 user nova-compute[74994]:       </nova:ports>
Nov 28 10:55:53 user nova-compute[74994]:     </nova:instance>
Nov 28 10:55:53 user nova-compute[74994]:   </metadata>
Nov 28 10:55:53 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 10:55:53 user nova-compute[74994]:     <system>
Nov 28 10:55:53 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 10:55:53 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 10:55:53 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 10:55:53 user nova-compute[74994]:       <entry name="serial">8bce88d5-64b3-450b-b7e0-26a1c5d299c6</entry>
Nov 28 10:55:53 user nova-compute[74994]:       <entry name="uuid">8bce88d5-64b3-450b-b7e0-26a1c5d299c6</entry>
Nov 28 10:55:53 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 10:55:53 user nova-compute[74994]:     </system>
Nov 28 10:55:53 user nova-compute[74994]:   </sysinfo>
Nov 28 10:55:53 user nova-compute[74994]:   <os>
Nov 28 10:55:53 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 10:55:53 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 10:55:53 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 10:55:53 user nova-compute[74994]:   </os>
Nov 28 10:55:53 user nova-compute[74994]:   <features>
Nov 28 10:55:53 user nova-compute[74994]:     <acpi/>
Nov 28 10:55:53 user nova-compute[74994]:     <apic/>
Nov 28 10:55:53 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 10:55:53 user nova-compute[74994]:   </features>
Nov 28 10:55:53 user nova-compute[74994]:   <clock offset="utc">
Nov 28 10:55:53 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 10:55:53 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 10:55:53 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 10:55:53 user nova-compute[74994]:   </clock>
Nov 28 10:55:53 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 10:55:53 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 10:55:53 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 10:55:53 user nova-compute[74994]:   </cpu>
Nov 28 10:55:53 user nova-compute[74994]:   <devices>
Nov 28 10:55:53 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 10:55:53 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 10:55:53 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/8bce88d5-64b3-450b-b7e0-26a1c5d299c6/disk"/>
Nov 28 10:55:53 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 10:55:53 user nova-compute[74994]:     </disk>
Nov 28 10:55:53 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 10:55:53 user nova-compute[74994]:       <mac address="fa:16:3e:17:ec:a3"/>
Nov 28 10:55:53 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:55:53 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 10:55:53 user nova-compute[74994]:       <target dev="tap6bb0f5b6-4a"/>
Nov 28 10:55:53 user nova-compute[74994]:     </interface>
Nov 28 10:55:53 user nova-compute[74994]:     <serial type="pty">
Nov 28 10:55:53 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/8bce88d5-64b3-450b-b7e0-26a1c5d299c6/console.log" append="off"/>
Nov 28 10:55:53 user nova-compute[74994]:     </serial>
Nov 28 10:55:53 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 10:55:53 user nova-compute[74994]:     <video>
Nov 28 10:55:53 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:55:53 user nova-compute[74994]:     </video>
Nov 28 10:55:53 user nova-compute[74994]:     <rng model="virtio">
Nov 28 10:55:53 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 10:55:53 user nova-compute[74994]:     </rng>
Nov 28 10:55:53 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 10:55:53 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 10:55:53 user nova-compute[74994]:       <stats period="10"/>
Nov 28 10:55:53 user nova-compute[74994]:     </memballoon>
Nov 28 10:55:53 user nova-compute[74994]:   </devices>
Nov 28 10:55:53 user nova-compute[74994]: </domain>
Nov 28 10:55:53 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:55:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-715704735',display_name='tempest-AttachVolumeNegativeTest-server-715704735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-715704735',id=22,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIqUYdv2qX864mCPJ62mRiaUG7GDM8sZKHfXSu+vrSnal0ef3yMg4dhy3vADiPcUNp5z1zQcHoyl9neZkyygAieKrM6/IqE0q5QluSzjkDcv2GyzIt97If/c7559KWk6MA==',key_name='tempest-keypair-159042515',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='636fa9a1f046425e9332cc3807f8fb46',ramdisk_id='',reservation_id='r-9e3z5f7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-3431122',owner_user_name='tempest-AttachVolumeNegativeTest-3431122-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:55:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa362c35530641a687a33182012c2332',uuid=8bce88d5-64b3-450b-b7e0-26a1c5d299c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a", "address": "fa:16:3e:17:ec:a3", "network": {"id": "d9bcdec6-69e0-4e65-8a26-1af1f8232365", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1227861580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "636fa9a1f046425e9332cc3807f8fb46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bb0f5b6-4a", "ovs_interfaceid": "6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Converting VIF {"id": "6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a", "address": "fa:16:3e:17:ec:a3", "network": {"id": "d9bcdec6-69e0-4e65-8a26-1af1f8232365", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1227861580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "636fa9a1f046425e9332cc3807f8fb46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bb0f5b6-4a", "ovs_interfaceid": "6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:ec:a3,bridge_name='br-int',has_traffic_filtering=True,id=6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a,network=Network(d9bcdec6-69e0-4e65-8a26-1af1f8232365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bb0f5b6-4a') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG os_vif [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:ec:a3,bridge_name='br-int',has_traffic_filtering=True,id=6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a,network=Network(d9bcdec6-69e0-4e65-8a26-1af1f8232365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bb0f5b6-4a') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cd185d18-c8ed-5ea0-bd5a-861f08019dfb', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6bb0f5b6-4a, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6bb0f5b6-4a, col_values=(('qos', UUID('572c7f18-4643-459a-ba3a-e95ce71b80bb')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6bb0f5b6-4a, col_values=(('external_ids', {'iface-id': '6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:ec:a3', 'vm-uuid': '8bce88d5-64b3-450b-b7e0-26a1c5d299c6'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:55:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:53 user nova-compute[74994]: INFO os_vif [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:ec:a3,bridge_name='br-int',has_traffic_filtering=True,id=6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a,network=Network(d9bcdec6-69e0-4e65-8a26-1af1f8232365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bb0f5b6-4a')
Nov 28 10:55:54 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:55:54 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] No VIF found with MAC fa:16:3e:17:ec:a3, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:55:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:54 user nova-compute[74994]: DEBUG nova.network.neutron [req-3507a08e-8ccc-429a-92ea-0fb187182ba4 req-4ac3881c-9c0d-4a19-b02a-a5ee33391b0c service nova] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Updated VIF entry in instance network info cache for port 6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 10:55:54 user nova-compute[74994]: DEBUG nova.network.neutron [req-3507a08e-8ccc-429a-92ea-0fb187182ba4 req-4ac3881c-9c0d-4a19-b02a-a5ee33391b0c service nova] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Updating instance_info_cache with network_info: [{"id": "6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a", "address": "fa:16:3e:17:ec:a3", "network": {"id": "d9bcdec6-69e0-4e65-8a26-1af1f8232365", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1227861580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "636fa9a1f046425e9332cc3807f8fb46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bb0f5b6-4a", "ovs_interfaceid": "6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:55:54 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-3507a08e-8ccc-429a-92ea-0fb187182ba4 req-4ac3881c-9c0d-4a19-b02a-a5ee33391b0c service nova] Releasing lock "refresh_cache-8bce88d5-64b3-450b-b7e0-26a1c5d299c6" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:55:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:55 user nova-compute[74994]: DEBUG nova.compute.manager [req-e13d2784-81a0-4658-84ff-7b58702e9c1a req-bcab9751-5bff-4d9d-ba63-2bfb1c85509e service nova] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Received event network-vif-plugged-6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:55:55 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-e13d2784-81a0-4658-84ff-7b58702e9c1a req-bcab9751-5bff-4d9d-ba63-2bfb1c85509e service nova] Acquiring lock "8bce88d5-64b3-450b-b7e0-26a1c5d299c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:55 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-e13d2784-81a0-4658-84ff-7b58702e9c1a req-bcab9751-5bff-4d9d-ba63-2bfb1c85509e service nova] Lock "8bce88d5-64b3-450b-b7e0-26a1c5d299c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:55 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-e13d2784-81a0-4658-84ff-7b58702e9c1a req-bcab9751-5bff-4d9d-ba63-2bfb1c85509e service nova] Lock "8bce88d5-64b3-450b-b7e0-26a1c5d299c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:55 user nova-compute[74994]: DEBUG nova.compute.manager [req-e13d2784-81a0-4658-84ff-7b58702e9c1a req-bcab9751-5bff-4d9d-ba63-2bfb1c85509e service nova] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] No waiting events found dispatching network-vif-plugged-6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:55:55 user nova-compute[74994]: WARNING nova.compute.manager [req-e13d2784-81a0-4658-84ff-7b58702e9c1a req-bcab9751-5bff-4d9d-ba63-2bfb1c85509e service nova] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Received unexpected event network-vif-plugged-6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a for instance with vm_state building and task_state spawning.
Nov 28 10:55:56 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:56 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:56 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:56 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:57 user nova-compute[74994]: DEBUG nova.compute.manager [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 10:55:57 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 10:55:57 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Instance spawned successfully.
Nov 28 10:55:57 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 10:55:57 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:55:57 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:55:57 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:55:57 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:55:57 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:55:57 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:55:57 user nova-compute[74994]: DEBUG nova.compute.manager [req-4d57ca6b-a65c-48e3-8901-f8753f31ce09 req-21aff069-f828-4371-98b0-74748ad12157 service nova] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Received event network-vif-plugged-6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:55:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4d57ca6b-a65c-48e3-8901-f8753f31ce09 req-21aff069-f828-4371-98b0-74748ad12157 service nova] Acquiring lock "8bce88d5-64b3-450b-b7e0-26a1c5d299c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:55:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4d57ca6b-a65c-48e3-8901-f8753f31ce09 req-21aff069-f828-4371-98b0-74748ad12157 service nova] Lock "8bce88d5-64b3-450b-b7e0-26a1c5d299c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:55:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4d57ca6b-a65c-48e3-8901-f8753f31ce09 req-21aff069-f828-4371-98b0-74748ad12157 service nova] Lock "8bce88d5-64b3-450b-b7e0-26a1c5d299c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:57 user nova-compute[74994]: DEBUG nova.compute.manager [req-4d57ca6b-a65c-48e3-8901-f8753f31ce09 req-21aff069-f828-4371-98b0-74748ad12157 service nova] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] No waiting events found dispatching network-vif-plugged-6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:55:57 user nova-compute[74994]: WARNING nova.compute.manager [req-4d57ca6b-a65c-48e3-8901-f8753f31ce09 req-21aff069-f828-4371-98b0-74748ad12157 service nova] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Received unexpected event network-vif-plugged-6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a for instance with vm_state building and task_state spawning.
Nov 28 10:55:57 user nova-compute[74994]: INFO nova.compute.manager [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Took 5.65 seconds to spawn the instance on the hypervisor.
Nov 28 10:55:57 user nova-compute[74994]: DEBUG nova.compute.manager [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 10:55:57 user nova-compute[74994]: INFO nova.compute.manager [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Took 6.49 seconds to build instance.
Nov 28 10:55:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2fe3857c-09fb-41f1-a9dc-8575b398ce24 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "8bce88d5-64b3-450b-b7e0-26a1c5d299c6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.596s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:55:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:55:59 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:04 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:56:05 user nova-compute[74994]: DEBUG nova.compute.manager [req-b9ac1886-b2f2-4363-be59-559ae543c5e5 req-a802e1fe-814b-48ff-a134-7e22d30f4df7 service nova] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Received event network-changed-b7041f22-1202-44d0-848a-3a3019d64e28 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:56:05 user nova-compute[74994]: DEBUG nova.compute.manager [req-b9ac1886-b2f2-4363-be59-559ae543c5e5 req-a802e1fe-814b-48ff-a134-7e22d30f4df7 service nova] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Refreshing instance network info cache due to event network-changed-b7041f22-1202-44d0-848a-3a3019d64e28. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:56:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-b9ac1886-b2f2-4363-be59-559ae543c5e5 req-a802e1fe-814b-48ff-a134-7e22d30f4df7 service nova] Acquiring lock "refresh_cache-857e3cbc-af52-46f6-9b59-87bae405f009" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:56:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-b9ac1886-b2f2-4363-be59-559ae543c5e5 req-a802e1fe-814b-48ff-a134-7e22d30f4df7 service nova] Acquired lock "refresh_cache-857e3cbc-af52-46f6-9b59-87bae405f009" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:56:05 user nova-compute[74994]: DEBUG nova.network.neutron [req-b9ac1886-b2f2-4363-be59-559ae543c5e5 req-a802e1fe-814b-48ff-a134-7e22d30f4df7 service nova] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Refreshing network info cache for port b7041f22-1202-44d0-848a-3a3019d64e28 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:56:05 user nova-compute[74994]: DEBUG nova.network.neutron [req-b9ac1886-b2f2-4363-be59-559ae543c5e5 req-a802e1fe-814b-48ff-a134-7e22d30f4df7 service nova] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Updated VIF entry in instance network info cache for port b7041f22-1202-44d0-848a-3a3019d64e28. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 10:56:05 user nova-compute[74994]: DEBUG nova.network.neutron [req-b9ac1886-b2f2-4363-be59-559ae543c5e5 req-a802e1fe-814b-48ff-a134-7e22d30f4df7 service nova] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Updating instance_info_cache with network_info: [{"id": "b7041f22-1202-44d0-848a-3a3019d64e28", "address": "fa:16:3e:37:c1:48", "network": {"id": "eaf51f61-18e2-4b5d-a014-e8c14a30dd64", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-390069039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ad067812a804757a4326e0ed01ebee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7041f22-12", "ovs_interfaceid": "b7041f22-1202-44d0-848a-3a3019d64e28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:56:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-b9ac1886-b2f2-4363-be59-559ae543c5e5 req-a802e1fe-814b-48ff-a134-7e22d30f4df7 service nova] Releasing lock "refresh_cache-857e3cbc-af52-46f6-9b59-87bae405f009" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:56:06 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:56:06 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 10:56:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Acquiring lock "857e3cbc-af52-46f6-9b59-87bae405f009" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:56:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Lock "857e3cbc-af52-46f6-9b59-87bae405f009" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:56:07 user nova-compute[74994]: DEBUG nova.objects.instance [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Lazy-loading 'flavor' on Instance uuid 857e3cbc-af52-46f6-9b59-87bae405f009 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:56:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Lock "857e3cbc-af52-46f6-9b59-87bae405f009" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:56:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Acquiring lock "857e3cbc-af52-46f6-9b59-87bae405f009" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:56:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Lock "857e3cbc-af52-46f6-9b59-87bae405f009" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:56:07 user nova-compute[74994]: INFO nova.compute.manager [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Attaching volume f9d62de7-a7d8-402f-b8ac-4af182b3a7eb to /dev/sdc
Nov 28 10:56:08 user nova-compute[74994]: DEBUG os_brick.utils [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:56:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:08 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c7a47f-9076-4288-94ce-545342cff50d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:08 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb53b04-f7e0-4c2a-a9a1-6d523a134fc6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:08 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe0c9b5-17de-4dfd-816e-902ae6f5a8a2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:08 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b9d880-bf43-477e-8365-cd3448a19a45]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:56:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 10:56:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:56:08 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 10:56:08 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea42335-02bf-480a-b16c-c5a7a82fedba]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 10:56:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 10:56:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 10:56:08 user nova-compute[74994]: DEBUG os_brick.utils [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:56:08 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Updating existing volume attachment record: 2c62920b-d97c-4302-a183-f2902b2505f8 {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 10:56:08 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:56:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:09 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:56:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:56:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:56:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:56:09 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 10:56:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bce88d5-64b3-450b-b7e0-26a1c5d299c6/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bce88d5-64b3-450b-b7e0-26a1c5d299c6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bce88d5-64b3-450b-b7e0-26a1c5d299c6/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bce88d5-64b3-450b-b7e0-26a1c5d299c6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:11 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 10:56:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:12 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 10:56:12 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 10:56:12 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 10:56:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/857e3cbc-af52-46f6-9b59-87bae405f009/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/857e3cbc-af52-46f6-9b59-87bae405f009/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/857e3cbc-af52-46f6-9b59-87bae405f009/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/857e3cbc-af52-46f6-9b59-87bae405f009/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b51d690-8198-4748-807d-1902e75564b9/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b51d690-8198-4748-807d-1902e75564b9/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b51d690-8198-4748-807d-1902e75564b9/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b51d690-8198-4748-807d-1902e75564b9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:13 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 10:56:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:14 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:56:14 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:56:14 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=7243MB free_disk=25.246047973632812GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 10:56:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:56:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:56:14 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:56:14 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance bf357856-2d97-42e8-928d-71d0378f48c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:56:14 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 279e1c4c-36f9-492f-ab3f-1b587347eadd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:56:14 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 5b51d690-8198-4748-807d-1902e75564b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:56:14 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 759fbcfd-ab13-438f-b860-6393a97d1205 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:56:14 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:56:14 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:56:14 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 20716905-c56a-4729-8c5b-9188502dc477 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:56:14 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 857e3cbc-af52-46f6-9b59-87bae405f009 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:56:14 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 2f4b631a-46c8-4f9b-b5f9-6e2542484658 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:56:14 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance ab5b6240-0510-48fb-bbf5-104696eb52d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:56:14 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 8bce88d5-64b3-450b-b7e0-26a1c5d299c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:56:14 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 10:56:14 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 10:56:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6b874694-f190-4a4c-80fc-e1525f016858 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Acquiring lock "b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:56:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6b874694-f190-4a4c-80fc-e1525f016858 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Lock "b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:56:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6b874694-f190-4a4c-80fc-e1525f016858 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Acquiring lock "b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:56:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6b874694-f190-4a4c-80fc-e1525f016858 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Lock "b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:56:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6b874694-f190-4a4c-80fc-e1525f016858 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Lock "b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:56:14 user nova-compute[74994]: INFO nova.compute.manager [None req-6b874694-f190-4a4c-80fc-e1525f016858 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Terminating instance
Nov 28 10:56:14 user nova-compute[74994]: DEBUG nova.compute.manager [None req-6b874694-f190-4a4c-80fc-e1525f016858 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 10:56:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:14 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:56:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:14 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:56:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:14 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 10:56:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.575s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:56:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:14 user nova-compute[74994]: DEBUG nova.compute.manager [req-d766caf6-6900-4a39-b4cb-da52e1eae81a req-863c5a7f-1e57-4150-9862-3844c5f8a648 service nova] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Received event network-vif-unplugged-4dfa3aa6-df94-4d84-ac44-2e0c807640bb {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:56:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d766caf6-6900-4a39-b4cb-da52e1eae81a req-863c5a7f-1e57-4150-9862-3844c5f8a648 service nova] Acquiring lock "b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:56:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d766caf6-6900-4a39-b4cb-da52e1eae81a req-863c5a7f-1e57-4150-9862-3844c5f8a648 service nova] Lock "b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:56:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d766caf6-6900-4a39-b4cb-da52e1eae81a req-863c5a7f-1e57-4150-9862-3844c5f8a648 service nova] Lock "b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:56:14 user nova-compute[74994]: DEBUG nova.compute.manager [req-d766caf6-6900-4a39-b4cb-da52e1eae81a req-863c5a7f-1e57-4150-9862-3844c5f8a648 service nova] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] No waiting events found dispatching network-vif-unplugged-4dfa3aa6-df94-4d84-ac44-2e0c807640bb {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:56:14 user nova-compute[74994]: DEBUG nova.compute.manager [req-d766caf6-6900-4a39-b4cb-da52e1eae81a req-863c5a7f-1e57-4150-9862-3844c5f8a648 service nova] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Received event network-vif-unplugged-4dfa3aa6-df94-4d84-ac44-2e0c807640bb for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 10:56:15 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Instance destroyed successfully.
Nov 28 10:56:15 user nova-compute[74994]: DEBUG nova.objects.instance [None req-6b874694-f190-4a4c-80fc-e1525f016858 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Lazy-loading 'resources' on Instance uuid b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-6b874694-f190-4a4c-80fc-e1525f016858 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:53:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-334407463',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-334407463',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3344074',id=17,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAZD7cCV7qdiRDWORJYCVPD9BojVA/1PpPODS5g7foZBf4nGVbj2vd37Q5iWC7o7bL/HIvxEvdfj3u8xJu1kfOZQQZiLcun8yBQtArxEann9z8uDB+QC+TyTIenS55e+g==',key_name='tempest-keypair-722068600',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:53:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9120da612e254822a611672d14e37690',ramdisk_id='',reservation_id='r-842ks1jt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2035264822',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T10:53:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89011c8506684d7c8334479ceb563468',uuid=b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4dfa3aa6-df94-4d84-ac44-2e0c807640bb", "address": "fa:16:3e:ab:1e:fc", "network": {"id": "aeb89ffc-c2f3-4a19-b7cb-e273021f655a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-334414746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9120da612e254822a611672d14e37690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dfa3aa6-df", "ovs_interfaceid": "4dfa3aa6-df94-4d84-ac44-2e0c807640bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-6b874694-f190-4a4c-80fc-e1525f016858 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Converting VIF {"id": "4dfa3aa6-df94-4d84-ac44-2e0c807640bb", "address": "fa:16:3e:ab:1e:fc", "network": {"id": "aeb89ffc-c2f3-4a19-b7cb-e273021f655a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-334414746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9120da612e254822a611672d14e37690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dfa3aa6-df", "ovs_interfaceid": "4dfa3aa6-df94-4d84-ac44-2e0c807640bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-6b874694-f190-4a4c-80fc-e1525f016858 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:1e:fc,bridge_name='br-int',has_traffic_filtering=True,id=4dfa3aa6-df94-4d84-ac44-2e0c807640bb,network=Network(aeb89ffc-c2f3-4a19-b7cb-e273021f655a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dfa3aa6-df') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG os_vif [None req-6b874694-f190-4a4c-80fc-e1525f016858 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:1e:fc,bridge_name='br-int',has_traffic_filtering=True,id=4dfa3aa6-df94-4d84-ac44-2e0c807640bb,network=Network(aeb89ffc-c2f3-4a19-b7cb-e273021f655a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dfa3aa6-df') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4dfa3aa6-df, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ce1c5c89-5e17-4bff-9aa8-95715031bdab) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:15 user nova-compute[74994]: INFO os_vif [None req-6b874694-f190-4a4c-80fc-e1525f016858 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:1e:fc,bridge_name='br-int',has_traffic_filtering=True,id=4dfa3aa6-df94-4d84-ac44-2e0c807640bb,network=Network(aeb89ffc-c2f3-4a19-b7cb-e273021f655a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dfa3aa6-df')
Nov 28 10:56:15 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-6b874694-f190-4a4c-80fc-e1525f016858 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Deleting instance files /opt/stack/data/nova/instances/b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6_del
Nov 28 10:56:15 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-6b874694-f190-4a4c-80fc-e1525f016858 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Deletion of /opt/stack/data/nova/instances/b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6_del complete
Nov 28 10:56:15 user nova-compute[74994]: INFO nova.compute.manager [None req-6b874694-f190-4a4c-80fc-e1525f016858 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 28 10:56:15 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-6b874694-f190-4a4c-80fc-e1525f016858 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LYoIDJSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:56:15 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:56:15 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:56:15 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:56:15 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:56:15 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 10:56:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11f68b3-4f1a-43c7-9a70-19149acb07b1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 10:56:15 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8174570-181f-47eb-a708-18b150fbb9d7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb] added
Nov 28 10:56:15 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[506fee5f-0e71-4e3b-9597-9913a1575831]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd6e01d-bd37-4533-9e09-fdeee281308e]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LYoIDJSH {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LYoIDJSH" returned: 0 in 0.031s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42b2143-f35d-485e-838a-3ebf0c4d412e]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LYoIDJSH'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a339850a-ff83-446b-9ed4-14e38f2a9872]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[554f8c2a-7ca2-47b7-93c3-f67bcb3754c4]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:56:15 user nova-compute[74994]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)
Nov 28 10:56:15 user nova-compute[74994]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb (non-flash)
Nov 28 10:56:15 user nova-compute[74994]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f (non-flash)
Nov 28 10:56:15 user nova-compute[74994]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)
Nov 28 10:56:15 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:56:15 user nova-compute[74994]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)
Nov 28 10:56:15 user nova-compute[74994]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb (non-flash)
Nov 28 10:56:15 user nova-compute[74994]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f (non-flash)
Nov 28 10:56:15 user nova-compute[74994]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)
Nov 28 10:56:15 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb02d39-313a-45ee-89f2-00757351ca7d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb, portal: 172.16.0.220,3260]
Nov 28 10:56:15 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb, portal: 172.16.0.220,3260] successful.
Nov 28 10:56:15 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Didn't find any instances for network info cache update. {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc316a9-3e7d-4869-a66c-dfcd6a7da251]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0537f38b-b21a-43e9-8171-eab664f62343]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:56:15 user nova-compute[74994]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)
Nov 28 10:56:15 user nova-compute[74994]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb (non-flash)
Nov 28 10:56:15 user nova-compute[74994]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f (non-flash)
Nov 28 10:56:15 user nova-compute[74994]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)
Nov 28 10:56:15 user nova-compute[74994]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb (non-flash)
Nov 28 10:56:15 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:56:15 user nova-compute[74994]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)
Nov 28 10:56:15 user nova-compute[74994]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb (non-flash)
Nov 28 10:56:15 user nova-compute[74994]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f (non-flash)
Nov 28 10:56:15 user nova-compute[74994]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)
Nov 28 10:56:15 user nova-compute[74994]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb (non-flash)
Nov 28 10:56:15 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:56:15 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 10:56:16 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] HCTL ('37', '-', '-', 0) found on session 21 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 10:56:16 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 10:56:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.033s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:16 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54638bb-2bc6-4944-806b-3918523915df]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:16 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Searching for a device in session 21 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 10:56:16 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LYoIDJSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 10:56:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:16 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:56:16 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Took 1.21 seconds to deallocate network for instance.
Nov 28 10:56:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6b874694-f190-4a4c-80fc-e1525f016858 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:56:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6b874694-f190-4a4c-80fc-e1525f016858 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:56:17 user nova-compute[74994]: DEBUG nova.compute.manager [req-cd1f2580-6323-4a8f-b4a3-0e3e9ce25cee req-c93dc59f-f5ae-44f3-80b9-ac835cdebea7 service nova] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Received event network-vif-plugged-4dfa3aa6-df94-4d84-ac44-2e0c807640bb {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:56:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-cd1f2580-6323-4a8f-b4a3-0e3e9ce25cee req-c93dc59f-f5ae-44f3-80b9-ac835cdebea7 service nova] Acquiring lock "b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:56:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-cd1f2580-6323-4a8f-b4a3-0e3e9ce25cee req-c93dc59f-f5ae-44f3-80b9-ac835cdebea7 service nova] Lock "b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:56:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-cd1f2580-6323-4a8f-b4a3-0e3e9ce25cee req-c93dc59f-f5ae-44f3-80b9-ac835cdebea7 service nova] Lock "b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:56:17 user nova-compute[74994]: DEBUG nova.compute.manager [req-cd1f2580-6323-4a8f-b4a3-0e3e9ce25cee req-c93dc59f-f5ae-44f3-80b9-ac835cdebea7 service nova] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] No waiting events found dispatching network-vif-plugged-4dfa3aa6-df94-4d84-ac44-2e0c807640bb {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:56:17 user nova-compute[74994]: WARNING nova.compute.manager [req-cd1f2580-6323-4a8f-b4a3-0e3e9ce25cee req-c93dc59f-f5ae-44f3-80b9-ac835cdebea7 service nova] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Received unexpected event network-vif-plugged-4dfa3aa6-df94-4d84-ac44-2e0c807640bb for instance with vm_state deleted and task_state None.
Nov 28 10:56:17 user nova-compute[74994]: DEBUG nova.compute.manager [req-cd1f2580-6323-4a8f-b4a3-0e3e9ce25cee req-c93dc59f-f5ae-44f3-80b9-ac835cdebea7 service nova] [instance: b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6] Received event network-vif-deleted-4dfa3aa6-df94-4d84-ac44-2e0c807640bb {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:56:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:56:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '23465346330643239', 'path': '/dev/sdf'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:56:17 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465346330643239', 'path': '/dev/sdf'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 10:56:17 user nova-compute[74994]: DEBUG nova.objects.instance [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Lazy-loading 'flavor' on Instance uuid 857e3cbc-af52-46f6-9b59-87bae405f009 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:56:17 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 10:56:17 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 10:56:17 user nova-compute[74994]:   <source dev="/dev/sdf"/>
Nov 28 10:56:17 user nova-compute[74994]:   <target dev="sdc" bus="scsi"/>
Nov 28 10:56:17 user nova-compute[74994]:   <serial>f9d62de7-a7d8-402f-b8ac-4af182b3a7eb</serial>
Nov 28 10:56:17 user nova-compute[74994]:   <address type="drive" controller="0" unit="2"/>
Nov 28 10:56:17 user nova-compute[74994]: </disk>
Nov 28 10:56:17 user nova-compute[74994]:  {{(pid=74994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 10:56:17 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-6b874694-f190-4a4c-80fc-e1525f016858 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:56:17 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-6b874694-f190-4a4c-80fc-e1525f016858 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:56:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6b874694-f190-4a4c-80fc-e1525f016858 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:56:17 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-6b874694-f190-4a4c-80fc-e1525f016858 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Deleted allocations for instance b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6
Nov 28 10:56:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6b874694-f190-4a4c-80fc-e1525f016858 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822 tempest-TestServerVolumeAttachScenarioOldVersion-2035264822-project-member] Lock "b6b33f80-b3a4-4bbe-b9c0-d5992b35e7a6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.737s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:56:17 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] No BDM found with device name sda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:56:17 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:56:17 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:56:17 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] No VIF found with MAC fa:16:3e:37:c1:48, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:56:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-781baa18-5a75-429b-b135-803ce01ac34d tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Lock "857e3cbc-af52-46f6-9b59-87bae405f009" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.741s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:56:19 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-15866bfc-a61f-4c08-9833-01e9b55eb5da tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Acquiring lock "857e3cbc-af52-46f6-9b59-87bae405f009" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:56:19 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-15866bfc-a61f-4c08-9833-01e9b55eb5da tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Lock "857e3cbc-af52-46f6-9b59-87bae405f009" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:56:19 user nova-compute[74994]: INFO nova.compute.manager [None req-15866bfc-a61f-4c08-9833-01e9b55eb5da tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Detaching volume f9d62de7-a7d8-402f-b8ac-4af182b3a7eb
Nov 28 10:56:19 user nova-compute[74994]: INFO nova.virt.block_device [None req-15866bfc-a61f-4c08-9833-01e9b55eb5da tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Attempting to driver detach volume f9d62de7-a7d8-402f-b8ac-4af182b3a7eb from mountpoint /dev/sdc
Nov 28 10:56:19 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-15866bfc-a61f-4c08-9833-01e9b55eb5da tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Attempting to detach device sdc from instance 857e3cbc-af52-46f6-9b59-87bae405f009 from the persistent domain config. {{(pid=74994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 10:56:19 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-15866bfc-a61f-4c08-9833-01e9b55eb5da tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 10:56:19 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 10:56:19 user nova-compute[74994]:   <source dev="/dev/sdf"/>
Nov 28 10:56:19 user nova-compute[74994]:   <target dev="sdc" bus="scsi"/>
Nov 28 10:56:19 user nova-compute[74994]:   <serial>f9d62de7-a7d8-402f-b8ac-4af182b3a7eb</serial>
Nov 28 10:56:19 user nova-compute[74994]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 28 10:56:19 user nova-compute[74994]: </disk>
Nov 28 10:56:19 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 10:56:19 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-15866bfc-a61f-4c08-9833-01e9b55eb5da tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Successfully detached device sdc from instance 857e3cbc-af52-46f6-9b59-87bae405f009 from the persistent domain config.
Nov 28 10:56:19 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-15866bfc-a61f-4c08-9833-01e9b55eb5da tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 857e3cbc-af52-46f6-9b59-87bae405f009 from the live domain config. {{(pid=74994) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 10:56:19 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-15866bfc-a61f-4c08-9833-01e9b55eb5da tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 10:56:19 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 10:56:19 user nova-compute[74994]:   <source dev="/dev/sdf"/>
Nov 28 10:56:19 user nova-compute[74994]:   <target dev="sdc" bus="scsi"/>
Nov 28 10:56:19 user nova-compute[74994]:   <serial>f9d62de7-a7d8-402f-b8ac-4af182b3a7eb</serial>
Nov 28 10:56:19 user nova-compute[74994]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 28 10:56:19 user nova-compute[74994]: </disk>
Nov 28 10:56:19 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 10:56:19 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:19 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-15866bfc-a61f-4c08-9833-01e9b55eb5da tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 857e3cbc-af52-46f6-9b59-87bae405f009 {{(pid=74994) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 10:56:19 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:21 user nova-compute[74994]: DEBUG nova.compute.manager [req-3687cce3-5eda-4fbe-97fd-546510f48c59 req-2310bd48-63c4-4219-8504-7916020b043f service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Received event network-changed-068080a2-5847-4053-a463-9fc29cb64bb4 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:56:21 user nova-compute[74994]: DEBUG nova.compute.manager [req-3687cce3-5eda-4fbe-97fd-546510f48c59 req-2310bd48-63c4-4219-8504-7916020b043f service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Refreshing instance network info cache due to event network-changed-068080a2-5847-4053-a463-9fc29cb64bb4. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:56:21 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-3687cce3-5eda-4fbe-97fd-546510f48c59 req-2310bd48-63c4-4219-8504-7916020b043f service nova] Acquiring lock "refresh_cache-2f4b631a-46c8-4f9b-b5f9-6e2542484658" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:56:21 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-3687cce3-5eda-4fbe-97fd-546510f48c59 req-2310bd48-63c4-4219-8504-7916020b043f service nova] Acquired lock "refresh_cache-2f4b631a-46c8-4f9b-b5f9-6e2542484658" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:56:21 user nova-compute[74994]: DEBUG nova.network.neutron [req-3687cce3-5eda-4fbe-97fd-546510f48c59 req-2310bd48-63c4-4219-8504-7916020b043f service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Refreshing network info cache for port 068080a2-5847-4053-a463-9fc29cb64bb4 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:56:22 user nova-compute[74994]: DEBUG nova.network.neutron [req-3687cce3-5eda-4fbe-97fd-546510f48c59 req-2310bd48-63c4-4219-8504-7916020b043f service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Updated VIF entry in instance network info cache for port 068080a2-5847-4053-a463-9fc29cb64bb4. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 10:56:22 user nova-compute[74994]: DEBUG nova.network.neutron [req-3687cce3-5eda-4fbe-97fd-546510f48c59 req-2310bd48-63c4-4219-8504-7916020b043f service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Updating instance_info_cache with network_info: [{"id": "068080a2-5847-4053-a463-9fc29cb64bb4", "address": "fa:16:3e:21:e9:f5", "network": {"id": "844b3eab-57f3-4582-9fcc-04594e44081b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-233988918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33727b28c7d94b7bbe8987c1301eec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068080a2-58", "ovs_interfaceid": "068080a2-5847-4053-a463-9fc29cb64bb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:56:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-3687cce3-5eda-4fbe-97fd-546510f48c59 req-2310bd48-63c4-4219-8504-7916020b043f service nova] Releasing lock "refresh_cache-2f4b631a-46c8-4f9b-b5f9-6e2542484658" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:56:22 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Acquiring lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:56:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:56:24 user nova-compute[74994]: DEBUG nova.objects.instance [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lazy-loading 'flavor' on Instance uuid 2f4b631a-46c8-4f9b-b5f9-6e2542484658 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:56:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:56:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Acquiring lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:56:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:56:24 user nova-compute[74994]: INFO nova.compute.manager [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Attaching volume dbafc9fb-40fc-4788-8115-7bfe2a0c53cb to /dev/vdb
Nov 28 10:56:24 user nova-compute[74994]: DEBUG os_brick.utils [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:56:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:24 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a88a19-0d29-49e7-a683-4c31c036a16b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:24 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5c0353-f2cd-47e7-848a-03d8eb64a4bc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:24 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fd0768-f3c6-48d1-89bf-ce038457e10a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:24 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12d5380-2744-4a86-bdfa-1bf53bbc55ed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:56:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 10:56:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:56:24 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 10:56:24 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a18153-31a9-4141-bf57-0fbdaf2428e5]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 10:56:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 10:56:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 10:56:24 user nova-compute[74994]: DEBUG os_brick.utils [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:56:24 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Updating existing volume attachment record: a8106954-adb4-48fd-84a9-f3ad02e5ef65 {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 10:56:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:32 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 10:56:32 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXFPpJyM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:56:32 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:56:32 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:56:32 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:56:32 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:56:32 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:56:32 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:56:32 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 10:56:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:32 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7eb823-7968-4a2c-a598-626a3f9e173b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:32 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 10:56:32 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:56:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:32 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d68e608-e8e7-4e5f-aef3-803851b3ffc5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:32 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb] added
Nov 28 10:56:32 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:56:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:32 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[364f1059-24e4-494c-b55e-8554ce0a7336]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:32 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:56:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:32 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[033bbd6b-8ab8-4879-9f82-7c0e73566d61]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:32 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:56:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EXFPpJyM {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EXFPpJyM" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:32 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[826d1039-30dc-4e31-aa1b-87640475ab4d]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:32 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EXFPpJyM'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:56:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:32 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1004ae99-a66c-4058-8c86-542b85f12f7d]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:32 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:56:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:32 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b342162-c894-4373-add5-e6a4beffcabd]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:32 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:56:32 user nova-compute[74994]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)
Nov 28 10:56:32 user nova-compute[74994]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb (non-flash)
Nov 28 10:56:32 user nova-compute[74994]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f (non-flash)
Nov 28 10:56:32 user nova-compute[74994]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)
Nov 28 10:56:32 user nova-compute[74994]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb (non-flash)
Nov 28 10:56:32 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:56:32 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:56:32 user nova-compute[74994]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)
Nov 28 10:56:32 user nova-compute[74994]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb (non-flash)
Nov 28 10:56:32 user nova-compute[74994]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f (non-flash)
Nov 28 10:56:32 user nova-compute[74994]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)
Nov 28 10:56:32 user nova-compute[74994]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb (non-flash)
Nov 28 10:56:32 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:56:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:32 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee30471f-c950-48dc-abf2-7a76d6b0a185]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:32 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb, portal: 172.16.0.220,3260]
Nov 28 10:56:32 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb, portal: 172.16.0.220,3260] successful.
Nov 28 10:56:32 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:56:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:32 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a39987-c314-49d3-b602-f25fa1998440]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:32 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:56:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:33 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e90edad-b55a-48f9-9c0c-76cb41f4e718]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:56:33 user nova-compute[74994]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)
Nov 28 10:56:33 user nova-compute[74994]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb (non-flash)
Nov 28 10:56:33 user nova-compute[74994]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f (non-flash)
Nov 28 10:56:33 user nova-compute[74994]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)
Nov 28 10:56:33 user nova-compute[74994]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb (non-flash)
Nov 28 10:56:33 user nova-compute[74994]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 10:56:33 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:56:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:56:33 user nova-compute[74994]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)
Nov 28 10:56:33 user nova-compute[74994]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb (non-flash)
Nov 28 10:56:33 user nova-compute[74994]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f (non-flash)
Nov 28 10:56:33 user nova-compute[74994]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)
Nov 28 10:56:33 user nova-compute[74994]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb (non-flash)
Nov 28 10:56:33 user nova-compute[74994]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 10:56:33 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:56:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:56:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 10:56:33 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] HCTL ('39', '-', '-', 0) found on session 22 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 10:56:33 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 10:56:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:33 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea171ab1-ada6-4a2d-bfc4-577abc91f892]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:33 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Searching for a device in session 22 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 10:56:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXFPpJyM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 10:56:34 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:56:34 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '26165336339613339', 'path': '/dev/sdh'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:56:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165336339613339', 'path': '/dev/sdh'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 10:56:34 user nova-compute[74994]: DEBUG nova.objects.instance [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lazy-loading 'flavor' on Instance uuid 2f4b631a-46c8-4f9b-b5f9-6e2542484658 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:56:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 10:56:34 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 10:56:34 user nova-compute[74994]:   <source dev="/dev/sdh"/>
Nov 28 10:56:34 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 10:56:34 user nova-compute[74994]:   <serial>dbafc9fb-40fc-4788-8115-7bfe2a0c53cb</serial>
Nov 28 10:56:34 user nova-compute[74994]: </disk>
Nov 28 10:56:34 user nova-compute[74994]:  {{(pid=74994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 10:56:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:56:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:56:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] No VIF found with MAC fa:16:3e:21:e9:f5, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:56:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1ca2cec6-6c4d-4d3f-8619-22fc58365d2f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.113s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:56:35 user nova-compute[74994]: DEBUG nova.compute.manager [req-423e3736-16a1-4ce7-a4b2-827ee153324b req-8879ea4a-e210-4176-8c7b-450f868afda3 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received event network-changed-18e1fc8f-76a7-400e-bcde-5178f8b061bd {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:56:35 user nova-compute[74994]: DEBUG nova.compute.manager [req-423e3736-16a1-4ce7-a4b2-827ee153324b req-8879ea4a-e210-4176-8c7b-450f868afda3 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Refreshing instance network info cache due to event network-changed-18e1fc8f-76a7-400e-bcde-5178f8b061bd. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:56:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-423e3736-16a1-4ce7-a4b2-827ee153324b req-8879ea4a-e210-4176-8c7b-450f868afda3 service nova] Acquiring lock "refresh_cache-ab5b6240-0510-48fb-bbf5-104696eb52d7" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:56:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-423e3736-16a1-4ce7-a4b2-827ee153324b req-8879ea4a-e210-4176-8c7b-450f868afda3 service nova] Acquired lock "refresh_cache-ab5b6240-0510-48fb-bbf5-104696eb52d7" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:56:35 user nova-compute[74994]: DEBUG nova.network.neutron [req-423e3736-16a1-4ce7-a4b2-827ee153324b req-8879ea4a-e210-4176-8c7b-450f868afda3 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Refreshing network info cache for port 18e1fc8f-76a7-400e-bcde-5178f8b061bd {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:56:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6ad8ff96-af31-4d47-bb27-a2d7195bf4b5 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Acquiring lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:56:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6ad8ff96-af31-4d47-bb27-a2d7195bf4b5 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:56:35 user nova-compute[74994]: DEBUG nova.compute.manager [None req-6ad8ff96-af31-4d47-bb27-a2d7195bf4b5 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 10:56:35 user nova-compute[74994]: DEBUG nova.compute.manager [None req-6ad8ff96-af31-4d47-bb27-a2d7195bf4b5 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74994) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 28 10:56:35 user nova-compute[74994]: DEBUG nova.objects.instance [None req-6ad8ff96-af31-4d47-bb27-a2d7195bf4b5 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lazy-loading 'flavor' on Instance uuid 2f4b631a-46c8-4f9b-b5f9-6e2542484658 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:56:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:35 user nova-compute[74994]: DEBUG nova.network.neutron [req-423e3736-16a1-4ce7-a4b2-827ee153324b req-8879ea4a-e210-4176-8c7b-450f868afda3 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Updated VIF entry in instance network info cache for port 18e1fc8f-76a7-400e-bcde-5178f8b061bd. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 10:56:35 user nova-compute[74994]: DEBUG nova.network.neutron [req-423e3736-16a1-4ce7-a4b2-827ee153324b req-8879ea4a-e210-4176-8c7b-450f868afda3 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Updating instance_info_cache with network_info: [{"id": "18e1fc8f-76a7-400e-bcde-5178f8b061bd", "address": "fa:16:3e:5f:2c:f1", "network": {"id": "c6d0db1d-6898-4ee2-bd5d-cc190c70128f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-510684947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18e1fc8f-76", "ovs_interfaceid": "18e1fc8f-76a7-400e-bcde-5178f8b061bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50", "address": "fa:16:3e:cb:7d:77", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cdf27ff-58", "ovs_interfaceid": "9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3d8a5004-44ff-4247-b63e-9cc70b4c91e7", "address": "fa:16:3e:15:89:0f", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8a5004-44", "ovs_interfaceid": "3d8a5004-44ff-4247-b63e-9cc70b4c91e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "df9a6a76-006b-4adc-9e84-ee61d037da31", "address": "fa:16:3e:78:52:33", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf9a6a76-00", "ovs_interfaceid": "df9a6a76-006b-4adc-9e84-ee61d037da31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0c67dc60-232f-45b1-b637-48db3477ce20", "address": "fa:16:3e:89:ae:7a", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c67dc60-23", "ovs_interfaceid": "0c67dc60-232f-45b1-b637-48db3477ce20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "64313c64-2811-46b0-8953-8b80db3604a2", "address": "fa:16:3e:95:6b:d7", "network": {"id": "12f2a6c7-ea1a-4a67-9b24-50b67341a827", "bridge": "br-int", "label": "tempest-device-tagging-net2-1808297123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64313c64-28", "ovs_interfaceid": "64313c64-2811-46b0-8953-8b80db3604a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f27415ef-3b18-4406-8cc2-f5bd07325d95", "address": "fa:16:3e:25:6c:cc", "network": {"id": "12f2a6c7-ea1a-4a67-9b24-50b67341a827", "bridge": "br-int", "label": "tempest-device-tagging-net2-1808297123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf27415ef-3b", "ovs_interfaceid": "f27415ef-3b18-4406-8cc2-f5bd07325d95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:56:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-423e3736-16a1-4ce7-a4b2-827ee153324b req-8879ea4a-e210-4176-8c7b-450f868afda3 service nova] Releasing lock "refresh_cache-ab5b6240-0510-48fb-bbf5-104696eb52d7" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:56:36 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Instance destroyed successfully.
Nov 28 10:56:36 user nova-compute[74994]: DEBUG nova.compute.manager [None req-6ad8ff96-af31-4d47-bb27-a2d7195bf4b5 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 10:56:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6ad8ff96-af31-4d47-bb27-a2d7195bf4b5 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.904s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:56:37 user nova-compute[74994]: DEBUG nova.compute.manager [req-d579beed-fc64-464e-9369-9e28e6342cd4 req-c42c919d-de58-45b1-9ae2-52cbdd066afc service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Received event network-vif-unplugged-068080a2-5847-4053-a463-9fc29cb64bb4 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:56:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d579beed-fc64-464e-9369-9e28e6342cd4 req-c42c919d-de58-45b1-9ae2-52cbdd066afc service nova] Acquiring lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:56:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d579beed-fc64-464e-9369-9e28e6342cd4 req-c42c919d-de58-45b1-9ae2-52cbdd066afc service nova] Lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:56:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d579beed-fc64-464e-9369-9e28e6342cd4 req-c42c919d-de58-45b1-9ae2-52cbdd066afc service nova] Lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:56:37 user nova-compute[74994]: DEBUG nova.compute.manager [req-d579beed-fc64-464e-9369-9e28e6342cd4 req-c42c919d-de58-45b1-9ae2-52cbdd066afc service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] No waiting events found dispatching network-vif-unplugged-068080a2-5847-4053-a463-9fc29cb64bb4 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:56:37 user nova-compute[74994]: WARNING nova.compute.manager [req-d579beed-fc64-464e-9369-9e28e6342cd4 req-c42c919d-de58-45b1-9ae2-52cbdd066afc service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Received unexpected event network-vif-unplugged-068080a2-5847-4053-a463-9fc29cb64bb4 for instance with vm_state stopped and task_state None.
Nov 28 10:56:37 user nova-compute[74994]: DEBUG nova.compute.manager [req-d579beed-fc64-464e-9369-9e28e6342cd4 req-c42c919d-de58-45b1-9ae2-52cbdd066afc service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Received event network-vif-plugged-068080a2-5847-4053-a463-9fc29cb64bb4 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:56:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d579beed-fc64-464e-9369-9e28e6342cd4 req-c42c919d-de58-45b1-9ae2-52cbdd066afc service nova] Acquiring lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:56:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d579beed-fc64-464e-9369-9e28e6342cd4 req-c42c919d-de58-45b1-9ae2-52cbdd066afc service nova] Lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:56:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d579beed-fc64-464e-9369-9e28e6342cd4 req-c42c919d-de58-45b1-9ae2-52cbdd066afc service nova] Lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:56:37 user nova-compute[74994]: DEBUG nova.compute.manager [req-d579beed-fc64-464e-9369-9e28e6342cd4 req-c42c919d-de58-45b1-9ae2-52cbdd066afc service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] No waiting events found dispatching network-vif-plugged-068080a2-5847-4053-a463-9fc29cb64bb4 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:56:37 user nova-compute[74994]: WARNING nova.compute.manager [req-d579beed-fc64-464e-9369-9e28e6342cd4 req-c42c919d-de58-45b1-9ae2-52cbdd066afc service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Received unexpected event network-vif-plugged-068080a2-5847-4053-a463-9fc29cb64bb4 for instance with vm_state stopped and task_state None.
Nov 28 10:56:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Acquiring lock "ab5b6240-0510-48fb-bbf5-104696eb52d7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:56:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:56:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Acquiring lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:56:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:56:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:56:37 user nova-compute[74994]: INFO nova.compute.manager [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Terminating instance
Nov 28 10:56:37 user nova-compute[74994]: DEBUG nova.compute.manager [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 10:56:37 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:37 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:37 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:37 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:37 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:37 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:38 user nova-compute[74994]: DEBUG nova.compute.manager [req-3b3e3ea6-854c-4b3d-a240-040d617081a4 req-96502f76-8c3f-42c6-8477-65d9d86c713c service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received event network-vif-unplugged-18e1fc8f-76a7-400e-bcde-5178f8b061bd {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:56:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-3b3e3ea6-854c-4b3d-a240-040d617081a4 req-96502f76-8c3f-42c6-8477-65d9d86c713c service nova] Acquiring lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:56:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-3b3e3ea6-854c-4b3d-a240-040d617081a4 req-96502f76-8c3f-42c6-8477-65d9d86c713c service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:56:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-3b3e3ea6-854c-4b3d-a240-040d617081a4 req-96502f76-8c3f-42c6-8477-65d9d86c713c service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:56:38 user nova-compute[74994]: DEBUG nova.compute.manager [req-3b3e3ea6-854c-4b3d-a240-040d617081a4 req-96502f76-8c3f-42c6-8477-65d9d86c713c service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] No waiting events found dispatching network-vif-unplugged-18e1fc8f-76a7-400e-bcde-5178f8b061bd {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:56:38 user nova-compute[74994]: DEBUG nova.compute.manager [req-3b3e3ea6-854c-4b3d-a240-040d617081a4 req-96502f76-8c3f-42c6-8477-65d9d86c713c service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received event network-vif-unplugged-18e1fc8f-76a7-400e-bcde-5178f8b061bd for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 10:56:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:38 user nova-compute[74994]: DEBUG nova.compute.manager [req-6c2a8886-0754-4bb5-be23-d3e35879a62d req-bba73d6a-d38f-48e5-a20d-11b2ea9f669e service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received event network-vif-unplugged-9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:56:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6c2a8886-0754-4bb5-be23-d3e35879a62d req-bba73d6a-d38f-48e5-a20d-11b2ea9f669e service nova] Acquiring lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:56:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6c2a8886-0754-4bb5-be23-d3e35879a62d req-bba73d6a-d38f-48e5-a20d-11b2ea9f669e service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:56:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6c2a8886-0754-4bb5-be23-d3e35879a62d req-bba73d6a-d38f-48e5-a20d-11b2ea9f669e service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:56:38 user nova-compute[74994]: DEBUG nova.compute.manager [req-6c2a8886-0754-4bb5-be23-d3e35879a62d req-bba73d6a-d38f-48e5-a20d-11b2ea9f669e service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] No waiting events found dispatching network-vif-unplugged-9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:56:38 user nova-compute[74994]: DEBUG nova.compute.manager [req-6c2a8886-0754-4bb5-be23-d3e35879a62d req-bba73d6a-d38f-48e5-a20d-11b2ea9f669e service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received event network-vif-unplugged-9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 10:56:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Acquiring lock "c608eb72-4375-4e2a-aae8-a03d086b72e8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:56:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Lock "c608eb72-4375-4e2a-aae8-a03d086b72e8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:56:38 user nova-compute[74994]: DEBUG nova.compute.manager [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 10:56:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:56:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:56:38 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 10:56:38 user nova-compute[74994]: INFO nova.compute.claims [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Claim successful on node user
Nov 28 10:56:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.519s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG nova.compute.manager [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG nova.compute.manager [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG nova.network.neutron [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 10:56:39 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 10:56:39 user nova-compute[74994]: DEBUG nova.compute.manager [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 10:56:39 user nova-compute[74994]: INFO nova.virt.block_device [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Booting with volume 86619b11-b935-4f21-a4e1-f6d121626ef8 at /dev/vda
Nov 28 10:56:39 user nova-compute[74994]: DEBUG nova.policy [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '564e6983bd92417a81d0ec2b5e6253b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f56f0f99bee04f7baace9d7aa22cffa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 10:56:39 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-15866bfc-a61f-4c08-9833-01e9b55eb5da tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 857e3cbc-af52-46f6-9b59-87bae405f009 is timed out.
Nov 28 10:56:39 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-15866bfc-a61f-4c08-9833-01e9b55eb5da tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Successfully detached device sdc from instance 857e3cbc-af52-46f6-9b59-87bae405f009 from the live domain config.
Nov 28 10:56:39 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15866bfc-a61f-4c08-9833-01e9b55eb5da tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-15866bfc-a61f-4c08-9833-01e9b55eb5da tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LYoIDJSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:56:39 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-15866bfc-a61f-4c08-9833-01e9b55eb5da tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:56:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-15866bfc-a61f-4c08-9833-01e9b55eb5da tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-15866bfc-a61f-4c08-9833-01e9b55eb5da tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ea036c-69b1-4016-b4eb-8a1b0175af26]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-15866bfc-a61f-4c08-9833-01e9b55eb5da tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 10:56:39 user nova-compute[74994]: No targets found.
Nov 28 10:56:39 user nova-compute[74994]: iSNS:
Nov 28 10:56:39 user nova-compute[74994]: No targets found.
Nov 28 10:56:39 user nova-compute[74994]: STATIC:
Nov 28 10:56:39 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb
Nov 28 10:56:39 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:56:39 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:56:39 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77
Nov 28 10:56:39 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:56:39 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:56:39 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb
Nov 28 10:56:39 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:56:39 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:56:39 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de
Nov 28 10:56:39 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:56:39 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:56:39 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb
Nov 28 10:56:39 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:56:39 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:56:39 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f
Nov 28 10:56:39 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:56:39 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:56:39 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de
Nov 28 10:56:39 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:56:39 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:56:39 user nova-compute[74994]: FIRMWARE:
Nov 28 10:56:39 user nova-compute[74994]: No targets found.
Nov 28 10:56:39 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-15866bfc-a61f-4c08-9833-01e9b55eb5da tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 10:56:39 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 10:56:39 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-15866bfc-a61f-4c08-9833-01e9b55eb5da tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:39 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Instance destroyed successfully.
Nov 28 10:56:39 user nova-compute[74994]: DEBUG nova.objects.instance [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Lazy-loading 'resources' on Instance uuid ab5b6240-0510-48fb-bbf5-104696eb52d7 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG os_brick.utils [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ce7c14-337e-49a3-a101-ae15a0e9f990]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:54:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-537495686',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-537495686',id=21,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqHrRyRg6I8eTYdqY68nxH49PM4ovXVY9WTRn5Yi13IOjr3kGi2fsLAAdzHm0npqM4El3WRdX3N2yVoZzavfQhY9WIuL5YyK4/Ma9dvX+uAy+stjWneVfr/h/UrvxggqA==',key_name='tempest-keypair-117466054',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:55:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f75aabbbe5d644d1a5752a68847017aa',ramdisk_id='',reservation_id='r-2nksu579',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-724507959',owner_user_name='tempest-TaggedBootDevicesTest-724507959-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T10:55:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70bc9e7d86a3429e8c7bc10b3190f450',uuid=ab5b6240-0510-48fb-bbf5-104696eb52d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18e1fc8f-76a7-400e-bcde-5178f8b061bd", "address": "fa:16:3e:5f:2c:f1", "network": {"id": "c6d0db1d-6898-4ee2-bd5d-cc190c70128f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-510684947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18e1fc8f-76", "ovs_interfaceid": "18e1fc8f-76a7-400e-bcde-5178f8b061bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Converting VIF {"id": "18e1fc8f-76a7-400e-bcde-5178f8b061bd", "address": "fa:16:3e:5f:2c:f1", "network": {"id": "c6d0db1d-6898-4ee2-bd5d-cc190c70128f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-510684947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18e1fc8f-76", "ovs_interfaceid": "18e1fc8f-76a7-400e-bcde-5178f8b061bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:2c:f1,bridge_name='br-int',has_traffic_filtering=True,id=18e1fc8f-76a7-400e-bcde-5178f8b061bd,network=Network(c6d0db1d-6898-4ee2-bd5d-cc190c70128f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18e1fc8f-76') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG os_vif [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:2c:f1,bridge_name='br-int',has_traffic_filtering=True,id=18e1fc8f-76a7-400e-bcde-5178f8b061bd,network=Network(c6d0db1d-6898-4ee2-bd5d-cc190c70128f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18e1fc8f-76') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18e1fc8f-76, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ea03fe-955f-4049-980e-9b012e291c5d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6df753b-d4e1-40b3-aa24-52556342a3ca]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-15866bfc-a61f-4c08-9833-01e9b55eb5da tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:56:39 user nova-compute[74994]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)
Nov 28 10:56:39 user nova-compute[74994]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb (non-flash)
Nov 28 10:56:39 user nova-compute[74994]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f (non-flash)
Nov 28 10:56:39 user nova-compute[74994]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)
Nov 28 10:56:39 user nova-compute[74994]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb (non-flash)
Nov 28 10:56:39 user nova-compute[74994]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 10:56:39 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-15866bfc-a61f-4c08-9833-01e9b55eb5da tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:56:39 user nova-compute[74994]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)
Nov 28 10:56:39 user nova-compute[74994]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb (non-flash)
Nov 28 10:56:39 user nova-compute[74994]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f (non-flash)
Nov 28 10:56:39 user nova-compute[74994]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)
Nov 28 10:56:39 user nova-compute[74994]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb (non-flash)
Nov 28 10:56:39 user nova-compute[74994]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 10:56:39 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-15866bfc-a61f-4c08-9833-01e9b55eb5da tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9206e1a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb'): ({'sdf'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-15866bfc-a61f-4c08-9833-01e9b55eb5da tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Removing single pathed devices sdf {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15b3c8e-22c4-4ef4-9ff1-6d7f48917f62]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9635cba-10b0-48cd-8b40-6e87a25a9be2]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[35124cc4-309a-4d31-a257-6bff8085cba6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc420aba-570a-4000-986f-8219837f3ccb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c0e38afd-9287-44e9-beff-d9823a7414b3) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.027s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[253c5714-adb9-4610-9ea7-ed9f6c423809]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-15866bfc-a61f-4c08-9833-01e9b55eb5da tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Flushing IO for device /dev/sdf {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:56:39 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 10:56:39 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1695c0-f124-4702-896d-00325b2fd62a]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:39 user nova-compute[74994]: INFO os_vif [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:2c:f1,bridge_name='br-int',has_traffic_filtering=True,id=18e1fc8f-76a7-400e-bcde-5178f8b061bd,network=Network(c6d0db1d-6898-4ee2-bd5d-cc190c70128f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18e1fc8f-76')
Nov 28 10:56:39 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:54:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-537495686',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-537495686',id=21,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqHrRyRg6I8eTYdqY68nxH49PM4ovXVY9WTRn5Yi13IOjr3kGi2fsLAAdzHm0npqM4El3WRdX3N2yVoZzavfQhY9WIuL5YyK4/Ma9dvX+uAy+stjWneVfr/h/UrvxggqA==',key_name='tempest-keypair-117466054',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:55:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f75aabbbe5d644d1a5752a68847017aa',ramdisk_id='',reservation_id='r-2nksu579',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-724507959',owner_user_name='tempest-TaggedBootDevicesTest-724507959-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T10:55:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70bc9e7d86a3429e8c7bc10b3190f450',uuid=ab5b6240-0510-48fb-bbf5-104696eb52d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50", "address": "fa:16:3e:cb:7d:77", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cdf27ff-58", "ovs_interfaceid": "9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Converting VIF {"id": "9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50", "address": "fa:16:3e:cb:7d:77", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cdf27ff-58", "ovs_interfaceid": "9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:7d:77,bridge_name='br-int',has_traffic_filtering=True,id=9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50,network=Network(d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9cdf27ff-58') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG os_vif [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:7d:77,bridge_name='br-int',has_traffic_filtering=True,id=9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50,network=Network(d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9cdf27ff-58') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG os_brick.utils [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] <== get_connector_properties: return (205ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Updating existing volume attachment record: 11b4e095-ca56-4bd2-bbd4-b0a4b40933bf {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e64c123-db5a-449f-8f32-7753aa7312a2]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-15866bfc-a61f-4c08-9833-01e9b55eb5da tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9cdf27ff-58, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e89428-d18c-4757-9b59-45e4e945f34a]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-15866bfc-a61f-4c08-9833-01e9b55eb5da tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-15866bfc-a61f-4c08-9833-01e9b55eb5da tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] SCSI volumes sdf have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-15866bfc-a61f-4c08-9833-01e9b55eb5da tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c4d057fe-89af-4bd6-9820-d2222a3e7426) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d400e2-be39-4968-9702-4c2a062c9c30]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-15866bfc-a61f-4c08-9833-01e9b55eb5da tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:39 user nova-compute[74994]: INFO os_vif [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:7d:77,bridge_name='br-int',has_traffic_filtering=True,id=9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50,network=Network(d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9cdf27ff-58')
Nov 28 10:56:39 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:54:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-537495686',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-537495686',id=21,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqHrRyRg6I8eTYdqY68nxH49PM4ovXVY9WTRn5Yi13IOjr3kGi2fsLAAdzHm0npqM4El3WRdX3N2yVoZzavfQhY9WIuL5YyK4/Ma9dvX+uAy+stjWneVfr/h/UrvxggqA==',key_name='tempest-keypair-117466054',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:55:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f75aabbbe5d644d1a5752a68847017aa',ramdisk_id='',reservation_id='r-2nksu579',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-724507959',owner_user_name='tempest-TaggedBootDevicesTest-724507959-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T10:55:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70bc9e7d86a3429e8c7bc10b3190f450',uuid=ab5b6240-0510-48fb-bbf5-104696eb52d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d8a5004-44ff-4247-b63e-9cc70b4c91e7", "address": "fa:16:3e:15:89:0f", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8a5004-44", "ovs_interfaceid": "3d8a5004-44ff-4247-b63e-9cc70b4c91e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Converting VIF {"id": "3d8a5004-44ff-4247-b63e-9cc70b4c91e7", "address": "fa:16:3e:15:89:0f", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8a5004-44", "ovs_interfaceid": "3d8a5004-44ff-4247-b63e-9cc70b4c91e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:89:0f,bridge_name='br-int',has_traffic_filtering=True,id=3d8a5004-44ff-4247-b63e-9cc70b4c91e7,network=Network(d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3d8a5004-44') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG os_vif [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:89:0f,bridge_name='br-int',has_traffic_filtering=True,id=3d8a5004-44ff-4247-b63e-9cc70b4c91e7,network=Network(d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3d8a5004-44') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d8a5004-44, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[786010d3-4387-4edf-9118-6052f38699cc]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-15866bfc-a61f-4c08-9833-01e9b55eb5da tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb, portal: 172.16.0.220,3260]
Nov 28 10:56:39 user nova-compute[74994]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb, portal: 172.16.0.220,3260] successful.
Nov 28 10:56:39 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:56:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9d62de7-a7d8-402f-b8ac-4af182b3a7eb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2167b4-433b-43c1-8678-cb46e7503b03]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-15866bfc-a61f-4c08-9833-01e9b55eb5da tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-15866bfc-a61f-4c08-9833-01e9b55eb5da tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.551s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-15866bfc-a61f-4c08-9833-01e9b55eb5da tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] <== disconnect_volume: return (552ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15866bfc-a61f-4c08-9833-01e9b55eb5da tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=26396ccb-d8d4-489c-a621-0db51167db33) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG nova.compute.manager [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received event network-vif-plugged-18e1fc8f-76a7-400e-bcde-5178f8b061bd {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] Acquiring lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG nova.compute.manager [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] No waiting events found dispatching network-vif-plugged-18e1fc8f-76a7-400e-bcde-5178f8b061bd {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:56:40 user nova-compute[74994]: WARNING nova.compute.manager [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received unexpected event network-vif-plugged-18e1fc8f-76a7-400e-bcde-5178f8b061bd for instance with vm_state active and task_state deleting.
Nov 28 10:56:40 user nova-compute[74994]: DEBUG nova.compute.manager [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received event network-vif-unplugged-3d8a5004-44ff-4247-b63e-9cc70b4c91e7 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] Acquiring lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG nova.compute.manager [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] No waiting events found dispatching network-vif-unplugged-3d8a5004-44ff-4247-b63e-9cc70b4c91e7 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG nova.compute.manager [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received event network-vif-unplugged-3d8a5004-44ff-4247-b63e-9cc70b4c91e7 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG nova.compute.manager [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received event network-vif-plugged-3d8a5004-44ff-4247-b63e-9cc70b4c91e7 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] Acquiring lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG nova.compute.manager [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] No waiting events found dispatching network-vif-plugged-3d8a5004-44ff-4247-b63e-9cc70b4c91e7 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:56:40 user nova-compute[74994]: WARNING nova.compute.manager [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received unexpected event network-vif-plugged-3d8a5004-44ff-4247-b63e-9cc70b4c91e7 for instance with vm_state active and task_state deleting.
Nov 28 10:56:40 user nova-compute[74994]: DEBUG nova.compute.manager [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received event network-vif-unplugged-df9a6a76-006b-4adc-9e84-ee61d037da31 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] Acquiring lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG nova.compute.manager [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] No waiting events found dispatching network-vif-unplugged-df9a6a76-006b-4adc-9e84-ee61d037da31 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG nova.compute.manager [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received event network-vif-unplugged-df9a6a76-006b-4adc-9e84-ee61d037da31 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG nova.compute.manager [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received event network-vif-plugged-df9a6a76-006b-4adc-9e84-ee61d037da31 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] Acquiring lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG nova.compute.manager [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] No waiting events found dispatching network-vif-plugged-df9a6a76-006b-4adc-9e84-ee61d037da31 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:56:40 user nova-compute[74994]: WARNING nova.compute.manager [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received unexpected event network-vif-plugged-df9a6a76-006b-4adc-9e84-ee61d037da31 for instance with vm_state active and task_state deleting.
Nov 28 10:56:40 user nova-compute[74994]: DEBUG nova.compute.manager [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received event network-vif-unplugged-0c67dc60-232f-45b1-b637-48db3477ce20 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] Acquiring lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG nova.compute.manager [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] No waiting events found dispatching network-vif-unplugged-0c67dc60-232f-45b1-b637-48db3477ce20 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG nova.compute.manager [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received event network-vif-unplugged-0c67dc60-232f-45b1-b637-48db3477ce20 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG nova.compute.manager [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received event network-vif-plugged-0c67dc60-232f-45b1-b637-48db3477ce20 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] Acquiring lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG nova.compute.manager [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] No waiting events found dispatching network-vif-plugged-0c67dc60-232f-45b1-b637-48db3477ce20 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:56:40 user nova-compute[74994]: WARNING nova.compute.manager [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received unexpected event network-vif-plugged-0c67dc60-232f-45b1-b637-48db3477ce20 for instance with vm_state active and task_state deleting.
Nov 28 10:56:40 user nova-compute[74994]: DEBUG nova.compute.manager [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received event network-vif-unplugged-64313c64-2811-46b0-8953-8b80db3604a2 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] Acquiring lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG nova.compute.manager [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] No waiting events found dispatching network-vif-unplugged-64313c64-2811-46b0-8953-8b80db3604a2 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG nova.compute.manager [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received event network-vif-unplugged-64313c64-2811-46b0-8953-8b80db3604a2 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG nova.compute.manager [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received event network-vif-plugged-64313c64-2811-46b0-8953-8b80db3604a2 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] Acquiring lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG nova.compute.manager [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] No waiting events found dispatching network-vif-plugged-64313c64-2811-46b0-8953-8b80db3604a2 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:56:40 user nova-compute[74994]: WARNING nova.compute.manager [req-bfb30a89-8c25-40d7-b112-deaa86b3c66b req-ea975a37-190c-41a5-808f-b01cebf39105 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received unexpected event network-vif-plugged-64313c64-2811-46b0-8953-8b80db3604a2 for instance with vm_state active and task_state deleting.
Nov 28 10:56:40 user nova-compute[74994]: INFO os_vif [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:89:0f,bridge_name='br-int',has_traffic_filtering=True,id=3d8a5004-44ff-4247-b63e-9cc70b4c91e7,network=Network(d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3d8a5004-44')
Nov 28 10:56:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:54:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-537495686',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-537495686',id=21,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqHrRyRg6I8eTYdqY68nxH49PM4ovXVY9WTRn5Yi13IOjr3kGi2fsLAAdzHm0npqM4El3WRdX3N2yVoZzavfQhY9WIuL5YyK4/Ma9dvX+uAy+stjWneVfr/h/UrvxggqA==',key_name='tempest-keypair-117466054',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:55:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f75aabbbe5d644d1a5752a68847017aa',ramdisk_id='',reservation_id='r-2nksu579',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-724507959',owner_user_name='tempest-TaggedBootDevicesTest-724507959-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T10:55:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70bc9e7d86a3429e8c7bc10b3190f450',uuid=ab5b6240-0510-48fb-bbf5-104696eb52d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df9a6a76-006b-4adc-9e84-ee61d037da31", "address": "fa:16:3e:78:52:33", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf9a6a76-00", "ovs_interfaceid": "df9a6a76-006b-4adc-9e84-ee61d037da31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Converting VIF {"id": "df9a6a76-006b-4adc-9e84-ee61d037da31", "address": "fa:16:3e:78:52:33", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf9a6a76-00", "ovs_interfaceid": "df9a6a76-006b-4adc-9e84-ee61d037da31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:52:33,bridge_name='br-int',has_traffic_filtering=True,id=df9a6a76-006b-4adc-9e84-ee61d037da31,network=Network(d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf9a6a76-00') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG os_vif [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:52:33,bridge_name='br-int',has_traffic_filtering=True,id=df9a6a76-006b-4adc-9e84-ee61d037da31,network=Network(d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf9a6a76-00') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf9a6a76-00, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG nova.compute.manager [req-f08fa1bb-40f2-41e7-a889-1c47d814b244 req-8287fb64-6d2d-4040-88aa-68e722eb3972 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received event network-vif-plugged-9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f08fa1bb-40f2-41e7-a889-1c47d814b244 req-8287fb64-6d2d-4040-88aa-68e722eb3972 service nova] Acquiring lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f08fa1bb-40f2-41e7-a889-1c47d814b244 req-8287fb64-6d2d-4040-88aa-68e722eb3972 service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f08fa1bb-40f2-41e7-a889-1c47d814b244 req-8287fb64-6d2d-4040-88aa-68e722eb3972 service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG nova.compute.manager [req-f08fa1bb-40f2-41e7-a889-1c47d814b244 req-8287fb64-6d2d-4040-88aa-68e722eb3972 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] No waiting events found dispatching network-vif-plugged-9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:56:40 user nova-compute[74994]: WARNING nova.compute.manager [req-f08fa1bb-40f2-41e7-a889-1c47d814b244 req-8287fb64-6d2d-4040-88aa-68e722eb3972 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received unexpected event network-vif-plugged-9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50 for instance with vm_state active and task_state deleting.
Nov 28 10:56:40 user nova-compute[74994]: DEBUG nova.compute.manager [req-f08fa1bb-40f2-41e7-a889-1c47d814b244 req-8287fb64-6d2d-4040-88aa-68e722eb3972 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received event network-vif-unplugged-f27415ef-3b18-4406-8cc2-f5bd07325d95 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f08fa1bb-40f2-41e7-a889-1c47d814b244 req-8287fb64-6d2d-4040-88aa-68e722eb3972 service nova] Acquiring lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f08fa1bb-40f2-41e7-a889-1c47d814b244 req-8287fb64-6d2d-4040-88aa-68e722eb3972 service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f08fa1bb-40f2-41e7-a889-1c47d814b244 req-8287fb64-6d2d-4040-88aa-68e722eb3972 service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG nova.compute.manager [req-f08fa1bb-40f2-41e7-a889-1c47d814b244 req-8287fb64-6d2d-4040-88aa-68e722eb3972 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] No waiting events found dispatching network-vif-unplugged-f27415ef-3b18-4406-8cc2-f5bd07325d95 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG nova.compute.manager [req-f08fa1bb-40f2-41e7-a889-1c47d814b244 req-8287fb64-6d2d-4040-88aa-68e722eb3972 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received event network-vif-unplugged-f27415ef-3b18-4406-8cc2-f5bd07325d95 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG nova.compute.manager [req-f08fa1bb-40f2-41e7-a889-1c47d814b244 req-8287fb64-6d2d-4040-88aa-68e722eb3972 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received event network-vif-plugged-f27415ef-3b18-4406-8cc2-f5bd07325d95 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f08fa1bb-40f2-41e7-a889-1c47d814b244 req-8287fb64-6d2d-4040-88aa-68e722eb3972 service nova] Acquiring lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f08fa1bb-40f2-41e7-a889-1c47d814b244 req-8287fb64-6d2d-4040-88aa-68e722eb3972 service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f08fa1bb-40f2-41e7-a889-1c47d814b244 req-8287fb64-6d2d-4040-88aa-68e722eb3972 service nova] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG nova.compute.manager [req-f08fa1bb-40f2-41e7-a889-1c47d814b244 req-8287fb64-6d2d-4040-88aa-68e722eb3972 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] No waiting events found dispatching network-vif-plugged-f27415ef-3b18-4406-8cc2-f5bd07325d95 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:56:40 user nova-compute[74994]: WARNING nova.compute.manager [req-f08fa1bb-40f2-41e7-a889-1c47d814b244 req-8287fb64-6d2d-4040-88aa-68e722eb3972 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received unexpected event network-vif-plugged-f27415ef-3b18-4406-8cc2-f5bd07325d95 for instance with vm_state active and task_state deleting.
Nov 28 10:56:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b9f300c6-9bff-4ce9-9ef9-0cd4fd1a4cc6) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG nova.network.neutron [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Successfully created port: 32f4f44f-44b7-47f0-9c06-bd33d3a48216 {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:40 user nova-compute[74994]: INFO os_vif [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:52:33,bridge_name='br-int',has_traffic_filtering=True,id=df9a6a76-006b-4adc-9e84-ee61d037da31,network=Network(d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf9a6a76-00')
Nov 28 10:56:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:54:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-537495686',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-537495686',id=21,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqHrRyRg6I8eTYdqY68nxH49PM4ovXVY9WTRn5Yi13IOjr3kGi2fsLAAdzHm0npqM4El3WRdX3N2yVoZzavfQhY9WIuL5YyK4/Ma9dvX+uAy+stjWneVfr/h/UrvxggqA==',key_name='tempest-keypair-117466054',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:55:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f75aabbbe5d644d1a5752a68847017aa',ramdisk_id='',reservation_id='r-2nksu579',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-724507959',owner_user_name='tempest-TaggedBootDevicesTest-724507959-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T10:55:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70bc9e7d86a3429e8c7bc10b3190f450',uuid=ab5b6240-0510-48fb-bbf5-104696eb52d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c67dc60-232f-45b1-b637-48db3477ce20", "address": "fa:16:3e:89:ae:7a", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c67dc60-23", "ovs_interfaceid": "0c67dc60-232f-45b1-b637-48db3477ce20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Converting VIF {"id": "0c67dc60-232f-45b1-b637-48db3477ce20", "address": "fa:16:3e:89:ae:7a", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c67dc60-23", "ovs_interfaceid": "0c67dc60-232f-45b1-b637-48db3477ce20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:ae:7a,bridge_name='br-int',has_traffic_filtering=True,id=0c67dc60-232f-45b1-b637-48db3477ce20,network=Network(d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c67dc60-23') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG os_vif [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:ae:7a,bridge_name='br-int',has_traffic_filtering=True,id=0c67dc60-232f-45b1-b637-48db3477ce20,network=Network(d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c67dc60-23') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c67dc60-23, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2f383153-997b-4577-9098-4bcf4eb753ee) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:40 user nova-compute[74994]: INFO os_vif [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:ae:7a,bridge_name='br-int',has_traffic_filtering=True,id=0c67dc60-232f-45b1-b637-48db3477ce20,network=Network(d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c67dc60-23')
Nov 28 10:56:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:54:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-537495686',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-537495686',id=21,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqHrRyRg6I8eTYdqY68nxH49PM4ovXVY9WTRn5Yi13IOjr3kGi2fsLAAdzHm0npqM4El3WRdX3N2yVoZzavfQhY9WIuL5YyK4/Ma9dvX+uAy+stjWneVfr/h/UrvxggqA==',key_name='tempest-keypair-117466054',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:55:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f75aabbbe5d644d1a5752a68847017aa',ramdisk_id='',reservation_id='r-2nksu579',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-724507959',owner_user_name='tempest-TaggedBootDevicesTest-724507959-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T10:55:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70bc9e7d86a3429e8c7bc10b3190f450',uuid=ab5b6240-0510-48fb-bbf5-104696eb52d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64313c64-2811-46b0-8953-8b80db3604a2", "address": "fa:16:3e:95:6b:d7", "network": {"id": "12f2a6c7-ea1a-4a67-9b24-50b67341a827", "bridge": "br-int", "label": "tempest-device-tagging-net2-1808297123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64313c64-28", "ovs_interfaceid": "64313c64-2811-46b0-8953-8b80db3604a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Converting VIF {"id": "64313c64-2811-46b0-8953-8b80db3604a2", "address": "fa:16:3e:95:6b:d7", "network": {"id": "12f2a6c7-ea1a-4a67-9b24-50b67341a827", "bridge": "br-int", "label": "tempest-device-tagging-net2-1808297123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64313c64-28", "ovs_interfaceid": "64313c64-2811-46b0-8953-8b80db3604a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:6b:d7,bridge_name='br-int',has_traffic_filtering=True,id=64313c64-2811-46b0-8953-8b80db3604a2,network=Network(12f2a6c7-ea1a-4a67-9b24-50b67341a827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64313c64-28') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG os_vif [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:6b:d7,bridge_name='br-int',has_traffic_filtering=True,id=64313c64-2811-46b0-8953-8b80db3604a2,network=Network(12f2a6c7-ea1a-4a67-9b24-50b67341a827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64313c64-28') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64313c64-28, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=00b63e3e-35b8-440c-8d88-f3d505b2e1f7) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:40 user nova-compute[74994]: INFO os_vif [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:6b:d7,bridge_name='br-int',has_traffic_filtering=True,id=64313c64-2811-46b0-8953-8b80db3604a2,network=Network(12f2a6c7-ea1a-4a67-9b24-50b67341a827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64313c64-28')
Nov 28 10:56:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:54:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-537495686',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-537495686',id=21,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqHrRyRg6I8eTYdqY68nxH49PM4ovXVY9WTRn5Yi13IOjr3kGi2fsLAAdzHm0npqM4El3WRdX3N2yVoZzavfQhY9WIuL5YyK4/Ma9dvX+uAy+stjWneVfr/h/UrvxggqA==',key_name='tempest-keypair-117466054',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:55:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f75aabbbe5d644d1a5752a68847017aa',ramdisk_id='',reservation_id='r-2nksu579',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-724507959',owner_user_name='tempest-TaggedBootDevicesTest-724507959-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T10:55:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70bc9e7d86a3429e8c7bc10b3190f450',uuid=ab5b6240-0510-48fb-bbf5-104696eb52d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f27415ef-3b18-4406-8cc2-f5bd07325d95", "address": "fa:16:3e:25:6c:cc", "network": {"id": "12f2a6c7-ea1a-4a67-9b24-50b67341a827", "bridge": "br-int", "label": "tempest-device-tagging-net2-1808297123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf27415ef-3b", "ovs_interfaceid": "f27415ef-3b18-4406-8cc2-f5bd07325d95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Converting VIF {"id": "f27415ef-3b18-4406-8cc2-f5bd07325d95", "address": "fa:16:3e:25:6c:cc", "network": {"id": "12f2a6c7-ea1a-4a67-9b24-50b67341a827", "bridge": "br-int", "label": "tempest-device-tagging-net2-1808297123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf27415ef-3b", "ovs_interfaceid": "f27415ef-3b18-4406-8cc2-f5bd07325d95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:6c:cc,bridge_name='br-int',has_traffic_filtering=True,id=f27415ef-3b18-4406-8cc2-f5bd07325d95,network=Network(12f2a6c7-ea1a-4a67-9b24-50b67341a827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf27415ef-3b') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG os_vif [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:6c:cc,bridge_name='br-int',has_traffic_filtering=True,id=f27415ef-3b18-4406-8cc2-f5bd07325d95,network=Network(12f2a6c7-ea1a-4a67-9b24-50b67341a827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf27415ef-3b') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf27415ef-3b, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3f7386f5-ed63-44d4-b901-a40a1dfa3406) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:40 user nova-compute[74994]: INFO os_vif [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:6c:cc,bridge_name='br-int',has_traffic_filtering=True,id=f27415ef-3b18-4406-8cc2-f5bd07325d95,network=Network(12f2a6c7-ea1a-4a67-9b24-50b67341a827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf27415ef-3b')
Nov 28 10:56:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QWlmhogJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:56:40 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:56:40 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ab05cc-484d-4250-8613-2746c9717249]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 10:56:40 user nova-compute[74994]: No targets found.
Nov 28 10:56:40 user nova-compute[74994]: iSNS:
Nov 28 10:56:40 user nova-compute[74994]: No targets found.
Nov 28 10:56:40 user nova-compute[74994]: STATIC:
Nov 28 10:56:40 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb
Nov 28 10:56:40 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:56:40 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:56:40 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77
Nov 28 10:56:40 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:56:40 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:56:40 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de
Nov 28 10:56:40 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:56:40 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:56:40 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb
Nov 28 10:56:40 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:56:40 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:56:40 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f
Nov 28 10:56:40 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:56:40 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:56:40 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de
Nov 28 10:56:40 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:56:40 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:56:40 user nova-compute[74994]: FIRMWARE:
Nov 28 10:56:40 user nova-compute[74994]: No targets found.
Nov 28 10:56:40 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 10:56:40 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 10:56:40 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[043f4ca1-43bd-4ee7-85e8-63f99b6c7a72]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ab0602-186d-45d1-a1b5-6674c027a32c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:56:40 user nova-compute[74994]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)
Nov 28 10:56:40 user nova-compute[74994]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb (non-flash)
Nov 28 10:56:40 user nova-compute[74994]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f (non-flash)
Nov 28 10:56:40 user nova-compute[74994]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)
Nov 28 10:56:40 user nova-compute[74994]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 10:56:40 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:56:40 user nova-compute[74994]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de (non-flash)
Nov 28 10:56:40 user nova-compute[74994]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb (non-flash)
Nov 28 10:56:40 user nova-compute[74994]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f (non-flash)
Nov 28 10:56:40 user nova-compute[74994]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)
Nov 28 10:56:40 user nova-compute[74994]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 10:56:40 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb944636830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de'): ({'sdd'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Removing single pathed devices sdd {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 10:56:40 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2143b2c4-344b-4b44-bdd6-cbc9161bb794]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[988ebef7-5c8c-424b-98c8-e085f79e113e]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Flushing IO for device /dev/sdd {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[96310a26-ad7f-4091-8a4f-0135cf132583]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.208s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c01fcf-2e07-4582-bf87-fc5400b53b25]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] SCSI volumes sdd have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.070s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5129c70d-1085-466e-a796-72123ee54551]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG nova.objects.instance [None req-15866bfc-a61f-4c08-9833-01e9b55eb5da tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Lazy-loading 'flavor' on Instance uuid 857e3cbc-af52-46f6-9b59-87bae405f009 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de -p 172.16.0.220:3260 --logout" returned: 0 in 0.227s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[37cef31e-1f8b-4068-8c85-cb3181aa6250]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de, portal: 172.16.0.220,3260]
Nov 28 10:56:41 user nova-compute[74994]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de, portal: 172.16.0.220,3260] successful.
Nov 28 10:56:41 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-15866bfc-a61f-4c08-9833-01e9b55eb5da tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Lock "857e3cbc-af52-46f6-9b59-87bae405f009" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.189s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:350ac8ea-49b5-4ae4-8301-7533add977de -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[176b46e5-8921-4552-a422-cc5b0a998138]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.711s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] <== disconnect_volume: return (712ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DOxfJzyh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:56:41 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:56:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG nova.network.neutron [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Successfully updated port: 32f4f44f-44b7-47f0-9c06-bd33d3a48216 {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.035s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[192f6640-5a19-4f3a-9dad-f53583403004]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 10:56:41 user nova-compute[74994]: No targets found.
Nov 28 10:56:41 user nova-compute[74994]: iSNS:
Nov 28 10:56:41 user nova-compute[74994]: No targets found.
Nov 28 10:56:41 user nova-compute[74994]: STATIC:
Nov 28 10:56:41 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb
Nov 28 10:56:41 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:56:41 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:56:41 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77
Nov 28 10:56:41 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:56:41 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:56:41 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de
Nov 28 10:56:41 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:56:41 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:56:41 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb
Nov 28 10:56:41 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:56:41 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:56:41 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f
Nov 28 10:56:41 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:56:41 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:56:41 user nova-compute[74994]: FIRMWARE:
Nov 28 10:56:41 user nova-compute[74994]: No targets found.
Nov 28 10:56:41 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 10:56:41 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 10:56:41 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Acquiring lock "refresh_cache-c608eb72-4375-4e2a-aae8-a03d086b72e8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Acquired lock "refresh_cache-c608eb72-4375-4e2a-aae8-a03d086b72e8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG nova.network.neutron [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4abfd1-0626-4a99-9080-8419fdd39725]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG nova.network.neutron [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b7f2a7-7cb0-47b4-ab64-ff6c0f7d6d91]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:56:41 user nova-compute[74994]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb (non-flash)
Nov 28 10:56:41 user nova-compute[74994]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f (non-flash)
Nov 28 10:56:41 user nova-compute[74994]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)
Nov 28 10:56:41 user nova-compute[74994]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 10:56:41 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:56:41 user nova-compute[74994]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb (non-flash)
Nov 28 10:56:41 user nova-compute[74994]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f (non-flash)
Nov 28 10:56:41 user nova-compute[74994]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)
Nov 28 10:56:41 user nova-compute[74994]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 10:56:41 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb944715120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb'): ({'sde'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Removing single pathed devices sde {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1dc9659-24bf-4b35-a6c1-44ff3680bbfe]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[941d8a87-5b05-43d2-bb91-e5fd84e4f746]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Flushing IO for device /dev/sde {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be8e457-5123-4244-aa63-1cee48d15cee]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db0be40-a72c-47f8-b000-84b8946a2a12]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] SCSI volumes sde have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6700f42-0d9a-4336-8354-afd2fcce9b4e]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fece59c4-3d13-4a82-9f4c-78ada72b66b4]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb, portal: 172.16.0.220,3260]
Nov 28 10:56:41 user nova-compute[74994]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb, portal: 172.16.0.220,3260] successful.
Nov 28 10:56:41 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cb83a7e-5241-4cf9-88d4-01aeb4c1c1eb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc79dedb-2cfd-446a-bc73-cd196335edb6]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] <== disconnect_volume: return (359ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MJkXDsto', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:56:41 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:56:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG nova.network.neutron [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Updating instance_info_cache with network_info: [{"id": "32f4f44f-44b7-47f0-9c06-bd33d3a48216", "address": "fa:16:3e:12:e4:7a", "network": {"id": "d339a2cb-dddd-4921-9ac8-bde483746df2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1820767196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56f0f99bee04f7baace9d7aa22cffa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32f4f44f-44", "ovs_interfaceid": "32f4f44f-44b7-47f0-9c06-bd33d3a48216", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ddc4cf-1db5-434f-93e5-03629311456b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 10:56:41 user nova-compute[74994]: No targets found.
Nov 28 10:56:41 user nova-compute[74994]: iSNS:
Nov 28 10:56:41 user nova-compute[74994]: No targets found.
Nov 28 10:56:41 user nova-compute[74994]: STATIC:
Nov 28 10:56:41 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb
Nov 28 10:56:41 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:56:41 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:56:41 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77
Nov 28 10:56:41 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:56:41 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:56:41 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de
Nov 28 10:56:41 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:56:41 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:56:41 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f
Nov 28 10:56:41 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:56:41 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:56:41 user nova-compute[74994]: FIRMWARE:
Nov 28 10:56:41 user nova-compute[74994]: No targets found.
Nov 28 10:56:41 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 10:56:41 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 10:56:41 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Releasing lock "refresh_cache-c608eb72-4375-4e2a-aae8-a03d086b72e8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG nova.compute.manager [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Instance network_info: |[{"id": "32f4f44f-44b7-47f0-9c06-bd33d3a48216", "address": "fa:16:3e:12:e4:7a", "network": {"id": "d339a2cb-dddd-4921-9ac8-bde483746df2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1820767196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56f0f99bee04f7baace9d7aa22cffa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32f4f44f-44", "ovs_interfaceid": "32f4f44f-44b7-47f0-9c06-bd33d3a48216", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[efabda6e-e2e2-4b2a-95de-6817fca3a2d2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2dafaf1-7cbe-4d9e-9cc1-730cd467e243]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:56:41 user nova-compute[74994]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f (non-flash)
Nov 28 10:56:41 user nova-compute[74994]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)
Nov 28 10:56:41 user nova-compute[74994]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 10:56:41 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:56:41 user nova-compute[74994]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f (non-flash)
Nov 28 10:56:41 user nova-compute[74994]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)
Nov 28 10:56:41 user nova-compute[74994]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 10:56:41 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb944715120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f'): ({'sdc'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Removing single pathed devices sdc {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0cd79df-b981-41e8-8511-f3862a6c2d2d]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ae9cef-9495-4c5c-b7f9-161d6d46eb4b]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Flushing IO for device /dev/sdc {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a089f8-b9ad-46f2-b1d3-e098e538c1e5]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5354b97-b58c-43eb-a2f5-2db238398c2a]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] SCSI volumes sdc have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[865db95d-5965-4bd9-89fa-927583ee4034]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afe0868-e5ec-4d5c-bab0-951469527900]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f, portal: 172.16.0.220,3260]
Nov 28 10:56:41 user nova-compute[74994]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f, portal: 172.16.0.220,3260] successful.
Nov 28 10:56:41 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d56b4123-7ab2-47c2-8f25-d4653a389f3f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[33683dcd-d45c-4103-8d6f-a8b1d45ce155]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] <== disconnect_volume: return (311ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 10:56:41 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Deleting instance files /opt/stack/data/nova/instances/ab5b6240-0510-48fb-bbf5-104696eb52d7_del
Nov 28 10:56:41 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Deletion of /opt/stack/data/nova/instances/ab5b6240-0510-48fb-bbf5-104696eb52d7_del complete
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4d916b36-cd54-4f45-8658-53824eccd034 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Acquiring lock "857e3cbc-af52-46f6-9b59-87bae405f009" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4d916b36-cd54-4f45-8658-53824eccd034 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Lock "857e3cbc-af52-46f6-9b59-87bae405f009" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4d916b36-cd54-4f45-8658-53824eccd034 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Acquiring lock "857e3cbc-af52-46f6-9b59-87bae405f009-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4d916b36-cd54-4f45-8658-53824eccd034 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Lock "857e3cbc-af52-46f6-9b59-87bae405f009-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4d916b36-cd54-4f45-8658-53824eccd034 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Lock "857e3cbc-af52-46f6-9b59-87bae405f009-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:56:41 user nova-compute[74994]: INFO nova.compute.manager [None req-4d916b36-cd54-4f45-8658-53824eccd034 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Terminating instance
Nov 28 10:56:41 user nova-compute[74994]: DEBUG nova.compute.manager [None req-4d916b36-cd54-4f45-8658-53824eccd034 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 10:56:41 user nova-compute[74994]: INFO nova.compute.manager [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Took 4.37 seconds to destroy the instance on the hypervisor.
Nov 28 10:56:41 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 10:56:41 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 10:56:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:42 user nova-compute[74994]: DEBUG nova.compute.manager [req-ac1770d7-6a5f-4e1a-a078-c206f516e04f req-26a6822d-d750-41d7-b2b5-5dd7c3a57932 service nova] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Received event network-vif-unplugged-b7041f22-1202-44d0-848a-3a3019d64e28 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:56:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ac1770d7-6a5f-4e1a-a078-c206f516e04f req-26a6822d-d750-41d7-b2b5-5dd7c3a57932 service nova] Acquiring lock "857e3cbc-af52-46f6-9b59-87bae405f009-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:56:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ac1770d7-6a5f-4e1a-a078-c206f516e04f req-26a6822d-d750-41d7-b2b5-5dd7c3a57932 service nova] Lock "857e3cbc-af52-46f6-9b59-87bae405f009-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:56:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ac1770d7-6a5f-4e1a-a078-c206f516e04f req-26a6822d-d750-41d7-b2b5-5dd7c3a57932 service nova] Lock "857e3cbc-af52-46f6-9b59-87bae405f009-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:56:42 user nova-compute[74994]: DEBUG nova.compute.manager [req-ac1770d7-6a5f-4e1a-a078-c206f516e04f req-26a6822d-d750-41d7-b2b5-5dd7c3a57932 service nova] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] No waiting events found dispatching network-vif-unplugged-b7041f22-1202-44d0-848a-3a3019d64e28 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:56:42 user nova-compute[74994]: DEBUG nova.compute.manager [req-ac1770d7-6a5f-4e1a-a078-c206f516e04f req-26a6822d-d750-41d7-b2b5-5dd7c3a57932 service nova] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Received event network-vif-unplugged-b7041f22-1202-44d0-848a-3a3019d64e28 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 10:56:42 user nova-compute[74994]: DEBUG nova.compute.manager [req-3fbee977-11a5-41fd-abc1-3a64ccf0f38a req-334545db-f4b7-4c60-89f9-14f70e5614da service nova] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Received event network-changed-32f4f44f-44b7-47f0-9c06-bd33d3a48216 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:56:42 user nova-compute[74994]: DEBUG nova.compute.manager [req-3fbee977-11a5-41fd-abc1-3a64ccf0f38a req-334545db-f4b7-4c60-89f9-14f70e5614da service nova] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Refreshing instance network info cache due to event network-changed-32f4f44f-44b7-47f0-9c06-bd33d3a48216. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:56:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-3fbee977-11a5-41fd-abc1-3a64ccf0f38a req-334545db-f4b7-4c60-89f9-14f70e5614da service nova] Acquiring lock "refresh_cache-c608eb72-4375-4e2a-aae8-a03d086b72e8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:56:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-3fbee977-11a5-41fd-abc1-3a64ccf0f38a req-334545db-f4b7-4c60-89f9-14f70e5614da service nova] Acquired lock "refresh_cache-c608eb72-4375-4e2a-aae8-a03d086b72e8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:56:42 user nova-compute[74994]: DEBUG nova.network.neutron [req-3fbee977-11a5-41fd-abc1-3a64ccf0f38a req-334545db-f4b7-4c60-89f9-14f70e5614da service nova] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Refreshing network info cache for port 32f4f44f-44b7-47f0-9c06-bd33d3a48216 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:56:42 user nova-compute[74994]: DEBUG nova.network.neutron [req-3fbee977-11a5-41fd-abc1-3a64ccf0f38a req-334545db-f4b7-4c60-89f9-14f70e5614da service nova] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Updated VIF entry in instance network info cache for port 32f4f44f-44b7-47f0-9c06-bd33d3a48216. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 10:56:42 user nova-compute[74994]: DEBUG nova.network.neutron [req-3fbee977-11a5-41fd-abc1-3a64ccf0f38a req-334545db-f4b7-4c60-89f9-14f70e5614da service nova] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Updating instance_info_cache with network_info: [{"id": "32f4f44f-44b7-47f0-9c06-bd33d3a48216", "address": "fa:16:3e:12:e4:7a", "network": {"id": "d339a2cb-dddd-4921-9ac8-bde483746df2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1820767196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56f0f99bee04f7baace9d7aa22cffa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32f4f44f-44", "ovs_interfaceid": "32f4f44f-44b7-47f0-9c06-bd33d3a48216", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:56:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-3fbee977-11a5-41fd-abc1-3a64ccf0f38a req-334545db-f4b7-4c60-89f9-14f70e5614da service nova] Releasing lock "refresh_cache-c608eb72-4375-4e2a-aae8-a03d086b72e8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:56:42 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Instance destroyed successfully.
Nov 28 10:56:42 user nova-compute[74994]: DEBUG nova.objects.instance [None req-4d916b36-cd54-4f45-8658-53824eccd034 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Lazy-loading 'resources' on Instance uuid 857e3cbc-af52-46f6-9b59-87bae405f009 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:56:42 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-4d916b36-cd54-4f45-8658-53824eccd034 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T10:54:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-903806156',display_name='tempest-AttachSCSIVolumeTestJSON-server-903806156',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-903806156',id=19,image_ref='9b906531-9562-42f5-8c85-218030b4dd15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPcUZLmEz9qP2NFqGz7dZDlDjinXbY21BrWxY4+x9M9cs8G3GHxbjbglEL/W0zXmUI949C8vNadb0OJJe8XGbmIppujSCN/mtiQi8Eld996hJ8R5ykCozM1cb2Xr9W/XNA==',key_name='tempest-keypair-617834919',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:54:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ad067812a804757a4326e0ed01ebee0',ramdisk_id='',reservation_id='r-z0xepplf',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9b906531-9562-42f5-8c85-218030b4dd15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-505349781',owner_user_name='tempest-AttachSCSIVolumeTestJSON-505349781-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T10:54:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0676ca6f7364e2a84ef988dae17c9e6',uuid=857e3cbc-af52-46f6-9b59-87bae405f009,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7041f22-1202-44d0-848a-3a3019d64e28", "address": "fa:16:3e:37:c1:48", "network": {"id": "eaf51f61-18e2-4b5d-a014-e8c14a30dd64", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-390069039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ad067812a804757a4326e0ed01ebee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7041f22-12", "ovs_interfaceid": "b7041f22-1202-44d0-848a-3a3019d64e28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 10:56:42 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-4d916b36-cd54-4f45-8658-53824eccd034 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Converting VIF {"id": "b7041f22-1202-44d0-848a-3a3019d64e28", "address": "fa:16:3e:37:c1:48", "network": {"id": "eaf51f61-18e2-4b5d-a014-e8c14a30dd64", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-390069039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ad067812a804757a4326e0ed01ebee0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7041f22-12", "ovs_interfaceid": "b7041f22-1202-44d0-848a-3a3019d64e28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:56:42 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-4d916b36-cd54-4f45-8658-53824eccd034 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:c1:48,bridge_name='br-int',has_traffic_filtering=True,id=b7041f22-1202-44d0-848a-3a3019d64e28,network=Network(eaf51f61-18e2-4b5d-a014-e8c14a30dd64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7041f22-12') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:56:42 user nova-compute[74994]: DEBUG os_vif [None req-4d916b36-cd54-4f45-8658-53824eccd034 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:c1:48,bridge_name='br-int',has_traffic_filtering=True,id=b7041f22-1202-44d0-848a-3a3019d64e28,network=Network(eaf51f61-18e2-4b5d-a014-e8c14a30dd64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7041f22-12') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 10:56:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7041f22-12, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:56:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:56:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=522cc705-9d39-4467-83c3-89c6eac46c3d) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:56:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:56:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:42 user nova-compute[74994]: INFO os_vif [None req-4d916b36-cd54-4f45-8658-53824eccd034 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:c1:48,bridge_name='br-int',has_traffic_filtering=True,id=b7041f22-1202-44d0-848a-3a3019d64e28,network=Network(eaf51f61-18e2-4b5d-a014-e8c14a30dd64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7041f22-12')
Nov 28 10:56:42 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-4d916b36-cd54-4f45-8658-53824eccd034 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Deleting instance files /opt/stack/data/nova/instances/857e3cbc-af52-46f6-9b59-87bae405f009_del
Nov 28 10:56:42 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-4d916b36-cd54-4f45-8658-53824eccd034 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Deletion of /opt/stack/data/nova/instances/857e3cbc-af52-46f6-9b59-87bae405f009_del complete
Nov 28 10:56:42 user nova-compute[74994]: INFO nova.compute.manager [None req-4d916b36-cd54-4f45-8658-53824eccd034 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 28 10:56:42 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-4d916b36-cd54-4f45-8658-53824eccd034 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 10:56:42 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 10:56:42 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 10:56:43 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:56:43 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Took 0.89 seconds to deallocate network for instance.
Nov 28 10:56:43 user nova-compute[74994]: DEBUG nova.compute.manager [req-1492db93-28fb-45f8-874c-a96458e027b1 req-6a106e3a-ec7f-4daa-9e19-d0a8126f8b3b service nova] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Received event network-vif-deleted-b7041f22-1202-44d0-848a-3a3019d64e28 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:56:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4d916b36-cd54-4f45-8658-53824eccd034 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:56:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4d916b36-cd54-4f45-8658-53824eccd034 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:56:44 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-4d916b36-cd54-4f45-8658-53824eccd034 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:56:44 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-4d916b36-cd54-4f45-8658-53824eccd034 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:56:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4d916b36-cd54-4f45-8658-53824eccd034 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.413s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:56:44 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-4d916b36-cd54-4f45-8658-53824eccd034 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Deleted allocations for instance 857e3cbc-af52-46f6-9b59-87bae405f009
Nov 28 10:56:44 user nova-compute[74994]: DEBUG nova.compute.manager [req-86c69c45-8b55-40b5-b288-7923ab8b67b7 req-3e4b262d-7da0-4d31-8b4c-0b7288479b74 service nova] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Received event network-vif-plugged-b7041f22-1202-44d0-848a-3a3019d64e28 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:56:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-86c69c45-8b55-40b5-b288-7923ab8b67b7 req-3e4b262d-7da0-4d31-8b4c-0b7288479b74 service nova] Acquiring lock "857e3cbc-af52-46f6-9b59-87bae405f009-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:56:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-86c69c45-8b55-40b5-b288-7923ab8b67b7 req-3e4b262d-7da0-4d31-8b4c-0b7288479b74 service nova] Lock "857e3cbc-af52-46f6-9b59-87bae405f009-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:56:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-86c69c45-8b55-40b5-b288-7923ab8b67b7 req-3e4b262d-7da0-4d31-8b4c-0b7288479b74 service nova] Lock "857e3cbc-af52-46f6-9b59-87bae405f009-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:56:44 user nova-compute[74994]: DEBUG nova.compute.manager [req-86c69c45-8b55-40b5-b288-7923ab8b67b7 req-3e4b262d-7da0-4d31-8b4c-0b7288479b74 service nova] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] No waiting events found dispatching network-vif-plugged-b7041f22-1202-44d0-848a-3a3019d64e28 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:56:44 user nova-compute[74994]: WARNING nova.compute.manager [req-86c69c45-8b55-40b5-b288-7923ab8b67b7 req-3e4b262d-7da0-4d31-8b4c-0b7288479b74 service nova] [instance: 857e3cbc-af52-46f6-9b59-87bae405f009] Received unexpected event network-vif-plugged-b7041f22-1202-44d0-848a-3a3019d64e28 for instance with vm_state deleted and task_state None.
Nov 28 10:56:44 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:44 user nova-compute[74994]: DEBUG nova.compute.manager [req-158cf132-91b1-4feb-b287-2d1d4987d743 req-0b189650-04a9-40b9-969b-398a0734397a service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received event network-vif-deleted-18e1fc8f-76a7-400e-bcde-5178f8b061bd {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:56:44 user nova-compute[74994]: INFO nova.compute.manager [req-158cf132-91b1-4feb-b287-2d1d4987d743 req-0b189650-04a9-40b9-969b-398a0734397a service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Neutron deleted interface 18e1fc8f-76a7-400e-bcde-5178f8b061bd; detaching it from the instance and deleting it from the info cache
Nov 28 10:56:44 user nova-compute[74994]: DEBUG nova.network.neutron [req-158cf132-91b1-4feb-b287-2d1d4987d743 req-0b189650-04a9-40b9-969b-398a0734397a service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Updating instance_info_cache with network_info: [{"id": "9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50", "address": "fa:16:3e:cb:7d:77", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cdf27ff-58", "ovs_interfaceid": "9cdf27ff-5873-4691-b9c0-2ecd8eb8fa50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3d8a5004-44ff-4247-b63e-9cc70b4c91e7", "address": "fa:16:3e:15:89:0f", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8a5004-44", "ovs_interfaceid": "3d8a5004-44ff-4247-b63e-9cc70b4c91e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "df9a6a76-006b-4adc-9e84-ee61d037da31", "address": "fa:16:3e:78:52:33", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf9a6a76-00", "ovs_interfaceid": "df9a6a76-006b-4adc-9e84-ee61d037da31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0c67dc60-232f-45b1-b637-48db3477ce20", "address": "fa:16:3e:89:ae:7a", "network": {"id": "d367a4f8-41c7-4ce3-a7f4-ca8d5d76e227", "bridge": "br-int", "label": "tempest-device-tagging-net1-116152012", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c67dc60-23", "ovs_interfaceid": "0c67dc60-232f-45b1-b637-48db3477ce20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "64313c64-2811-46b0-8953-8b80db3604a2", "address": "fa:16:3e:95:6b:d7", "network": {"id": "12f2a6c7-ea1a-4a67-9b24-50b67341a827", "bridge": "br-int", "label": "tempest-device-tagging-net2-1808297123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64313c64-28", "ovs_interfaceid": "64313c64-2811-46b0-8953-8b80db3604a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f27415ef-3b18-4406-8cc2-f5bd07325d95", "address": "fa:16:3e:25:6c:cc", "network": {"id": "12f2a6c7-ea1a-4a67-9b24-50b67341a827", "bridge": "br-int", "label": "tempest-device-tagging-net2-1808297123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f75aabbbe5d644d1a5752a68847017aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf27415ef-3b", "ovs_interfaceid": "f27415ef-3b18-4406-8cc2-f5bd07325d95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:56:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4d916b36-cd54-4f45-8658-53824eccd034 tempest-AttachSCSIVolumeTestJSON-505349781 tempest-AttachSCSIVolumeTestJSON-505349781-project-member] Lock "857e3cbc-af52-46f6-9b59-87bae405f009" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.455s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:56:44 user nova-compute[74994]: DEBUG nova.compute.manager [req-158cf132-91b1-4feb-b287-2d1d4987d743 req-0b189650-04a9-40b9-969b-398a0734397a service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Detach interface failed, port_id=18e1fc8f-76a7-400e-bcde-5178f8b061bd, reason: Instance ab5b6240-0510-48fb-bbf5-104696eb52d7 could not be found. {{(pid=74994) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 10:56:45 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:56:45 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Took 3.73 seconds to deallocate network for instance.
Nov 28 10:56:46 user nova-compute[74994]: DEBUG nova.compute.manager [req-aa104d04-5298-4519-9720-62d2eca0a2aa req-734ca998-3514-4ba7-850d-1636b98adb03 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received event network-vif-deleted-f27415ef-3b18-4406-8cc2-f5bd07325d95 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:56:46 user nova-compute[74994]: DEBUG nova.compute.manager [req-aa104d04-5298-4519-9720-62d2eca0a2aa req-734ca998-3514-4ba7-850d-1636b98adb03 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received event network-vif-deleted-df9a6a76-006b-4adc-9e84-ee61d037da31 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:56:46 user nova-compute[74994]: DEBUG nova.compute.manager [req-aa104d04-5298-4519-9720-62d2eca0a2aa req-734ca998-3514-4ba7-850d-1636b98adb03 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received event network-vif-deleted-64313c64-2811-46b0-8953-8b80db3604a2 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:56:46 user nova-compute[74994]: DEBUG nova.compute.manager [req-aa104d04-5298-4519-9720-62d2eca0a2aa req-734ca998-3514-4ba7-850d-1636b98adb03 service nova] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Received event network-vif-deleted-0c67dc60-232f-45b1-b637-48db3477ce20 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG nova.compute.manager [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 10:56:47 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Creating image(s)
Nov 28 10:56:47 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Did not create local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Ensure instance console log exists: /opt/stack/data/nova/instances/c608eb72-4375-4e2a-aae8-a03d086b72e8/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Start _get_guest_xml network_info=[{"id": "32f4f44f-44b7-47f0-9c06-bd33d3a48216", "address": "fa:16:3e:12:e4:7a", "network": {"id": "d339a2cb-dddd-4921-9ac8-bde483746df2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1820767196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56f0f99bee04f7baace9d7aa22cffa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32f4f44f-44", "ovs_interfaceid": "32f4f44f-44b7-47f0-9c06-bd33d3a48216", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FuvdZRiP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c608eb72-4375-4e2a-aae8-a03d086b72e8', 'attached_at': '', 'detached_at': '', 'volume_id': '86619b11-b935-4f21-a4e1-f6d121626ef8', 'serial': '86619b11-b935-4f21-a4e1-f6d121626ef8'}, 'attachment_id': '11b4e095-ca56-4bd2-bbd4-b0a4b40933bf', 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 10:56:47 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:56:47 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:56:47 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FuvdZRiP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:56:47 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:56:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.006s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:56:47 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:56:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:56:47 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 10:56:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc82f04-3197-42f4-ad21-bcb68b3a4070]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 10:56:47 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[854b9273-e2a9-44dc-9210-b59e3c15199d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8] added
Nov 28 10:56:47 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1f6e94-8979-4538-922f-0472c729aed7]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3698f1-d590-4369-848b-2665c4dbcc2f]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FuvdZRiP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FuvdZRiP" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3836dec5-ad2e-44d2-a191-02a95a200d75]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FuvdZRiP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.173s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf49a35-9dc8-4892-ab83-00decacde2ae]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[78717b0d-771e-432d-a726-d5f501c0a553]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:56:47 user nova-compute[74994]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)
Nov 28 10:56:47 user nova-compute[74994]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 10:56:47 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:56:47 user nova-compute[74994]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)
Nov 28 10:56:47 user nova-compute[74994]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 10:56:47 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[66105559-f7c8-4932-87a8-d96a832ecbb2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8, portal: 172.16.0.220,3260]
Nov 28 10:56:47 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8, portal: 172.16.0.220,3260] successful.
Nov 28 10:56:47 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[36663161-8139-4d0e-9a9a-d2374c08b780]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda3a751-87f1-44e7-bcd9-c889baabb870]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:56:47 user nova-compute[74994]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)
Nov 28 10:56:47 user nova-compute[74994]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 10:56:47 user nova-compute[74994]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)
Nov 28 10:56:47 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:56:47 user nova-compute[74994]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)
Nov 28 10:56:47 user nova-compute[74994]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 10:56:47 user nova-compute[74994]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)
Nov 28 10:56:47 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.436s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 10:56:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:56:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:56:48 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecffa3b7-2b27-43ec-a24d-00f9550209dc]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:56:48 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: None {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 10:56:48 user nova-compute[74994]: INFO nova.compute.manager [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] [instance: ab5b6240-0510-48fb-bbf5-104696eb52d7] Took 2.40 seconds to detach 3 volumes for instance.
Nov 28 10:56:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:56:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:56:48 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:56:48 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:56:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.322s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:56:48 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Deleted allocations for instance ab5b6240-0510-48fb-bbf5-104696eb52d7
Nov 28 10:56:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5ab04dea-097e-426a-b8de-e3e7bb806bde tempest-TaggedBootDevicesTest-724507959 tempest-TaggedBootDevicesTest-724507959-project-member] Lock "ab5b6240-0510-48fb-bbf5-104696eb52d7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.986s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:56:49 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 10:56:49 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FuvdZRiP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 10:56:49 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.467s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:56:49 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] <== connect_volume: return (1473ms) {'type': 'block', 'scsi_wwn': '23539656133363639', 'path': '/dev/sdc'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:56:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539656133363639', 'path': '/dev/sdc'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 10:56:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:56:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1331166102',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1331166102',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsPFcHXuCq3kbGJDtMMmhIV4dbLKEKBvccID7JXVRtX2m0hXUtB+UaF2Z44+Aof8FA3hDVjNSG6/8w3Oy5AFwAhAf7X79exeFfPY7JAvpS4tXuC4Ysn2gqz/3KAQRfb2w==',key_name='tempest-keypair-1144255784',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f56f0f99bee04f7baace9d7aa22cffa8',ramdisk_id='',reservation_id='r-f0it11pn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1394089599',owner_user_name='tempest-ServerActionsV293TestJSON-1394089599-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:56:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='564e6983bd92417a81d0ec2b5e6253b3',uuid=c608eb72-4375-4e2a-aae8-a03d086b72e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32f4f44f-44b7-47f0-9c06-bd33d3a48216", "address": "fa:16:3e:12:e4:7a", "network": {"id": "d339a2cb-dddd-4921-9ac8-bde483746df2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1820767196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56f0f99bee04f7baace9d7aa22cffa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32f4f44f-44", "ovs_interfaceid": "32f4f44f-44b7-47f0-9c06-bd33d3a48216", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:56:49 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Converting VIF {"id": "32f4f44f-44b7-47f0-9c06-bd33d3a48216", "address": "fa:16:3e:12:e4:7a", "network": {"id": "d339a2cb-dddd-4921-9ac8-bde483746df2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1820767196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56f0f99bee04f7baace9d7aa22cffa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32f4f44f-44", "ovs_interfaceid": "32f4f44f-44b7-47f0-9c06-bd33d3a48216", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:56:49 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:e4:7a,bridge_name='br-int',has_traffic_filtering=True,id=32f4f44f-44b7-47f0-9c06-bd33d3a48216,network=Network(d339a2cb-dddd-4921-9ac8-bde483746df2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32f4f44f-44') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:56:49 user nova-compute[74994]: DEBUG nova.objects.instance [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Lazy-loading 'pci_devices' on Instance uuid c608eb72-4375-4e2a-aae8-a03d086b72e8 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:56:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] End _get_guest_xml xml=<domain type="kvm">
Nov 28 10:56:49 user nova-compute[74994]:   <uuid>c608eb72-4375-4e2a-aae8-a03d086b72e8</uuid>
Nov 28 10:56:49 user nova-compute[74994]:   <name>instance-00000017</name>
Nov 28 10:56:49 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 10:56:49 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 10:56:49 user nova-compute[74994]:   <metadata>
Nov 28 10:56:49 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 10:56:49 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 10:56:49 user nova-compute[74994]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1331166102</nova:name>
Nov 28 10:56:49 user nova-compute[74994]:       <nova:creationTime>2023-11-28 10:56:47</nova:creationTime>
Nov 28 10:56:49 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 10:56:49 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 10:56:49 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 10:56:49 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 10:56:49 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 10:56:49 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 10:56:49 user nova-compute[74994]:       </nova:flavor>
Nov 28 10:56:49 user nova-compute[74994]:       <nova:owner>
Nov 28 10:56:49 user nova-compute[74994]:         <nova:user uuid="564e6983bd92417a81d0ec2b5e6253b3">tempest-ServerActionsV293TestJSON-1394089599-project-member</nova:user>
Nov 28 10:56:49 user nova-compute[74994]:         <nova:project uuid="f56f0f99bee04f7baace9d7aa22cffa8">tempest-ServerActionsV293TestJSON-1394089599</nova:project>
Nov 28 10:56:49 user nova-compute[74994]:       </nova:owner>
Nov 28 10:56:49 user nova-compute[74994]:       <nova:ports>
Nov 28 10:56:49 user nova-compute[74994]:         <nova:port uuid="32f4f44f-44b7-47f0-9c06-bd33d3a48216">
Nov 28 10:56:49 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 10:56:49 user nova-compute[74994]:         </nova:port>
Nov 28 10:56:49 user nova-compute[74994]:       </nova:ports>
Nov 28 10:56:49 user nova-compute[74994]:     </nova:instance>
Nov 28 10:56:49 user nova-compute[74994]:   </metadata>
Nov 28 10:56:49 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 10:56:49 user nova-compute[74994]:     <system>
Nov 28 10:56:49 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 10:56:49 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 10:56:49 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 10:56:49 user nova-compute[74994]:       <entry name="serial">c608eb72-4375-4e2a-aae8-a03d086b72e8</entry>
Nov 28 10:56:49 user nova-compute[74994]:       <entry name="uuid">c608eb72-4375-4e2a-aae8-a03d086b72e8</entry>
Nov 28 10:56:49 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 10:56:49 user nova-compute[74994]:     </system>
Nov 28 10:56:49 user nova-compute[74994]:   </sysinfo>
Nov 28 10:56:49 user nova-compute[74994]:   <os>
Nov 28 10:56:49 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 10:56:49 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 10:56:49 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 10:56:49 user nova-compute[74994]:   </os>
Nov 28 10:56:49 user nova-compute[74994]:   <features>
Nov 28 10:56:49 user nova-compute[74994]:     <acpi/>
Nov 28 10:56:49 user nova-compute[74994]:     <apic/>
Nov 28 10:56:49 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 10:56:49 user nova-compute[74994]:   </features>
Nov 28 10:56:49 user nova-compute[74994]:   <clock offset="utc">
Nov 28 10:56:49 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 10:56:49 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 10:56:49 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 10:56:49 user nova-compute[74994]:   </clock>
Nov 28 10:56:49 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 10:56:49 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 10:56:49 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 10:56:49 user nova-compute[74994]:   </cpu>
Nov 28 10:56:49 user nova-compute[74994]:   <devices>
Nov 28 10:56:49 user nova-compute[74994]:     <disk type="block" device="disk">
Nov 28 10:56:49 user nova-compute[74994]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 10:56:49 user nova-compute[74994]:       <source dev="/dev/sdc"/>
Nov 28 10:56:49 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 10:56:49 user nova-compute[74994]:       <serial>86619b11-b935-4f21-a4e1-f6d121626ef8</serial>
Nov 28 10:56:49 user nova-compute[74994]:     </disk>
Nov 28 10:56:49 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 10:56:49 user nova-compute[74994]:       <mac address="fa:16:3e:12:e4:7a"/>
Nov 28 10:56:49 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:56:49 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 10:56:49 user nova-compute[74994]:       <target dev="tap32f4f44f-44"/>
Nov 28 10:56:49 user nova-compute[74994]:     </interface>
Nov 28 10:56:49 user nova-compute[74994]:     <serial type="pty">
Nov 28 10:56:49 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/c608eb72-4375-4e2a-aae8-a03d086b72e8/console.log" append="off"/>
Nov 28 10:56:49 user nova-compute[74994]:     </serial>
Nov 28 10:56:49 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 10:56:49 user nova-compute[74994]:     <video>
Nov 28 10:56:49 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:56:49 user nova-compute[74994]:     </video>
Nov 28 10:56:49 user nova-compute[74994]:     <rng model="virtio">
Nov 28 10:56:49 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 10:56:49 user nova-compute[74994]:     </rng>
Nov 28 10:56:49 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 10:56:49 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 10:56:49 user nova-compute[74994]:       <stats period="10"/>
Nov 28 10:56:49 user nova-compute[74994]:     </memballoon>
Nov 28 10:56:49 user nova-compute[74994]:   </devices>
Nov 28 10:56:49 user nova-compute[74994]: </domain>
Nov 28 10:56:49 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 10:56:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:56:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1331166102',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1331166102',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsPFcHXuCq3kbGJDtMMmhIV4dbLKEKBvccID7JXVRtX2m0hXUtB+UaF2Z44+Aof8FA3hDVjNSG6/8w3Oy5AFwAhAf7X79exeFfPY7JAvpS4tXuC4Ysn2gqz/3KAQRfb2w==',key_name='tempest-keypair-1144255784',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f56f0f99bee04f7baace9d7aa22cffa8',ramdisk_id='',reservation_id='r-f0it11pn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1394089599',owner_user_name='tempest-ServerActionsV293TestJSON-1394089599-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:56:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='564e6983bd92417a81d0ec2b5e6253b3',uuid=c608eb72-4375-4e2a-aae8-a03d086b72e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32f4f44f-44b7-47f0-9c06-bd33d3a48216", "address": "fa:16:3e:12:e4:7a", "network": {"id": "d339a2cb-dddd-4921-9ac8-bde483746df2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1820767196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56f0f99bee04f7baace9d7aa22cffa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32f4f44f-44", "ovs_interfaceid": "32f4f44f-44b7-47f0-9c06-bd33d3a48216", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 10:56:49 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Converting VIF {"id": "32f4f44f-44b7-47f0-9c06-bd33d3a48216", "address": "fa:16:3e:12:e4:7a", "network": {"id": "d339a2cb-dddd-4921-9ac8-bde483746df2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1820767196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56f0f99bee04f7baace9d7aa22cffa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32f4f44f-44", "ovs_interfaceid": "32f4f44f-44b7-47f0-9c06-bd33d3a48216", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:56:49 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:e4:7a,bridge_name='br-int',has_traffic_filtering=True,id=32f4f44f-44b7-47f0-9c06-bd33d3a48216,network=Network(d339a2cb-dddd-4921-9ac8-bde483746df2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32f4f44f-44') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:56:49 user nova-compute[74994]: DEBUG os_vif [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:e4:7a,bridge_name='br-int',has_traffic_filtering=True,id=32f4f44f-44b7-47f0-9c06-bd33d3a48216,network=Network(d339a2cb-dddd-4921-9ac8-bde483746df2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32f4f44f-44') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 10:56:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:56:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 10:56:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8ccd21f0-2521-5c31-9b72-a3ed68d18d6f', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:56:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:56:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap32f4f44f-44, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:56:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap32f4f44f-44, col_values=(('qos', UUID('94dd4220-ddb7-4940-8e5d-ffb05ff879cb')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:56:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap32f4f44f-44, col_values=(('external_ids', {'iface-id': '32f4f44f-44b7-47f0-9c06-bd33d3a48216', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:e4:7a', 'vm-uuid': 'c608eb72-4375-4e2a-aae8-a03d086b72e8'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:56:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:56:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:49 user nova-compute[74994]: INFO os_vif [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:e4:7a,bridge_name='br-int',has_traffic_filtering=True,id=32f4f44f-44b7-47f0-9c06-bd33d3a48216,network=Network(d339a2cb-dddd-4921-9ac8-bde483746df2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32f4f44f-44')
Nov 28 10:56:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:56:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] No VIF found with MAC fa:16:3e:12:e4:7a, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:56:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:50 user nova-compute[74994]: DEBUG nova.compute.manager [req-cee652f9-058e-42da-81f3-94ade18ceba5 req-ffe3a8f6-8ef0-423f-aa24-64e9bc733470 service nova] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Received event network-vif-plugged-32f4f44f-44b7-47f0-9c06-bd33d3a48216 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:56:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-cee652f9-058e-42da-81f3-94ade18ceba5 req-ffe3a8f6-8ef0-423f-aa24-64e9bc733470 service nova] Acquiring lock "c608eb72-4375-4e2a-aae8-a03d086b72e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:56:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-cee652f9-058e-42da-81f3-94ade18ceba5 req-ffe3a8f6-8ef0-423f-aa24-64e9bc733470 service nova] Lock "c608eb72-4375-4e2a-aae8-a03d086b72e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:56:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-cee652f9-058e-42da-81f3-94ade18ceba5 req-ffe3a8f6-8ef0-423f-aa24-64e9bc733470 service nova] Lock "c608eb72-4375-4e2a-aae8-a03d086b72e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:56:50 user nova-compute[74994]: DEBUG nova.compute.manager [req-cee652f9-058e-42da-81f3-94ade18ceba5 req-ffe3a8f6-8ef0-423f-aa24-64e9bc733470 service nova] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] No waiting events found dispatching network-vif-plugged-32f4f44f-44b7-47f0-9c06-bd33d3a48216 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:56:50 user nova-compute[74994]: WARNING nova.compute.manager [req-cee652f9-058e-42da-81f3-94ade18ceba5 req-ffe3a8f6-8ef0-423f-aa24-64e9bc733470 service nova] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Received unexpected event network-vif-plugged-32f4f44f-44b7-47f0-9c06-bd33d3a48216 for instance with vm_state building and task_state spawning.
Nov 28 10:56:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:52 user nova-compute[74994]: DEBUG nova.compute.manager [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 10:56:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 10:56:52 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Instance spawned successfully.
Nov 28 10:56:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 10:56:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:56:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:56:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:56:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:56:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:56:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:56:52 user nova-compute[74994]: INFO nova.compute.manager [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Took 5.04 seconds to spawn the instance on the hypervisor.
Nov 28 10:56:52 user nova-compute[74994]: DEBUG nova.compute.manager [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 10:56:52 user nova-compute[74994]: INFO nova.compute.manager [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Took 13.87 seconds to build instance.
Nov 28 10:56:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b59e923b-1284-4bc4-9155-4e3ebbccbb31 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Lock "c608eb72-4375-4e2a-aae8-a03d086b72e8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.988s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:56:52 user nova-compute[74994]: DEBUG nova.compute.manager [req-08e04d0a-4094-45f7-966c-3eca3fb22e31 req-c9b2069c-45d7-45fa-922e-b6189a338b3c service nova] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Received event network-vif-plugged-32f4f44f-44b7-47f0-9c06-bd33d3a48216 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:56:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-08e04d0a-4094-45f7-966c-3eca3fb22e31 req-c9b2069c-45d7-45fa-922e-b6189a338b3c service nova] Acquiring lock "c608eb72-4375-4e2a-aae8-a03d086b72e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:56:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-08e04d0a-4094-45f7-966c-3eca3fb22e31 req-c9b2069c-45d7-45fa-922e-b6189a338b3c service nova] Lock "c608eb72-4375-4e2a-aae8-a03d086b72e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:56:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-08e04d0a-4094-45f7-966c-3eca3fb22e31 req-c9b2069c-45d7-45fa-922e-b6189a338b3c service nova] Lock "c608eb72-4375-4e2a-aae8-a03d086b72e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:56:52 user nova-compute[74994]: DEBUG nova.compute.manager [req-08e04d0a-4094-45f7-966c-3eca3fb22e31 req-c9b2069c-45d7-45fa-922e-b6189a338b3c service nova] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] No waiting events found dispatching network-vif-plugged-32f4f44f-44b7-47f0-9c06-bd33d3a48216 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:56:52 user nova-compute[74994]: WARNING nova.compute.manager [req-08e04d0a-4094-45f7-966c-3eca3fb22e31 req-c9b2069c-45d7-45fa-922e-b6189a338b3c service nova] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Received unexpected event network-vif-plugged-32f4f44f-44b7-47f0-9c06-bd33d3a48216 for instance with vm_state active and task_state None.
Nov 28 10:56:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:56:59 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:57:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 10:57:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 10:57:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 10:57:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:06 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:57:07 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:57:07 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 10:57:07 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:08 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:57:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:10 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:57:10 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:57:10 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:57:10 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:57:10 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:57:10 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 10:57:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:57:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:57:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:57:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:57:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:57:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:57:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:57:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:57:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bce88d5-64b3-450b-b7e0-26a1c5d299c6/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:57:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bce88d5-64b3-450b-b7e0-26a1c5d299c6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:57:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bce88d5-64b3-450b-b7e0-26a1c5d299c6/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:57:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bce88d5-64b3-450b-b7e0-26a1c5d299c6/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:57:11 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 10:57:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:57:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:57:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:57:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:57:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:57:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:57:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:57:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:57:12 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 10:57:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:57:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:57:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:57:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:57:12 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 10:57:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b51d690-8198-4748-807d-1902e75564b9/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:57:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b51d690-8198-4748-807d-1902e75564b9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:57:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b51d690-8198-4748-807d-1902e75564b9/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:57:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b51d690-8198-4748-807d-1902e75564b9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:57:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:57:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:57:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:57:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:57:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:57:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:57:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:57:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:57:14 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 10:57:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:14 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:57:14 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:57:14 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=7743MB free_disk=25.253929138183594GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 10:57:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:57:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:57:14 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:57:14 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance bf357856-2d97-42e8-928d-71d0378f48c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:57:14 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 279e1c4c-36f9-492f-ab3f-1b587347eadd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:57:14 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 5b51d690-8198-4748-807d-1902e75564b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:57:14 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 759fbcfd-ab13-438f-b860-6393a97d1205 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:57:14 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:57:14 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 20716905-c56a-4729-8c5b-9188502dc477 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:57:14 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 2f4b631a-46c8-4f9b-b5f9-6e2542484658 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:57:14 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 8bce88d5-64b3-450b-b7e0-26a1c5d299c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:57:14 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance c608eb72-4375-4e2a-aae8-a03d086b72e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:57:14 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 10:57:14 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 10:57:15 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:57:15 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:57:15 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 10:57:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.538s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:57:16 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:57:16 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:57:16 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 10:57:16 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Rebuilding the list of instances to heal {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 10:57:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "refresh_cache-76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:57:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquired lock "refresh_cache-76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:57:16 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Forcefully refreshing network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 10:57:16 user nova-compute[74994]: DEBUG nova.objects.instance [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lazy-loading 'info_cache' on Instance uuid 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:57:16 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Updating instance_info_cache with network_info: [{"id": "6b1a991d-033b-45ab-839c-7b6b98082667", "address": "fa:16:3e:3c:9f:61", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b1a991d-03", "ovs_interfaceid": "6b1a991d-033b-45ab-839c-7b6b98082667", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:57:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Releasing lock "refresh_cache-76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:57:16 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Updated the network info_cache for instance {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 10:57:16 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:57:16 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:57:19 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:57:19 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:19 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "20605acb-092a-4214-a114-750f145d7af8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:57:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "20605acb-092a-4214-a114-750f145d7af8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:57:31 user nova-compute[74994]: DEBUG nova.compute.manager [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 10:57:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:57:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:57:31 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 10:57:31 user nova-compute[74994]: INFO nova.compute.claims [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Claim successful on node user
Nov 28 10:57:32 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:57:32 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:57:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.581s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:57:32 user nova-compute[74994]: DEBUG nova.compute.manager [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 10:57:32 user nova-compute[74994]: DEBUG nova.compute.manager [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 10:57:32 user nova-compute[74994]: DEBUG nova.network.neutron [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 10:57:32 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 10:57:32 user nova-compute[74994]: DEBUG nova.compute.manager [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 10:57:32 user nova-compute[74994]: DEBUG nova.policy [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd51be473c7284977a6533756a1f677f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb43a8fc7bd47728600741762f71112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 10:57:32 user nova-compute[74994]: DEBUG nova.compute.manager [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 10:57:32 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 10:57:32 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Creating image(s)
Nov 28 10:57:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "/opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:57:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "/opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:57:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "/opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:57:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:57:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.209s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:57:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:57:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:57:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:57:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.191s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:57:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8/disk 1073741824 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:57:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8/disk 1073741824" returned: 0 in 0.059s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:57:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:57:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:57:33 user nova-compute[74994]: DEBUG nova.network.neutron [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Successfully created port: 2b0693da-4e7d-4fb9-b7f0-adcb89d64f08 {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 10:57:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.231s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:57:33 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Checking if we can resize image /opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8/disk. size=1073741824 {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 10:57:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:57:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:57:33 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Cannot resize image /opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8/disk to a smaller size. {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 10:57:33 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Created local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 10:57:33 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Ensure instance console log exists: /opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 10:57:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:57:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:57:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:57:33 user nova-compute[74994]: DEBUG nova.network.neutron [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Successfully updated port: 2b0693da-4e7d-4fb9-b7f0-adcb89d64f08 {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 10:57:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "refresh_cache-20605acb-092a-4214-a114-750f145d7af8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:57:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquired lock "refresh_cache-20605acb-092a-4214-a114-750f145d7af8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:57:33 user nova-compute[74994]: DEBUG nova.network.neutron [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 10:57:33 user nova-compute[74994]: DEBUG nova.compute.manager [req-58b94679-88c8-4e13-b9d2-b59eac2bb45d req-6191603a-cabe-41fd-bb51-b13cbce23987 service nova] [instance: 20605acb-092a-4214-a114-750f145d7af8] Received event network-changed-2b0693da-4e7d-4fb9-b7f0-adcb89d64f08 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:57:33 user nova-compute[74994]: DEBUG nova.compute.manager [req-58b94679-88c8-4e13-b9d2-b59eac2bb45d req-6191603a-cabe-41fd-bb51-b13cbce23987 service nova] [instance: 20605acb-092a-4214-a114-750f145d7af8] Refreshing instance network info cache due to event network-changed-2b0693da-4e7d-4fb9-b7f0-adcb89d64f08. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:57:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-58b94679-88c8-4e13-b9d2-b59eac2bb45d req-6191603a-cabe-41fd-bb51-b13cbce23987 service nova] Acquiring lock "refresh_cache-20605acb-092a-4214-a114-750f145d7af8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:57:33 user nova-compute[74994]: DEBUG nova.network.neutron [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 10:57:33 user nova-compute[74994]: DEBUG nova.network.neutron [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Updating instance_info_cache with network_info: [{"id": "2b0693da-4e7d-4fb9-b7f0-adcb89d64f08", "address": "fa:16:3e:af:ea:62", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b0693da-4e", "ovs_interfaceid": "2b0693da-4e7d-4fb9-b7f0-adcb89d64f08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:57:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Releasing lock "refresh_cache-20605acb-092a-4214-a114-750f145d7af8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:57:33 user nova-compute[74994]: DEBUG nova.compute.manager [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Instance network_info: |[{"id": "2b0693da-4e7d-4fb9-b7f0-adcb89d64f08", "address": "fa:16:3e:af:ea:62", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b0693da-4e", "ovs_interfaceid": "2b0693da-4e7d-4fb9-b7f0-adcb89d64f08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 10:57:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-58b94679-88c8-4e13-b9d2-b59eac2bb45d req-6191603a-cabe-41fd-bb51-b13cbce23987 service nova] Acquired lock "refresh_cache-20605acb-092a-4214-a114-750f145d7af8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:57:34 user nova-compute[74994]: DEBUG nova.network.neutron [req-58b94679-88c8-4e13-b9d2-b59eac2bb45d req-6191603a-cabe-41fd-bb51-b13cbce23987 service nova] [instance: 20605acb-092a-4214-a114-750f145d7af8] Refreshing network info cache for port 2b0693da-4e7d-4fb9-b7f0-adcb89d64f08 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:57:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Start _get_guest_xml network_info=[{"id": "2b0693da-4e7d-4fb9-b7f0-adcb89d64f08", "address": "fa:16:3e:af:ea:62", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b0693da-4e", "ovs_interfaceid": "2b0693da-4e7d-4fb9-b7f0-adcb89d64f08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'aa939d1b-b8a6-4391-935b-0191bf5ccd0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 10:57:34 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:57:34 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:57:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 10:57:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 10:57:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 10:57:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 10:57:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 10:57:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 10:57:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 10:57:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 10:57:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 10:57:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 10:57:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 10:57:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 10:57:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 10:57:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 10:57:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 10:57:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 10:57:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:57:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-893238339',display_name='tempest-tempest.common.compute-instance-893238339',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-893238339',id=24,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBOY+NutkPemiyHeMnQLSk9aaZJeDN6wgP5qBeYjN7xZFqVw9TdQeE9oS3N1LsgeVKLYADzySBGVghLSJNwEz9H04AB8Wq7t5ky4d6BMahksF1kPbZitdOiyTWwqobeQw==',key_name='tempest-keypair-2025261715',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5eb43a8fc7bd47728600741762f71112',ramdisk_id='',reservation_id='r-qwz39s5c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1927948343',owner_user_name='tempest-ServerActionsTestOtherA-1927948343-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:57:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d51be473c7284977a6533756a1f677f9',uuid=20605acb-092a-4214-a114-750f145d7af8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b0693da-4e7d-4fb9-b7f0-adcb89d64f08", "address": "fa:16:3e:af:ea:62", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b0693da-4e", "ovs_interfaceid": "2b0693da-4e7d-4fb9-b7f0-adcb89d64f08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:57:34 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Converting VIF {"id": "2b0693da-4e7d-4fb9-b7f0-adcb89d64f08", "address": "fa:16:3e:af:ea:62", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b0693da-4e", "ovs_interfaceid": "2b0693da-4e7d-4fb9-b7f0-adcb89d64f08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:57:34 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:ea:62,bridge_name='br-int',has_traffic_filtering=True,id=2b0693da-4e7d-4fb9-b7f0-adcb89d64f08,network=Network(16dd32cd-5a00-4111-92e2-283e7635540f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b0693da-4e') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:57:34 user nova-compute[74994]: DEBUG nova.objects.instance [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lazy-loading 'pci_devices' on Instance uuid 20605acb-092a-4214-a114-750f145d7af8 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:57:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] End _get_guest_xml xml=<domain type="kvm">
Nov 28 10:57:34 user nova-compute[74994]:   <uuid>20605acb-092a-4214-a114-750f145d7af8</uuid>
Nov 28 10:57:34 user nova-compute[74994]:   <name>instance-00000018</name>
Nov 28 10:57:34 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 10:57:34 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 10:57:34 user nova-compute[74994]:   <metadata>
Nov 28 10:57:34 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 10:57:34 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 10:57:34 user nova-compute[74994]:       <nova:name>tempest-tempest.common.compute-instance-893238339</nova:name>
Nov 28 10:57:34 user nova-compute[74994]:       <nova:creationTime>2023-11-28 10:57:34</nova:creationTime>
Nov 28 10:57:34 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 10:57:34 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 10:57:34 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 10:57:34 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 10:57:34 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 10:57:34 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 10:57:34 user nova-compute[74994]:       </nova:flavor>
Nov 28 10:57:34 user nova-compute[74994]:       <nova:owner>
Nov 28 10:57:34 user nova-compute[74994]:         <nova:user uuid="d51be473c7284977a6533756a1f677f9">tempest-ServerActionsTestOtherA-1927948343-project-member</nova:user>
Nov 28 10:57:34 user nova-compute[74994]:         <nova:project uuid="5eb43a8fc7bd47728600741762f71112">tempest-ServerActionsTestOtherA-1927948343</nova:project>
Nov 28 10:57:34 user nova-compute[74994]:       </nova:owner>
Nov 28 10:57:34 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 10:57:34 user nova-compute[74994]:       <nova:ports>
Nov 28 10:57:34 user nova-compute[74994]:         <nova:port uuid="2b0693da-4e7d-4fb9-b7f0-adcb89d64f08">
Nov 28 10:57:34 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 10:57:34 user nova-compute[74994]:         </nova:port>
Nov 28 10:57:34 user nova-compute[74994]:       </nova:ports>
Nov 28 10:57:34 user nova-compute[74994]:     </nova:instance>
Nov 28 10:57:34 user nova-compute[74994]:   </metadata>
Nov 28 10:57:34 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 10:57:34 user nova-compute[74994]:     <system>
Nov 28 10:57:34 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 10:57:34 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 10:57:34 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 10:57:34 user nova-compute[74994]:       <entry name="serial">20605acb-092a-4214-a114-750f145d7af8</entry>
Nov 28 10:57:34 user nova-compute[74994]:       <entry name="uuid">20605acb-092a-4214-a114-750f145d7af8</entry>
Nov 28 10:57:34 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 10:57:34 user nova-compute[74994]:     </system>
Nov 28 10:57:34 user nova-compute[74994]:   </sysinfo>
Nov 28 10:57:34 user nova-compute[74994]:   <os>
Nov 28 10:57:34 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 10:57:34 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 10:57:34 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 10:57:34 user nova-compute[74994]:   </os>
Nov 28 10:57:34 user nova-compute[74994]:   <features>
Nov 28 10:57:34 user nova-compute[74994]:     <acpi/>
Nov 28 10:57:34 user nova-compute[74994]:     <apic/>
Nov 28 10:57:34 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 10:57:34 user nova-compute[74994]:   </features>
Nov 28 10:57:34 user nova-compute[74994]:   <clock offset="utc">
Nov 28 10:57:34 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 10:57:34 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 10:57:34 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 10:57:34 user nova-compute[74994]:   </clock>
Nov 28 10:57:34 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 10:57:34 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 10:57:34 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 10:57:34 user nova-compute[74994]:   </cpu>
Nov 28 10:57:34 user nova-compute[74994]:   <devices>
Nov 28 10:57:34 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 10:57:34 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 10:57:34 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8/disk"/>
Nov 28 10:57:34 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 10:57:34 user nova-compute[74994]:     </disk>
Nov 28 10:57:34 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 10:57:34 user nova-compute[74994]:       <mac address="fa:16:3e:af:ea:62"/>
Nov 28 10:57:34 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:57:34 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 10:57:34 user nova-compute[74994]:       <target dev="tap2b0693da-4e"/>
Nov 28 10:57:34 user nova-compute[74994]:     </interface>
Nov 28 10:57:34 user nova-compute[74994]:     <serial type="pty">
Nov 28 10:57:34 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8/console.log" append="off"/>
Nov 28 10:57:34 user nova-compute[74994]:     </serial>
Nov 28 10:57:34 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 10:57:34 user nova-compute[74994]:     <video>
Nov 28 10:57:34 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:57:34 user nova-compute[74994]:     </video>
Nov 28 10:57:34 user nova-compute[74994]:     <rng model="virtio">
Nov 28 10:57:34 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 10:57:34 user nova-compute[74994]:     </rng>
Nov 28 10:57:34 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 10:57:34 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 10:57:34 user nova-compute[74994]:       <stats period="10"/>
Nov 28 10:57:34 user nova-compute[74994]:     </memballoon>
Nov 28 10:57:34 user nova-compute[74994]:   </devices>
Nov 28 10:57:34 user nova-compute[74994]: </domain>
Nov 28 10:57:34 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 10:57:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:57:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-893238339',display_name='tempest-tempest.common.compute-instance-893238339',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-893238339',id=24,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBOY+NutkPemiyHeMnQLSk9aaZJeDN6wgP5qBeYjN7xZFqVw9TdQeE9oS3N1LsgeVKLYADzySBGVghLSJNwEz9H04AB8Wq7t5ky4d6BMahksF1kPbZitdOiyTWwqobeQw==',key_name='tempest-keypair-2025261715',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5eb43a8fc7bd47728600741762f71112',ramdisk_id='',reservation_id='r-qwz39s5c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1927948343',owner_user_name='tempest-ServerActionsTestOtherA-1927948343-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:57:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d51be473c7284977a6533756a1f677f9',uuid=20605acb-092a-4214-a114-750f145d7af8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b0693da-4e7d-4fb9-b7f0-adcb89d64f08", "address": "fa:16:3e:af:ea:62", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b0693da-4e", "ovs_interfaceid": "2b0693da-4e7d-4fb9-b7f0-adcb89d64f08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 10:57:34 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Converting VIF {"id": "2b0693da-4e7d-4fb9-b7f0-adcb89d64f08", "address": "fa:16:3e:af:ea:62", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b0693da-4e", "ovs_interfaceid": "2b0693da-4e7d-4fb9-b7f0-adcb89d64f08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:57:34 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:ea:62,bridge_name='br-int',has_traffic_filtering=True,id=2b0693da-4e7d-4fb9-b7f0-adcb89d64f08,network=Network(16dd32cd-5a00-4111-92e2-283e7635540f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b0693da-4e') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:57:34 user nova-compute[74994]: DEBUG os_vif [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:ea:62,bridge_name='br-int',has_traffic_filtering=True,id=2b0693da-4e7d-4fb9-b7f0-adcb89d64f08,network=Network(16dd32cd-5a00-4111-92e2-283e7635540f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b0693da-4e') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 10:57:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:57:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 10:57:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7a23f22e-2ff9-5461-8012-746eff0f8409', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:57:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:57:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b0693da-4e, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:57:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2b0693da-4e, col_values=(('qos', UUID('5de3e85a-cb43-4c84-969f-c8643fabf2b0')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:57:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2b0693da-4e, col_values=(('external_ids', {'iface-id': '2b0693da-4e7d-4fb9-b7f0-adcb89d64f08', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:ea:62', 'vm-uuid': '20605acb-092a-4214-a114-750f145d7af8'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:57:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:57:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:34 user nova-compute[74994]: INFO os_vif [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:ea:62,bridge_name='br-int',has_traffic_filtering=True,id=2b0693da-4e7d-4fb9-b7f0-adcb89d64f08,network=Network(16dd32cd-5a00-4111-92e2-283e7635540f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b0693da-4e')
Nov 28 10:57:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:57:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] No VIF found with MAC fa:16:3e:af:ea:62, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:57:34 user nova-compute[74994]: DEBUG nova.network.neutron [req-58b94679-88c8-4e13-b9d2-b59eac2bb45d req-6191603a-cabe-41fd-bb51-b13cbce23987 service nova] [instance: 20605acb-092a-4214-a114-750f145d7af8] Updated VIF entry in instance network info cache for port 2b0693da-4e7d-4fb9-b7f0-adcb89d64f08. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 10:57:34 user nova-compute[74994]: DEBUG nova.network.neutron [req-58b94679-88c8-4e13-b9d2-b59eac2bb45d req-6191603a-cabe-41fd-bb51-b13cbce23987 service nova] [instance: 20605acb-092a-4214-a114-750f145d7af8] Updating instance_info_cache with network_info: [{"id": "2b0693da-4e7d-4fb9-b7f0-adcb89d64f08", "address": "fa:16:3e:af:ea:62", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b0693da-4e", "ovs_interfaceid": "2b0693da-4e7d-4fb9-b7f0-adcb89d64f08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:57:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-58b94679-88c8-4e13-b9d2-b59eac2bb45d req-6191603a-cabe-41fd-bb51-b13cbce23987 service nova] Releasing lock "refresh_cache-20605acb-092a-4214-a114-750f145d7af8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:57:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:35 user nova-compute[74994]: DEBUG nova.compute.manager [req-f7cf5d0b-741d-423e-bedf-641ff176eaad req-b201a1e8-e579-43cd-a293-41e7a39d119c service nova] [instance: 20605acb-092a-4214-a114-750f145d7af8] Received event network-vif-plugged-2b0693da-4e7d-4fb9-b7f0-adcb89d64f08 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:57:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f7cf5d0b-741d-423e-bedf-641ff176eaad req-b201a1e8-e579-43cd-a293-41e7a39d119c service nova] Acquiring lock "20605acb-092a-4214-a114-750f145d7af8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:57:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f7cf5d0b-741d-423e-bedf-641ff176eaad req-b201a1e8-e579-43cd-a293-41e7a39d119c service nova] Lock "20605acb-092a-4214-a114-750f145d7af8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:57:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f7cf5d0b-741d-423e-bedf-641ff176eaad req-b201a1e8-e579-43cd-a293-41e7a39d119c service nova] Lock "20605acb-092a-4214-a114-750f145d7af8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:57:35 user nova-compute[74994]: DEBUG nova.compute.manager [req-f7cf5d0b-741d-423e-bedf-641ff176eaad req-b201a1e8-e579-43cd-a293-41e7a39d119c service nova] [instance: 20605acb-092a-4214-a114-750f145d7af8] No waiting events found dispatching network-vif-plugged-2b0693da-4e7d-4fb9-b7f0-adcb89d64f08 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:57:35 user nova-compute[74994]: WARNING nova.compute.manager [req-f7cf5d0b-741d-423e-bedf-641ff176eaad req-b201a1e8-e579-43cd-a293-41e7a39d119c service nova] [instance: 20605acb-092a-4214-a114-750f145d7af8] Received unexpected event network-vif-plugged-2b0693da-4e7d-4fb9-b7f0-adcb89d64f08 for instance with vm_state building and task_state spawning.
Nov 28 10:57:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "b743c491-ece8-4781-9530-b2f38ffc1079" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:57:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "b743c491-ece8-4781-9530-b2f38ffc1079" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:57:37 user nova-compute[74994]: DEBUG nova.compute.manager [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 10:57:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:57:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:57:37 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 10:57:37 user nova-compute[74994]: INFO nova.compute.claims [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Claim successful on node user
Nov 28 10:57:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquiring lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:57:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:57:37 user nova-compute[74994]: DEBUG nova.compute.manager [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 10:57:37 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:57:37 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:57:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.570s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:57:37 user nova-compute[74994]: DEBUG nova.compute.manager [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 10:57:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:57:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:57:37 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 10:57:37 user nova-compute[74994]: INFO nova.compute.claims [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Claim successful on node user
Nov 28 10:57:38 user nova-compute[74994]: DEBUG nova.compute.manager [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 10:57:38 user nova-compute[74994]: DEBUG nova.network.neutron [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 10:57:38 user nova-compute[74994]: DEBUG nova.compute.manager [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 10:57:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 10:57:38 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 20605acb-092a-4214-a114-750f145d7af8] Instance spawned successfully.
Nov 28 10:57:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 10:57:38 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 10:57:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:57:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:57:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:57:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:57:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:57:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:57:38 user nova-compute[74994]: DEBUG nova.compute.manager [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 10:57:38 user nova-compute[74994]: DEBUG nova.policy [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c49cba00cff4c4b80080c5f917b4176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612ae9ec21ad40a4b68e0926843874ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 10:57:38 user nova-compute[74994]: INFO nova.compute.manager [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Took 5.89 seconds to spawn the instance on the hypervisor.
Nov 28 10:57:38 user nova-compute[74994]: DEBUG nova.compute.manager [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 10:57:38 user nova-compute[74994]: DEBUG nova.compute.manager [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 10:57:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 10:57:38 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Creating image(s)
Nov 28 10:57:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "/opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:57:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "/opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:57:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "/opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:57:38 user nova-compute[74994]: INFO nova.compute.manager [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Took 6.85 seconds to build instance.
Nov 28 10:57:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:57:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f850924d-4663-4de0-b90b-87a3de29e654 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "20605acb-092a-4214-a114-750f145d7af8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.009s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:57:38 user nova-compute[74994]: DEBUG nova.compute.manager [req-1c28a048-eb1a-47ea-b298-898e2773398b req-6986a990-e9ab-4dc6-af13-b3837e56f660 service nova] [instance: 20605acb-092a-4214-a114-750f145d7af8] Received event network-vif-plugged-2b0693da-4e7d-4fb9-b7f0-adcb89d64f08 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:57:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-1c28a048-eb1a-47ea-b298-898e2773398b req-6986a990-e9ab-4dc6-af13-b3837e56f660 service nova] Acquiring lock "20605acb-092a-4214-a114-750f145d7af8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:57:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-1c28a048-eb1a-47ea-b298-898e2773398b req-6986a990-e9ab-4dc6-af13-b3837e56f660 service nova] Lock "20605acb-092a-4214-a114-750f145d7af8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:57:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-1c28a048-eb1a-47ea-b298-898e2773398b req-6986a990-e9ab-4dc6-af13-b3837e56f660 service nova] Lock "20605acb-092a-4214-a114-750f145d7af8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:57:38 user nova-compute[74994]: DEBUG nova.compute.manager [req-1c28a048-eb1a-47ea-b298-898e2773398b req-6986a990-e9ab-4dc6-af13-b3837e56f660 service nova] [instance: 20605acb-092a-4214-a114-750f145d7af8] No waiting events found dispatching network-vif-plugged-2b0693da-4e7d-4fb9-b7f0-adcb89d64f08 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:57:38 user nova-compute[74994]: WARNING nova.compute.manager [req-1c28a048-eb1a-47ea-b298-898e2773398b req-6986a990-e9ab-4dc6-af13-b3837e56f660 service nova] [instance: 20605acb-092a-4214-a114-750f145d7af8] Received unexpected event network-vif-plugged-2b0693da-4e7d-4fb9-b7f0-adcb89d64f08 for instance with vm_state active and task_state None.
Nov 28 10:57:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.194s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:57:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:57:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:57:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:57:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.187s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:57:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/disk 1073741824 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:57:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/disk 1073741824" returned: 0 in 0.114s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:57:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.306s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:57:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:57:38 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:57:38 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:57:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.003s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:57:38 user nova-compute[74994]: DEBUG nova.compute.manager [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 10:57:38 user nova-compute[74994]: DEBUG nova.network.neutron [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Successfully created port: 35d909ae-33dc-4cf7-90af-5d781ee6bb64 {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 10:57:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.196s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:57:39 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/disk. size=1073741824 {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 10:57:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:57:39 user nova-compute[74994]: DEBUG nova.compute.manager [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 10:57:39 user nova-compute[74994]: DEBUG nova.network.neutron [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 10:57:39 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 10:57:39 user nova-compute[74994]: DEBUG nova.compute.manager [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 10:57:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:39 user nova-compute[74994]: DEBUG nova.policy [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6b5c1a1f2efc4a2faf8b82d467681d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77126f6f39db4a628b74551ea7d0aa21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 10:57:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:57:39 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Cannot resize image /opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/disk to a smaller size. {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 10:57:39 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Created local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 10:57:39 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Ensure instance console log exists: /opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 10:57:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:57:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:57:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:57:39 user nova-compute[74994]: DEBUG nova.compute.manager [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 10:57:39 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 10:57:39 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Creating image(s)
Nov 28 10:57:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquiring lock "/opt/stack/data/nova/instances/4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:57:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "/opt/stack/data/nova/instances/4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:57:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "/opt/stack/data/nova/instances/4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:57:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:57:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.204s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:57:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquiring lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:57:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:57:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:57:39 user nova-compute[74994]: DEBUG nova.network.neutron [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Successfully updated port: 35d909ae-33dc-4cf7-90af-5d781ee6bb64 {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 10:57:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.213s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:57:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123/disk 1073741824 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:57:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "refresh_cache-b743c491-ece8-4781-9530-b2f38ffc1079" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:57:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquired lock "refresh_cache-b743c491-ece8-4781-9530-b2f38ffc1079" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:57:39 user nova-compute[74994]: DEBUG nova.network.neutron [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 10:57:39 user nova-compute[74994]: DEBUG nova.compute.manager [req-8209189b-aaba-43cb-869e-ead598ff63ea req-83a290f9-4fc9-4bd5-838c-1087797429dc service nova] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Received event network-changed-35d909ae-33dc-4cf7-90af-5d781ee6bb64 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:57:39 user nova-compute[74994]: DEBUG nova.compute.manager [req-8209189b-aaba-43cb-869e-ead598ff63ea req-83a290f9-4fc9-4bd5-838c-1087797429dc service nova] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Refreshing instance network info cache due to event network-changed-35d909ae-33dc-4cf7-90af-5d781ee6bb64. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:57:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8209189b-aaba-43cb-869e-ead598ff63ea req-83a290f9-4fc9-4bd5-838c-1087797429dc service nova] Acquiring lock "refresh_cache-b743c491-ece8-4781-9530-b2f38ffc1079" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:57:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123/disk 1073741824" returned: 0 in 0.067s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:57:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:57:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:57:39 user nova-compute[74994]: DEBUG nova.network.neutron [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.202s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123/disk. size=1073741824 {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Cannot resize image /opt/stack/data/nova/instances/4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123/disk to a smaller size. {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Created local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Ensure instance console log exists: /opt/stack/data/nova/instances/4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG nova.network.neutron [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Updating instance_info_cache with network_info: [{"id": "35d909ae-33dc-4cf7-90af-5d781ee6bb64", "address": "fa:16:3e:48:76:e2", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d909ae-33", "ovs_interfaceid": "35d909ae-33dc-4cf7-90af-5d781ee6bb64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG nova.network.neutron [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Successfully created port: a20ff85b-6e1c-4430-ab03-696b8521b056 {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Releasing lock "refresh_cache-b743c491-ece8-4781-9530-b2f38ffc1079" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG nova.compute.manager [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Instance network_info: |[{"id": "35d909ae-33dc-4cf7-90af-5d781ee6bb64", "address": "fa:16:3e:48:76:e2", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d909ae-33", "ovs_interfaceid": "35d909ae-33dc-4cf7-90af-5d781ee6bb64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8209189b-aaba-43cb-869e-ead598ff63ea req-83a290f9-4fc9-4bd5-838c-1087797429dc service nova] Acquired lock "refresh_cache-b743c491-ece8-4781-9530-b2f38ffc1079" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG nova.network.neutron [req-8209189b-aaba-43cb-869e-ead598ff63ea req-83a290f9-4fc9-4bd5-838c-1087797429dc service nova] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Refreshing network info cache for port 35d909ae-33dc-4cf7-90af-5d781ee6bb64 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Start _get_guest_xml network_info=[{"id": "35d909ae-33dc-4cf7-90af-5d781ee6bb64", "address": "fa:16:3e:48:76:e2", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d909ae-33", "ovs_interfaceid": "35d909ae-33dc-4cf7-90af-5d781ee6bb64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'aa939d1b-b8a6-4391-935b-0191bf5ccd0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 10:57:40 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:57:40 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:57:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:57:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-154052709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-154052709',id=25,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='612ae9ec21ad40a4b68e0926843874ae',ramdisk_id='',reservation_id='r-ja5k9c6j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-332508527',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:57:38Z,user_data=None,user_id='6c49cba00cff4c4b80080c5f917b4176',uuid=b743c491-ece8-4781-9530-b2f38ffc1079,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35d909ae-33dc-4cf7-90af-5d781ee6bb64", "address": "fa:16:3e:48:76:e2", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d909ae-33", "ovs_interfaceid": "35d909ae-33dc-4cf7-90af-5d781ee6bb64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Converting VIF {"id": "35d909ae-33dc-4cf7-90af-5d781ee6bb64", "address": "fa:16:3e:48:76:e2", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d909ae-33", "ovs_interfaceid": "35d909ae-33dc-4cf7-90af-5d781ee6bb64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:76:e2,bridge_name='br-int',has_traffic_filtering=True,id=35d909ae-33dc-4cf7-90af-5d781ee6bb64,network=Network(a1692a13-d1d7-4df6-bfc0-54f231846889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d909ae-33') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG nova.objects.instance [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lazy-loading 'pci_devices' on Instance uuid b743c491-ece8-4781-9530-b2f38ffc1079 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] End _get_guest_xml xml=<domain type="kvm">
Nov 28 10:57:40 user nova-compute[74994]:   <uuid>b743c491-ece8-4781-9530-b2f38ffc1079</uuid>
Nov 28 10:57:40 user nova-compute[74994]:   <name>instance-00000019</name>
Nov 28 10:57:40 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 10:57:40 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 10:57:40 user nova-compute[74994]:   <metadata>
Nov 28 10:57:40 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 10:57:40 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 10:57:40 user nova-compute[74994]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-154052709</nova:name>
Nov 28 10:57:40 user nova-compute[74994]:       <nova:creationTime>2023-11-28 10:57:40</nova:creationTime>
Nov 28 10:57:40 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 10:57:40 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 10:57:40 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 10:57:40 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 10:57:40 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 10:57:40 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 10:57:40 user nova-compute[74994]:       </nova:flavor>
Nov 28 10:57:40 user nova-compute[74994]:       <nova:owner>
Nov 28 10:57:40 user nova-compute[74994]:         <nova:user uuid="6c49cba00cff4c4b80080c5f917b4176">tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member</nova:user>
Nov 28 10:57:40 user nova-compute[74994]:         <nova:project uuid="612ae9ec21ad40a4b68e0926843874ae">tempest-ServerBootFromVolumeStableRescueTest-332508527</nova:project>
Nov 28 10:57:40 user nova-compute[74994]:       </nova:owner>
Nov 28 10:57:40 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 10:57:40 user nova-compute[74994]:       <nova:ports>
Nov 28 10:57:40 user nova-compute[74994]:         <nova:port uuid="35d909ae-33dc-4cf7-90af-5d781ee6bb64">
Nov 28 10:57:40 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 28 10:57:40 user nova-compute[74994]:         </nova:port>
Nov 28 10:57:40 user nova-compute[74994]:       </nova:ports>
Nov 28 10:57:40 user nova-compute[74994]:     </nova:instance>
Nov 28 10:57:40 user nova-compute[74994]:   </metadata>
Nov 28 10:57:40 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 10:57:40 user nova-compute[74994]:     <system>
Nov 28 10:57:40 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 10:57:40 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 10:57:40 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 10:57:40 user nova-compute[74994]:       <entry name="serial">b743c491-ece8-4781-9530-b2f38ffc1079</entry>
Nov 28 10:57:40 user nova-compute[74994]:       <entry name="uuid">b743c491-ece8-4781-9530-b2f38ffc1079</entry>
Nov 28 10:57:40 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 10:57:40 user nova-compute[74994]:     </system>
Nov 28 10:57:40 user nova-compute[74994]:   </sysinfo>
Nov 28 10:57:40 user nova-compute[74994]:   <os>
Nov 28 10:57:40 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 10:57:40 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 10:57:40 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 10:57:40 user nova-compute[74994]:   </os>
Nov 28 10:57:40 user nova-compute[74994]:   <features>
Nov 28 10:57:40 user nova-compute[74994]:     <acpi/>
Nov 28 10:57:40 user nova-compute[74994]:     <apic/>
Nov 28 10:57:40 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 10:57:40 user nova-compute[74994]:   </features>
Nov 28 10:57:40 user nova-compute[74994]:   <clock offset="utc">
Nov 28 10:57:40 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 10:57:40 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 10:57:40 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 10:57:40 user nova-compute[74994]:   </clock>
Nov 28 10:57:40 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 10:57:40 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 10:57:40 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 10:57:40 user nova-compute[74994]:   </cpu>
Nov 28 10:57:40 user nova-compute[74994]:   <devices>
Nov 28 10:57:40 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 10:57:40 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 10:57:40 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/disk"/>
Nov 28 10:57:40 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 10:57:40 user nova-compute[74994]:     </disk>
Nov 28 10:57:40 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 10:57:40 user nova-compute[74994]:       <mac address="fa:16:3e:48:76:e2"/>
Nov 28 10:57:40 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:57:40 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 10:57:40 user nova-compute[74994]:       <target dev="tap35d909ae-33"/>
Nov 28 10:57:40 user nova-compute[74994]:     </interface>
Nov 28 10:57:40 user nova-compute[74994]:     <serial type="pty">
Nov 28 10:57:40 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/console.log" append="off"/>
Nov 28 10:57:40 user nova-compute[74994]:     </serial>
Nov 28 10:57:40 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 10:57:40 user nova-compute[74994]:     <video>
Nov 28 10:57:40 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:57:40 user nova-compute[74994]:     </video>
Nov 28 10:57:40 user nova-compute[74994]:     <rng model="virtio">
Nov 28 10:57:40 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 10:57:40 user nova-compute[74994]:     </rng>
Nov 28 10:57:40 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 10:57:40 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 10:57:40 user nova-compute[74994]:       <stats period="10"/>
Nov 28 10:57:40 user nova-compute[74994]:     </memballoon>
Nov 28 10:57:40 user nova-compute[74994]:   </devices>
Nov 28 10:57:40 user nova-compute[74994]: </domain>
Nov 28 10:57:40 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:57:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-154052709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-154052709',id=25,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='612ae9ec21ad40a4b68e0926843874ae',ramdisk_id='',reservation_id='r-ja5k9c6j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-332508527',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:57:38Z,user_data=None,user_id='6c49cba00cff4c4b80080c5f917b4176',uuid=b743c491-ece8-4781-9530-b2f38ffc1079,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35d909ae-33dc-4cf7-90af-5d781ee6bb64", "address": "fa:16:3e:48:76:e2", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d909ae-33", "ovs_interfaceid": "35d909ae-33dc-4cf7-90af-5d781ee6bb64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Converting VIF {"id": "35d909ae-33dc-4cf7-90af-5d781ee6bb64", "address": "fa:16:3e:48:76:e2", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d909ae-33", "ovs_interfaceid": "35d909ae-33dc-4cf7-90af-5d781ee6bb64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:76:e2,bridge_name='br-int',has_traffic_filtering=True,id=35d909ae-33dc-4cf7-90af-5d781ee6bb64,network=Network(a1692a13-d1d7-4df6-bfc0-54f231846889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d909ae-33') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG os_vif [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:76:e2,bridge_name='br-int',has_traffic_filtering=True,id=35d909ae-33dc-4cf7-90af-5d781ee6bb64,network=Network(a1692a13-d1d7-4df6-bfc0-54f231846889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d909ae-33') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '03fb76e9-da22-55da-8d12-b50492964398', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap35d909ae-33, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap35d909ae-33, col_values=(('qos', UUID('49fa5272-79f9-47a0-91e8-022aaa850d54')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap35d909ae-33, col_values=(('external_ids', {'iface-id': '35d909ae-33dc-4cf7-90af-5d781ee6bb64', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:76:e2', 'vm-uuid': 'b743c491-ece8-4781-9530-b2f38ffc1079'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:40 user nova-compute[74994]: INFO os_vif [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:76:e2,bridge_name='br-int',has_traffic_filtering=True,id=35d909ae-33dc-4cf7-90af-5d781ee6bb64,network=Network(a1692a13-d1d7-4df6-bfc0-54f231846889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d909ae-33')
Nov 28 10:57:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:57:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] No VIF found with MAC fa:16:3e:48:76:e2, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:57:41 user nova-compute[74994]: DEBUG nova.network.neutron [req-8209189b-aaba-43cb-869e-ead598ff63ea req-83a290f9-4fc9-4bd5-838c-1087797429dc service nova] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Updated VIF entry in instance network info cache for port 35d909ae-33dc-4cf7-90af-5d781ee6bb64. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 10:57:41 user nova-compute[74994]: DEBUG nova.network.neutron [req-8209189b-aaba-43cb-869e-ead598ff63ea req-83a290f9-4fc9-4bd5-838c-1087797429dc service nova] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Updating instance_info_cache with network_info: [{"id": "35d909ae-33dc-4cf7-90af-5d781ee6bb64", "address": "fa:16:3e:48:76:e2", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d909ae-33", "ovs_interfaceid": "35d909ae-33dc-4cf7-90af-5d781ee6bb64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:57:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8209189b-aaba-43cb-869e-ead598ff63ea req-83a290f9-4fc9-4bd5-838c-1087797429dc service nova] Releasing lock "refresh_cache-b743c491-ece8-4781-9530-b2f38ffc1079" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:57:41 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:41 user nova-compute[74994]: DEBUG nova.network.neutron [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Successfully updated port: a20ff85b-6e1c-4430-ab03-696b8521b056 {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 10:57:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquiring lock "refresh_cache-4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:57:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquired lock "refresh_cache-4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:57:41 user nova-compute[74994]: DEBUG nova.network.neutron [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 10:57:41 user nova-compute[74994]: DEBUG nova.compute.manager [req-0e99e20a-10b2-4f65-8004-9456890ca03b req-0222b696-d86b-427d-957d-548d7d181995 service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Received event network-changed-a20ff85b-6e1c-4430-ab03-696b8521b056 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:57:41 user nova-compute[74994]: DEBUG nova.compute.manager [req-0e99e20a-10b2-4f65-8004-9456890ca03b req-0222b696-d86b-427d-957d-548d7d181995 service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Refreshing instance network info cache due to event network-changed-a20ff85b-6e1c-4430-ab03-696b8521b056. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:57:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-0e99e20a-10b2-4f65-8004-9456890ca03b req-0222b696-d86b-427d-957d-548d7d181995 service nova] Acquiring lock "refresh_cache-4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:57:41 user nova-compute[74994]: DEBUG nova.network.neutron [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 10:57:41 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:41 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:41 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG nova.network.neutron [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Updating instance_info_cache with network_info: [{"id": "a20ff85b-6e1c-4430-ab03-696b8521b056", "address": "fa:16:3e:95:4c:68", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20ff85b-6e", "ovs_interfaceid": "a20ff85b-6e1c-4430-ab03-696b8521b056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Releasing lock "refresh_cache-4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG nova.compute.manager [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Instance network_info: |[{"id": "a20ff85b-6e1c-4430-ab03-696b8521b056", "address": "fa:16:3e:95:4c:68", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20ff85b-6e", "ovs_interfaceid": "a20ff85b-6e1c-4430-ab03-696b8521b056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-0e99e20a-10b2-4f65-8004-9456890ca03b req-0222b696-d86b-427d-957d-548d7d181995 service nova] Acquired lock "refresh_cache-4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG nova.network.neutron [req-0e99e20a-10b2-4f65-8004-9456890ca03b req-0222b696-d86b-427d-957d-548d7d181995 service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Refreshing network info cache for port a20ff85b-6e1c-4430-ab03-696b8521b056 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Start _get_guest_xml network_info=[{"id": "a20ff85b-6e1c-4430-ab03-696b8521b056", "address": "fa:16:3e:95:4c:68", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20ff85b-6e", "ovs_interfaceid": "a20ff85b-6e1c-4430-ab03-696b8521b056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'aa939d1b-b8a6-4391-935b-0191bf5ccd0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 10:57:42 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:57:42 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:57:42 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:57:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-892718169',display_name='tempest-ServerRescueNegativeTestJSON-server-892718169',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-892718169',id=26,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKf5ESvipQJb0Iy+fLJcCq3i72ZQzalzqaJRpG18kEB0C4ECw8ZCyHCDlbhVhf/3wT65emm8riA8xYo1pzKgniQzaQjG+2hH2XTChDTrJLemP/56rwknIxLY1WAxl8EywQ==',key_name='tempest-keypair-487100257',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77126f6f39db4a628b74551ea7d0aa21',ramdisk_id='',reservation_id='r-b20q91a0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1900175697',owner_user_name='tempest-ServerRescueNegativeTestJSON-1900175697-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:57:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b5c1a1f2efc4a2faf8b82d467681d45',uuid=4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a20ff85b-6e1c-4430-ab03-696b8521b056", "address": "fa:16:3e:95:4c:68", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20ff85b-6e", "ovs_interfaceid": "a20ff85b-6e1c-4430-ab03-696b8521b056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Converting VIF {"id": "a20ff85b-6e1c-4430-ab03-696b8521b056", "address": "fa:16:3e:95:4c:68", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20ff85b-6e", "ovs_interfaceid": "a20ff85b-6e1c-4430-ab03-696b8521b056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:4c:68,bridge_name='br-int',has_traffic_filtering=True,id=a20ff85b-6e1c-4430-ab03-696b8521b056,network=Network(77bc68aa-1654-4e4d-9c65-7515fe6f4b2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa20ff85b-6e') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG nova.objects.instance [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lazy-loading 'pci_devices' on Instance uuid 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] End _get_guest_xml xml=<domain type="kvm">
Nov 28 10:57:42 user nova-compute[74994]:   <uuid>4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123</uuid>
Nov 28 10:57:42 user nova-compute[74994]:   <name>instance-0000001a</name>
Nov 28 10:57:42 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 10:57:42 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 10:57:42 user nova-compute[74994]:   <metadata>
Nov 28 10:57:42 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 10:57:42 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 10:57:42 user nova-compute[74994]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-892718169</nova:name>
Nov 28 10:57:42 user nova-compute[74994]:       <nova:creationTime>2023-11-28 10:57:42</nova:creationTime>
Nov 28 10:57:42 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 10:57:42 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 10:57:42 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 10:57:42 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 10:57:42 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 10:57:42 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 10:57:42 user nova-compute[74994]:       </nova:flavor>
Nov 28 10:57:42 user nova-compute[74994]:       <nova:owner>
Nov 28 10:57:42 user nova-compute[74994]:         <nova:user uuid="6b5c1a1f2efc4a2faf8b82d467681d45">tempest-ServerRescueNegativeTestJSON-1900175697-project-member</nova:user>
Nov 28 10:57:42 user nova-compute[74994]:         <nova:project uuid="77126f6f39db4a628b74551ea7d0aa21">tempest-ServerRescueNegativeTestJSON-1900175697</nova:project>
Nov 28 10:57:42 user nova-compute[74994]:       </nova:owner>
Nov 28 10:57:42 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 10:57:42 user nova-compute[74994]:       <nova:ports>
Nov 28 10:57:42 user nova-compute[74994]:         <nova:port uuid="a20ff85b-6e1c-4430-ab03-696b8521b056">
Nov 28 10:57:42 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 28 10:57:42 user nova-compute[74994]:         </nova:port>
Nov 28 10:57:42 user nova-compute[74994]:       </nova:ports>
Nov 28 10:57:42 user nova-compute[74994]:     </nova:instance>
Nov 28 10:57:42 user nova-compute[74994]:   </metadata>
Nov 28 10:57:42 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 10:57:42 user nova-compute[74994]:     <system>
Nov 28 10:57:42 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 10:57:42 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 10:57:42 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 10:57:42 user nova-compute[74994]:       <entry name="serial">4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123</entry>
Nov 28 10:57:42 user nova-compute[74994]:       <entry name="uuid">4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123</entry>
Nov 28 10:57:42 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 10:57:42 user nova-compute[74994]:     </system>
Nov 28 10:57:42 user nova-compute[74994]:   </sysinfo>
Nov 28 10:57:42 user nova-compute[74994]:   <os>
Nov 28 10:57:42 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 10:57:42 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 10:57:42 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 10:57:42 user nova-compute[74994]:   </os>
Nov 28 10:57:42 user nova-compute[74994]:   <features>
Nov 28 10:57:42 user nova-compute[74994]:     <acpi/>
Nov 28 10:57:42 user nova-compute[74994]:     <apic/>
Nov 28 10:57:42 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 10:57:42 user nova-compute[74994]:   </features>
Nov 28 10:57:42 user nova-compute[74994]:   <clock offset="utc">
Nov 28 10:57:42 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 10:57:42 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 10:57:42 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 10:57:42 user nova-compute[74994]:   </clock>
Nov 28 10:57:42 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 10:57:42 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 10:57:42 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 10:57:42 user nova-compute[74994]:   </cpu>
Nov 28 10:57:42 user nova-compute[74994]:   <devices>
Nov 28 10:57:42 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 10:57:42 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 10:57:42 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123/disk"/>
Nov 28 10:57:42 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 10:57:42 user nova-compute[74994]:     </disk>
Nov 28 10:57:42 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 10:57:42 user nova-compute[74994]:       <mac address="fa:16:3e:95:4c:68"/>
Nov 28 10:57:42 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:57:42 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 10:57:42 user nova-compute[74994]:       <target dev="tapa20ff85b-6e"/>
Nov 28 10:57:42 user nova-compute[74994]:     </interface>
Nov 28 10:57:42 user nova-compute[74994]:     <serial type="pty">
Nov 28 10:57:42 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123/console.log" append="off"/>
Nov 28 10:57:42 user nova-compute[74994]:     </serial>
Nov 28 10:57:42 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 10:57:42 user nova-compute[74994]:     <video>
Nov 28 10:57:42 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:57:42 user nova-compute[74994]:     </video>
Nov 28 10:57:42 user nova-compute[74994]:     <rng model="virtio">
Nov 28 10:57:42 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 10:57:42 user nova-compute[74994]:     </rng>
Nov 28 10:57:42 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 10:57:42 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 10:57:42 user nova-compute[74994]:       <stats period="10"/>
Nov 28 10:57:42 user nova-compute[74994]:     </memballoon>
Nov 28 10:57:42 user nova-compute[74994]:   </devices>
Nov 28 10:57:42 user nova-compute[74994]: </domain>
Nov 28 10:57:42 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:57:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-892718169',display_name='tempest-ServerRescueNegativeTestJSON-server-892718169',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-892718169',id=26,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKf5ESvipQJb0Iy+fLJcCq3i72ZQzalzqaJRpG18kEB0C4ECw8ZCyHCDlbhVhf/3wT65emm8riA8xYo1pzKgniQzaQjG+2hH2XTChDTrJLemP/56rwknIxLY1WAxl8EywQ==',key_name='tempest-keypair-487100257',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77126f6f39db4a628b74551ea7d0aa21',ramdisk_id='',reservation_id='r-b20q91a0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1900175697',owner_user_name='tempest-ServerRescueNegativeTestJSON-1900175697-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:57:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b5c1a1f2efc4a2faf8b82d467681d45',uuid=4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a20ff85b-6e1c-4430-ab03-696b8521b056", "address": "fa:16:3e:95:4c:68", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20ff85b-6e", "ovs_interfaceid": "a20ff85b-6e1c-4430-ab03-696b8521b056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Converting VIF {"id": "a20ff85b-6e1c-4430-ab03-696b8521b056", "address": "fa:16:3e:95:4c:68", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20ff85b-6e", "ovs_interfaceid": "a20ff85b-6e1c-4430-ab03-696b8521b056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:4c:68,bridge_name='br-int',has_traffic_filtering=True,id=a20ff85b-6e1c-4430-ab03-696b8521b056,network=Network(77bc68aa-1654-4e4d-9c65-7515fe6f4b2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa20ff85b-6e') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG os_vif [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:4c:68,bridge_name='br-int',has_traffic_filtering=True,id=a20ff85b-6e1c-4430-ab03-696b8521b056,network=Network(77bc68aa-1654-4e4d-9c65-7515fe6f4b2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa20ff85b-6e') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eae97610-7b6e-5dbb-9eac-38ba61289918', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa20ff85b-6e, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa20ff85b-6e, col_values=(('qos', UUID('7e019223-124c-4ad1-b8e3-c731ef62eeae')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa20ff85b-6e, col_values=(('external_ids', {'iface-id': 'a20ff85b-6e1c-4430-ab03-696b8521b056', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:4c:68', 'vm-uuid': '4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:42 user nova-compute[74994]: INFO os_vif [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:4c:68,bridge_name='br-int',has_traffic_filtering=True,id=a20ff85b-6e1c-4430-ab03-696b8521b056,network=Network(77bc68aa-1654-4e4d-9c65-7515fe6f4b2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa20ff85b-6e')
Nov 28 10:57:42 user nova-compute[74994]: DEBUG nova.compute.manager [req-c29cc5b6-344d-40d0-9789-7fbfdfeaa78b req-cbef598f-cac2-44cb-929e-b311eb9e18ae service nova] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Received event network-vif-plugged-35d909ae-33dc-4cf7-90af-5d781ee6bb64 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c29cc5b6-344d-40d0-9789-7fbfdfeaa78b req-cbef598f-cac2-44cb-929e-b311eb9e18ae service nova] Acquiring lock "b743c491-ece8-4781-9530-b2f38ffc1079-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c29cc5b6-344d-40d0-9789-7fbfdfeaa78b req-cbef598f-cac2-44cb-929e-b311eb9e18ae service nova] Lock "b743c491-ece8-4781-9530-b2f38ffc1079-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c29cc5b6-344d-40d0-9789-7fbfdfeaa78b req-cbef598f-cac2-44cb-929e-b311eb9e18ae service nova] Lock "b743c491-ece8-4781-9530-b2f38ffc1079-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG nova.compute.manager [req-c29cc5b6-344d-40d0-9789-7fbfdfeaa78b req-cbef598f-cac2-44cb-929e-b311eb9e18ae service nova] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] No waiting events found dispatching network-vif-plugged-35d909ae-33dc-4cf7-90af-5d781ee6bb64 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:57:42 user nova-compute[74994]: WARNING nova.compute.manager [req-c29cc5b6-344d-40d0-9789-7fbfdfeaa78b req-cbef598f-cac2-44cb-929e-b311eb9e18ae service nova] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Received unexpected event network-vif-plugged-35d909ae-33dc-4cf7-90af-5d781ee6bb64 for instance with vm_state building and task_state spawning.
Nov 28 10:57:42 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] No VIF found with MAC fa:16:3e:95:4c:68, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG nova.network.neutron [req-0e99e20a-10b2-4f65-8004-9456890ca03b req-0222b696-d86b-427d-957d-548d7d181995 service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Updated VIF entry in instance network info cache for port a20ff85b-6e1c-4430-ab03-696b8521b056. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG nova.network.neutron [req-0e99e20a-10b2-4f65-8004-9456890ca03b req-0222b696-d86b-427d-957d-548d7d181995 service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Updating instance_info_cache with network_info: [{"id": "a20ff85b-6e1c-4430-ab03-696b8521b056", "address": "fa:16:3e:95:4c:68", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20ff85b-6e", "ovs_interfaceid": "a20ff85b-6e1c-4430-ab03-696b8521b056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:57:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-0e99e20a-10b2-4f65-8004-9456890ca03b req-0222b696-d86b-427d-957d-548d7d181995 service nova] Releasing lock "refresh_cache-4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:57:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:44 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:44 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:44 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:44 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:44 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:44 user nova-compute[74994]: DEBUG nova.compute.manager [req-901d6088-6874-459f-9e65-93d359df3ec1 req-a70440c7-0ad0-40fa-8ec5-37de22b7ea20 service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Received event network-vif-plugged-a20ff85b-6e1c-4430-ab03-696b8521b056 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:57:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-901d6088-6874-459f-9e65-93d359df3ec1 req-a70440c7-0ad0-40fa-8ec5-37de22b7ea20 service nova] Acquiring lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:57:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-901d6088-6874-459f-9e65-93d359df3ec1 req-a70440c7-0ad0-40fa-8ec5-37de22b7ea20 service nova] Lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:57:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-901d6088-6874-459f-9e65-93d359df3ec1 req-a70440c7-0ad0-40fa-8ec5-37de22b7ea20 service nova] Lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:57:44 user nova-compute[74994]: DEBUG nova.compute.manager [req-901d6088-6874-459f-9e65-93d359df3ec1 req-a70440c7-0ad0-40fa-8ec5-37de22b7ea20 service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] No waiting events found dispatching network-vif-plugged-a20ff85b-6e1c-4430-ab03-696b8521b056 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:57:44 user nova-compute[74994]: WARNING nova.compute.manager [req-901d6088-6874-459f-9e65-93d359df3ec1 req-a70440c7-0ad0-40fa-8ec5-37de22b7ea20 service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Received unexpected event network-vif-plugged-a20ff85b-6e1c-4430-ab03-696b8521b056 for instance with vm_state building and task_state spawning.
Nov 28 10:57:44 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:44 user nova-compute[74994]: DEBUG nova.compute.manager [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 10:57:44 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 10:57:44 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Instance spawned successfully.
Nov 28 10:57:44 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 10:57:44 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:57:44 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:57:44 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:57:44 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:57:44 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:57:44 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:57:44 user nova-compute[74994]: DEBUG nova.compute.manager [req-d270d34f-0415-44f4-b581-6acd0d1518c5 req-564af010-f66f-4c5f-a268-afcb18667744 service nova] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Received event network-vif-plugged-35d909ae-33dc-4cf7-90af-5d781ee6bb64 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:57:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d270d34f-0415-44f4-b581-6acd0d1518c5 req-564af010-f66f-4c5f-a268-afcb18667744 service nova] Acquiring lock "b743c491-ece8-4781-9530-b2f38ffc1079-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:57:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d270d34f-0415-44f4-b581-6acd0d1518c5 req-564af010-f66f-4c5f-a268-afcb18667744 service nova] Lock "b743c491-ece8-4781-9530-b2f38ffc1079-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:57:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d270d34f-0415-44f4-b581-6acd0d1518c5 req-564af010-f66f-4c5f-a268-afcb18667744 service nova] Lock "b743c491-ece8-4781-9530-b2f38ffc1079-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:57:44 user nova-compute[74994]: DEBUG nova.compute.manager [req-d270d34f-0415-44f4-b581-6acd0d1518c5 req-564af010-f66f-4c5f-a268-afcb18667744 service nova] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] No waiting events found dispatching network-vif-plugged-35d909ae-33dc-4cf7-90af-5d781ee6bb64 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:57:44 user nova-compute[74994]: WARNING nova.compute.manager [req-d270d34f-0415-44f4-b581-6acd0d1518c5 req-564af010-f66f-4c5f-a268-afcb18667744 service nova] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Received unexpected event network-vif-plugged-35d909ae-33dc-4cf7-90af-5d781ee6bb64 for instance with vm_state building and task_state spawning.
Nov 28 10:57:44 user nova-compute[74994]: DEBUG nova.compute.manager [req-d270d34f-0415-44f4-b581-6acd0d1518c5 req-564af010-f66f-4c5f-a268-afcb18667744 service nova] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Received event network-changed-6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:57:44 user nova-compute[74994]: DEBUG nova.compute.manager [req-d270d34f-0415-44f4-b581-6acd0d1518c5 req-564af010-f66f-4c5f-a268-afcb18667744 service nova] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Refreshing instance network info cache due to event network-changed-6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:57:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d270d34f-0415-44f4-b581-6acd0d1518c5 req-564af010-f66f-4c5f-a268-afcb18667744 service nova] Acquiring lock "refresh_cache-8bce88d5-64b3-450b-b7e0-26a1c5d299c6" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:57:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d270d34f-0415-44f4-b581-6acd0d1518c5 req-564af010-f66f-4c5f-a268-afcb18667744 service nova] Acquired lock "refresh_cache-8bce88d5-64b3-450b-b7e0-26a1c5d299c6" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:57:44 user nova-compute[74994]: DEBUG nova.network.neutron [req-d270d34f-0415-44f4-b581-6acd0d1518c5 req-564af010-f66f-4c5f-a268-afcb18667744 service nova] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Refreshing network info cache for port 6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:57:44 user nova-compute[74994]: INFO nova.compute.manager [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Took 6.37 seconds to spawn the instance on the hypervisor.
Nov 28 10:57:44 user nova-compute[74994]: DEBUG nova.compute.manager [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 10:57:44 user nova-compute[74994]: INFO nova.compute.manager [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Took 7.45 seconds to build instance.
Nov 28 10:57:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ed51766a-b00a-4043-9686-2130c0610733 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "b743c491-ece8-4781-9530-b2f38ffc1079" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.584s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:57:45 user nova-compute[74994]: DEBUG nova.network.neutron [req-d270d34f-0415-44f4-b581-6acd0d1518c5 req-564af010-f66f-4c5f-a268-afcb18667744 service nova] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Updated VIF entry in instance network info cache for port 6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 10:57:45 user nova-compute[74994]: DEBUG nova.network.neutron [req-d270d34f-0415-44f4-b581-6acd0d1518c5 req-564af010-f66f-4c5f-a268-afcb18667744 service nova] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Updating instance_info_cache with network_info: [{"id": "6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a", "address": "fa:16:3e:17:ec:a3", "network": {"id": "d9bcdec6-69e0-4e65-8a26-1af1f8232365", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1227861580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "636fa9a1f046425e9332cc3807f8fb46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bb0f5b6-4a", "ovs_interfaceid": "6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:57:45 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d270d34f-0415-44f4-b581-6acd0d1518c5 req-564af010-f66f-4c5f-a268-afcb18667744 service nova] Releasing lock "refresh_cache-8bce88d5-64b3-450b-b7e0-26a1c5d299c6" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:57:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "8bce88d5-64b3-450b-b7e0-26a1c5d299c6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:57:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "8bce88d5-64b3-450b-b7e0-26a1c5d299c6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:57:46 user nova-compute[74994]: DEBUG nova.objects.instance [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lazy-loading 'flavor' on Instance uuid 8bce88d5-64b3-450b-b7e0-26a1c5d299c6 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:57:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "8bce88d5-64b3-450b-b7e0-26a1c5d299c6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:57:46 user nova-compute[74994]: DEBUG nova.compute.manager [req-c143aa87-02c1-46bd-aa61-aaee0df50012 req-f76abe39-077e-4b0a-b587-1d35a543bc70 service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Received event network-vif-plugged-a20ff85b-6e1c-4430-ab03-696b8521b056 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:57:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c143aa87-02c1-46bd-aa61-aaee0df50012 req-f76abe39-077e-4b0a-b587-1d35a543bc70 service nova] Acquiring lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:57:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c143aa87-02c1-46bd-aa61-aaee0df50012 req-f76abe39-077e-4b0a-b587-1d35a543bc70 service nova] Lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:57:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c143aa87-02c1-46bd-aa61-aaee0df50012 req-f76abe39-077e-4b0a-b587-1d35a543bc70 service nova] Lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:57:46 user nova-compute[74994]: DEBUG nova.compute.manager [req-c143aa87-02c1-46bd-aa61-aaee0df50012 req-f76abe39-077e-4b0a-b587-1d35a543bc70 service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] No waiting events found dispatching network-vif-plugged-a20ff85b-6e1c-4430-ab03-696b8521b056 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:57:46 user nova-compute[74994]: WARNING nova.compute.manager [req-c143aa87-02c1-46bd-aa61-aaee0df50012 req-f76abe39-077e-4b0a-b587-1d35a543bc70 service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Received unexpected event network-vif-plugged-a20ff85b-6e1c-4430-ab03-696b8521b056 for instance with vm_state building and task_state spawning.
Nov 28 10:57:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "8bce88d5-64b3-450b-b7e0-26a1c5d299c6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:57:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "8bce88d5-64b3-450b-b7e0-26a1c5d299c6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:57:46 user nova-compute[74994]: INFO nova.compute.manager [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Attaching volume cb8f73aa-1f33-413f-bec6-e2491c811580 to /dev/vdb
Nov 28 10:57:46 user nova-compute[74994]: DEBUG os_brick.utils [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:57:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:57:46 user nova-compute[74994]: DEBUG nova.compute.manager [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 10:57:46 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 10:57:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:57:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccfb6f2-50bc-454a-89a7-aacd2e91219a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:57:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:57:46 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Instance spawned successfully.
Nov 28 10:57:46 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 10:57:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.042s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:57:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa62ee2-3caf-43fb-8520-f7bfd55ac334]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:57:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:57:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.030s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:57:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ede527-0618-4143-b998-d0b416268197]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:57:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fd2ab1-d2a9-4aba-8a70-db676179850e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:57:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:57:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:57:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 10:57:46 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:57:46 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:57:46 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:57:46 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:57:46 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:57:46 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:57:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:57:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:57:46 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 10:57:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c91d55-6a9f-404f-968b-ec5b94ed9488]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:57:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 10:57:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 10:57:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 10:57:46 user nova-compute[74994]: DEBUG os_brick.utils [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] <== get_connector_properties: return (258ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:57:46 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Updating existing volume attachment record: 23e4d456-1d69-4148-ad3b-f51a4632a4b7 {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 10:57:46 user nova-compute[74994]: INFO nova.compute.manager [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Took 7.58 seconds to spawn the instance on the hypervisor.
Nov 28 10:57:46 user nova-compute[74994]: DEBUG nova.compute.manager [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 10:57:46 user nova-compute[74994]: INFO nova.compute.manager [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Took 9.04 seconds to build instance.
Nov 28 10:57:47 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5c7cfdfc-2c92-4706-b033-8db598563708 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.158s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:57:47 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-0e459ea1-80de-4774-a0a0-db6f2e0c4dcf tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Acquiring lock "5b51d690-8198-4748-807d-1902e75564b9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-0e459ea1-80de-4774-a0a0-db6f2e0c4dcf tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Lock "5b51d690-8198-4748-807d-1902e75564b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-0e459ea1-80de-4774-a0a0-db6f2e0c4dcf tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Acquiring lock "5b51d690-8198-4748-807d-1902e75564b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-0e459ea1-80de-4774-a0a0-db6f2e0c4dcf tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Lock "5b51d690-8198-4748-807d-1902e75564b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-0e459ea1-80de-4774-a0a0-db6f2e0c4dcf tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Lock "5b51d690-8198-4748-807d-1902e75564b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:57:55 user nova-compute[74994]: INFO nova.compute.manager [None req-0e459ea1-80de-4774-a0a0-db6f2e0c4dcf tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Terminating instance
Nov 28 10:57:55 user nova-compute[74994]: DEBUG nova.compute.manager [None req-0e459ea1-80de-4774-a0a0-db6f2e0c4dcf tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zeLPqfFC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:57:55 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:57:55 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:57:55 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:57:55 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:57:55 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 10:57:55 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580 -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c25e137-d064-4446-97c9-deca27105038]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 10:57:55 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580 -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG nova.compute.manager [req-ef93e315-bd99-4ef0-8e65-847a1c2ccbbb req-efb2681c-6e34-4dca-b171-4c5a6dcf01e6 service nova] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Received event network-vif-unplugged-df20cfaa-368c-4bfd-b535-9192c3f240a0 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ef93e315-bd99-4ef0-8e65-847a1c2ccbbb req-efb2681c-6e34-4dca-b171-4c5a6dcf01e6 service nova] Acquiring lock "5b51d690-8198-4748-807d-1902e75564b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ef93e315-bd99-4ef0-8e65-847a1c2ccbbb req-efb2681c-6e34-4dca-b171-4c5a6dcf01e6 service nova] Lock "5b51d690-8198-4748-807d-1902e75564b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ef93e315-bd99-4ef0-8e65-847a1c2ccbbb req-efb2681c-6e34-4dca-b171-4c5a6dcf01e6 service nova] Lock "5b51d690-8198-4748-807d-1902e75564b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG nova.compute.manager [req-ef93e315-bd99-4ef0-8e65-847a1c2ccbbb req-efb2681c-6e34-4dca-b171-4c5a6dcf01e6 service nova] [instance: 5b51d690-8198-4748-807d-1902e75564b9] No waiting events found dispatching network-vif-unplugged-df20cfaa-368c-4bfd-b535-9192c3f240a0 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG nova.compute.manager [req-ef93e315-bd99-4ef0-8e65-847a1c2ccbbb req-efb2681c-6e34-4dca-b171-4c5a6dcf01e6 service nova] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Received event network-vif-unplugged-df20cfaa-368c-4bfd-b535-9192c3f240a0 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[484e4999-cd1d-4fce-9b03-66fa84da90b3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580] added
Nov 28 10:57:55 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[38461f73-de44-4a0d-a017-99a7e804cb12]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e745afe-76e2-42a0-8254-c894707540b8]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zeLPqfFC {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zeLPqfFC" returned: 0 in 0.025s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[15092b8b-e54d-48b2-889c-be166deaa713]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zeLPqfFC'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54efdbf-5d7e-45d7-9281-7724576d5208]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a0c443-266b-480c-a9ab-ec0648bdf3b4]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:57:55 user nova-compute[74994]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)
Nov 28 10:57:55 user nova-compute[74994]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 10:57:55 user nova-compute[74994]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)
Nov 28 10:57:55 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:57:55 user nova-compute[74994]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)
Nov 28 10:57:55 user nova-compute[74994]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 10:57:55 user nova-compute[74994]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)
Nov 28 10:57:55 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580 -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da0ea0c-23eb-40fc-97f6-09e006b66926]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580, portal: 172.16.0.220,3260]
Nov 28 10:57:55 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580, portal: 172.16.0.220,3260] successful.
Nov 28 10:57:55 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f03cce-ca88-4eb1-92c6-5ccb2e49590e]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:57:55 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:57:56 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:57:56 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:57:56 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7523b20-cee6-4c96-8337-b4add91591fd]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:57:56 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:56 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:57:56 user nova-compute[74994]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)
Nov 28 10:57:56 user nova-compute[74994]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 10:57:56 user nova-compute[74994]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)
Nov 28 10:57:56 user nova-compute[74994]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580 (non-flash)
Nov 28 10:57:56 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:57:56 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:57:56 user nova-compute[74994]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)
Nov 28 10:57:56 user nova-compute[74994]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 10:57:56 user nova-compute[74994]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)
Nov 28 10:57:56 user nova-compute[74994]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580 (non-flash)
Nov 28 10:57:56 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:57:56 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.366s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:57:56 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 10:57:56 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] HCTL ('35', '-', '-', 0) found on session 24 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 10:57:56 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 10:57:56 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:57:56 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:56 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:57:56 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8a7cbe-dfc9-4446-9ad8-12d2ee922714]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:57:56 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: None {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 10:57:56 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Instance destroyed successfully.
Nov 28 10:57:56 user nova-compute[74994]: DEBUG nova.objects.instance [None req-0e459ea1-80de-4774-a0a0-db6f2e0c4dcf tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Lazy-loading 'resources' on Instance uuid 5b51d690-8198-4748-807d-1902e75564b9 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:57:56 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-0e459ea1-80de-4774-a0a0-db6f2e0c4dcf tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:49:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-64217862',display_name='tempest-ServersNegativeTestJSON-server-64217862',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-64217862',id=5,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:49:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1c23e61575784c8baffda1deda7812fd',ramdisk_id='',reservation_id='r-9v5we5o3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1243683462',owner_user_name='tempest-ServersNegativeTestJSON-1243683462-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T10:49:25Z,user_data=None,user_id='3c29f1c4e20e4bfd80b1d565b58330aa',uuid=5b51d690-8198-4748-807d-1902e75564b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df20cfaa-368c-4bfd-b535-9192c3f240a0", "address": "fa:16:3e:c3:4c:99", "network": {"id": "434398a7-094f-4b01-ae77-ae83f21a8390", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1446659533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c23e61575784c8baffda1deda7812fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf20cfaa-36", "ovs_interfaceid": "df20cfaa-368c-4bfd-b535-9192c3f240a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 10:57:56 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-0e459ea1-80de-4774-a0a0-db6f2e0c4dcf tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Converting VIF {"id": "df20cfaa-368c-4bfd-b535-9192c3f240a0", "address": "fa:16:3e:c3:4c:99", "network": {"id": "434398a7-094f-4b01-ae77-ae83f21a8390", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1446659533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c23e61575784c8baffda1deda7812fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf20cfaa-36", "ovs_interfaceid": "df20cfaa-368c-4bfd-b535-9192c3f240a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:57:56 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-0e459ea1-80de-4774-a0a0-db6f2e0c4dcf tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:4c:99,bridge_name='br-int',has_traffic_filtering=True,id=df20cfaa-368c-4bfd-b535-9192c3f240a0,network=Network(434398a7-094f-4b01-ae77-ae83f21a8390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf20cfaa-36') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:57:56 user nova-compute[74994]: DEBUG os_vif [None req-0e459ea1-80de-4774-a0a0-db6f2e0c4dcf tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:4c:99,bridge_name='br-int',has_traffic_filtering=True,id=df20cfaa-368c-4bfd-b535-9192c3f240a0,network=Network(434398a7-094f-4b01-ae77-ae83f21a8390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf20cfaa-36') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 10:57:56 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:56 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf20cfaa-36, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:57:56 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:56 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:57:56 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:56 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:56 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=712123c9-c268-4521-9aa5-5b1d078231b7) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:57:56 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:56 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:57:56 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:56 user nova-compute[74994]: INFO os_vif [None req-0e459ea1-80de-4774-a0a0-db6f2e0c4dcf tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:4c:99,bridge_name='br-int',has_traffic_filtering=True,id=df20cfaa-368c-4bfd-b535-9192c3f240a0,network=Network(434398a7-094f-4b01-ae77-ae83f21a8390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf20cfaa-36')
Nov 28 10:57:56 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-0e459ea1-80de-4774-a0a0-db6f2e0c4dcf tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Deleting instance files /opt/stack/data/nova/instances/5b51d690-8198-4748-807d-1902e75564b9_del
Nov 28 10:57:56 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-0e459ea1-80de-4774-a0a0-db6f2e0c4dcf tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Deletion of /opt/stack/data/nova/instances/5b51d690-8198-4748-807d-1902e75564b9_del complete
Nov 28 10:57:56 user nova-compute[74994]: INFO nova.compute.manager [None req-0e459ea1-80de-4774-a0a0-db6f2e0c4dcf tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 28 10:57:56 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-0e459ea1-80de-4774-a0a0-db6f2e0c4dcf tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 10:57:56 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 10:57:56 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 5b51d690-8198-4748-807d-1902e75564b9] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 10:57:56 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:57:56 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Took 0.57 seconds to deallocate network for instance.
Nov 28 10:57:56 user nova-compute[74994]: DEBUG nova.compute.manager [req-42b7ac92-5eae-4402-aaef-3469d268b39f req-741bc680-15bc-4c9b-8ee8-bc371fcb638f service nova] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Received event network-vif-deleted-df20cfaa-368c-4bfd-b535-9192c3f240a0 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:57:56 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-0e459ea1-80de-4774-a0a0-db6f2e0c4dcf tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:57:56 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-0e459ea1-80de-4774-a0a0-db6f2e0c4dcf tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:57:57 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 10:57:57 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zeLPqfFC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 10:57:57 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.410s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:57:57 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] <== connect_volume: return (1412ms) {'type': 'block', 'scsi_wwn': '23863353664363531', 'path': '/dev/sdd'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:57:57 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863353664363531', 'path': '/dev/sdd'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 10:57:57 user nova-compute[74994]: DEBUG nova.objects.instance [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lazy-loading 'flavor' on Instance uuid 8bce88d5-64b3-450b-b7e0-26a1c5d299c6 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:57:57 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 10:57:57 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 10:57:57 user nova-compute[74994]:   <source dev="/dev/sdd"/>
Nov 28 10:57:57 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 10:57:57 user nova-compute[74994]:   <serial>cb8f73aa-1f33-413f-bec6-e2491c811580</serial>
Nov 28 10:57:57 user nova-compute[74994]: </disk>
Nov 28 10:57:57 user nova-compute[74994]:  {{(pid=74994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 10:57:57 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-0e459ea1-80de-4774-a0a0-db6f2e0c4dcf tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:57:57 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-0e459ea1-80de-4774-a0a0-db6f2e0c4dcf tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:57:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-0e459ea1-80de-4774-a0a0-db6f2e0c4dcf tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.517s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:57:57 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-0e459ea1-80de-4774-a0a0-db6f2e0c4dcf tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Deleted allocations for instance 5b51d690-8198-4748-807d-1902e75564b9
Nov 28 10:57:57 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:57:57 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:57:57 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] No VIF found with MAC fa:16:3e:17:ec:a3, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:57:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-0e459ea1-80de-4774-a0a0-db6f2e0c4dcf tempest-ServersNegativeTestJSON-1243683462 tempest-ServersNegativeTestJSON-1243683462-project-member] Lock "5b51d690-8198-4748-807d-1902e75564b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.405s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:57:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-0ce32d8b-f7ba-4388-be30-ca0fb686c277 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "8bce88d5-64b3-450b-b7e0-26a1c5d299c6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.342s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:57:57 user nova-compute[74994]: DEBUG nova.compute.manager [req-cbbb1081-ec3a-4375-bbd4-0e48a10b1945 req-e2f3a542-7af4-406c-a5e6-e31b591ec459 service nova] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Received event network-vif-plugged-df20cfaa-368c-4bfd-b535-9192c3f240a0 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:57:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-cbbb1081-ec3a-4375-bbd4-0e48a10b1945 req-e2f3a542-7af4-406c-a5e6-e31b591ec459 service nova] Acquiring lock "5b51d690-8198-4748-807d-1902e75564b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:57:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-cbbb1081-ec3a-4375-bbd4-0e48a10b1945 req-e2f3a542-7af4-406c-a5e6-e31b591ec459 service nova] Lock "5b51d690-8198-4748-807d-1902e75564b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:57:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-cbbb1081-ec3a-4375-bbd4-0e48a10b1945 req-e2f3a542-7af4-406c-a5e6-e31b591ec459 service nova] Lock "5b51d690-8198-4748-807d-1902e75564b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:57:57 user nova-compute[74994]: DEBUG nova.compute.manager [req-cbbb1081-ec3a-4375-bbd4-0e48a10b1945 req-e2f3a542-7af4-406c-a5e6-e31b591ec459 service nova] [instance: 5b51d690-8198-4748-807d-1902e75564b9] No waiting events found dispatching network-vif-plugged-df20cfaa-368c-4bfd-b535-9192c3f240a0 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:57:57 user nova-compute[74994]: WARNING nova.compute.manager [req-cbbb1081-ec3a-4375-bbd4-0e48a10b1945 req-e2f3a542-7af4-406c-a5e6-e31b591ec459 service nova] [instance: 5b51d690-8198-4748-807d-1902e75564b9] Received unexpected event network-vif-plugged-df20cfaa-368c-4bfd-b535-9192c3f240a0 for instance with vm_state deleted and task_state None.
Nov 28 10:57:58 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2d9ed888-8136-4d45-b042-571cf94882a6 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "8bce88d5-64b3-450b-b7e0-26a1c5d299c6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:57:58 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2d9ed888-8136-4d45-b042-571cf94882a6 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "8bce88d5-64b3-450b-b7e0-26a1c5d299c6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:57:58 user nova-compute[74994]: INFO nova.compute.manager [None req-2d9ed888-8136-4d45-b042-571cf94882a6 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Detaching volume cb8f73aa-1f33-413f-bec6-e2491c811580
Nov 28 10:57:58 user nova-compute[74994]: INFO nova.virt.block_device [None req-2d9ed888-8136-4d45-b042-571cf94882a6 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Attempting to driver detach volume cb8f73aa-1f33-413f-bec6-e2491c811580 from mountpoint /dev/vdb
Nov 28 10:57:59 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2d9ed888-8136-4d45-b042-571cf94882a6 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Attempting to detach device vdb from instance 8bce88d5-64b3-450b-b7e0-26a1c5d299c6 from the persistent domain config. {{(pid=74994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 10:57:59 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-2d9ed888-8136-4d45-b042-571cf94882a6 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 10:57:59 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 10:57:59 user nova-compute[74994]:   <source dev="/dev/sdd"/>
Nov 28 10:57:59 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 10:57:59 user nova-compute[74994]:   <serial>cb8f73aa-1f33-413f-bec6-e2491c811580</serial>
Nov 28 10:57:59 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 10:57:59 user nova-compute[74994]: </disk>
Nov 28 10:57:59 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 10:57:59 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-2d9ed888-8136-4d45-b042-571cf94882a6 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Successfully detached device vdb from instance 8bce88d5-64b3-450b-b7e0-26a1c5d299c6 from the persistent domain config.
Nov 28 10:57:59 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2d9ed888-8136-4d45-b042-571cf94882a6 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8bce88d5-64b3-450b-b7e0-26a1c5d299c6 from the live domain config. {{(pid=74994) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 10:57:59 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-2d9ed888-8136-4d45-b042-571cf94882a6 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 10:57:59 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 10:57:59 user nova-compute[74994]:   <source dev="/dev/sdd"/>
Nov 28 10:57:59 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 10:57:59 user nova-compute[74994]:   <serial>cb8f73aa-1f33-413f-bec6-e2491c811580</serial>
Nov 28 10:57:59 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 10:57:59 user nova-compute[74994]: </disk>
Nov 28 10:57:59 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 10:57:59 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:57:59 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2d9ed888-8136-4d45-b042-571cf94882a6 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8bce88d5-64b3-450b-b7e0-26a1c5d299c6 {{(pid=74994) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 10:57:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ca5cc1e0-7250-470c-a535-abb242007b06 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Acquiring lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:57:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ca5cc1e0-7250-470c-a535-abb242007b06 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:57:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ca5cc1e0-7250-470c-a535-abb242007b06 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Acquiring lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:57:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ca5cc1e0-7250-470c-a535-abb242007b06 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:57:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ca5cc1e0-7250-470c-a535-abb242007b06 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:57:59 user nova-compute[74994]: INFO nova.compute.manager [None req-ca5cc1e0-7250-470c-a535-abb242007b06 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Terminating instance
Nov 28 10:57:59 user nova-compute[74994]: DEBUG nova.compute.manager [None req-ca5cc1e0-7250-470c-a535-abb242007b06 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 10:58:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:00 user nova-compute[74994]: DEBUG nova.compute.manager [req-3fc959e6-9c45-4c82-8a50-46209ad333b8 req-bd5fd902-a71a-4215-bb55-0ce26792106a service nova] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Received event network-vif-unplugged-7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:58:00 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-3fc959e6-9c45-4c82-8a50-46209ad333b8 req-bd5fd902-a71a-4215-bb55-0ce26792106a service nova] Acquiring lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:58:00 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-3fc959e6-9c45-4c82-8a50-46209ad333b8 req-bd5fd902-a71a-4215-bb55-0ce26792106a service nova] Lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:58:00 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-3fc959e6-9c45-4c82-8a50-46209ad333b8 req-bd5fd902-a71a-4215-bb55-0ce26792106a service nova] Lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:58:00 user nova-compute[74994]: DEBUG nova.compute.manager [req-3fc959e6-9c45-4c82-8a50-46209ad333b8 req-bd5fd902-a71a-4215-bb55-0ce26792106a service nova] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] No waiting events found dispatching network-vif-unplugged-7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:58:00 user nova-compute[74994]: DEBUG nova.compute.manager [req-3fc959e6-9c45-4c82-8a50-46209ad333b8 req-bd5fd902-a71a-4215-bb55-0ce26792106a service nova] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Received event network-vif-unplugged-7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 10:58:00 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Instance destroyed successfully.
Nov 28 10:58:00 user nova-compute[74994]: DEBUG nova.objects.instance [None req-ca5cc1e0-7250-470c-a535-abb242007b06 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lazy-loading 'resources' on Instance uuid 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:58:00 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-ca5cc1e0-7250-470c-a535-abb242007b06 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:49:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-502885888',display_name='tempest-ServerActionsTestOtherB-server-502885888',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-502885888',id=7,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAP2WYAYbmEHvo9gpy8E02p/bOJRkvsKNh1AOdzva6YpAs9spAOOEI0cMhVl9gL/EJuJSrtBF2pmysHal8/jsBIX9uFnmSQR89/cpFlQWiHlWT+1v4Gox5jUD1SpkJCj+g==',key_name='tempest-keypair-1209998822',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:55:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9bc007c45c84765bb2739844c7af055',ramdisk_id='',reservation_id='r-w4ylqmii',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-585983328',owner_user_name='tempest-ServerActionsTestOtherB-585983328-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T10:55:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d4253b9511f408a9c62c79cff8fc0d7',uuid=2535b6f2-2a4b-4ce1-bd47-0f97d15700fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "address": "fa:16:3e:5d:59:b1", "network": {"id": "670b5fe0-96f5-4414-9425-31ee24eda138", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1327797043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9bc007c45c84765bb2739844c7af055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcb29ac-ee", "ovs_interfaceid": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 10:58:00 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-ca5cc1e0-7250-470c-a535-abb242007b06 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Converting VIF {"id": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "address": "fa:16:3e:5d:59:b1", "network": {"id": "670b5fe0-96f5-4414-9425-31ee24eda138", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1327797043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9bc007c45c84765bb2739844c7af055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcb29ac-ee", "ovs_interfaceid": "7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:58:00 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-ca5cc1e0-7250-470c-a535-abb242007b06 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:59:b1,bridge_name='br-int',has_traffic_filtering=True,id=7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a,network=Network(670b5fe0-96f5-4414-9425-31ee24eda138),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bcb29ac-ee') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:58:00 user nova-compute[74994]: DEBUG os_vif [None req-ca5cc1e0-7250-470c-a535-abb242007b06 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:59:b1,bridge_name='br-int',has_traffic_filtering=True,id=7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a,network=Network(670b5fe0-96f5-4414-9425-31ee24eda138),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bcb29ac-ee') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 10:58:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7bcb29ac-ee, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:58:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:58:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8ce108a1-a6a3-440a-8e56-42f83dc7a1c9) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:58:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:58:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:00 user nova-compute[74994]: INFO os_vif [None req-ca5cc1e0-7250-470c-a535-abb242007b06 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:59:b1,bridge_name='br-int',has_traffic_filtering=True,id=7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a,network=Network(670b5fe0-96f5-4414-9425-31ee24eda138),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bcb29ac-ee')
Nov 28 10:58:00 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca5cc1e0-7250-470c-a535-abb242007b06 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 10:58:00 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5cc1e0-7250-470c-a535-abb242007b06 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QFVecHNB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:58:00 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-ca5cc1e0-7250-470c-a535-abb242007b06 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:58:00 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-ca5cc1e0-7250-470c-a535-abb242007b06 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:58:00 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-ca5cc1e0-7250-470c-a535-abb242007b06 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:58:00 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:00 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:00 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[df076885-1510-4ba5-8b55-34d013654dce]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:00 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5cc1e0-7250-470c-a535-abb242007b06 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 10:58:00 user nova-compute[74994]: No targets found.
Nov 28 10:58:00 user nova-compute[74994]: iSNS:
Nov 28 10:58:00 user nova-compute[74994]: No targets found.
Nov 28 10:58:00 user nova-compute[74994]: STATIC:
Nov 28 10:58:00 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb
Nov 28 10:58:00 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:58:00 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:58:00 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580
Nov 28 10:58:00 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:58:00 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:58:00 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77
Nov 28 10:58:00 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:58:00 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:58:00 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8
Nov 28 10:58:00 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:58:00 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:58:00 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de
Nov 28 10:58:00 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:58:00 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:58:00 user nova-compute[74994]: FIRMWARE:
Nov 28 10:58:00 user nova-compute[74994]: No targets found.
Nov 28 10:58:00 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:58:00 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5cc1e0-7250-470c-a535-abb242007b06 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 10:58:00 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 10:58:00 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 10:58:00 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5cc1e0-7250-470c-a535-abb242007b06 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 10:58:00 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:00 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:00 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5186f4dc-f63f-4158-a1fe-7a1dd49d2068]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:00 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:00 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:00 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ca1fa7-0dae-4b89-b07f-4d2d9e952494]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:00 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5cc1e0-7250-470c-a535-abb242007b06 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:58:00 user nova-compute[74994]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)
Nov 28 10:58:00 user nova-compute[74994]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 10:58:00 user nova-compute[74994]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)
Nov 28 10:58:00 user nova-compute[74994]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580 (non-flash)
Nov 28 10:58:00 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:58:00 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5cc1e0-7250-470c-a535-abb242007b06 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:58:00 user nova-compute[74994]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 (non-flash)
Nov 28 10:58:00 user nova-compute[74994]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 10:58:00 user nova-compute[74994]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)
Nov 28 10:58:00 user nova-compute[74994]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580 (non-flash)
Nov 28 10:58:00 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:58:00 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5cc1e0-7250-470c-a535-abb242007b06 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb920746dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77'): ({'sdg'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 10:58:00 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-ca5cc1e0-7250-470c-a535-abb242007b06 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Removing single pathed devices sdg {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 10:58:00 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:01 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:01 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ceddbb-103c-468d-b190-e0c14624ce2c]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:01 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:01 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:01 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b226a0dd-50d9-4232-906b-63217aeabd1b]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:01 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-ca5cc1e0-7250-470c-a535-abb242007b06 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Flushing IO for device /dev/sdg {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 10:58:01 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:01 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:01 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ad46b6-8e14-4ee5-8702-41495b116065]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:01 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-ca5cc1e0-7250-470c-a535-abb242007b06 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 10:58:01 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:01 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.052s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:01 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[720ff3ee-522b-4b80-8e90-36c00ea198e8]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:01 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-ca5cc1e0-7250-470c-a535-abb242007b06 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 10:58:01 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-ca5cc1e0-7250-470c-a535-abb242007b06 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] SCSI volumes sdg have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 10:58:01 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5cc1e0-7250-470c-a535-abb242007b06 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 10:58:01 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:01 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.086s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:01 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77e86a3-7268-4499-9742-bbd2a0a91f99]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:01 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5cc1e0-7250-470c-a535-abb242007b06 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:58:01 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:01 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:01 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f647cc2-3d3a-4d35-94d4-0ee2f2c561c7]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:01 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5cc1e0-7250-470c-a535-abb242007b06 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77, portal: 172.16.0.220,3260]
Nov 28 10:58:01 user nova-compute[74994]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77, portal: 172.16.0.220,3260] successful.
Nov 28 10:58:01 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:58:01 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:01 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35aee3f6-cd85-4e5a-9b2e-f9646455aa77 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:01 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb485e10-688c-4274-ba6f-eff670f01bd3]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:01 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5cc1e0-7250-470c-a535-abb242007b06 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:58:01 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-ca5cc1e0-7250-470c-a535-abb242007b06 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.452s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:58:01 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5cc1e0-7250-470c-a535-abb242007b06 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] <== disconnect_volume: return (453ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:58:01 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca5cc1e0-7250-470c-a535-abb242007b06 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 10:58:01 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-ca5cc1e0-7250-470c-a535-abb242007b06 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Deleting instance files /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb_del
Nov 28 10:58:01 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-ca5cc1e0-7250-470c-a535-abb242007b06 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Deletion of /opt/stack/data/nova/instances/2535b6f2-2a4b-4ce1-bd47-0f97d15700fb_del complete
Nov 28 10:58:01 user nova-compute[74994]: INFO nova.compute.manager [None req-ca5cc1e0-7250-470c-a535-abb242007b06 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Took 1.52 seconds to destroy the instance on the hypervisor.
Nov 28 10:58:01 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-ca5cc1e0-7250-470c-a535-abb242007b06 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 10:58:01 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 10:58:01 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 10:58:02 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:58:02 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Took 0.95 seconds to deallocate network for instance.
Nov 28 10:58:02 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:02 user nova-compute[74994]: DEBUG nova.compute.manager [req-85b91be3-fe8b-4c88-b1c2-7d4145b1d385 req-3ee97211-ba87-4551-8994-595abd623f89 service nova] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Received event network-vif-plugged-7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:58:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-85b91be3-fe8b-4c88-b1c2-7d4145b1d385 req-3ee97211-ba87-4551-8994-595abd623f89 service nova] Acquiring lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:58:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-85b91be3-fe8b-4c88-b1c2-7d4145b1d385 req-3ee97211-ba87-4551-8994-595abd623f89 service nova] Lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:58:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-85b91be3-fe8b-4c88-b1c2-7d4145b1d385 req-3ee97211-ba87-4551-8994-595abd623f89 service nova] Lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:58:02 user nova-compute[74994]: DEBUG nova.compute.manager [req-85b91be3-fe8b-4c88-b1c2-7d4145b1d385 req-3ee97211-ba87-4551-8994-595abd623f89 service nova] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] No waiting events found dispatching network-vif-plugged-7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:58:02 user nova-compute[74994]: WARNING nova.compute.manager [req-85b91be3-fe8b-4c88-b1c2-7d4145b1d385 req-3ee97211-ba87-4551-8994-595abd623f89 service nova] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Received unexpected event network-vif-plugged-7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a for instance with vm_state active and task_state deleting.
Nov 28 10:58:02 user nova-compute[74994]: DEBUG nova.compute.manager [req-85b91be3-fe8b-4c88-b1c2-7d4145b1d385 req-3ee97211-ba87-4551-8994-595abd623f89 service nova] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Received event network-vif-deleted-7bcb29ac-ee7f-48d9-9391-d0cbb2a23c5a {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:58:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:04 user nova-compute[74994]: INFO nova.compute.manager [None req-ca5cc1e0-7250-470c-a535-abb242007b06 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] [instance: 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb] Took 2.06 seconds to detach 1 volumes for instance.
Nov 28 10:58:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ca5cc1e0-7250-470c-a535-abb242007b06 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:58:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ca5cc1e0-7250-470c-a535-abb242007b06 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:58:04 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-ca5cc1e0-7250-470c-a535-abb242007b06 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:58:04 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-ca5cc1e0-7250-470c-a535-abb242007b06 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:58:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ca5cc1e0-7250-470c-a535-abb242007b06 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.420s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:58:04 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-ca5cc1e0-7250-470c-a535-abb242007b06 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Deleted allocations for instance 2535b6f2-2a4b-4ce1-bd47-0f97d15700fb
Nov 28 10:58:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ca5cc1e0-7250-470c-a535-abb242007b06 tempest-ServerActionsTestOtherB-585983328 tempest-ServerActionsTestOtherB-585983328-project-member] Lock "2535b6f2-2a4b-4ce1-bd47-0f97d15700fb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.153s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:58:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Acquiring lock "3cf241c8-e888-4e47-8213-3c83c045e4a3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:58:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "3cf241c8-e888-4e47-8213-3c83c045e4a3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:58:05 user nova-compute[74994]: DEBUG nova.compute.manager [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 10:58:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:58:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:58:05 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 10:58:05 user nova-compute[74994]: INFO nova.compute.claims [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Claim successful on node user
Nov 28 10:58:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:05 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:58:06 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:58:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.659s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:58:06 user nova-compute[74994]: DEBUG nova.compute.manager [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 10:58:06 user nova-compute[74994]: DEBUG nova.compute.manager [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 10:58:06 user nova-compute[74994]: DEBUG nova.network.neutron [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 10:58:06 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 10:58:06 user nova-compute[74994]: DEBUG nova.compute.manager [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 10:58:06 user nova-compute[74994]: DEBUG nova.policy [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c4e1257b844940bebdeab3061c3e0ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4dcdeafd6420d8606b37673e3255f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 10:58:06 user nova-compute[74994]: DEBUG nova.compute.manager [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 10:58:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 10:58:06 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Creating image(s)
Nov 28 10:58:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Acquiring lock "/opt/stack/data/nova/instances/3cf241c8-e888-4e47-8213-3c83c045e4a3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:58:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "/opt/stack/data/nova/instances/3cf241c8-e888-4e47-8213-3c83c045e4a3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:58:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "/opt/stack/data/nova/instances/3cf241c8-e888-4e47-8213-3c83c045e4a3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:58:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.169s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Acquiring lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:58:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:58:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.222s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/3cf241c8-e888-4e47-8213-3c83c045e4a3/disk 1073741824 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/3cf241c8-e888-4e47-8213-3c83c045e4a3/disk 1073741824" returned: 0 in 0.065s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:58:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:06 user nova-compute[74994]: DEBUG nova.network.neutron [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Successfully created port: 017867da-26d5-4fff-9eb9-eb8686888b55 {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 10:58:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.195s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:06 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3cf241c8-e888-4e47-8213-3c83c045e4a3/disk. size=1073741824 {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 10:58:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf241c8-e888-4e47-8213-3c83c045e4a3/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf241c8-e888-4e47-8213-3c83c045e4a3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:07 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Cannot resize image /opt/stack/data/nova/instances/3cf241c8-e888-4e47-8213-3c83c045e4a3/disk to a smaller size. {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 10:58:07 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Created local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 10:58:07 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Ensure instance console log exists: /opt/stack/data/nova/instances/3cf241c8-e888-4e47-8213-3c83c045e4a3/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 10:58:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:58:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:58:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:58:07 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:58:07 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 10:58:07 user nova-compute[74994]: DEBUG nova.network.neutron [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Successfully updated port: 017867da-26d5-4fff-9eb9-eb8686888b55 {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 10:58:07 user nova-compute[74994]: DEBUG nova.compute.manager [req-c9bcd119-077b-41fe-9536-0f49d0c52565 req-67631a6d-1c0b-49f6-9337-b7085ad6c685 service nova] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Received event network-changed-017867da-26d5-4fff-9eb9-eb8686888b55 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:58:07 user nova-compute[74994]: DEBUG nova.compute.manager [req-c9bcd119-077b-41fe-9536-0f49d0c52565 req-67631a6d-1c0b-49f6-9337-b7085ad6c685 service nova] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Refreshing instance network info cache due to event network-changed-017867da-26d5-4fff-9eb9-eb8686888b55. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:58:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c9bcd119-077b-41fe-9536-0f49d0c52565 req-67631a6d-1c0b-49f6-9337-b7085ad6c685 service nova] Acquiring lock "refresh_cache-3cf241c8-e888-4e47-8213-3c83c045e4a3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:58:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c9bcd119-077b-41fe-9536-0f49d0c52565 req-67631a6d-1c0b-49f6-9337-b7085ad6c685 service nova] Acquired lock "refresh_cache-3cf241c8-e888-4e47-8213-3c83c045e4a3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:58:07 user nova-compute[74994]: DEBUG nova.network.neutron [req-c9bcd119-077b-41fe-9536-0f49d0c52565 req-67631a6d-1c0b-49f6-9337-b7085ad6c685 service nova] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Refreshing network info cache for port 017867da-26d5-4fff-9eb9-eb8686888b55 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:58:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Acquiring lock "refresh_cache-3cf241c8-e888-4e47-8213-3c83c045e4a3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:58:07 user nova-compute[74994]: DEBUG nova.network.neutron [req-c9bcd119-077b-41fe-9536-0f49d0c52565 req-67631a6d-1c0b-49f6-9337-b7085ad6c685 service nova] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 10:58:07 user nova-compute[74994]: DEBUG nova.network.neutron [req-c9bcd119-077b-41fe-9536-0f49d0c52565 req-67631a6d-1c0b-49f6-9337-b7085ad6c685 service nova] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:58:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c9bcd119-077b-41fe-9536-0f49d0c52565 req-67631a6d-1c0b-49f6-9337-b7085ad6c685 service nova] Releasing lock "refresh_cache-3cf241c8-e888-4e47-8213-3c83c045e4a3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:58:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Acquired lock "refresh_cache-3cf241c8-e888-4e47-8213-3c83c045e4a3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:58:07 user nova-compute[74994]: DEBUG nova.network.neutron [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 10:58:07 user nova-compute[74994]: DEBUG nova.network.neutron [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 10:58:08 user nova-compute[74994]: DEBUG nova.network.neutron [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Updating instance_info_cache with network_info: [{"id": "017867da-26d5-4fff-9eb9-eb8686888b55", "address": "fa:16:3e:8f:30:5e", "network": {"id": "d46e72ec-d7d5-45f7-951a-b4381f0b472b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-179057367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a4dcdeafd6420d8606b37673e3255f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017867da-26", "ovs_interfaceid": "017867da-26d5-4fff-9eb9-eb8686888b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:58:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Releasing lock "refresh_cache-3cf241c8-e888-4e47-8213-3c83c045e4a3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:58:08 user nova-compute[74994]: DEBUG nova.compute.manager [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Instance network_info: |[{"id": "017867da-26d5-4fff-9eb9-eb8686888b55", "address": "fa:16:3e:8f:30:5e", "network": {"id": "d46e72ec-d7d5-45f7-951a-b4381f0b472b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-179057367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a4dcdeafd6420d8606b37673e3255f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017867da-26", "ovs_interfaceid": "017867da-26d5-4fff-9eb9-eb8686888b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 10:58:08 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Start _get_guest_xml network_info=[{"id": "017867da-26d5-4fff-9eb9-eb8686888b55", "address": "fa:16:3e:8f:30:5e", "network": {"id": "d46e72ec-d7d5-45f7-951a-b4381f0b472b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-179057367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a4dcdeafd6420d8606b37673e3255f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017867da-26", "ovs_interfaceid": "017867da-26d5-4fff-9eb9-eb8686888b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'aa939d1b-b8a6-4391-935b-0191bf5ccd0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 10:58:08 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:58:08 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:58:08 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 10:58:08 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 10:58:08 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 10:58:08 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 10:58:08 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 10:58:08 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 10:58:08 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 10:58:08 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 10:58:08 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 10:58:08 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 10:58:08 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 10:58:08 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 10:58:08 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 10:58:08 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 10:58:08 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 10:58:08 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 10:58:08 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:58:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1735278754',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1735278754',id=27,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmqmu20KDfDBzBY6oASozowL+3S5vdHl8okXBPig0+AxtHwGAkdyi4k3S1Z/tCjZiCbxQI9z+EmWbdqY++IX2p/emffftg2gvlyMhSRLFVHnD/cO28qJSWLbeC6Cv/mew==',key_name='tempest-keypair-2137635767',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d3a4dcdeafd6420d8606b37673e3255f',ramdisk_id='',reservation_id='r-8cjiqvp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1700061593',owner_user_name='tempest-AttachVolumeShelveTestJSON-1700061593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:58:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4e1257b844940bebdeab3061c3e0ab4',uuid=3cf241c8-e888-4e47-8213-3c83c045e4a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "017867da-26d5-4fff-9eb9-eb8686888b55", "address": "fa:16:3e:8f:30:5e", "network": {"id": "d46e72ec-d7d5-45f7-951a-b4381f0b472b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-179057367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a4dcdeafd6420d8606b37673e3255f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017867da-26", "ovs_interfaceid": "017867da-26d5-4fff-9eb9-eb8686888b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:58:08 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Converting VIF {"id": "017867da-26d5-4fff-9eb9-eb8686888b55", "address": "fa:16:3e:8f:30:5e", "network": {"id": "d46e72ec-d7d5-45f7-951a-b4381f0b472b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-179057367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a4dcdeafd6420d8606b37673e3255f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017867da-26", "ovs_interfaceid": "017867da-26d5-4fff-9eb9-eb8686888b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:58:08 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:30:5e,bridge_name='br-int',has_traffic_filtering=True,id=017867da-26d5-4fff-9eb9-eb8686888b55,network=Network(d46e72ec-d7d5-45f7-951a-b4381f0b472b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap017867da-26') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:58:08 user nova-compute[74994]: DEBUG nova.objects.instance [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lazy-loading 'pci_devices' on Instance uuid 3cf241c8-e888-4e47-8213-3c83c045e4a3 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:58:08 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] End _get_guest_xml xml=<domain type="kvm">
Nov 28 10:58:08 user nova-compute[74994]:   <uuid>3cf241c8-e888-4e47-8213-3c83c045e4a3</uuid>
Nov 28 10:58:08 user nova-compute[74994]:   <name>instance-0000001b</name>
Nov 28 10:58:08 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 10:58:08 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 10:58:08 user nova-compute[74994]:   <metadata>
Nov 28 10:58:08 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 10:58:08 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 10:58:08 user nova-compute[74994]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1735278754</nova:name>
Nov 28 10:58:08 user nova-compute[74994]:       <nova:creationTime>2023-11-28 10:58:08</nova:creationTime>
Nov 28 10:58:08 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 10:58:08 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 10:58:08 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 10:58:08 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 10:58:08 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 10:58:08 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 10:58:08 user nova-compute[74994]:       </nova:flavor>
Nov 28 10:58:08 user nova-compute[74994]:       <nova:owner>
Nov 28 10:58:08 user nova-compute[74994]:         <nova:user uuid="c4e1257b844940bebdeab3061c3e0ab4">tempest-AttachVolumeShelveTestJSON-1700061593-project-member</nova:user>
Nov 28 10:58:08 user nova-compute[74994]:         <nova:project uuid="d3a4dcdeafd6420d8606b37673e3255f">tempest-AttachVolumeShelveTestJSON-1700061593</nova:project>
Nov 28 10:58:08 user nova-compute[74994]:       </nova:owner>
Nov 28 10:58:08 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 10:58:08 user nova-compute[74994]:       <nova:ports>
Nov 28 10:58:08 user nova-compute[74994]:         <nova:port uuid="017867da-26d5-4fff-9eb9-eb8686888b55">
Nov 28 10:58:08 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 10:58:08 user nova-compute[74994]:         </nova:port>
Nov 28 10:58:08 user nova-compute[74994]:       </nova:ports>
Nov 28 10:58:08 user nova-compute[74994]:     </nova:instance>
Nov 28 10:58:08 user nova-compute[74994]:   </metadata>
Nov 28 10:58:08 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 10:58:08 user nova-compute[74994]:     <system>
Nov 28 10:58:08 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 10:58:08 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 10:58:08 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 10:58:08 user nova-compute[74994]:       <entry name="serial">3cf241c8-e888-4e47-8213-3c83c045e4a3</entry>
Nov 28 10:58:08 user nova-compute[74994]:       <entry name="uuid">3cf241c8-e888-4e47-8213-3c83c045e4a3</entry>
Nov 28 10:58:08 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 10:58:08 user nova-compute[74994]:     </system>
Nov 28 10:58:08 user nova-compute[74994]:   </sysinfo>
Nov 28 10:58:08 user nova-compute[74994]:   <os>
Nov 28 10:58:08 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 10:58:08 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 10:58:08 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 10:58:08 user nova-compute[74994]:   </os>
Nov 28 10:58:08 user nova-compute[74994]:   <features>
Nov 28 10:58:08 user nova-compute[74994]:     <acpi/>
Nov 28 10:58:08 user nova-compute[74994]:     <apic/>
Nov 28 10:58:08 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 10:58:08 user nova-compute[74994]:   </features>
Nov 28 10:58:08 user nova-compute[74994]:   <clock offset="utc">
Nov 28 10:58:08 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 10:58:08 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 10:58:08 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 10:58:08 user nova-compute[74994]:   </clock>
Nov 28 10:58:08 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 10:58:08 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 10:58:08 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 10:58:08 user nova-compute[74994]:   </cpu>
Nov 28 10:58:08 user nova-compute[74994]:   <devices>
Nov 28 10:58:08 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 10:58:08 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 10:58:08 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/3cf241c8-e888-4e47-8213-3c83c045e4a3/disk"/>
Nov 28 10:58:08 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 10:58:08 user nova-compute[74994]:     </disk>
Nov 28 10:58:08 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 10:58:08 user nova-compute[74994]:       <mac address="fa:16:3e:8f:30:5e"/>
Nov 28 10:58:08 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:58:08 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 10:58:08 user nova-compute[74994]:       <target dev="tap017867da-26"/>
Nov 28 10:58:08 user nova-compute[74994]:     </interface>
Nov 28 10:58:08 user nova-compute[74994]:     <serial type="pty">
Nov 28 10:58:08 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/3cf241c8-e888-4e47-8213-3c83c045e4a3/console.log" append="off"/>
Nov 28 10:58:08 user nova-compute[74994]:     </serial>
Nov 28 10:58:08 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 10:58:08 user nova-compute[74994]:     <video>
Nov 28 10:58:08 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:58:08 user nova-compute[74994]:     </video>
Nov 28 10:58:08 user nova-compute[74994]:     <rng model="virtio">
Nov 28 10:58:08 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 10:58:08 user nova-compute[74994]:     </rng>
Nov 28 10:58:08 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 10:58:08 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 10:58:08 user nova-compute[74994]:       <stats period="10"/>
Nov 28 10:58:08 user nova-compute[74994]:     </memballoon>
Nov 28 10:58:08 user nova-compute[74994]:   </devices>
Nov 28 10:58:08 user nova-compute[74994]: </domain>
Nov 28 10:58:08 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 10:58:08 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:58:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1735278754',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1735278754',id=27,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmqmu20KDfDBzBY6oASozowL+3S5vdHl8okXBPig0+AxtHwGAkdyi4k3S1Z/tCjZiCbxQI9z+EmWbdqY++IX2p/emffftg2gvlyMhSRLFVHnD/cO28qJSWLbeC6Cv/mew==',key_name='tempest-keypair-2137635767',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d3a4dcdeafd6420d8606b37673e3255f',ramdisk_id='',reservation_id='r-8cjiqvp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1700061593',owner_user_name='tempest-AttachVolumeShelveTestJSON-1700061593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:58:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4e1257b844940bebdeab3061c3e0ab4',uuid=3cf241c8-e888-4e47-8213-3c83c045e4a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "017867da-26d5-4fff-9eb9-eb8686888b55", "address": "fa:16:3e:8f:30:5e", "network": {"id": "d46e72ec-d7d5-45f7-951a-b4381f0b472b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-179057367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a4dcdeafd6420d8606b37673e3255f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017867da-26", "ovs_interfaceid": "017867da-26d5-4fff-9eb9-eb8686888b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 10:58:08 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Converting VIF {"id": "017867da-26d5-4fff-9eb9-eb8686888b55", "address": "fa:16:3e:8f:30:5e", "network": {"id": "d46e72ec-d7d5-45f7-951a-b4381f0b472b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-179057367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a4dcdeafd6420d8606b37673e3255f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017867da-26", "ovs_interfaceid": "017867da-26d5-4fff-9eb9-eb8686888b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:58:08 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:30:5e,bridge_name='br-int',has_traffic_filtering=True,id=017867da-26d5-4fff-9eb9-eb8686888b55,network=Network(d46e72ec-d7d5-45f7-951a-b4381f0b472b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap017867da-26') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:58:08 user nova-compute[74994]: DEBUG os_vif [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:30:5e,bridge_name='br-int',has_traffic_filtering=True,id=017867da-26d5-4fff-9eb9-eb8686888b55,network=Network(d46e72ec-d7d5-45f7-951a-b4381f0b472b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap017867da-26') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 10:58:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:58:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 10:58:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3c26ab80-119f-58fd-a1fe-39a634e3bd4c', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:58:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:58:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap017867da-26, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:58:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap017867da-26, col_values=(('qos', UUID('9a635a1c-5869-4679-a443-5d1ca7c4295a')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:58:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap017867da-26, col_values=(('external_ids', {'iface-id': '017867da-26d5-4fff-9eb9-eb8686888b55', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:30:5e', 'vm-uuid': '3cf241c8-e888-4e47-8213-3c83c045e4a3'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:58:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:58:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:08 user nova-compute[74994]: INFO os_vif [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:30:5e,bridge_name='br-int',has_traffic_filtering=True,id=017867da-26d5-4fff-9eb9-eb8686888b55,network=Network(d46e72ec-d7d5-45f7-951a-b4381f0b472b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap017867da-26')
Nov 28 10:58:08 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:58:08 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] No VIF found with MAC fa:16:3e:8f:30:5e, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:58:08 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:58:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:09 user nova-compute[74994]: DEBUG nova.compute.manager [req-db30d947-f404-461c-a68a-97015496c893 req-f0c32733-ebfd-4036-a5b8-8a6175618a42 service nova] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Received event network-vif-plugged-017867da-26d5-4fff-9eb9-eb8686888b55 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:58:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-db30d947-f404-461c-a68a-97015496c893 req-f0c32733-ebfd-4036-a5b8-8a6175618a42 service nova] Acquiring lock "3cf241c8-e888-4e47-8213-3c83c045e4a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:58:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-db30d947-f404-461c-a68a-97015496c893 req-f0c32733-ebfd-4036-a5b8-8a6175618a42 service nova] Lock "3cf241c8-e888-4e47-8213-3c83c045e4a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:58:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-db30d947-f404-461c-a68a-97015496c893 req-f0c32733-ebfd-4036-a5b8-8a6175618a42 service nova] Lock "3cf241c8-e888-4e47-8213-3c83c045e4a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:58:09 user nova-compute[74994]: DEBUG nova.compute.manager [req-db30d947-f404-461c-a68a-97015496c893 req-f0c32733-ebfd-4036-a5b8-8a6175618a42 service nova] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] No waiting events found dispatching network-vif-plugged-017867da-26d5-4fff-9eb9-eb8686888b55 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:58:09 user nova-compute[74994]: WARNING nova.compute.manager [req-db30d947-f404-461c-a68a-97015496c893 req-f0c32733-ebfd-4036-a5b8-8a6175618a42 service nova] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Received unexpected event network-vif-plugged-017867da-26d5-4fff-9eb9-eb8686888b55 for instance with vm_state building and task_state spawning.
Nov 28 10:58:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:10 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:58:11 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:58:11 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:58:11 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:58:11 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:58:11 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 10:58:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:11 user nova-compute[74994]: DEBUG nova.compute.manager [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 10:58:11 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 10:58:11 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Instance spawned successfully.
Nov 28 10:58:11 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 10:58:11 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:58:11 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:58:11 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:58:11 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:58:11 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:58:11 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:58:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:11 user nova-compute[74994]: DEBUG nova.compute.manager [req-54906310-bcbd-4f2e-b7b0-b6973cf9c723 req-fa946d41-1a2b-4171-8500-44f5e2fa62c8 service nova] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Received event network-vif-plugged-017867da-26d5-4fff-9eb9-eb8686888b55 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:58:11 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-54906310-bcbd-4f2e-b7b0-b6973cf9c723 req-fa946d41-1a2b-4171-8500-44f5e2fa62c8 service nova] Acquiring lock "3cf241c8-e888-4e47-8213-3c83c045e4a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:58:11 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-54906310-bcbd-4f2e-b7b0-b6973cf9c723 req-fa946d41-1a2b-4171-8500-44f5e2fa62c8 service nova] Lock "3cf241c8-e888-4e47-8213-3c83c045e4a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:58:11 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-54906310-bcbd-4f2e-b7b0-b6973cf9c723 req-fa946d41-1a2b-4171-8500-44f5e2fa62c8 service nova] Lock "3cf241c8-e888-4e47-8213-3c83c045e4a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:58:11 user nova-compute[74994]: DEBUG nova.compute.manager [req-54906310-bcbd-4f2e-b7b0-b6973cf9c723 req-fa946d41-1a2b-4171-8500-44f5e2fa62c8 service nova] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] No waiting events found dispatching network-vif-plugged-017867da-26d5-4fff-9eb9-eb8686888b55 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:58:11 user nova-compute[74994]: WARNING nova.compute.manager [req-54906310-bcbd-4f2e-b7b0-b6973cf9c723 req-fa946d41-1a2b-4171-8500-44f5e2fa62c8 service nova] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Received unexpected event network-vif-plugged-017867da-26d5-4fff-9eb9-eb8686888b55 for instance with vm_state building and task_state spawning.
Nov 28 10:58:11 user nova-compute[74994]: INFO nova.compute.manager [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Took 5.67 seconds to spawn the instance on the hypervisor.
Nov 28 10:58:11 user nova-compute[74994]: DEBUG nova.compute.manager [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 10:58:12 user nova-compute[74994]: INFO nova.compute.manager [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Took 6.69 seconds to build instance.
Nov 28 10:58:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-01727258-2183-44ef-8c83-33a68a1f83b0 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "3cf241c8-e888-4e47-8213-3c83c045e4a3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.806s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:58:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bce88d5-64b3-450b-b7e0-26a1c5d299c6/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bce88d5-64b3-450b-b7e0-26a1c5d299c6/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bce88d5-64b3-450b-b7e0-26a1c5d299c6/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bce88d5-64b3-450b-b7e0-26a1c5d299c6/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:13 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 10:58:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:14 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 10:58:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf241c8-e888-4e47-8213-3c83c045e4a3/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf241c8-e888-4e47-8213-3c83c045e4a3/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf241c8-e888-4e47-8213-3c83c045e4a3/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf241c8-e888-4e47-8213-3c83c045e4a3/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:16 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 10:58:16 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:58:16 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:58:16 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=7487MB free_disk=25.241058349609375GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 10:58:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:58:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:58:16 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:58:16 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance bf357856-2d97-42e8-928d-71d0378f48c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:58:16 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 279e1c4c-36f9-492f-ab3f-1b587347eadd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:58:16 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 759fbcfd-ab13-438f-b860-6393a97d1205 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:58:16 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 20716905-c56a-4729-8c5b-9188502dc477 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:58:16 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 2f4b631a-46c8-4f9b-b5f9-6e2542484658 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:58:16 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 8bce88d5-64b3-450b-b7e0-26a1c5d299c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:58:16 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance c608eb72-4375-4e2a-aae8-a03d086b72e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:58:16 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 20605acb-092a-4214-a114-750f145d7af8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:58:16 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance b743c491-ece8-4781-9530-b2f38ffc1079 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:58:16 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:58:16 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 3cf241c8-e888-4e47-8213-3c83c045e4a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:58:16 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 10:58:16 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 10:58:17 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:58:17 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:58:17 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 10:58:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.720s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:58:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:18 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:58:18 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:58:18 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 10:58:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "refresh_cache-bf357856-2d97-42e8-928d-71d0378f48c8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:58:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquired lock "refresh_cache-bf357856-2d97-42e8-928d-71d0378f48c8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:58:18 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Forcefully refreshing network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 10:58:18 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Updating instance_info_cache with network_info: [{"id": "6a884296-8f6f-4647-b4c6-09d7f4e92887", "address": "fa:16:3e:a2:e1:5b", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a884296-8f", "ovs_interfaceid": "6a884296-8f6f-4647-b4c6-09d7f4e92887", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:58:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Releasing lock "refresh_cache-bf357856-2d97-42e8-928d-71d0378f48c8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:58:18 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Updated the network info_cache for instance {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 10:58:18 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:58:18 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:58:18 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:19 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-2d9ed888-8136-4d45-b042-571cf94882a6 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8bce88d5-64b3-450b-b7e0-26a1c5d299c6 is timed out.
Nov 28 10:58:19 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-2d9ed888-8136-4d45-b042-571cf94882a6 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Successfully detached device vdb from instance 8bce88d5-64b3-450b-b7e0-26a1c5d299c6 from the live domain config.
Nov 28 10:58:19 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d9ed888-8136-4d45-b042-571cf94882a6 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d9ed888-8136-4d45-b042-571cf94882a6 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zeLPqfFC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:58:19 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-2d9ed888-8136-4d45-b042-571cf94882a6 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:58:19 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-2d9ed888-8136-4d45-b042-571cf94882a6 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-2d9ed888-8136-4d45-b042-571cf94882a6 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db07a19-9588-445a-a469-99ef0c2a05f2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d9ed888-8136-4d45-b042-571cf94882a6 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 10:58:19 user nova-compute[74994]: No targets found.
Nov 28 10:58:19 user nova-compute[74994]: iSNS:
Nov 28 10:58:19 user nova-compute[74994]: No targets found.
Nov 28 10:58:19 user nova-compute[74994]: STATIC:
Nov 28 10:58:19 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb
Nov 28 10:58:19 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:58:19 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:58:19 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580
Nov 28 10:58:19 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:58:19 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:58:19 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8
Nov 28 10:58:19 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:58:19 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:58:19 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de
Nov 28 10:58:19 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:58:19 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:58:19 user nova-compute[74994]: FIRMWARE:
Nov 28 10:58:19 user nova-compute[74994]: No targets found.
Nov 28 10:58:19 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d9ed888-8136-4d45-b042-571cf94882a6 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 10:58:19 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 10:58:19 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d9ed888-8136-4d45-b042-571cf94882a6 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[56109af2-7f41-4aad-b75c-fb0fcf9576ee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fcd863c-7a64-4d1c-a04f-232bc1f6d6a4]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d9ed888-8136-4d45-b042-571cf94882a6 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:58:19 user nova-compute[74994]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 10:58:19 user nova-compute[74994]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)
Nov 28 10:58:19 user nova-compute[74994]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580 (non-flash)
Nov 28 10:58:19 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d9ed888-8136-4d45-b042-571cf94882a6 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:58:19 user nova-compute[74994]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 10:58:19 user nova-compute[74994]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)
Nov 28 10:58:19 user nova-compute[74994]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580 (non-flash)
Nov 28 10:58:19 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d9ed888-8136-4d45-b042-571cf94882a6 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb94452c8b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580'): ({'sdd'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-2d9ed888-8136-4d45-b042-571cf94882a6 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Removing single pathed devices sdd {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c165f036-793e-4d0a-ba42-ff58779aa5c3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b89028-1b2e-4b8e-9578-cc018e6e4a7c]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-2d9ed888-8136-4d45-b042-571cf94882a6 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Flushing IO for device /dev/sdd {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e529489-781c-40a4-8fd2-d6e6d65f4dbd]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-2d9ed888-8136-4d45-b042-571cf94882a6 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbef3e13-95fa-442e-ac0d-cfc19f1a60b1]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-2d9ed888-8136-4d45-b042-571cf94882a6 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-2d9ed888-8136-4d45-b042-571cf94882a6 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] SCSI volumes sdd have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d9ed888-8136-4d45-b042-571cf94882a6 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d099ee-58ef-4e37-88aa-25c8c1b1ef7d]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d9ed888-8136-4d45-b042-571cf94882a6 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580 -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8d0493-8d32-437e-8e15-d8fc714492dd]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d9ed888-8136-4d45-b042-571cf94882a6 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580, portal: 172.16.0.220,3260]
Nov 28 10:58:19 user nova-compute[74994]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580, portal: 172.16.0.220,3260] successful.
Nov 28 10:58:19 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580 -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb8f73aa-1f33-413f-bec6-e2491c811580 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ddfe5d-3c01-4df3-b00a-59450016d3b4]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d9ed888-8136-4d45-b042-571cf94882a6 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-2d9ed888-8136-4d45-b042-571cf94882a6 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d9ed888-8136-4d45-b042-571cf94882a6 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] <== disconnect_volume: return (306ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:58:19 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d9ed888-8136-4d45-b042-571cf94882a6 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 10:58:20 user nova-compute[74994]: DEBUG nova.objects.instance [None req-2d9ed888-8136-4d45-b042-571cf94882a6 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lazy-loading 'flavor' on Instance uuid 8bce88d5-64b3-450b-b7e0-26a1c5d299c6 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:58:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2d9ed888-8136-4d45-b042-571cf94882a6 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "8bce88d5-64b3-450b-b7e0-26a1c5d299c6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.772s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:58:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG nova.objects.instance [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lazy-loading 'flavor' on Instance uuid 2f4b631a-46c8-4f9b-b5f9-6e2542484658 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Acquiring lock "refresh_cache-2f4b631a-46c8-4f9b-b5f9-6e2542484658" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Acquired lock "refresh_cache-2f4b631a-46c8-4f9b-b5f9-6e2542484658" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG nova.network.neutron [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG nova.objects.instance [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lazy-loading 'info_cache' on Instance uuid 2f4b631a-46c8-4f9b-b5f9-6e2542484658 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG nova.objects.base [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Object Instance<2f4b631a-46c8-4f9b-b5f9-6e2542484658> lazy-loaded attributes: flavor,info_cache {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG nova.network.neutron [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Updating instance_info_cache with network_info: [{"id": "068080a2-5847-4053-a463-9fc29cb64bb4", "address": "fa:16:3e:21:e9:f5", "network": {"id": "844b3eab-57f3-4582-9fcc-04594e44081b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-233988918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33727b28c7d94b7bbe8987c1301eec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068080a2-58", "ovs_interfaceid": "068080a2-5847-4053-a463-9fc29cb64bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Releasing lock "refresh_cache-2f4b631a-46c8-4f9b-b5f9-6e2542484658" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:58:26 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Instance destroyed successfully.
Nov 28 10:58:26 user nova-compute[74994]: DEBUG nova.objects.instance [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lazy-loading 'resources' on Instance uuid 2f4b631a-46c8-4f9b-b5f9-6e2542484658 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG nova.objects.base [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Object Instance<2f4b631a-46c8-4f9b-b5f9-6e2542484658> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:54:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-107367549',display_name='tempest-AttachVolumeTestJSON-server-107367549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-107367549',id=20,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPaObEUIaQ+CDNwt47CPRXIZ7eFISJE/iAezjV3I0JL+MYNy2O/xy+BPGpqSlurI4jnHrFjLiC5c/eman9PMAcvN7snGFvVpuVRua1rqVAVoDQMEJZ1527ex29ZklUbnQ==',key_name='tempest-keypair-1250905933',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:54:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='33727b28c7d94b7bbe8987c1301eec04',ramdisk_id='',reservation_id='r-5ou66u0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-565652019',owner_user_name='tempest-AttachVolumeTestJSON-565652019-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T10:56:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44e7cead5a1a4ed09ee100e9b7a4968d',uuid=2f4b631a-46c8-4f9b-b5f9-6e2542484658,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "068080a2-5847-4053-a463-9fc29cb64bb4", "address": "fa:16:3e:21:e9:f5", "network": {"id": "844b3eab-57f3-4582-9fcc-04594e44081b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-233988918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33727b28c7d94b7bbe8987c1301eec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068080a2-58", "ovs_interfaceid": "068080a2-5847-4053-a463-9fc29cb64bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Converting VIF {"id": "068080a2-5847-4053-a463-9fc29cb64bb4", "address": "fa:16:3e:21:e9:f5", "network": {"id": "844b3eab-57f3-4582-9fcc-04594e44081b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-233988918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33727b28c7d94b7bbe8987c1301eec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068080a2-58", "ovs_interfaceid": "068080a2-5847-4053-a463-9fc29cb64bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:e9:f5,bridge_name='br-int',has_traffic_filtering=True,id=068080a2-5847-4053-a463-9fc29cb64bb4,network=Network(844b3eab-57f3-4582-9fcc-04594e44081b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068080a2-58') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG os_vif [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:e9:f5,bridge_name='br-int',has_traffic_filtering=True,id=068080a2-5847-4053-a463-9fc29cb64bb4,network=Network(844b3eab-57f3-4582-9fcc-04594e44081b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068080a2-58') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap068080a2-58, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6ba3411f-4075-4b45-b006-568a968ccdaa) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:26 user nova-compute[74994]: INFO os_vif [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:e9:f5,bridge_name='br-int',has_traffic_filtering=True,id=068080a2-5847-4053-a463-9fc29cb64bb4,network=Network(844b3eab-57f3-4582-9fcc-04594e44081b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068080a2-58')
Nov 28 10:58:26 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXFPpJyM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:58:26 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:58:26 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d63ef2f-b5ed-4adc-908f-df4115ded2be]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 10:58:26 user nova-compute[74994]: No targets found.
Nov 28 10:58:26 user nova-compute[74994]: iSNS:
Nov 28 10:58:26 user nova-compute[74994]: No targets found.
Nov 28 10:58:26 user nova-compute[74994]: STATIC:
Nov 28 10:58:26 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb
Nov 28 10:58:26 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:58:26 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:58:26 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8
Nov 28 10:58:26 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:58:26 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:58:26 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de
Nov 28 10:58:26 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:58:26 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:58:26 user nova-compute[74994]: FIRMWARE:
Nov 28 10:58:26 user nova-compute[74994]: No targets found.
Nov 28 10:58:26 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 10:58:26 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 10:58:26 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1112ff9f-8bf2-4559-9448-4975c4514331]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96fccd6-31b2-4a7e-84ca-db460e090187]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:58:26 user nova-compute[74994]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 10:58:26 user nova-compute[74994]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)
Nov 28 10:58:26 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:58:26 user nova-compute[74994]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 10:58:26 user nova-compute[74994]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)
Nov 28 10:58:26 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb94452fac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb'): ({'sdh'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Removing single pathed devices sdh {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd4afc4-b481-4375-90ed-4886d4122c55]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c47dae-3d12-41d3-9c61-0727c0210783]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Flushing IO for device /dev/sdh {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[be324931-5d8d-4b63-af1b-55b52e502f87]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.041s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0daaa721-0722-4190-ae61-66512e34a96b]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] SCSI volumes sdh have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa84f6be-9387-49ec-8b46-16b8d09a7a04]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:58:26 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[97cbc6f5-0c21-4990-9293-dd50930d1878]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb, portal: 172.16.0.220,3260]
Nov 28 10:58:27 user nova-compute[74994]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb, portal: 172.16.0.220,3260] successful.
Nov 28 10:58:27 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd4b581-0c40-457f-b760-85422dec0085]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] <== disconnect_volume: return (322ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Start _get_guest_xml network_info=[{"id": "068080a2-5847-4053-a463-9fc29cb64bb4", "address": "fa:16:3e:21:e9:f5", "network": {"id": "844b3eab-57f3-4582-9fcc-04594e44081b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-233988918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33727b28c7d94b7bbe8987c1301eec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068080a2-58", "ovs_interfaceid": "068080a2-5847-4053-a463-9fc29cb64bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'aa939d1b-b8a6-4391-935b-0191bf5ccd0a'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXFPpJyM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '2f4b631a-46c8-4f9b-b5f9-6e2542484658', 'attached_at': '', 'detached_at': '', 'volume_id': 'dbafc9fb-40fc-4788-8115-7bfe2a0c53cb', 'serial': 'dbafc9fb-40fc-4788-8115-7bfe2a0c53cb'}, 'attachment_id': 'a8106954-adb4-48fd-84a9-f3ad02e5ef65', 'boot_index': None, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG nova.objects.instance [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lazy-loading 'numa_topology' on Instance uuid 2f4b631a-46c8-4f9b-b5f9-6e2542484658 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG nova.objects.base [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Object Instance<2f4b631a-46c8-4f9b-b5f9-6e2542484658> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 10:58:27 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:58:27 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:58:27 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG nova.objects.instance [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2f4b631a-46c8-4f9b-b5f9-6e2542484658 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG nova.objects.base [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Object Instance<2f4b631a-46c8-4f9b-b5f9-6e2542484658> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXFPpJyM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:58:27 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:58:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:58:27 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:58:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:58:27 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 10:58:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[75982944-12e7-416c-a477-7c206ad6edc2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 10:58:27 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd9b199-a16b-4ea2-99ae-0120d34763fa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb] added
Nov 28 10:58:27 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a4d06e-b4cc-432d-b1c2-29b67fa643f4]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea38954-77d3-4ce5-8a2a-932f16fac1d3]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EXFPpJyM {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EXFPpJyM" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce64ae2-d1be-41d5-9ad0-c705a6feb992]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EXFPpJyM'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[de505250-7767-4c8b-8c4b-4a40b0f88f35]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[935b2bed-a6f8-45ff-a830-9c1a08017c73]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:58:27 user nova-compute[74994]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)
Nov 28 10:58:27 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:58:27 user nova-compute[74994]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)
Nov 28 10:58:27 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[012bf459-b18f-46df-bd78-873afa6e131e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb, portal: 172.16.0.220,3260]
Nov 28 10:58:27 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb, portal: 172.16.0.220,3260] successful.
Nov 28 10:58:27 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3482be9-fcc2-4d68-acd1-74a687ed35e0]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d87dd5-c486-41fd-810e-3a7aa6b145ae]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:58:27 user nova-compute[74994]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)
Nov 28 10:58:27 user nova-compute[74994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 10:58:27 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:58:27 user nova-compute[74994]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)
Nov 28 10:58:27 user nova-compute[74994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 10:58:27 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9b12f3-443b-4cba-8363-f8de1c2aead3]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 10:58:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXFPpJyM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 10:58:28 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:58:28 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '26165336339613339', 'path': '/dev/sdd'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:58:28 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165336339613339', 'path': '/dev/sdd'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 10:58:28 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:54:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-107367549',display_name='tempest-AttachVolumeTestJSON-server-107367549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-107367549',id=20,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPaObEUIaQ+CDNwt47CPRXIZ7eFISJE/iAezjV3I0JL+MYNy2O/xy+BPGpqSlurI4jnHrFjLiC5c/eman9PMAcvN7snGFvVpuVRua1rqVAVoDQMEJZ1527ex29ZklUbnQ==',key_name='tempest-keypair-1250905933',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:54:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='33727b28c7d94b7bbe8987c1301eec04',ramdisk_id='',reservation_id='r-5ou66u0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-565652019',owner_user_name='tempest-AttachVolumeTestJSON-565652019-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T10:56:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44e7cead5a1a4ed09ee100e9b7a4968d',uuid=2f4b631a-46c8-4f9b-b5f9-6e2542484658,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "068080a2-5847-4053-a463-9fc29cb64bb4", "address": "fa:16:3e:21:e9:f5", "network": {"id": "844b3eab-57f3-4582-9fcc-04594e44081b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-233988918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33727b28c7d94b7bbe8987c1301eec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068080a2-58", "ovs_interfaceid": "068080a2-5847-4053-a463-9fc29cb64bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:58:28 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Converting VIF {"id": "068080a2-5847-4053-a463-9fc29cb64bb4", "address": "fa:16:3e:21:e9:f5", "network": {"id": "844b3eab-57f3-4582-9fcc-04594e44081b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-233988918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33727b28c7d94b7bbe8987c1301eec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068080a2-58", "ovs_interfaceid": "068080a2-5847-4053-a463-9fc29cb64bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:58:28 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:e9:f5,bridge_name='br-int',has_traffic_filtering=True,id=068080a2-5847-4053-a463-9fc29cb64bb4,network=Network(844b3eab-57f3-4582-9fcc-04594e44081b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068080a2-58') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:58:28 user nova-compute[74994]: DEBUG nova.objects.instance [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f4b631a-46c8-4f9b-b5f9-6e2542484658 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:58:28 user nova-compute[74994]: DEBUG nova.objects.base [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Object Instance<2f4b631a-46c8-4f9b-b5f9-6e2542484658> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 10:58:28 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] End _get_guest_xml xml=<domain type="kvm">
Nov 28 10:58:28 user nova-compute[74994]:   <uuid>2f4b631a-46c8-4f9b-b5f9-6e2542484658</uuid>
Nov 28 10:58:28 user nova-compute[74994]:   <name>instance-00000014</name>
Nov 28 10:58:28 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 10:58:28 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 10:58:28 user nova-compute[74994]:   <metadata>
Nov 28 10:58:28 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 10:58:28 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 10:58:28 user nova-compute[74994]:       <nova:name>tempest-AttachVolumeTestJSON-server-107367549</nova:name>
Nov 28 10:58:28 user nova-compute[74994]:       <nova:creationTime>2023-11-28 10:58:27</nova:creationTime>
Nov 28 10:58:28 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 10:58:28 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 10:58:28 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 10:58:28 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 10:58:28 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 10:58:28 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 10:58:28 user nova-compute[74994]:       </nova:flavor>
Nov 28 10:58:28 user nova-compute[74994]:       <nova:owner>
Nov 28 10:58:28 user nova-compute[74994]:         <nova:user uuid="44e7cead5a1a4ed09ee100e9b7a4968d">tempest-AttachVolumeTestJSON-565652019-project-member</nova:user>
Nov 28 10:58:28 user nova-compute[74994]:         <nova:project uuid="33727b28c7d94b7bbe8987c1301eec04">tempest-AttachVolumeTestJSON-565652019</nova:project>
Nov 28 10:58:28 user nova-compute[74994]:       </nova:owner>
Nov 28 10:58:28 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 10:58:28 user nova-compute[74994]:       <nova:ports>
Nov 28 10:58:28 user nova-compute[74994]:         <nova:port uuid="068080a2-5847-4053-a463-9fc29cb64bb4">
Nov 28 10:58:28 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 28 10:58:28 user nova-compute[74994]:         </nova:port>
Nov 28 10:58:28 user nova-compute[74994]:       </nova:ports>
Nov 28 10:58:28 user nova-compute[74994]:     </nova:instance>
Nov 28 10:58:28 user nova-compute[74994]:   </metadata>
Nov 28 10:58:28 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 10:58:28 user nova-compute[74994]:     <system>
Nov 28 10:58:28 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 10:58:28 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 10:58:28 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 10:58:28 user nova-compute[74994]:       <entry name="serial">2f4b631a-46c8-4f9b-b5f9-6e2542484658</entry>
Nov 28 10:58:28 user nova-compute[74994]:       <entry name="uuid">2f4b631a-46c8-4f9b-b5f9-6e2542484658</entry>
Nov 28 10:58:28 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 10:58:28 user nova-compute[74994]:     </system>
Nov 28 10:58:28 user nova-compute[74994]:   </sysinfo>
Nov 28 10:58:28 user nova-compute[74994]:   <os>
Nov 28 10:58:28 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 10:58:28 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 10:58:28 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 10:58:28 user nova-compute[74994]:   </os>
Nov 28 10:58:28 user nova-compute[74994]:   <features>
Nov 28 10:58:28 user nova-compute[74994]:     <acpi/>
Nov 28 10:58:28 user nova-compute[74994]:     <apic/>
Nov 28 10:58:28 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 10:58:28 user nova-compute[74994]:   </features>
Nov 28 10:58:28 user nova-compute[74994]:   <clock offset="utc">
Nov 28 10:58:28 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 10:58:28 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 10:58:28 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 10:58:28 user nova-compute[74994]:   </clock>
Nov 28 10:58:28 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 10:58:28 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 10:58:28 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 10:58:28 user nova-compute[74994]:   </cpu>
Nov 28 10:58:28 user nova-compute[74994]:   <devices>
Nov 28 10:58:28 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 10:58:28 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 10:58:28 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk"/>
Nov 28 10:58:28 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 10:58:28 user nova-compute[74994]:     </disk>
Nov 28 10:58:28 user nova-compute[74994]:     <disk type="block" device="disk">
Nov 28 10:58:28 user nova-compute[74994]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 10:58:28 user nova-compute[74994]:       <source dev="/dev/sdd"/>
Nov 28 10:58:28 user nova-compute[74994]:       <target dev="vdb" bus="virtio"/>
Nov 28 10:58:28 user nova-compute[74994]:       <serial>dbafc9fb-40fc-4788-8115-7bfe2a0c53cb</serial>
Nov 28 10:58:28 user nova-compute[74994]:     </disk>
Nov 28 10:58:28 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 10:58:28 user nova-compute[74994]:       <mac address="fa:16:3e:21:e9:f5"/>
Nov 28 10:58:28 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:58:28 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 10:58:28 user nova-compute[74994]:       <target dev="tap068080a2-58"/>
Nov 28 10:58:28 user nova-compute[74994]:     </interface>
Nov 28 10:58:28 user nova-compute[74994]:     <serial type="pty">
Nov 28 10:58:28 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/console.log" append="off"/>
Nov 28 10:58:28 user nova-compute[74994]:     </serial>
Nov 28 10:58:28 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 10:58:28 user nova-compute[74994]:     <video>
Nov 28 10:58:28 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:58:28 user nova-compute[74994]:     </video>
Nov 28 10:58:28 user nova-compute[74994]:     <rng model="virtio">
Nov 28 10:58:28 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 10:58:28 user nova-compute[74994]:     </rng>
Nov 28 10:58:28 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 10:58:28 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 10:58:28 user nova-compute[74994]:       <stats period="10"/>
Nov 28 10:58:28 user nova-compute[74994]:     </memballoon>
Nov 28 10:58:28 user nova-compute[74994]:   </devices>
Nov 28 10:58:28 user nova-compute[74994]: </domain>
Nov 28 10:58:28 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 10:58:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:28 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 10:58:28 user nova-compute[74994]: DEBUG nova.objects.instance [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2f4b631a-46c8-4f9b-b5f9-6e2542484658 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:58:28 user nova-compute[74994]: DEBUG nova.objects.base [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Object Instance<2f4b631a-46c8-4f9b-b5f9-6e2542484658> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 10:58:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.185s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:29 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk. size=1073741824 {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 10:58:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:29 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Cannot resize image /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk to a smaller size. {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 10:58:29 user nova-compute[74994]: DEBUG nova.objects.instance [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lazy-loading 'migration_context' on Instance uuid 2f4b631a-46c8-4f9b-b5f9-6e2542484658 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:58:29 user nova-compute[74994]: DEBUG nova.objects.base [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Object Instance<2f4b631a-46c8-4f9b-b5f9-6e2542484658> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 10:58:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:54:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-107367549',display_name='tempest-AttachVolumeTestJSON-server-107367549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-107367549',id=20,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPaObEUIaQ+CDNwt47CPRXIZ7eFISJE/iAezjV3I0JL+MYNy2O/xy+BPGpqSlurI4jnHrFjLiC5c/eman9PMAcvN7snGFvVpuVRua1rqVAVoDQMEJZ1527ex29ZklUbnQ==',key_name='tempest-keypair-1250905933',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:54:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='33727b28c7d94b7bbe8987c1301eec04',ramdisk_id='',reservation_id='r-5ou66u0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-565652019',owner_user_name='tempest-AttachVolumeTestJSON-565652019-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:56:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44e7cead5a1a4ed09ee100e9b7a4968d',uuid=2f4b631a-46c8-4f9b-b5f9-6e2542484658,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "068080a2-5847-4053-a463-9fc29cb64bb4", "address": "fa:16:3e:21:e9:f5", "network": {"id": "844b3eab-57f3-4582-9fcc-04594e44081b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-233988918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33727b28c7d94b7bbe8987c1301eec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068080a2-58", "ovs_interfaceid": "068080a2-5847-4053-a463-9fc29cb64bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 10:58:29 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Converting VIF {"id": "068080a2-5847-4053-a463-9fc29cb64bb4", "address": "fa:16:3e:21:e9:f5", "network": {"id": "844b3eab-57f3-4582-9fcc-04594e44081b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-233988918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33727b28c7d94b7bbe8987c1301eec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068080a2-58", "ovs_interfaceid": "068080a2-5847-4053-a463-9fc29cb64bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:58:29 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:e9:f5,bridge_name='br-int',has_traffic_filtering=True,id=068080a2-5847-4053-a463-9fc29cb64bb4,network=Network(844b3eab-57f3-4582-9fcc-04594e44081b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068080a2-58') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:58:29 user nova-compute[74994]: DEBUG os_vif [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:e9:f5,bridge_name='br-int',has_traffic_filtering=True,id=068080a2-5847-4053-a463-9fc29cb64bb4,network=Network(844b3eab-57f3-4582-9fcc-04594e44081b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068080a2-58') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 10:58:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:58:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 10:58:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5676dbdb-86ff-5262-ad33-dca06f2d9f0f', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:58:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:58:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap068080a2-58, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:58:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap068080a2-58, col_values=(('qos', UUID('bb7402a4-dd7e-40b9-87e2-c82f626d0e1d')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:58:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap068080a2-58, col_values=(('external_ids', {'iface-id': '068080a2-5847-4053-a463-9fc29cb64bb4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:e9:f5', 'vm-uuid': '2f4b631a-46c8-4f9b-b5f9-6e2542484658'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:58:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:58:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:29 user nova-compute[74994]: INFO os_vif [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:e9:f5,bridge_name='br-int',has_traffic_filtering=True,id=068080a2-5847-4053-a463-9fc29cb64bb4,network=Network(844b3eab-57f3-4582-9fcc-04594e44081b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068080a2-58')
Nov 28 10:58:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:29 user nova-compute[74994]: DEBUG nova.compute.manager [req-a3df791d-6649-40d2-aac7-efc3701d31d2 req-4ad53269-c45b-4795-9c45-8dc40f9a470f service nova] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Received event network-changed-32f4f44f-44b7-47f0-9c06-bd33d3a48216 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:58:29 user nova-compute[74994]: DEBUG nova.compute.manager [req-a3df791d-6649-40d2-aac7-efc3701d31d2 req-4ad53269-c45b-4795-9c45-8dc40f9a470f service nova] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Refreshing instance network info cache due to event network-changed-32f4f44f-44b7-47f0-9c06-bd33d3a48216. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:58:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a3df791d-6649-40d2-aac7-efc3701d31d2 req-4ad53269-c45b-4795-9c45-8dc40f9a470f service nova] Acquiring lock "refresh_cache-c608eb72-4375-4e2a-aae8-a03d086b72e8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:58:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a3df791d-6649-40d2-aac7-efc3701d31d2 req-4ad53269-c45b-4795-9c45-8dc40f9a470f service nova] Acquired lock "refresh_cache-c608eb72-4375-4e2a-aae8-a03d086b72e8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:58:29 user nova-compute[74994]: DEBUG nova.network.neutron [req-a3df791d-6649-40d2-aac7-efc3701d31d2 req-4ad53269-c45b-4795-9c45-8dc40f9a470f service nova] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Refreshing network info cache for port 32f4f44f-44b7-47f0-9c06-bd33d3a48216 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:58:30 user nova-compute[74994]: DEBUG nova.network.neutron [req-a3df791d-6649-40d2-aac7-efc3701d31d2 req-4ad53269-c45b-4795-9c45-8dc40f9a470f service nova] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Updated VIF entry in instance network info cache for port 32f4f44f-44b7-47f0-9c06-bd33d3a48216. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 10:58:30 user nova-compute[74994]: DEBUG nova.network.neutron [req-a3df791d-6649-40d2-aac7-efc3701d31d2 req-4ad53269-c45b-4795-9c45-8dc40f9a470f service nova] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Updating instance_info_cache with network_info: [{"id": "32f4f44f-44b7-47f0-9c06-bd33d3a48216", "address": "fa:16:3e:12:e4:7a", "network": {"id": "d339a2cb-dddd-4921-9ac8-bde483746df2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1820767196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56f0f99bee04f7baace9d7aa22cffa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32f4f44f-44", "ovs_interfaceid": "32f4f44f-44b7-47f0-9c06-bd33d3a48216", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:58:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a3df791d-6649-40d2-aac7-efc3701d31d2 req-4ad53269-c45b-4795-9c45-8dc40f9a470f service nova] Releasing lock "refresh_cache-c608eb72-4375-4e2a-aae8-a03d086b72e8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:58:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:31 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:31 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:31 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:31 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:31 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:31 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:31 user nova-compute[74994]: DEBUG nova.compute.manager [req-6ba6c49b-6061-4659-9afe-aecfc0b6f16e req-8654c0cf-3585-4bc4-b651-8813dae0a321 service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Received event network-vif-plugged-068080a2-5847-4053-a463-9fc29cb64bb4 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:58:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6ba6c49b-6061-4659-9afe-aecfc0b6f16e req-8654c0cf-3585-4bc4-b651-8813dae0a321 service nova] Acquiring lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:58:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6ba6c49b-6061-4659-9afe-aecfc0b6f16e req-8654c0cf-3585-4bc4-b651-8813dae0a321 service nova] Lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:58:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6ba6c49b-6061-4659-9afe-aecfc0b6f16e req-8654c0cf-3585-4bc4-b651-8813dae0a321 service nova] Lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:58:31 user nova-compute[74994]: DEBUG nova.compute.manager [req-6ba6c49b-6061-4659-9afe-aecfc0b6f16e req-8654c0cf-3585-4bc4-b651-8813dae0a321 service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] No waiting events found dispatching network-vif-plugged-068080a2-5847-4053-a463-9fc29cb64bb4 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:58:31 user nova-compute[74994]: WARNING nova.compute.manager [req-6ba6c49b-6061-4659-9afe-aecfc0b6f16e req-8654c0cf-3585-4bc4-b651-8813dae0a321 service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Received unexpected event network-vif-plugged-068080a2-5847-4053-a463-9fc29cb64bb4 for instance with vm_state stopped and task_state powering-on.
Nov 28 10:58:31 user nova-compute[74994]: DEBUG nova.compute.manager [req-6ba6c49b-6061-4659-9afe-aecfc0b6f16e req-8654c0cf-3585-4bc4-b651-8813dae0a321 service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Received event network-vif-plugged-068080a2-5847-4053-a463-9fc29cb64bb4 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:58:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6ba6c49b-6061-4659-9afe-aecfc0b6f16e req-8654c0cf-3585-4bc4-b651-8813dae0a321 service nova] Acquiring lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:58:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6ba6c49b-6061-4659-9afe-aecfc0b6f16e req-8654c0cf-3585-4bc4-b651-8813dae0a321 service nova] Lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:58:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6ba6c49b-6061-4659-9afe-aecfc0b6f16e req-8654c0cf-3585-4bc4-b651-8813dae0a321 service nova] Lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:58:31 user nova-compute[74994]: DEBUG nova.compute.manager [req-6ba6c49b-6061-4659-9afe-aecfc0b6f16e req-8654c0cf-3585-4bc4-b651-8813dae0a321 service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] No waiting events found dispatching network-vif-plugged-068080a2-5847-4053-a463-9fc29cb64bb4 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:58:31 user nova-compute[74994]: WARNING nova.compute.manager [req-6ba6c49b-6061-4659-9afe-aecfc0b6f16e req-8654c0cf-3585-4bc4-b651-8813dae0a321 service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Received unexpected event network-vif-plugged-068080a2-5847-4053-a463-9fc29cb64bb4 for instance with vm_state stopped and task_state powering-on.
Nov 28 10:58:32 user nova-compute[74994]: INFO nova.compute.manager [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Rebuilding instance
Nov 28 10:58:32 user nova-compute[74994]: DEBUG nova.compute.manager [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 10:58:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:32 user nova-compute[74994]: DEBUG nova.compute.manager [req-6bdb8b8c-d87f-4440-96d3-ac6841d32df3 req-74133ad2-f6df-4779-a375-f93b56e7b7ac service nova] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Received event network-vif-unplugged-32f4f44f-44b7-47f0-9c06-bd33d3a48216 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:58:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6bdb8b8c-d87f-4440-96d3-ac6841d32df3 req-74133ad2-f6df-4779-a375-f93b56e7b7ac service nova] Acquiring lock "c608eb72-4375-4e2a-aae8-a03d086b72e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:58:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6bdb8b8c-d87f-4440-96d3-ac6841d32df3 req-74133ad2-f6df-4779-a375-f93b56e7b7ac service nova] Lock "c608eb72-4375-4e2a-aae8-a03d086b72e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:58:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6bdb8b8c-d87f-4440-96d3-ac6841d32df3 req-74133ad2-f6df-4779-a375-f93b56e7b7ac service nova] Lock "c608eb72-4375-4e2a-aae8-a03d086b72e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:58:32 user nova-compute[74994]: DEBUG nova.compute.manager [req-6bdb8b8c-d87f-4440-96d3-ac6841d32df3 req-74133ad2-f6df-4779-a375-f93b56e7b7ac service nova] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] No waiting events found dispatching network-vif-unplugged-32f4f44f-44b7-47f0-9c06-bd33d3a48216 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:58:32 user nova-compute[74994]: WARNING nova.compute.manager [req-6bdb8b8c-d87f-4440-96d3-ac6841d32df3 req-74133ad2-f6df-4779-a375-f93b56e7b7ac service nova] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Received unexpected event network-vif-unplugged-32f4f44f-44b7-47f0-9c06-bd33d3a48216 for instance with vm_state active and task_state rebuilding.
Nov 28 10:58:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:33 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Instance destroyed successfully.
Nov 28 10:58:33 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Instance destroyed successfully.
Nov 28 10:58:33 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:56:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2008816957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1331166102',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsPFcHXuCq3kbGJDtMMmhIV4dbLKEKBvccID7JXVRtX2m0hXUtB+UaF2Z44+Aof8FA3hDVjNSG6/8w3Oy5AFwAhAf7X79exeFfPY7JAvpS4tXuC4Ysn2gqz/3KAQRfb2w==',key_name='tempest-keypair-1144255784',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:56:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f56f0f99bee04f7baace9d7aa22cffa8',ramdisk_id='',reservation_id='r-f0it11pn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1394089599',owner_user_name='tempest-ServerActionsV293TestJSON-1394089599-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:58:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='564e6983bd92417a81d0ec2b5e6253b3',uuid=c608eb72-4375-4e2a-aae8-a03d086b72e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32f4f44f-44b7-47f0-9c06-bd33d3a48216", "address": "fa:16:3e:12:e4:7a", "network": {"id": "d339a2cb-dddd-4921-9ac8-bde483746df2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1820767196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56f0f99bee04f7baace9d7aa22cffa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32f4f44f-44", "ovs_interfaceid": "32f4f44f-44b7-47f0-9c06-bd33d3a48216", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Converting VIF {"id": "32f4f44f-44b7-47f0-9c06-bd33d3a48216", "address": "fa:16:3e:12:e4:7a", "network": {"id": "d339a2cb-dddd-4921-9ac8-bde483746df2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1820767196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56f0f99bee04f7baace9d7aa22cffa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32f4f44f-44", "ovs_interfaceid": "32f4f44f-44b7-47f0-9c06-bd33d3a48216", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:e4:7a,bridge_name='br-int',has_traffic_filtering=True,id=32f4f44f-44b7-47f0-9c06-bd33d3a48216,network=Network(d339a2cb-dddd-4921-9ac8-bde483746df2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32f4f44f-44') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG os_vif [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:e4:7a,bridge_name='br-int',has_traffic_filtering=True,id=32f4f44f-44b7-47f0-9c06-bd33d3a48216,network=Network(d339a2cb-dddd-4921-9ac8-bde483746df2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32f4f44f-44') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap32f4f44f-44, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=94dd4220-ddb7-4940-8e5d-ffb05ff879cb) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:58:33 user nova-compute[74994]: INFO os_vif [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:e4:7a,bridge_name='br-int',has_traffic_filtering=True,id=32f4f44f-44b7-47f0-9c06-bd33d3a48216,network=Network(d339a2cb-dddd-4921-9ac8-bde483746df2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32f4f44f-44')
Nov 28 10:58:33 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FuvdZRiP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:58:33 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 10:58:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[395d497d-01d7-4e07-bdbf-26fb4218e9c2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 10:58:33 user nova-compute[74994]: No targets found.
Nov 28 10:58:33 user nova-compute[74994]: iSNS:
Nov 28 10:58:33 user nova-compute[74994]: No targets found.
Nov 28 10:58:33 user nova-compute[74994]: STATIC:
Nov 28 10:58:33 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb
Nov 28 10:58:33 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:58:33 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:58:33 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8
Nov 28 10:58:33 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:58:33 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:58:33 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de
Nov 28 10:58:33 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:58:33 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:58:33 user nova-compute[74994]: FIRMWARE:
Nov 28 10:58:33 user nova-compute[74994]: No targets found.
Nov 28 10:58:33 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 10:58:33 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 10:58:33 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36ed886-f541-43ed-896b-e04e912614c3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d8551b-f716-46a3-b39f-1b26b70bde36]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:58:33 user nova-compute[74994]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)
Nov 28 10:58:33 user nova-compute[74994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 10:58:33 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:58:33 user nova-compute[74994]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)
Nov 28 10:58:33 user nova-compute[74994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 10:58:33 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9206cc430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8'): ({'sdc'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Removing single pathed devices sdc {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee46ed5b-86a1-4074-8757-4dacef9f2b81]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[feaab3b1-e1e0-4a82-ad73-3ddfb3a7fb51]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Flushing IO for device /dev/sdc {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.031s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c4c620-a21d-458a-92e0-9787b3b04019]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f652bb3a-7c3a-4761-8aaf-5d95688f4beb]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] SCSI volumes sdc have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a971778a-43a3-489a-b4eb-367617463ba9]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa40916-3bff-481b-88a7-58f787ff271f]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8, portal: 172.16.0.220,3260]
Nov 28 10:58:33 user nova-compute[74994]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8, portal: 172.16.0.220,3260] successful.
Nov 28 10:58:33 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bb5631-8bc1-499c-a29c-f24d55e22949]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] <== disconnect_volume: return (364ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 10:58:33 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Deleting instance files /opt/stack/data/nova/instances/c608eb72-4375-4e2a-aae8-a03d086b72e8_del
Nov 28 10:58:33 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Deletion of /opt/stack/data/nova/instances/c608eb72-4375-4e2a-aae8-a03d086b72e8_del complete
Nov 28 10:58:33 user nova-compute[74994]: DEBUG nova.compute.manager [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 10:58:33 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Instance rebooted successfully.
Nov 28 10:58:33 user nova-compute[74994]: DEBUG nova.compute.manager [None req-ceda9fa8-4ea4-46d4-85b2-9a85d13cb60f tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 10:58:33 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance c608eb72-4375-4e2a-aae8-a03d086b72e8 could not be found.
Nov 28 10:58:33 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FuvdZRiP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:58:33 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 10:58:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2794cf9a-bb1a-4601-b5eb-fcbdea06b49b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 10:58:33 user nova-compute[74994]: No targets found.
Nov 28 10:58:33 user nova-compute[74994]: iSNS:
Nov 28 10:58:33 user nova-compute[74994]: No targets found.
Nov 28 10:58:33 user nova-compute[74994]: STATIC:
Nov 28 10:58:33 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb
Nov 28 10:58:33 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:58:33 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:58:33 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de
Nov 28 10:58:33 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:58:33 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:58:33 user nova-compute[74994]: FIRMWARE:
Nov 28 10:58:33 user nova-compute[74994]: No targets found.
Nov 28 10:58:33 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 10:58:33 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 10:58:33 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8d9384-dc18-4a06-9649-953396247596]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[79349aec-8179-42de-a4f8-0ac70b7f4b6f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:58:33 user nova-compute[74994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 10:58:33 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:58:33 user nova-compute[74994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 10:58:33 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb94452c8b0>, {}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Disconnecting from: [] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.073s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] <== disconnect_volume: return (74ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:58:33 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 10:58:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:34 user nova-compute[74994]: DEBUG nova.compute.manager [req-4120b0f1-3356-465e-9c6c-adbcb236827e req-a6e43f4f-eb10-429b-af70-181b289178e6 service nova] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Received event network-vif-plugged-32f4f44f-44b7-47f0-9c06-bd33d3a48216 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:58:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4120b0f1-3356-465e-9c6c-adbcb236827e req-a6e43f4f-eb10-429b-af70-181b289178e6 service nova] Acquiring lock "c608eb72-4375-4e2a-aae8-a03d086b72e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:58:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4120b0f1-3356-465e-9c6c-adbcb236827e req-a6e43f4f-eb10-429b-af70-181b289178e6 service nova] Lock "c608eb72-4375-4e2a-aae8-a03d086b72e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:58:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4120b0f1-3356-465e-9c6c-adbcb236827e req-a6e43f4f-eb10-429b-af70-181b289178e6 service nova] Lock "c608eb72-4375-4e2a-aae8-a03d086b72e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:58:34 user nova-compute[74994]: DEBUG nova.compute.manager [req-4120b0f1-3356-465e-9c6c-adbcb236827e req-a6e43f4f-eb10-429b-af70-181b289178e6 service nova] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] No waiting events found dispatching network-vif-plugged-32f4f44f-44b7-47f0-9c06-bd33d3a48216 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:58:34 user nova-compute[74994]: WARNING nova.compute.manager [req-4120b0f1-3356-465e-9c6c-adbcb236827e req-a6e43f4f-eb10-429b-af70-181b289178e6 service nova] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Received unexpected event network-vif-plugged-32f4f44f-44b7-47f0-9c06-bd33d3a48216 for instance with vm_state active and task_state rebuilding.
Nov 28 10:58:34 user nova-compute[74994]: DEBUG nova.compute.manager [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Preparing to wait for external event volume-reimaged-86619b11-b935-4f21-a4e1-f6d121626ef8 {{(pid=74994) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 28 10:58:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Acquiring lock "c608eb72-4375-4e2a-aae8-a03d086b72e8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:58:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Lock "c608eb72-4375-4e2a-aae8-a03d086b72e8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:58:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Lock "c608eb72-4375-4e2a-aae8-a03d086b72e8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:58:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:44 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-70651508-7efe-44cc-8e77-97390a4b8eb7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "8bce88d5-64b3-450b-b7e0-26a1c5d299c6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:58:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-70651508-7efe-44cc-8e77-97390a4b8eb7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "8bce88d5-64b3-450b-b7e0-26a1c5d299c6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:58:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-70651508-7efe-44cc-8e77-97390a4b8eb7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "8bce88d5-64b3-450b-b7e0-26a1c5d299c6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:58:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-70651508-7efe-44cc-8e77-97390a4b8eb7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "8bce88d5-64b3-450b-b7e0-26a1c5d299c6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:58:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-70651508-7efe-44cc-8e77-97390a4b8eb7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "8bce88d5-64b3-450b-b7e0-26a1c5d299c6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:58:49 user nova-compute[74994]: INFO nova.compute.manager [None req-70651508-7efe-44cc-8e77-97390a4b8eb7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Terminating instance
Nov 28 10:58:49 user nova-compute[74994]: DEBUG nova.compute.manager [None req-70651508-7efe-44cc-8e77-97390a4b8eb7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 10:58:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:49 user nova-compute[74994]: DEBUG nova.compute.manager [req-cc7ddd83-304a-4dd7-a5a2-a54d794a9e9f req-7ed50c9b-5a90-4ce8-8384-7aa19a965cc0 service nova] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Received event network-vif-unplugged-6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:58:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-cc7ddd83-304a-4dd7-a5a2-a54d794a9e9f req-7ed50c9b-5a90-4ce8-8384-7aa19a965cc0 service nova] Acquiring lock "8bce88d5-64b3-450b-b7e0-26a1c5d299c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:58:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-cc7ddd83-304a-4dd7-a5a2-a54d794a9e9f req-7ed50c9b-5a90-4ce8-8384-7aa19a965cc0 service nova] Lock "8bce88d5-64b3-450b-b7e0-26a1c5d299c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:58:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-cc7ddd83-304a-4dd7-a5a2-a54d794a9e9f req-7ed50c9b-5a90-4ce8-8384-7aa19a965cc0 service nova] Lock "8bce88d5-64b3-450b-b7e0-26a1c5d299c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:58:49 user nova-compute[74994]: DEBUG nova.compute.manager [req-cc7ddd83-304a-4dd7-a5a2-a54d794a9e9f req-7ed50c9b-5a90-4ce8-8384-7aa19a965cc0 service nova] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] No waiting events found dispatching network-vif-unplugged-6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:58:49 user nova-compute[74994]: DEBUG nova.compute.manager [req-cc7ddd83-304a-4dd7-a5a2-a54d794a9e9f req-7ed50c9b-5a90-4ce8-8384-7aa19a965cc0 service nova] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Received event network-vif-unplugged-6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 10:58:50 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Instance destroyed successfully.
Nov 28 10:58:50 user nova-compute[74994]: DEBUG nova.objects.instance [None req-70651508-7efe-44cc-8e77-97390a4b8eb7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lazy-loading 'resources' on Instance uuid 8bce88d5-64b3-450b-b7e0-26a1c5d299c6 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:58:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-70651508-7efe-44cc-8e77-97390a4b8eb7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:55:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-715704735',display_name='tempest-AttachVolumeNegativeTest-server-715704735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-715704735',id=22,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIqUYdv2qX864mCPJ62mRiaUG7GDM8sZKHfXSu+vrSnal0ef3yMg4dhy3vADiPcUNp5z1zQcHoyl9neZkyygAieKrM6/IqE0q5QluSzjkDcv2GyzIt97If/c7559KWk6MA==',key_name='tempest-keypair-159042515',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:55:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='636fa9a1f046425e9332cc3807f8fb46',ramdisk_id='',reservation_id='r-9e3z5f7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-3431122',owner_user_name='tempest-AttachVolumeNegativeTest-3431122-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T10:55:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa362c35530641a687a33182012c2332',uuid=8bce88d5-64b3-450b-b7e0-26a1c5d299c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a", "address": "fa:16:3e:17:ec:a3", "network": {"id": "d9bcdec6-69e0-4e65-8a26-1af1f8232365", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1227861580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "636fa9a1f046425e9332cc3807f8fb46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bb0f5b6-4a", "ovs_interfaceid": "6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 10:58:50 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-70651508-7efe-44cc-8e77-97390a4b8eb7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Converting VIF {"id": "6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a", "address": "fa:16:3e:17:ec:a3", "network": {"id": "d9bcdec6-69e0-4e65-8a26-1af1f8232365", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1227861580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "636fa9a1f046425e9332cc3807f8fb46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bb0f5b6-4a", "ovs_interfaceid": "6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:58:50 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-70651508-7efe-44cc-8e77-97390a4b8eb7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:ec:a3,bridge_name='br-int',has_traffic_filtering=True,id=6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a,network=Network(d9bcdec6-69e0-4e65-8a26-1af1f8232365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bb0f5b6-4a') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:58:50 user nova-compute[74994]: DEBUG os_vif [None req-70651508-7efe-44cc-8e77-97390a4b8eb7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:ec:a3,bridge_name='br-int',has_traffic_filtering=True,id=6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a,network=Network(d9bcdec6-69e0-4e65-8a26-1af1f8232365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bb0f5b6-4a') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 10:58:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6bb0f5b6-4a, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:58:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:58:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=572c7f18-4643-459a-ba3a-e95ce71b80bb) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:58:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:50 user nova-compute[74994]: INFO os_vif [None req-70651508-7efe-44cc-8e77-97390a4b8eb7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:ec:a3,bridge_name='br-int',has_traffic_filtering=True,id=6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a,network=Network(d9bcdec6-69e0-4e65-8a26-1af1f8232365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bb0f5b6-4a')
Nov 28 10:58:50 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-70651508-7efe-44cc-8e77-97390a4b8eb7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Deleting instance files /opt/stack/data/nova/instances/8bce88d5-64b3-450b-b7e0-26a1c5d299c6_del
Nov 28 10:58:50 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-70651508-7efe-44cc-8e77-97390a4b8eb7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Deletion of /opt/stack/data/nova/instances/8bce88d5-64b3-450b-b7e0-26a1c5d299c6_del complete
Nov 28 10:58:50 user nova-compute[74994]: INFO nova.compute.manager [None req-70651508-7efe-44cc-8e77-97390a4b8eb7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 28 10:58:50 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-70651508-7efe-44cc-8e77-97390a4b8eb7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 10:58:50 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 10:58:50 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 10:58:51 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:58:51 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Took 0.87 seconds to deallocate network for instance.
Nov 28 10:58:51 user nova-compute[74994]: DEBUG nova.compute.manager [req-6ccacdcd-7bea-4fcc-a1b8-d7eac426e751 req-c5ab70ba-8066-49f4-9981-ae52a9ae21aa service nova] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Received event network-vif-deleted-6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:58:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-70651508-7efe-44cc-8e77-97390a4b8eb7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:58:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-70651508-7efe-44cc-8e77-97390a4b8eb7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:58:51 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-70651508-7efe-44cc-8e77-97390a4b8eb7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:58:51 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-70651508-7efe-44cc-8e77-97390a4b8eb7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:58:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-70651508-7efe-44cc-8e77-97390a4b8eb7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.398s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:58:51 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-70651508-7efe-44cc-8e77-97390a4b8eb7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Deleted allocations for instance 8bce88d5-64b3-450b-b7e0-26a1c5d299c6
Nov 28 10:58:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-70651508-7efe-44cc-8e77-97390a4b8eb7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "8bce88d5-64b3-450b-b7e0-26a1c5d299c6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.464s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:58:51 user nova-compute[74994]: DEBUG nova.compute.manager [req-57eff553-bb87-4758-97f3-aeff8c2657df req-2ef3bd3a-3314-4aa9-8b4a-1faf7b625a47 service nova] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Received event volume-reimaged-86619b11-b935-4f21-a4e1-f6d121626ef8 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:58:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-57eff553-bb87-4758-97f3-aeff8c2657df req-2ef3bd3a-3314-4aa9-8b4a-1faf7b625a47 service nova] Acquiring lock "c608eb72-4375-4e2a-aae8-a03d086b72e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:58:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-57eff553-bb87-4758-97f3-aeff8c2657df req-2ef3bd3a-3314-4aa9-8b4a-1faf7b625a47 service nova] Lock "c608eb72-4375-4e2a-aae8-a03d086b72e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:58:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-57eff553-bb87-4758-97f3-aeff8c2657df req-2ef3bd3a-3314-4aa9-8b4a-1faf7b625a47 service nova] Lock "c608eb72-4375-4e2a-aae8-a03d086b72e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:58:51 user nova-compute[74994]: DEBUG nova.compute.manager [req-57eff553-bb87-4758-97f3-aeff8c2657df req-2ef3bd3a-3314-4aa9-8b4a-1faf7b625a47 service nova] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Processing event volume-reimaged-86619b11-b935-4f21-a4e1-f6d121626ef8 {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 28 10:58:51 user nova-compute[74994]: DEBUG nova.compute.manager [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Instance event wait completed in 17 seconds for volume-reimaged {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 10:58:52 user nova-compute[74994]: INFO nova.virt.block_device [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Booting with volume 86619b11-b935-4f21-a4e1-f6d121626ef8 at /dev/vda
Nov 28 10:58:52 user nova-compute[74994]: DEBUG nova.compute.manager [req-a0c0331d-0716-4972-9779-483f04ae6581 req-b18f562d-7f73-4812-a980-bcfacc165d95 service nova] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Received event network-vif-plugged-6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:58:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a0c0331d-0716-4972-9779-483f04ae6581 req-b18f562d-7f73-4812-a980-bcfacc165d95 service nova] Acquiring lock "8bce88d5-64b3-450b-b7e0-26a1c5d299c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:58:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a0c0331d-0716-4972-9779-483f04ae6581 req-b18f562d-7f73-4812-a980-bcfacc165d95 service nova] Lock "8bce88d5-64b3-450b-b7e0-26a1c5d299c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:58:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a0c0331d-0716-4972-9779-483f04ae6581 req-b18f562d-7f73-4812-a980-bcfacc165d95 service nova] Lock "8bce88d5-64b3-450b-b7e0-26a1c5d299c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:58:52 user nova-compute[74994]: DEBUG nova.compute.manager [req-a0c0331d-0716-4972-9779-483f04ae6581 req-b18f562d-7f73-4812-a980-bcfacc165d95 service nova] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] No waiting events found dispatching network-vif-plugged-6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:58:52 user nova-compute[74994]: WARNING nova.compute.manager [req-a0c0331d-0716-4972-9779-483f04ae6581 req-b18f562d-7f73-4812-a980-bcfacc165d95 service nova] [instance: 8bce88d5-64b3-450b-b7e0-26a1c5d299c6] Received unexpected event network-vif-plugged-6bb0f5b6-4ab6-423d-aed6-4ce2bed6f38a for instance with vm_state deleted and task_state None.
Nov 28 10:58:52 user nova-compute[74994]: DEBUG os_brick.utils [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:58:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:52 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fcb2a0b-a87f-484d-acad-b61023fdce91]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:52 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf08ec4b-4800-481a-88bd-f71b997540a7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:52 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a03f27-f5b5-4e96-8b54-56a05c63e677]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:52 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6a7ead-3852-4b75-8766-c2b7e00dddca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:58:52 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 10:58:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:58:52 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 10:58:52 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6091f2-1250-4daa-aa10-0e9b60ab5b23]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:52 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 10:58:52 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 10:58:52 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 10:58:52 user nova-compute[74994]: DEBUG os_brick.utils [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:58:52 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Updating existing volume attachment record: 1033390c-6c00-41a2-be42-4518704b3c35 {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 10:58:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 10:58:59 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Creating image(s)
Nov 28 10:58:59 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Did not create local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Ensure instance console log exists: /opt/stack/data/nova/instances/c608eb72-4375-4e2a-aae8-a03d086b72e8/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Start _get_guest_xml network_info=[{"id": "32f4f44f-44b7-47f0-9c06-bd33d3a48216", "address": "fa:16:3e:12:e4:7a", "network": {"id": "d339a2cb-dddd-4921-9ac8-bde483746df2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1820767196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56f0f99bee04f7baace9d7aa22cffa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32f4f44f-44", "ovs_interfaceid": "32f4f44f-44b7-47f0-9c06-bd33d3a48216", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FuvdZRiP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c608eb72-4375-4e2a-aae8-a03d086b72e8', 'attached_at': '', 'detached_at': '', 'volume_id': '86619b11-b935-4f21-a4e1-f6d121626ef8', 'serial': '86619b11-b935-4f21-a4e1-f6d121626ef8'}, 'attachment_id': '1033390c-6c00-41a2-be42-4518704b3c35', 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 10:58:59 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 28 10:58:59 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 28 10:58:59 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG nova.objects.instance [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Lazy-loading 'vcpu_model' on Instance uuid c608eb72-4375-4e2a-aae8-a03d086b72e8 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FuvdZRiP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:58:59 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 10:58:59 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:58:59 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 10:58:59 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:58:59 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 10:58:59 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55fdb99-0f4a-4eb5-9001-976ecdd1d5b0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 10:58:59 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.034s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e23401a-33a0-4eb2-8f5d-a22cb93536ab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8] added
Nov 28 10:58:59 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[cddbe67d-b8a2-4763-afb6-e1d40bef1349]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbb506c-9aad-45c5-898b-7824e34736ff]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FuvdZRiP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FuvdZRiP" returned: 0 in 0.026s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de35a47-5393-44ff-bd11-e89153853abf]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FuvdZRiP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5296aa-46ce-4723-a727-f2d39056a730]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[956ea219-310e-4674-81dc-7823dd483176]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:58:59 user nova-compute[74994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 10:58:59 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:58:59 user nova-compute[74994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 10:58:59 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d18be8-7c5c-4328-a7e7-b4cc1441f175]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8, portal: 172.16.0.220,3260]
Nov 28 10:58:59 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8, portal: 172.16.0.220,3260] successful.
Nov 28 10:58:59 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b330a126-9241-4153-9cbb-2f116112035a]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[189a3282-d254-46f9-8611-89ea2aaf6867]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:58:59 user nova-compute[74994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 10:58:59 user nova-compute[74994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)
Nov 28 10:58:59 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:58:59 user nova-compute[74994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 10:58:59 user nova-compute[74994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)
Nov 28 10:58:59 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b7fd79-fe39-47c7-96cd-0ba86019718c]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 10:58:59 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FuvdZRiP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 10:59:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:00 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:59:00 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23539656133363639', 'path': '/dev/sdc'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:59:00 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539656133363639', 'path': '/dev/sdc'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 10:59:00 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T10:56:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2008816957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1331166102',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsPFcHXuCq3kbGJDtMMmhIV4dbLKEKBvccID7JXVRtX2m0hXUtB+UaF2Z44+Aof8FA3hDVjNSG6/8w3Oy5AFwAhAf7X79exeFfPY7JAvpS4tXuC4Ysn2gqz/3KAQRfb2w==',key_name='tempest-keypair-1144255784',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:56:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f56f0f99bee04f7baace9d7aa22cffa8',ramdisk_id='',reservation_id='r-f0it11pn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1394089599',owner_user_name='tempest-ServerActionsV293TestJSON-1394089599-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:58:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='564e6983bd92417a81d0ec2b5e6253b3',uuid=c608eb72-4375-4e2a-aae8-a03d086b72e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32f4f44f-44b7-47f0-9c06-bd33d3a48216", "address": "fa:16:3e:12:e4:7a", "network": {"id": "d339a2cb-dddd-4921-9ac8-bde483746df2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1820767196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56f0f99bee04f7baace9d7aa22cffa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32f4f44f-44", "ovs_interfaceid": "32f4f44f-44b7-47f0-9c06-bd33d3a48216", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:59:01 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Converting VIF {"id": "32f4f44f-44b7-47f0-9c06-bd33d3a48216", "address": "fa:16:3e:12:e4:7a", "network": {"id": "d339a2cb-dddd-4921-9ac8-bde483746df2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1820767196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56f0f99bee04f7baace9d7aa22cffa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32f4f44f-44", "ovs_interfaceid": "32f4f44f-44b7-47f0-9c06-bd33d3a48216", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:59:01 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:e4:7a,bridge_name='br-int',has_traffic_filtering=True,id=32f4f44f-44b7-47f0-9c06-bd33d3a48216,network=Network(d339a2cb-dddd-4921-9ac8-bde483746df2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32f4f44f-44') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:59:01 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] End _get_guest_xml xml=<domain type="kvm">
Nov 28 10:59:01 user nova-compute[74994]:   <uuid>c608eb72-4375-4e2a-aae8-a03d086b72e8</uuid>
Nov 28 10:59:01 user nova-compute[74994]:   <name>instance-00000017</name>
Nov 28 10:59:01 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 10:59:01 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 10:59:01 user nova-compute[74994]:   <metadata>
Nov 28 10:59:01 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 10:59:01 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 10:59:01 user nova-compute[74994]:       <nova:name>tempest-ServerActionsV293TestJSON-server-2008816957</nova:name>
Nov 28 10:59:01 user nova-compute[74994]:       <nova:creationTime>2023-11-28 10:58:59</nova:creationTime>
Nov 28 10:59:01 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 10:59:01 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 10:59:01 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 10:59:01 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 10:59:01 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 10:59:01 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 10:59:01 user nova-compute[74994]:       </nova:flavor>
Nov 28 10:59:01 user nova-compute[74994]:       <nova:owner>
Nov 28 10:59:01 user nova-compute[74994]:         <nova:user uuid="564e6983bd92417a81d0ec2b5e6253b3">tempest-ServerActionsV293TestJSON-1394089599-project-member</nova:user>
Nov 28 10:59:01 user nova-compute[74994]:         <nova:project uuid="f56f0f99bee04f7baace9d7aa22cffa8">tempest-ServerActionsV293TestJSON-1394089599</nova:project>
Nov 28 10:59:01 user nova-compute[74994]:       </nova:owner>
Nov 28 10:59:01 user nova-compute[74994]:       <nova:ports>
Nov 28 10:59:01 user nova-compute[74994]:         <nova:port uuid="32f4f44f-44b7-47f0-9c06-bd33d3a48216">
Nov 28 10:59:01 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 10:59:01 user nova-compute[74994]:         </nova:port>
Nov 28 10:59:01 user nova-compute[74994]:       </nova:ports>
Nov 28 10:59:01 user nova-compute[74994]:     </nova:instance>
Nov 28 10:59:01 user nova-compute[74994]:   </metadata>
Nov 28 10:59:01 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 10:59:01 user nova-compute[74994]:     <system>
Nov 28 10:59:01 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 10:59:01 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 10:59:01 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 10:59:01 user nova-compute[74994]:       <entry name="serial">c608eb72-4375-4e2a-aae8-a03d086b72e8</entry>
Nov 28 10:59:01 user nova-compute[74994]:       <entry name="uuid">c608eb72-4375-4e2a-aae8-a03d086b72e8</entry>
Nov 28 10:59:01 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 10:59:01 user nova-compute[74994]:     </system>
Nov 28 10:59:01 user nova-compute[74994]:   </sysinfo>
Nov 28 10:59:01 user nova-compute[74994]:   <os>
Nov 28 10:59:01 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 10:59:01 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 10:59:01 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 10:59:01 user nova-compute[74994]:   </os>
Nov 28 10:59:01 user nova-compute[74994]:   <features>
Nov 28 10:59:01 user nova-compute[74994]:     <acpi/>
Nov 28 10:59:01 user nova-compute[74994]:     <apic/>
Nov 28 10:59:01 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 10:59:01 user nova-compute[74994]:   </features>
Nov 28 10:59:01 user nova-compute[74994]:   <clock offset="utc">
Nov 28 10:59:01 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 10:59:01 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 10:59:01 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 10:59:01 user nova-compute[74994]:   </clock>
Nov 28 10:59:01 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 10:59:01 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 10:59:01 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 10:59:01 user nova-compute[74994]:   </cpu>
Nov 28 10:59:01 user nova-compute[74994]:   <devices>
Nov 28 10:59:01 user nova-compute[74994]:     <disk type="block" device="disk">
Nov 28 10:59:01 user nova-compute[74994]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 10:59:01 user nova-compute[74994]:       <source dev="/dev/sdc"/>
Nov 28 10:59:01 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 10:59:01 user nova-compute[74994]:       <serial>86619b11-b935-4f21-a4e1-f6d121626ef8</serial>
Nov 28 10:59:01 user nova-compute[74994]:     </disk>
Nov 28 10:59:01 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 10:59:01 user nova-compute[74994]:       <mac address="fa:16:3e:12:e4:7a"/>
Nov 28 10:59:01 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:59:01 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 10:59:01 user nova-compute[74994]:       <target dev="tap32f4f44f-44"/>
Nov 28 10:59:01 user nova-compute[74994]:     </interface>
Nov 28 10:59:01 user nova-compute[74994]:     <serial type="pty">
Nov 28 10:59:01 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/c608eb72-4375-4e2a-aae8-a03d086b72e8/console.log" append="off"/>
Nov 28 10:59:01 user nova-compute[74994]:     </serial>
Nov 28 10:59:01 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 10:59:01 user nova-compute[74994]:     <video>
Nov 28 10:59:01 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:59:01 user nova-compute[74994]:     </video>
Nov 28 10:59:01 user nova-compute[74994]:     <rng model="virtio">
Nov 28 10:59:01 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 10:59:01 user nova-compute[74994]:     </rng>
Nov 28 10:59:01 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 10:59:01 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 10:59:01 user nova-compute[74994]:       <stats period="10"/>
Nov 28 10:59:01 user nova-compute[74994]:     </memballoon>
Nov 28 10:59:01 user nova-compute[74994]:   </devices>
Nov 28 10:59:01 user nova-compute[74994]: </domain>
Nov 28 10:59:01 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 10:59:01 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T10:56:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2008816957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1331166102',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsPFcHXuCq3kbGJDtMMmhIV4dbLKEKBvccID7JXVRtX2m0hXUtB+UaF2Z44+Aof8FA3hDVjNSG6/8w3Oy5AFwAhAf7X79exeFfPY7JAvpS4tXuC4Ysn2gqz/3KAQRfb2w==',key_name='tempest-keypair-1144255784',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:56:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f56f0f99bee04f7baace9d7aa22cffa8',ramdisk_id='',reservation_id='r-f0it11pn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1394089599',owner_user_name='tempest-ServerActionsV293TestJSON-1394089599-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:58:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='564e6983bd92417a81d0ec2b5e6253b3',uuid=c608eb72-4375-4e2a-aae8-a03d086b72e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32f4f44f-44b7-47f0-9c06-bd33d3a48216", "address": "fa:16:3e:12:e4:7a", "network": {"id": "d339a2cb-dddd-4921-9ac8-bde483746df2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1820767196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56f0f99bee04f7baace9d7aa22cffa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32f4f44f-44", "ovs_interfaceid": "32f4f44f-44b7-47f0-9c06-bd33d3a48216", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 10:59:01 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Converting VIF {"id": "32f4f44f-44b7-47f0-9c06-bd33d3a48216", "address": "fa:16:3e:12:e4:7a", "network": {"id": "d339a2cb-dddd-4921-9ac8-bde483746df2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1820767196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56f0f99bee04f7baace9d7aa22cffa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32f4f44f-44", "ovs_interfaceid": "32f4f44f-44b7-47f0-9c06-bd33d3a48216", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:59:01 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:e4:7a,bridge_name='br-int',has_traffic_filtering=True,id=32f4f44f-44b7-47f0-9c06-bd33d3a48216,network=Network(d339a2cb-dddd-4921-9ac8-bde483746df2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32f4f44f-44') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:59:01 user nova-compute[74994]: DEBUG os_vif [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:e4:7a,bridge_name='br-int',has_traffic_filtering=True,id=32f4f44f-44b7-47f0-9c06-bd33d3a48216,network=Network(d339a2cb-dddd-4921-9ac8-bde483746df2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32f4f44f-44') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 10:59:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:59:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 10:59:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8ccd21f0-2521-5c31-9b72-a3ed68d18d6f', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:59:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap32f4f44f-44, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:59:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap32f4f44f-44, col_values=(('qos', UUID('ff2c6ae4-8b80-4ed0-a1aa-10360a4cd779')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:59:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap32f4f44f-44, col_values=(('external_ids', {'iface-id': '32f4f44f-44b7-47f0-9c06-bd33d3a48216', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:e4:7a', 'vm-uuid': 'c608eb72-4375-4e2a-aae8-a03d086b72e8'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:59:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:59:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:01 user nova-compute[74994]: INFO os_vif [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:e4:7a,bridge_name='br-int',has_traffic_filtering=True,id=32f4f44f-44b7-47f0-9c06-bd33d3a48216,network=Network(d339a2cb-dddd-4921-9ac8-bde483746df2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32f4f44f-44')
Nov 28 10:59:01 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:59:01 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] No VIF found with MAC fa:16:3e:12:e4:7a, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:59:02 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:02 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:02 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:02 user nova-compute[74994]: DEBUG nova.compute.manager [req-d4fa84f8-fe99-4417-9d42-9aeb388c0db1 req-f6dca1b2-49a1-4a29-bd5c-be825e58075c service nova] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Received event network-vif-plugged-32f4f44f-44b7-47f0-9c06-bd33d3a48216 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:59:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d4fa84f8-fe99-4417-9d42-9aeb388c0db1 req-f6dca1b2-49a1-4a29-bd5c-be825e58075c service nova] Acquiring lock "c608eb72-4375-4e2a-aae8-a03d086b72e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:59:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d4fa84f8-fe99-4417-9d42-9aeb388c0db1 req-f6dca1b2-49a1-4a29-bd5c-be825e58075c service nova] Lock "c608eb72-4375-4e2a-aae8-a03d086b72e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:59:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d4fa84f8-fe99-4417-9d42-9aeb388c0db1 req-f6dca1b2-49a1-4a29-bd5c-be825e58075c service nova] Lock "c608eb72-4375-4e2a-aae8-a03d086b72e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:59:02 user nova-compute[74994]: DEBUG nova.compute.manager [req-d4fa84f8-fe99-4417-9d42-9aeb388c0db1 req-f6dca1b2-49a1-4a29-bd5c-be825e58075c service nova] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] No waiting events found dispatching network-vif-plugged-32f4f44f-44b7-47f0-9c06-bd33d3a48216 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:59:02 user nova-compute[74994]: WARNING nova.compute.manager [req-d4fa84f8-fe99-4417-9d42-9aeb388c0db1 req-f6dca1b2-49a1-4a29-bd5c-be825e58075c service nova] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Received unexpected event network-vif-plugged-32f4f44f-44b7-47f0-9c06-bd33d3a48216 for instance with vm_state active and task_state rebuild_spawning.
Nov 28 10:59:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:04 user nova-compute[74994]: DEBUG nova.compute.manager [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 10:59:04 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 10:59:04 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Instance spawned successfully.
Nov 28 10:59:04 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 10:59:04 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:59:04 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:59:04 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:59:04 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:59:04 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:59:04 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:59:04 user nova-compute[74994]: DEBUG nova.compute.manager [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 10:59:04 user nova-compute[74994]: DEBUG nova.compute.manager [req-a7378369-1aab-409b-8e47-794effe0b7bd req-7e72c3c0-12f7-4a0c-bad9-ff665100915d service nova] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Received event network-vif-plugged-32f4f44f-44b7-47f0-9c06-bd33d3a48216 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:59:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a7378369-1aab-409b-8e47-794effe0b7bd req-7e72c3c0-12f7-4a0c-bad9-ff665100915d service nova] Acquiring lock "c608eb72-4375-4e2a-aae8-a03d086b72e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:59:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a7378369-1aab-409b-8e47-794effe0b7bd req-7e72c3c0-12f7-4a0c-bad9-ff665100915d service nova] Lock "c608eb72-4375-4e2a-aae8-a03d086b72e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:59:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a7378369-1aab-409b-8e47-794effe0b7bd req-7e72c3c0-12f7-4a0c-bad9-ff665100915d service nova] Lock "c608eb72-4375-4e2a-aae8-a03d086b72e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:59:04 user nova-compute[74994]: DEBUG nova.compute.manager [req-a7378369-1aab-409b-8e47-794effe0b7bd req-7e72c3c0-12f7-4a0c-bad9-ff665100915d service nova] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] No waiting events found dispatching network-vif-plugged-32f4f44f-44b7-47f0-9c06-bd33d3a48216 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:59:04 user nova-compute[74994]: WARNING nova.compute.manager [req-a7378369-1aab-409b-8e47-794effe0b7bd req-7e72c3c0-12f7-4a0c-bad9-ff665100915d service nova] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Received unexpected event network-vif-plugged-32f4f44f-44b7-47f0-9c06-bd33d3a48216 for instance with vm_state active and task_state rebuild_spawning.
Nov 28 10:59:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:59:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:59:04 user nova-compute[74994]: DEBUG nova.objects.instance [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74994) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 28 10:59:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-57eff553-bb87-4758-97f3-aeff8c2657df tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.116s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:59:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:08 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:59:08 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:59:08 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 10:59:10 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:59:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:59:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 10:59:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 10:59:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 10:59:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:12 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:59:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:59:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:59:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:59:12 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 10:59:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:12 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:14 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 10:59:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:15 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 10:59:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf241c8-e888-4e47-8213-3c83c045e4a3/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf241c8-e888-4e47-8213-3c83c045e4a3/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf241c8-e888-4e47-8213-3c83c045e4a3/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf241c8-e888-4e47-8213-3c83c045e4a3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:16 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 10:59:17 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:59:17 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:59:17 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=7559MB free_disk=25.235107421875GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 10:59:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:59:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:59:17 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:59:17 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance bf357856-2d97-42e8-928d-71d0378f48c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:59:17 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 279e1c4c-36f9-492f-ab3f-1b587347eadd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:59:17 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 759fbcfd-ab13-438f-b860-6393a97d1205 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:59:17 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 20716905-c56a-4729-8c5b-9188502dc477 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:59:17 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 2f4b631a-46c8-4f9b-b5f9-6e2542484658 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:59:17 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance c608eb72-4375-4e2a-aae8-a03d086b72e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:59:17 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 20605acb-092a-4214-a114-750f145d7af8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:59:17 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance b743c491-ece8-4781-9530-b2f38ffc1079 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:59:17 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:59:17 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 3cf241c8-e888-4e47-8213-3c83c045e4a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 10:59:17 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 10:59:17 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 10:59:17 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:59:17 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:59:17 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 10:59:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.514s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:59:19 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:59:19 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:59:19 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 10:59:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "refresh_cache-279e1c4c-36f9-492f-ab3f-1b587347eadd" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:59:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquired lock "refresh_cache-279e1c4c-36f9-492f-ab3f-1b587347eadd" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:59:20 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Forcefully refreshing network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 10:59:20 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Updating instance_info_cache with network_info: [{"id": "aeaddf62-0ca1-40d1-9228-897ee0015d4a", "address": "fa:16:3e:bc:02:82", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeaddf62-0c", "ovs_interfaceid": "aeaddf62-0ca1-40d1-9228-897ee0015d4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:59:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Releasing lock "refresh_cache-279e1c4c-36f9-492f-ab3f-1b587347eadd" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:59:20 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Updated the network info_cache for instance {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 10:59:20 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:59:20 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:59:20 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:59:21 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:22 user nova-compute[74994]: DEBUG nova.compute.manager [req-9acfe4d1-9334-4573-9062-50384e7d2a10 req-ff7f5878-b9c6-4afc-809b-abcca8a163ce service nova] [instance: 20605acb-092a-4214-a114-750f145d7af8] Received event network-changed-2b0693da-4e7d-4fb9-b7f0-adcb89d64f08 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:59:22 user nova-compute[74994]: DEBUG nova.compute.manager [req-9acfe4d1-9334-4573-9062-50384e7d2a10 req-ff7f5878-b9c6-4afc-809b-abcca8a163ce service nova] [instance: 20605acb-092a-4214-a114-750f145d7af8] Refreshing instance network info cache due to event network-changed-2b0693da-4e7d-4fb9-b7f0-adcb89d64f08. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:59:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9acfe4d1-9334-4573-9062-50384e7d2a10 req-ff7f5878-b9c6-4afc-809b-abcca8a163ce service nova] Acquiring lock "refresh_cache-20605acb-092a-4214-a114-750f145d7af8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:59:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9acfe4d1-9334-4573-9062-50384e7d2a10 req-ff7f5878-b9c6-4afc-809b-abcca8a163ce service nova] Acquired lock "refresh_cache-20605acb-092a-4214-a114-750f145d7af8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:59:22 user nova-compute[74994]: DEBUG nova.network.neutron [req-9acfe4d1-9334-4573-9062-50384e7d2a10 req-ff7f5878-b9c6-4afc-809b-abcca8a163ce service nova] [instance: 20605acb-092a-4214-a114-750f145d7af8] Refreshing network info cache for port 2b0693da-4e7d-4fb9-b7f0-adcb89d64f08 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:59:22 user nova-compute[74994]: DEBUG nova.network.neutron [req-9acfe4d1-9334-4573-9062-50384e7d2a10 req-ff7f5878-b9c6-4afc-809b-abcca8a163ce service nova] [instance: 20605acb-092a-4214-a114-750f145d7af8] Updated VIF entry in instance network info cache for port 2b0693da-4e7d-4fb9-b7f0-adcb89d64f08. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 10:59:22 user nova-compute[74994]: DEBUG nova.network.neutron [req-9acfe4d1-9334-4573-9062-50384e7d2a10 req-ff7f5878-b9c6-4afc-809b-abcca8a163ce service nova] [instance: 20605acb-092a-4214-a114-750f145d7af8] Updating instance_info_cache with network_info: [{"id": "2b0693da-4e7d-4fb9-b7f0-adcb89d64f08", "address": "fa:16:3e:af:ea:62", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b0693da-4e", "ovs_interfaceid": "2b0693da-4e7d-4fb9-b7f0-adcb89d64f08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:59:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9acfe4d1-9334-4573-9062-50384e7d2a10 req-ff7f5878-b9c6-4afc-809b-abcca8a163ce service nova] Releasing lock "refresh_cache-20605acb-092a-4214-a114-750f145d7af8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:59:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "20605acb-092a-4214-a114-750f145d7af8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:59:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "20605acb-092a-4214-a114-750f145d7af8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:59:23 user nova-compute[74994]: DEBUG nova.objects.instance [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lazy-loading 'flavor' on Instance uuid 20605acb-092a-4214-a114-750f145d7af8 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:59:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "20605acb-092a-4214-a114-750f145d7af8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:59:23 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 10:59:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "20605acb-092a-4214-a114-750f145d7af8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:59:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "20605acb-092a-4214-a114-750f145d7af8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:59:23 user nova-compute[74994]: INFO nova.compute.manager [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Attaching volume d070c683-4fcf-429a-a848-14db7a1e046b to /dev/vdb
Nov 28 10:59:23 user nova-compute[74994]: DEBUG os_brick.utils [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:59:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6da20b-abb7-4932-82fe-30f8f49659e8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a871aba5-a9cd-49b6-9ac9-57b62143aeb2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4230080f-4cf8-410b-865b-5d0a6c00f0b7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbc633d-02b8-472b-8b62-d8550d9cdcc3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:59:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 10:59:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:59:23 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 10:59:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56b3e0c-d0ca-463e-afd7-86f5e6474fc6]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 10:59:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 10:59:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 10:59:23 user nova-compute[74994]: DEBUG os_brick.utils [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:59:23 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Updating existing volume attachment record: 9773c7e8-745f-4012-97b7-e2e1f01488d8 {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 10:59:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:28 user nova-compute[74994]: DEBUG nova.compute.manager [None req-d572b607-d2e1-4202-9167-d501e827dd98 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 10:59:28 user nova-compute[74994]: INFO nova.compute.manager [None req-d572b607-d2e1-4202-9167-d501e827dd98 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] instance snapshotting
Nov 28 10:59:28 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-d572b607-d2e1-4202-9167-d501e827dd98 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Beginning live snapshot process
Nov 28 10:59:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-d572b607-d2e1-4202-9167-d501e827dd98 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/disk --force-share --output=json -f qcow2 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:28 user nova-compute[74994]: DEBUG nova.compute.manager [req-9e98a1ea-b0d3-408f-97ed-f40c244cc6aa req-d8067d96-7927-4104-af14-58d28b400fcc service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Received event network-changed-a20ff85b-6e1c-4430-ab03-696b8521b056 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:59:28 user nova-compute[74994]: DEBUG nova.compute.manager [req-9e98a1ea-b0d3-408f-97ed-f40c244cc6aa req-d8067d96-7927-4104-af14-58d28b400fcc service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Refreshing instance network info cache due to event network-changed-a20ff85b-6e1c-4430-ab03-696b8521b056. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:59:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9e98a1ea-b0d3-408f-97ed-f40c244cc6aa req-d8067d96-7927-4104-af14-58d28b400fcc service nova] Acquiring lock "refresh_cache-4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:59:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9e98a1ea-b0d3-408f-97ed-f40c244cc6aa req-d8067d96-7927-4104-af14-58d28b400fcc service nova] Acquired lock "refresh_cache-4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:59:28 user nova-compute[74994]: DEBUG nova.network.neutron [req-9e98a1ea-b0d3-408f-97ed-f40c244cc6aa req-d8067d96-7927-4104-af14-58d28b400fcc service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Refreshing network info cache for port a20ff85b-6e1c-4430-ab03-696b8521b056 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:59:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-d572b607-d2e1-4202-9167-d501e827dd98 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/disk --force-share --output=json -f qcow2" returned: 0 in 0.182s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-d572b607-d2e1-4202-9167-d501e827dd98 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/disk --force-share --output=json -f qcow2 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquiring lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:59:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:59:29 user nova-compute[74994]: DEBUG nova.objects.instance [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lazy-loading 'flavor' on Instance uuid 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:59:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-d572b607-d2e1-4202-9167-d501e827dd98 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/disk --force-share --output=json -f qcow2" returned: 0 in 0.196s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-d572b607-d2e1-4202-9167-d501e827dd98 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.130s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:59:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-d572b607-d2e1-4202-9167-d501e827dd98 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.242s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-d572b607-d2e1-4202-9167-d501e827dd98 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmplq_4smdf/eeb01dec0b484931ad2e2060e35fea42.delta 1073741824 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:29 user nova-compute[74994]: DEBUG nova.network.neutron [req-9e98a1ea-b0d3-408f-97ed-f40c244cc6aa req-d8067d96-7927-4104-af14-58d28b400fcc service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Updated VIF entry in instance network info cache for port a20ff85b-6e1c-4430-ab03-696b8521b056. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 10:59:29 user nova-compute[74994]: DEBUG nova.network.neutron [req-9e98a1ea-b0d3-408f-97ed-f40c244cc6aa req-d8067d96-7927-4104-af14-58d28b400fcc service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Updating instance_info_cache with network_info: [{"id": "a20ff85b-6e1c-4430-ab03-696b8521b056", "address": "fa:16:3e:95:4c:68", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20ff85b-6e", "ovs_interfaceid": "a20ff85b-6e1c-4430-ab03-696b8521b056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:59:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-d572b607-d2e1-4202-9167-d501e827dd98 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmplq_4smdf/eeb01dec0b484931ad2e2060e35fea42.delta 1073741824" returned: 0 in 0.087s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:29 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-d572b607-d2e1-4202-9167-d501e827dd98 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 28 10:59:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquiring lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:59:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:59:29 user nova-compute[74994]: INFO nova.compute.manager [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Attaching volume 6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 to /dev/vdb
Nov 28 10:59:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9e98a1ea-b0d3-408f-97ed-f40c244cc6aa req-d8067d96-7927-4104-af14-58d28b400fcc service nova] Releasing lock "refresh_cache-4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:59:29 user nova-compute[74994]: DEBUG os_brick.utils [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:59:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:29 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b13f33d-2dc3-4563-a371-3e6240d504d1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:29 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e99c251-68b4-4ed6-a9ee-97461a9f7769]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:29 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce497e14-52cd-4eda-a760-3422c77ddfb9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:29 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8477a8ed-d9b3-40df-884b-24a54a3894f8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:59:29 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 10:59:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:59:29 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 10:59:29 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e36a54c-c4b9-4093-ac9a-d56e7bcf0647]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:29 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 10:59:29 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 10:59:29 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 10:59:29 user nova-compute[74994]: DEBUG os_brick.utils [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:59:29 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Updating existing volume attachment record: 5530279d-341e-4ae4-a280-03364292cea4 {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 10:59:30 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-d572b607-d2e1-4202-9167-d501e827dd98 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 10:59:30 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-d572b607-d2e1-4202-9167-d501e827dd98 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] COPY block job progress, current cursor: 18087936 final cursor: 75497472 {{(pid=74994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 10:59:31 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:31 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-d572b607-d2e1-4202-9167-d501e827dd98 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 10:59:31 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-d572b607-d2e1-4202-9167-d501e827dd98 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 28 10:59:31 user nova-compute[74994]: DEBUG nova.privsep.utils [None req-d572b607-d2e1-4202-9167-d501e827dd98 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74994) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 10:59:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-d572b607-d2e1-4202-9167-d501e827dd98 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmplq_4smdf/eeb01dec0b484931ad2e2060e35fea42.delta /opt/stack/data/nova/instances/snapshots/tmplq_4smdf/eeb01dec0b484931ad2e2060e35fea42 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-d572b607-d2e1-4202-9167-d501e827dd98 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmplq_4smdf/eeb01dec0b484931ad2e2060e35fea42.delta /opt/stack/data/nova/instances/snapshots/tmplq_4smdf/eeb01dec0b484931ad2e2060e35fea42" returned: 0 in 0.497s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:32 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-d572b607-d2e1-4202-9167-d501e827dd98 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Snapshot extracted, beginning image upload
Nov 28 10:59:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:34 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-d572b607-d2e1-4202-9167-d501e827dd98 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Snapshot image upload complete
Nov 28 10:59:34 user nova-compute[74994]: INFO nova.compute.manager [None req-d572b607-d2e1-4202-9167-d501e827dd98 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Took 6.42 seconds to snapshot the instance on the hypervisor.
Nov 28 10:59:35 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HVFaUfcy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:59:35 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:59:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:59:35 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:59:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:59:35 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 10:59:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[422f1e9e-5599-4e4f-999a-61b5fa4db3f9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 10:59:35 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5b367e-fcd6-4fb8-981b-c4bb416731d8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b] added
Nov 28 10:59:35 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ce046f-7877-4e8c-a8af-6bbc8a149d79]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4d08e1-b46e-4be7-8548-1fbefccba0a2]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HVFaUfcy {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HVFaUfcy" returned: 0 in 0.029s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[587ddfad-e062-4051-ace4-42d5c4c45c97]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HVFaUfcy'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[11259c50-dde6-4a99-ab8a-dceb3da10b28]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e22fbc-afe7-4311-8793-955e0d515ed7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:59:35 user nova-compute[74994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 10:59:35 user nova-compute[74994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)
Nov 28 10:59:35 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:59:35 user nova-compute[74994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 10:59:35 user nova-compute[74994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)
Nov 28 10:59:35 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4cfde68-38e5-467d-8ec7-86ef5f44421a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b, portal: 172.16.0.220,3260]
Nov 28 10:59:35 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b, portal: 172.16.0.220,3260] successful.
Nov 28 10:59:35 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f385ea8-334e-4f7b-917e-92496380d2bd]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42fa65b-67e7-45be-ba2b-7cfd63b655c8]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:59:35 user nova-compute[74994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 10:59:35 user nova-compute[74994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)
Nov 28 10:59:35 user nova-compute[74994]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)
Nov 28 10:59:35 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:59:35 user nova-compute[74994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 10:59:35 user nova-compute[74994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)
Nov 28 10:59:35 user nova-compute[74994]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)
Nov 28 10:59:35 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] HCTL ('36', '-', '-', 0) found on session 28 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7fd06d-6e73-4b9b-9618-dcb49155cb59]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 10:59:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HVFaUfcy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 10:59:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:36 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:59:36 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23433356435396433', 'path': '/dev/sde'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:59:36 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433356435396433', 'path': '/dev/sde'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 10:59:36 user nova-compute[74994]: DEBUG nova.objects.instance [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lazy-loading 'flavor' on Instance uuid 20605acb-092a-4214-a114-750f145d7af8 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:59:36 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 10:59:36 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 10:59:36 user nova-compute[74994]:   <source dev="/dev/sde"/>
Nov 28 10:59:36 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 10:59:36 user nova-compute[74994]:   <serial>d070c683-4fcf-429a-a848-14db7a1e046b</serial>
Nov 28 10:59:36 user nova-compute[74994]: </disk>
Nov 28 10:59:36 user nova-compute[74994]:  {{(pid=74994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 10:59:37 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:59:37 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:59:37 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] No VIF found with MAC fa:16:3e:af:ea:62, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:59:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f57027ef-1b8e-465a-bb6b-1ef601f97121 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "20605acb-092a-4214-a114-750f145d7af8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.072s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YoINDARs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:59:38 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:59:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:59:38 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 10:59:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:59:38 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 10:59:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff47f451-f94a-46fa-a82a-7c218a113144]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 10:59:38 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5aabde-71c2-465a-9b35-db27a124e96c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2] added
Nov 28 10:59:38 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[664e952a-e00d-4b5e-aab5-70a7c3373e98]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf26081-cf14-42d1-814e-b2f69a4dc363]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YoINDARs {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:38 user nova-compute[74994]: INFO nova.compute.manager [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Rebuilding instance
Nov 28 10:59:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YoINDARs" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[543384df-baef-4ff1-bb0e-24e08a36281b]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YoINDARs'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66421e5-31f0-43cf-a30c-17057394678d]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f6162e-5dfe-4055-86f6-946354c8d455]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG nova.compute.manager [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:59:38 user nova-compute[74994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 10:59:38 user nova-compute[74994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)
Nov 28 10:59:38 user nova-compute[74994]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)
Nov 28 10:59:38 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:59:38 user nova-compute[74994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 10:59:38 user nova-compute[74994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)
Nov 28 10:59:38 user nova-compute[74994]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)
Nov 28 10:59:38 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7f176e-83dd-4b75-88e9-28833039360b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2, portal: 172.16.0.220,3260]
Nov 28 10:59:38 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2, portal: 172.16.0.220,3260] successful.
Nov 28 10:59:38 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[818e8207-a5da-4235-b5bc-eb774ad558a7]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3ab82d-4e8b-499b-a912-a5158d2c5808]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:59:38 user nova-compute[74994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 10:59:38 user nova-compute[74994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)
Nov 28 10:59:38 user nova-compute[74994]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)
Nov 28 10:59:38 user nova-compute[74994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)
Nov 28 10:59:38 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:59:38 user nova-compute[74994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 10:59:38 user nova-compute[74994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)
Nov 28 10:59:38 user nova-compute[74994]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)
Nov 28 10:59:38 user nova-compute[74994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)
Nov 28 10:59:38 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] HCTL ('37', '-', '-', 0) found on session 29 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9eab23-1953-4e2b-8343-ea1bd429fa2c]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Searching for a device in session 29 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YoINDARs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG nova.compute.manager [req-f4a7b99d-dc94-4d93-82b4-25e0981ca1ac req-41247843-7f32-4f21-886b-7d3e3dc3d8e1 service nova] [instance: 20605acb-092a-4214-a114-750f145d7af8] Received event network-vif-unplugged-2b0693da-4e7d-4fb9-b7f0-adcb89d64f08 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f4a7b99d-dc94-4d93-82b4-25e0981ca1ac req-41247843-7f32-4f21-886b-7d3e3dc3d8e1 service nova] Acquiring lock "20605acb-092a-4214-a114-750f145d7af8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f4a7b99d-dc94-4d93-82b4-25e0981ca1ac req-41247843-7f32-4f21-886b-7d3e3dc3d8e1 service nova] Lock "20605acb-092a-4214-a114-750f145d7af8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f4a7b99d-dc94-4d93-82b4-25e0981ca1ac req-41247843-7f32-4f21-886b-7d3e3dc3d8e1 service nova] Lock "20605acb-092a-4214-a114-750f145d7af8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:59:38 user nova-compute[74994]: DEBUG nova.compute.manager [req-f4a7b99d-dc94-4d93-82b4-25e0981ca1ac req-41247843-7f32-4f21-886b-7d3e3dc3d8e1 service nova] [instance: 20605acb-092a-4214-a114-750f145d7af8] No waiting events found dispatching network-vif-unplugged-2b0693da-4e7d-4fb9-b7f0-adcb89d64f08 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:59:38 user nova-compute[74994]: WARNING nova.compute.manager [req-f4a7b99d-dc94-4d93-82b4-25e0981ca1ac req-41247843-7f32-4f21-886b-7d3e3dc3d8e1 service nova] [instance: 20605acb-092a-4214-a114-750f145d7af8] Received unexpected event network-vif-unplugged-2b0693da-4e7d-4fb9-b7f0-adcb89d64f08 for instance with vm_state active and task_state rebuilding.
Nov 28 10:59:39 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 20605acb-092a-4214-a114-750f145d7af8] Instance destroyed successfully.
Nov 28 10:59:39 user nova-compute[74994]: INFO nova.compute.manager [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Detaching volume d070c683-4fcf-429a-a848-14db7a1e046b
Nov 28 10:59:39 user nova-compute[74994]: INFO nova.virt.block_device [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Attempting to driver detach volume d070c683-4fcf-429a-a848-14db7a1e046b from mountpoint /dev/vdb
Nov 28 10:59:39 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Attempting to detach device vdb from instance 20605acb-092a-4214-a114-750f145d7af8 from the persistent domain config. {{(pid=74994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 10:59:39 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 10:59:39 user nova-compute[74994]:   <source dev="/dev/sde"/>
Nov 28 10:59:39 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 10:59:39 user nova-compute[74994]:   <serial>d070c683-4fcf-429a-a848-14db7a1e046b</serial>
Nov 28 10:59:39 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 10:59:39 user nova-compute[74994]: </disk>
Nov 28 10:59:39 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '23531353236646337', 'path': '/dev/sdf'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531353236646337', 'path': '/dev/sdf'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 10:59:39 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Successfully detached device vdb from instance 20605acb-092a-4214-a114-750f145d7af8 from the persistent domain config.
Nov 28 10:59:39 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HVFaUfcy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:59:39 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 10:59:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG nova.objects.instance [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lazy-loading 'flavor' on Instance uuid 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5464fa-6f2d-476d-866c-020712e02815]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 10:59:39 user nova-compute[74994]: No targets found.
Nov 28 10:59:39 user nova-compute[74994]: iSNS:
Nov 28 10:59:39 user nova-compute[74994]: No targets found.
Nov 28 10:59:39 user nova-compute[74994]: STATIC:
Nov 28 10:59:39 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2
Nov 28 10:59:39 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:59:39 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:59:39 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb
Nov 28 10:59:39 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:59:39 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:59:39 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b
Nov 28 10:59:39 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:59:39 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:59:39 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8
Nov 28 10:59:39 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:59:39 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:59:39 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de
Nov 28 10:59:39 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:59:39 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:59:39 user nova-compute[74994]: FIRMWARE:
Nov 28 10:59:39 user nova-compute[74994]: No targets found.
Nov 28 10:59:39 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 10:59:39 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 10:59:39 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 10:59:39 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 10:59:39 user nova-compute[74994]:   <source dev="/dev/sdf"/>
Nov 28 10:59:39 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 10:59:39 user nova-compute[74994]:   <serial>6566a6d8-83ca-4fef-bfe5-cb67171cd3b2</serial>
Nov 28 10:59:39 user nova-compute[74994]: </disk>
Nov 28 10:59:39 user nova-compute[74994]:  {{(pid=74994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60b010c-f2fe-4570-9241-9c4bea939f4f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d2f073-61d4-4634-9455-43892470cae5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:59:39 user nova-compute[74994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 10:59:39 user nova-compute[74994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)
Nov 28 10:59:39 user nova-compute[74994]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)
Nov 28 10:59:39 user nova-compute[74994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)
Nov 28 10:59:39 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:59:39 user nova-compute[74994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 10:59:39 user nova-compute[74994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)
Nov 28 10:59:39 user nova-compute[74994]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)
Nov 28 10:59:39 user nova-compute[74994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)
Nov 28 10:59:39 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb92071be20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b'): ({'sde'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Removing single pathed devices sde {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c21d16-03c0-4d09-9735-41aaf856828b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd8c2a7-02fc-4cd2-b7a3-d113ac8083bd]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Flushing IO for device /dev/sde {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a1eaa7-d0ef-4012-9a0b-36ab89eb0271]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb37d35-7019-43ea-9410-d50e8a55d02a]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] SCSI volumes sde have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b54db7d-f057-4631-b1d4-446691054e32]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81159a7-c494-49ce-b89a-2f4003e0eca4]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b, portal: 172.16.0.220,3260]
Nov 28 10:59:39 user nova-compute[74994]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b, portal: 172.16.0.220,3260] successful.
Nov 28 10:59:39 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8255eed-afce-4e50-a443-d5542f0c4a10]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] <== disconnect_volume: return (365ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:59:39 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] No VIF found with MAC fa:16:3e:95:4c:68, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:59:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1efea712-f763-4cb5-80cb-289c63a2979d tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.484s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:59:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:40 user nova-compute[74994]: DEBUG nova.compute.manager [req-47b0ffa2-094f-43e3-97d0-c67af4e85fa8 req-ab492261-878d-4c3f-9768-b090c7a4ae2e service nova] [instance: 20605acb-092a-4214-a114-750f145d7af8] Received event network-vif-plugged-2b0693da-4e7d-4fb9-b7f0-adcb89d64f08 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:59:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-47b0ffa2-094f-43e3-97d0-c67af4e85fa8 req-ab492261-878d-4c3f-9768-b090c7a4ae2e service nova] Acquiring lock "20605acb-092a-4214-a114-750f145d7af8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:59:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-47b0ffa2-094f-43e3-97d0-c67af4e85fa8 req-ab492261-878d-4c3f-9768-b090c7a4ae2e service nova] Lock "20605acb-092a-4214-a114-750f145d7af8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:59:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-47b0ffa2-094f-43e3-97d0-c67af4e85fa8 req-ab492261-878d-4c3f-9768-b090c7a4ae2e service nova] Lock "20605acb-092a-4214-a114-750f145d7af8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:59:40 user nova-compute[74994]: DEBUG nova.compute.manager [req-47b0ffa2-094f-43e3-97d0-c67af4e85fa8 req-ab492261-878d-4c3f-9768-b090c7a4ae2e service nova] [instance: 20605acb-092a-4214-a114-750f145d7af8] No waiting events found dispatching network-vif-plugged-2b0693da-4e7d-4fb9-b7f0-adcb89d64f08 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:59:40 user nova-compute[74994]: WARNING nova.compute.manager [req-47b0ffa2-094f-43e3-97d0-c67af4e85fa8 req-ab492261-878d-4c3f-9768-b090c7a4ae2e service nova] [instance: 20605acb-092a-4214-a114-750f145d7af8] Received unexpected event network-vif-plugged-2b0693da-4e7d-4fb9-b7f0-adcb89d64f08 for instance with vm_state active and task_state rebuilding.
Nov 28 10:59:40 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 20605acb-092a-4214-a114-750f145d7af8] Instance destroyed successfully.
Nov 28 10:59:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:57:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-893238339',display_name='tempest-ServerActionsTestOtherA-server-431726265',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-893238339',id=24,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBOY+NutkPemiyHeMnQLSk9aaZJeDN6wgP5qBeYjN7xZFqVw9TdQeE9oS3N1LsgeVKLYADzySBGVghLSJNwEz9H04AB8Wq7t5ky4d6BMahksF1kPbZitdOiyTWwqobeQw==',key_name='tempest-keypair-2025261715',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:57:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5eb43a8fc7bd47728600741762f71112',ramdisk_id='',reservation_id='r-qwz39s5c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1927948343',owner_user_name='tempest-ServerActionsTestOtherA-1927948343-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:59:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d51be473c7284977a6533756a1f677f9',uuid=20605acb-092a-4214-a114-750f145d7af8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b0693da-4e7d-4fb9-b7f0-adcb89d64f08", "address": "fa:16:3e:af:ea:62", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b0693da-4e", "ovs_interfaceid": "2b0693da-4e7d-4fb9-b7f0-adcb89d64f08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 10:59:40 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Converting VIF {"id": "2b0693da-4e7d-4fb9-b7f0-adcb89d64f08", "address": "fa:16:3e:af:ea:62", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b0693da-4e", "ovs_interfaceid": "2b0693da-4e7d-4fb9-b7f0-adcb89d64f08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:59:40 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:ea:62,bridge_name='br-int',has_traffic_filtering=True,id=2b0693da-4e7d-4fb9-b7f0-adcb89d64f08,network=Network(16dd32cd-5a00-4111-92e2-283e7635540f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b0693da-4e') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:59:40 user nova-compute[74994]: DEBUG os_vif [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:ea:62,bridge_name='br-int',has_traffic_filtering=True,id=2b0693da-4e7d-4fb9-b7f0-adcb89d64f08,network=Network(16dd32cd-5a00-4111-92e2-283e7635540f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b0693da-4e') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 10:59:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b0693da-4e, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:59:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:59:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5de3e85a-cb43-4c84-969f-c8643fabf2b0) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:59:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:40 user nova-compute[74994]: INFO os_vif [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:ea:62,bridge_name='br-int',has_traffic_filtering=True,id=2b0693da-4e7d-4fb9-b7f0-adcb89d64f08,network=Network(16dd32cd-5a00-4111-92e2-283e7635540f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b0693da-4e')
Nov 28 10:59:41 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 10:59:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HVFaUfcy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:59:41 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 10:59:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:59:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:59:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e1bb6a-917e-45ed-b444-4edd54df65a1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 10:59:41 user nova-compute[74994]: No targets found.
Nov 28 10:59:41 user nova-compute[74994]: iSNS:
Nov 28 10:59:41 user nova-compute[74994]: No targets found.
Nov 28 10:59:41 user nova-compute[74994]: STATIC:
Nov 28 10:59:41 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2
Nov 28 10:59:41 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:59:41 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:59:41 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb
Nov 28 10:59:41 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:59:41 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:59:41 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8
Nov 28 10:59:41 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:59:41 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:59:41 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de
Nov 28 10:59:41 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 10:59:41 user nova-compute[74994]:                 Iface Name: default
Nov 28 10:59:41 user nova-compute[74994]: FIRMWARE:
Nov 28 10:59:41 user nova-compute[74994]: No targets found.
Nov 28 10:59:41 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:59:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 10:59:41 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 10:59:41 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 10:59:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 10:59:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[90680d66-d3f9-419b-b79c-5649d2f606c4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f092c8a-0adc-4b74-9e3d-1a064030e87c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:59:41 user nova-compute[74994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 10:59:41 user nova-compute[74994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)
Nov 28 10:59:41 user nova-compute[74994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)
Nov 28 10:59:41 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:59:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:59:41 user nova-compute[74994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 10:59:41 user nova-compute[74994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)
Nov 28 10:59:41 user nova-compute[74994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)
Nov 28 10:59:41 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:59:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9206bae60>, {}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 10:59:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Disconnecting from: [] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 10:59:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.082s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:59:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] <== disconnect_volume: return (83ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:59:41 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 10:59:41 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Deleting instance files /opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8_del
Nov 28 10:59:41 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Deletion of /opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8_del complete
Nov 28 10:59:41 user nova-compute[74994]: INFO nova.virt.block_device [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Booting with volume d070c683-4fcf-429a-a848-14db7a1e046b at /dev/vdb
Nov 28 10:59:41 user nova-compute[74994]: DEBUG os_brick.utils [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:59:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16b56cd-4da3-48aa-9990-63d9c145a832]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b043ec-83fe-49b0-a522-fc2dc0dc19d6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd86e68-2a8f-432c-8f56-7d97bba88925]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9740fc60-f5d7-4d0d-8b03-e22946bc4eb9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:59:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 10:59:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 10:59:41 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 10:59:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2544101e-952b-424b-928d-6402931e4647]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 10:59:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 10:59:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 10:59:41 user nova-compute[74994]: DEBUG os_brick.utils [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:59:41 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Updating existing volume attachment record: b5fb50b2-4194-4b51-9722-a55ce3569258 {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 10:59:41 user nova-compute[74994]: INFO nova.compute.manager [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Rescuing
Nov 28 10:59:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquiring lock "refresh_cache-4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:59:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquired lock "refresh_cache-4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:59:41 user nova-compute[74994]: DEBUG nova.network.neutron [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 10:59:42 user nova-compute[74994]: DEBUG nova.network.neutron [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Updating instance_info_cache with network_info: [{"id": "a20ff85b-6e1c-4430-ab03-696b8521b056", "address": "fa:16:3e:95:4c:68", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20ff85b-6e", "ovs_interfaceid": "a20ff85b-6e1c-4430-ab03-696b8521b056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:59:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Releasing lock "refresh_cache-4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:59:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:42 user nova-compute[74994]: DEBUG nova.compute.manager [req-5a85936a-4cf0-4cac-b053-f26f36ddd286 req-569b9837-f560-467a-9a2f-aca20bc290e9 service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Received event network-vif-unplugged-a20ff85b-6e1c-4430-ab03-696b8521b056 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:59:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-5a85936a-4cf0-4cac-b053-f26f36ddd286 req-569b9837-f560-467a-9a2f-aca20bc290e9 service nova] Acquiring lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:59:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-5a85936a-4cf0-4cac-b053-f26f36ddd286 req-569b9837-f560-467a-9a2f-aca20bc290e9 service nova] Lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:59:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-5a85936a-4cf0-4cac-b053-f26f36ddd286 req-569b9837-f560-467a-9a2f-aca20bc290e9 service nova] Lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:59:42 user nova-compute[74994]: DEBUG nova.compute.manager [req-5a85936a-4cf0-4cac-b053-f26f36ddd286 req-569b9837-f560-467a-9a2f-aca20bc290e9 service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] No waiting events found dispatching network-vif-unplugged-a20ff85b-6e1c-4430-ab03-696b8521b056 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:59:42 user nova-compute[74994]: WARNING nova.compute.manager [req-5a85936a-4cf0-4cac-b053-f26f36ddd286 req-569b9837-f560-467a-9a2f-aca20bc290e9 service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Received unexpected event network-vif-unplugged-a20ff85b-6e1c-4430-ab03-696b8521b056 for instance with vm_state active and task_state rescuing.
Nov 28 10:59:42 user nova-compute[74994]: DEBUG nova.compute.manager [req-5a85936a-4cf0-4cac-b053-f26f36ddd286 req-569b9837-f560-467a-9a2f-aca20bc290e9 service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Received event network-vif-plugged-a20ff85b-6e1c-4430-ab03-696b8521b056 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:59:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-5a85936a-4cf0-4cac-b053-f26f36ddd286 req-569b9837-f560-467a-9a2f-aca20bc290e9 service nova] Acquiring lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:59:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-5a85936a-4cf0-4cac-b053-f26f36ddd286 req-569b9837-f560-467a-9a2f-aca20bc290e9 service nova] Lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:59:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-5a85936a-4cf0-4cac-b053-f26f36ddd286 req-569b9837-f560-467a-9a2f-aca20bc290e9 service nova] Lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:59:42 user nova-compute[74994]: DEBUG nova.compute.manager [req-5a85936a-4cf0-4cac-b053-f26f36ddd286 req-569b9837-f560-467a-9a2f-aca20bc290e9 service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] No waiting events found dispatching network-vif-plugged-a20ff85b-6e1c-4430-ab03-696b8521b056 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:59:42 user nova-compute[74994]: WARNING nova.compute.manager [req-5a85936a-4cf0-4cac-b053-f26f36ddd286 req-569b9837-f560-467a-9a2f-aca20bc290e9 service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Received unexpected event network-vif-plugged-a20ff85b-6e1c-4430-ab03-696b8521b056 for instance with vm_state active and task_state rescuing.
Nov 28 10:59:43 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Instance destroyed successfully.
Nov 28 10:59:43 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Attempting rescue
Nov 28 10:59:43 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74994) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 10:59:43 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Instance directory exists: not creating {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 10:59:43 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Creating image(s)
Nov 28 10:59:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquiring lock "/opt/stack/data/nova/instances/4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:59:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "/opt/stack/data/nova/instances/4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:59:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "/opt/stack/data/nova/instances/4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:59:43 user nova-compute[74994]: DEBUG nova.objects.instance [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:59:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquiring lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:59:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:59:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.176s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123/disk.rescue {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123/disk.rescue" returned: 0 in 0.054s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:59:43 user nova-compute[74994]: DEBUG nova.objects.instance [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lazy-loading 'migration_context' on Instance uuid 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:59:43 user nova-compute[74994]: DEBUG nova.objects.base [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Object Instance<4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 10:59:43 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Created local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 10:59:43 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Start _get_guest_xml network_info=[{"id": "a20ff85b-6e1c-4430-ab03-696b8521b056", "address": "fa:16:3e:95:4c:68", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "vif_mac": "fa:16:3e:95:4c:68"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20ff85b-6e", "ovs_interfaceid": "a20ff85b-6e1c-4430-ab03-696b8521b056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'aa939d1b-b8a6-4391-935b-0191bf5ccd0a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 10:59:43 user nova-compute[74994]: DEBUG nova.objects.instance [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lazy-loading 'resources' on Instance uuid 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:59:43 user nova-compute[74994]: DEBUG nova.objects.base [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Object Instance<4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 10:59:43 user nova-compute[74994]: DEBUG nova.objects.instance [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lazy-loading 'numa_topology' on Instance uuid 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:59:43 user nova-compute[74994]: DEBUG nova.objects.base [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Object Instance<4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 10:59:43 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:59:43 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:59:43 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 10:59:43 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 10:59:43 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 10:59:43 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 10:59:43 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 10:59:43 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 10:59:43 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 10:59:43 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 10:59:43 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 10:59:43 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 10:59:43 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 10:59:43 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 10:59:43 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 10:59:43 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 10:59:43 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 10:59:43 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 10:59:43 user nova-compute[74994]: DEBUG nova.objects.instance [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:59:43 user nova-compute[74994]: DEBUG nova.objects.base [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Object Instance<4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 10:59:43 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:57:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-892718169',display_name='tempest-ServerRescueNegativeTestJSON-server-892718169',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-892718169',id=26,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKf5ESvipQJb0Iy+fLJcCq3i72ZQzalzqaJRpG18kEB0C4ECw8ZCyHCDlbhVhf/3wT65emm8riA8xYo1pzKgniQzaQjG+2hH2XTChDTrJLemP/56rwknIxLY1WAxl8EywQ==',key_name='tempest-keypair-487100257',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:57:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77126f6f39db4a628b74551ea7d0aa21',ramdisk_id='',reservation_id='r-b20q91a0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1900175697',owner_user_name='tempest-ServerRescueNegativeTestJSON-1900175697-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:57:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b5c1a1f2efc4a2faf8b82d467681d45',uuid=4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a20ff85b-6e1c-4430-ab03-696b8521b056", "address": "fa:16:3e:95:4c:68", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "vif_mac": "fa:16:3e:95:4c:68"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20ff85b-6e", "ovs_interfaceid": "a20ff85b-6e1c-4430-ab03-696b8521b056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:59:43 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Converting VIF {"id": "a20ff85b-6e1c-4430-ab03-696b8521b056", "address": "fa:16:3e:95:4c:68", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "vif_mac": "fa:16:3e:95:4c:68"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20ff85b-6e", "ovs_interfaceid": "a20ff85b-6e1c-4430-ab03-696b8521b056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:59:43 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:4c:68,bridge_name='br-int',has_traffic_filtering=True,id=a20ff85b-6e1c-4430-ab03-696b8521b056,network=Network(77bc68aa-1654-4e4d-9c65-7515fe6f4b2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa20ff85b-6e') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:59:43 user nova-compute[74994]: DEBUG nova.objects.instance [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lazy-loading 'pci_devices' on Instance uuid 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:59:43 user nova-compute[74994]: DEBUG nova.objects.base [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Object Instance<4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 10:59:43 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] End _get_guest_xml xml=<domain type="kvm">
Nov 28 10:59:43 user nova-compute[74994]:   <uuid>4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123</uuid>
Nov 28 10:59:43 user nova-compute[74994]:   <name>instance-0000001a</name>
Nov 28 10:59:43 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 10:59:43 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 10:59:43 user nova-compute[74994]:   <metadata>
Nov 28 10:59:43 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 10:59:43 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 10:59:43 user nova-compute[74994]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-892718169</nova:name>
Nov 28 10:59:43 user nova-compute[74994]:       <nova:creationTime>2023-11-28 10:59:43</nova:creationTime>
Nov 28 10:59:43 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 10:59:43 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 10:59:43 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 10:59:43 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 10:59:43 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 10:59:43 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 10:59:43 user nova-compute[74994]:       </nova:flavor>
Nov 28 10:59:43 user nova-compute[74994]:       <nova:owner>
Nov 28 10:59:43 user nova-compute[74994]:         <nova:user uuid="6b5c1a1f2efc4a2faf8b82d467681d45">tempest-ServerRescueNegativeTestJSON-1900175697-project-member</nova:user>
Nov 28 10:59:43 user nova-compute[74994]:         <nova:project uuid="77126f6f39db4a628b74551ea7d0aa21">tempest-ServerRescueNegativeTestJSON-1900175697</nova:project>
Nov 28 10:59:43 user nova-compute[74994]:       </nova:owner>
Nov 28 10:59:43 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 10:59:43 user nova-compute[74994]:       <nova:ports>
Nov 28 10:59:43 user nova-compute[74994]:         <nova:port uuid="a20ff85b-6e1c-4430-ab03-696b8521b056">
Nov 28 10:59:43 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 28 10:59:43 user nova-compute[74994]:         </nova:port>
Nov 28 10:59:43 user nova-compute[74994]:       </nova:ports>
Nov 28 10:59:43 user nova-compute[74994]:     </nova:instance>
Nov 28 10:59:43 user nova-compute[74994]:   </metadata>
Nov 28 10:59:43 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 10:59:43 user nova-compute[74994]:     <system>
Nov 28 10:59:43 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 10:59:43 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 10:59:43 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 10:59:43 user nova-compute[74994]:       <entry name="serial">4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123</entry>
Nov 28 10:59:43 user nova-compute[74994]:       <entry name="uuid">4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123</entry>
Nov 28 10:59:43 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 10:59:43 user nova-compute[74994]:     </system>
Nov 28 10:59:43 user nova-compute[74994]:   </sysinfo>
Nov 28 10:59:43 user nova-compute[74994]:   <os>
Nov 28 10:59:43 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 10:59:43 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 10:59:43 user nova-compute[74994]:   </os>
Nov 28 10:59:43 user nova-compute[74994]:   <features>
Nov 28 10:59:43 user nova-compute[74994]:     <acpi/>
Nov 28 10:59:43 user nova-compute[74994]:     <apic/>
Nov 28 10:59:43 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 10:59:43 user nova-compute[74994]:   </features>
Nov 28 10:59:43 user nova-compute[74994]:   <clock offset="utc">
Nov 28 10:59:43 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 10:59:43 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 10:59:43 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 10:59:43 user nova-compute[74994]:   </clock>
Nov 28 10:59:43 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 10:59:43 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 10:59:43 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 10:59:43 user nova-compute[74994]:   </cpu>
Nov 28 10:59:43 user nova-compute[74994]:   <devices>
Nov 28 10:59:43 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 10:59:43 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 10:59:43 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123/disk.rescue"/>
Nov 28 10:59:43 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 10:59:43 user nova-compute[74994]:     </disk>
Nov 28 10:59:43 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 10:59:43 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 10:59:43 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123/disk"/>
Nov 28 10:59:43 user nova-compute[74994]:       <target dev="vdb" bus="virtio"/>
Nov 28 10:59:43 user nova-compute[74994]:     </disk>
Nov 28 10:59:43 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 10:59:43 user nova-compute[74994]:       <mac address="fa:16:3e:95:4c:68"/>
Nov 28 10:59:43 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:59:43 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 10:59:43 user nova-compute[74994]:       <target dev="tapa20ff85b-6e"/>
Nov 28 10:59:43 user nova-compute[74994]:     </interface>
Nov 28 10:59:43 user nova-compute[74994]:     <serial type="pty">
Nov 28 10:59:43 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123/console.log" append="off"/>
Nov 28 10:59:43 user nova-compute[74994]:     </serial>
Nov 28 10:59:43 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 10:59:43 user nova-compute[74994]:     <video>
Nov 28 10:59:43 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:59:43 user nova-compute[74994]:     </video>
Nov 28 10:59:43 user nova-compute[74994]:     <rng model="virtio">
Nov 28 10:59:43 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 10:59:43 user nova-compute[74994]:     </rng>
Nov 28 10:59:43 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 10:59:43 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 10:59:43 user nova-compute[74994]:       <stats period="10"/>
Nov 28 10:59:43 user nova-compute[74994]:     </memballoon>
Nov 28 10:59:43 user nova-compute[74994]:   </devices>
Nov 28 10:59:43 user nova-compute[74994]: </domain>
Nov 28 10:59:43 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 10:59:43 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Instance destroyed successfully.
Nov 28 10:59:43 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:59:43 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:59:43 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] No VIF found with MAC fa:16:3e:95:4c:68, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:59:44 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "14ab0a02-7432-4630-8758-df82d6a17ef8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:59:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "14ab0a02-7432-4630-8758-df82d6a17ef8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:59:45 user nova-compute[74994]: DEBUG nova.compute.manager [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 10:59:45 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:59:45 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:59:45 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 10:59:45 user nova-compute[74994]: INFO nova.compute.claims [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Claim successful on node user
Nov 28 10:59:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:45 user nova-compute[74994]: DEBUG nova.compute.manager [req-87d7f444-08f3-44e3-a10b-0fd7ee851ec2 req-6cc72e00-c42f-47d8-8d20-ec70218af47d service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Received event network-vif-plugged-a20ff85b-6e1c-4430-ab03-696b8521b056 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:59:45 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-87d7f444-08f3-44e3-a10b-0fd7ee851ec2 req-6cc72e00-c42f-47d8-8d20-ec70218af47d service nova] Acquiring lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:59:45 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-87d7f444-08f3-44e3-a10b-0fd7ee851ec2 req-6cc72e00-c42f-47d8-8d20-ec70218af47d service nova] Lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:59:45 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-87d7f444-08f3-44e3-a10b-0fd7ee851ec2 req-6cc72e00-c42f-47d8-8d20-ec70218af47d service nova] Lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:59:45 user nova-compute[74994]: DEBUG nova.compute.manager [req-87d7f444-08f3-44e3-a10b-0fd7ee851ec2 req-6cc72e00-c42f-47d8-8d20-ec70218af47d service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] No waiting events found dispatching network-vif-plugged-a20ff85b-6e1c-4430-ab03-696b8521b056 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:59:45 user nova-compute[74994]: WARNING nova.compute.manager [req-87d7f444-08f3-44e3-a10b-0fd7ee851ec2 req-6cc72e00-c42f-47d8-8d20-ec70218af47d service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Received unexpected event network-vif-plugged-a20ff85b-6e1c-4430-ab03-696b8521b056 for instance with vm_state active and task_state rescuing.
Nov 28 10:59:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:45 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 10:59:45 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 10:59:45 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.635s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:59:45 user nova-compute[74994]: DEBUG nova.compute.manager [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 10:59:45 user nova-compute[74994]: DEBUG nova.compute.manager [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 10:59:45 user nova-compute[74994]: DEBUG nova.network.neutron [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 10:59:45 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 10:59:45 user nova-compute[74994]: DEBUG nova.compute.manager [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 10:59:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:46 user nova-compute[74994]: DEBUG nova.policy [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa362c35530641a687a33182012c2332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636fa9a1f046425e9332cc3807f8fb46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 10:59:46 user nova-compute[74994]: DEBUG nova.compute.manager [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 10:59:46 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 10:59:46 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Creating image(s)
Nov 28 10:59:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "/opt/stack/data/nova/instances/14ab0a02-7432-4630-8758-df82d6a17ef8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:59:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "/opt/stack/data/nova/instances/14ab0a02-7432-4630-8758-df82d6a17ef8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:59:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "/opt/stack/data/nova/instances/14ab0a02-7432-4630-8758-df82d6a17ef8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:59:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.216s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:59:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:59:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.193s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/14ab0a02-7432-4630-8758-df82d6a17ef8/disk 1073741824 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/14ab0a02-7432-4630-8758-df82d6a17ef8/disk 1073741824" returned: 0 in 0.067s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:59:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.188s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:46 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Checking if we can resize image /opt/stack/data/nova/instances/14ab0a02-7432-4630-8758-df82d6a17ef8/disk. size=1073741824 {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 10:59:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14ab0a02-7432-4630-8758-df82d6a17ef8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14ab0a02-7432-4630-8758-df82d6a17ef8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:46 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Cannot resize image /opt/stack/data/nova/instances/14ab0a02-7432-4630-8758-df82d6a17ef8/disk to a smaller size. {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 10:59:46 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Created local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 10:59:46 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Ensure instance console log exists: /opt/stack/data/nova/instances/14ab0a02-7432-4630-8758-df82d6a17ef8/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 10:59:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:59:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:59:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:59:47 user nova-compute[74994]: DEBUG nova.network.neutron [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Successfully created port: fd853050-2e07-4e5b-9dfc-b10bf3af51e7 {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 10:59:47 user nova-compute[74994]: DEBUG nova.compute.manager [req-5db2992b-7309-4d92-acc2-ff65c6f20c6e req-6824665c-a481-4a5b-a0e4-b37ae5033c78 service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Received event network-vif-plugged-a20ff85b-6e1c-4430-ab03-696b8521b056 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:59:47 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-5db2992b-7309-4d92-acc2-ff65c6f20c6e req-6824665c-a481-4a5b-a0e4-b37ae5033c78 service nova] Acquiring lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:59:47 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-5db2992b-7309-4d92-acc2-ff65c6f20c6e req-6824665c-a481-4a5b-a0e4-b37ae5033c78 service nova] Lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:59:47 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-5db2992b-7309-4d92-acc2-ff65c6f20c6e req-6824665c-a481-4a5b-a0e4-b37ae5033c78 service nova] Lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:59:47 user nova-compute[74994]: DEBUG nova.compute.manager [req-5db2992b-7309-4d92-acc2-ff65c6f20c6e req-6824665c-a481-4a5b-a0e4-b37ae5033c78 service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] No waiting events found dispatching network-vif-plugged-a20ff85b-6e1c-4430-ab03-696b8521b056 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:59:47 user nova-compute[74994]: WARNING nova.compute.manager [req-5db2992b-7309-4d92-acc2-ff65c6f20c6e req-6824665c-a481-4a5b-a0e4-b37ae5033c78 service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Received unexpected event network-vif-plugged-a20ff85b-6e1c-4430-ab03-696b8521b056 for instance with vm_state active and task_state rescuing.
Nov 28 10:59:47 user nova-compute[74994]: DEBUG nova.compute.manager [None req-e3af7258-de9d-44bd-88b7-c5c0ac158008 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 10:59:48 user nova-compute[74994]: DEBUG nova.network.neutron [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Successfully updated port: fd853050-2e07-4e5b-9dfc-b10bf3af51e7 {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 10:59:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "refresh_cache-14ab0a02-7432-4630-8758-df82d6a17ef8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:59:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquired lock "refresh_cache-14ab0a02-7432-4630-8758-df82d6a17ef8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:59:48 user nova-compute[74994]: DEBUG nova.network.neutron [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 10:59:48 user nova-compute[74994]: DEBUG nova.network.neutron [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 10:59:48 user nova-compute[74994]: DEBUG nova.network.neutron [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Updating instance_info_cache with network_info: [{"id": "fd853050-2e07-4e5b-9dfc-b10bf3af51e7", "address": "fa:16:3e:b2:d1:5c", "network": {"id": "d9bcdec6-69e0-4e65-8a26-1af1f8232365", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1227861580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "636fa9a1f046425e9332cc3807f8fb46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd853050-2e", "ovs_interfaceid": "fd853050-2e07-4e5b-9dfc-b10bf3af51e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:59:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Releasing lock "refresh_cache-14ab0a02-7432-4630-8758-df82d6a17ef8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:59:48 user nova-compute[74994]: DEBUG nova.compute.manager [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Instance network_info: |[{"id": "fd853050-2e07-4e5b-9dfc-b10bf3af51e7", "address": "fa:16:3e:b2:d1:5c", "network": {"id": "d9bcdec6-69e0-4e65-8a26-1af1f8232365", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1227861580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "636fa9a1f046425e9332cc3807f8fb46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd853050-2e", "ovs_interfaceid": "fd853050-2e07-4e5b-9dfc-b10bf3af51e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 10:59:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Start _get_guest_xml network_info=[{"id": "fd853050-2e07-4e5b-9dfc-b10bf3af51e7", "address": "fa:16:3e:b2:d1:5c", "network": {"id": "d9bcdec6-69e0-4e65-8a26-1af1f8232365", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1227861580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "636fa9a1f046425e9332cc3807f8fb46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd853050-2e", "ovs_interfaceid": "fd853050-2e07-4e5b-9dfc-b10bf3af51e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'aa939d1b-b8a6-4391-935b-0191bf5ccd0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 10:59:48 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:59:48 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 10:59:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 10:59:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 10:59:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 10:59:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 10:59:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 10:59:48 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 10:59:48 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 10:59:48 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 10:59:48 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 10:59:48 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 10:59:48 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 10:59:48 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 10:59:48 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 10:59:48 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 10:59:48 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 10:59:48 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 10:59:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:59:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1834467843',display_name='tempest-AttachVolumeNegativeTest-server-1834467843',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1834467843',id=28,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOci8O+B2cMqcmA6KutXpveM/McooapU0kTF2RLLqGuRlPJoZhRCMw3muU1qRbkoMbD+utKDzsNoO6WcCPJWtfjKSfnpALF0poFjiZmHHV3mM7UO8Uh+O5fQUuyb14Mmw==',key_name='tempest-keypair-600162787',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='636fa9a1f046425e9332cc3807f8fb46',ramdisk_id='',reservation_id='r-3xdmet7a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-3431122',owner_user_name='tempest-AttachVolumeNegativeTest-3431122-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:59:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa362c35530641a687a33182012c2332',uuid=14ab0a02-7432-4630-8758-df82d6a17ef8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd853050-2e07-4e5b-9dfc-b10bf3af51e7", "address": "fa:16:3e:b2:d1:5c", "network": {"id": "d9bcdec6-69e0-4e65-8a26-1af1f8232365", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1227861580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "636fa9a1f046425e9332cc3807f8fb46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd853050-2e", "ovs_interfaceid": "fd853050-2e07-4e5b-9dfc-b10bf3af51e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:59:48 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Converting VIF {"id": "fd853050-2e07-4e5b-9dfc-b10bf3af51e7", "address": "fa:16:3e:b2:d1:5c", "network": {"id": "d9bcdec6-69e0-4e65-8a26-1af1f8232365", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1227861580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "636fa9a1f046425e9332cc3807f8fb46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd853050-2e", "ovs_interfaceid": "fd853050-2e07-4e5b-9dfc-b10bf3af51e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:59:48 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:d1:5c,bridge_name='br-int',has_traffic_filtering=True,id=fd853050-2e07-4e5b-9dfc-b10bf3af51e7,network=Network(d9bcdec6-69e0-4e65-8a26-1af1f8232365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd853050-2e') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:59:48 user nova-compute[74994]: DEBUG nova.objects.instance [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lazy-loading 'pci_devices' on Instance uuid 14ab0a02-7432-4630-8758-df82d6a17ef8 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:59:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] End _get_guest_xml xml=<domain type="kvm">
Nov 28 10:59:48 user nova-compute[74994]:   <uuid>14ab0a02-7432-4630-8758-df82d6a17ef8</uuid>
Nov 28 10:59:48 user nova-compute[74994]:   <name>instance-0000001c</name>
Nov 28 10:59:48 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 10:59:48 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 10:59:48 user nova-compute[74994]:   <metadata>
Nov 28 10:59:48 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 10:59:48 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 10:59:48 user nova-compute[74994]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1834467843</nova:name>
Nov 28 10:59:48 user nova-compute[74994]:       <nova:creationTime>2023-11-28 10:59:48</nova:creationTime>
Nov 28 10:59:48 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 10:59:48 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 10:59:48 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 10:59:48 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 10:59:48 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 10:59:48 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 10:59:48 user nova-compute[74994]:       </nova:flavor>
Nov 28 10:59:48 user nova-compute[74994]:       <nova:owner>
Nov 28 10:59:48 user nova-compute[74994]:         <nova:user uuid="aa362c35530641a687a33182012c2332">tempest-AttachVolumeNegativeTest-3431122-project-member</nova:user>
Nov 28 10:59:48 user nova-compute[74994]:         <nova:project uuid="636fa9a1f046425e9332cc3807f8fb46">tempest-AttachVolumeNegativeTest-3431122</nova:project>
Nov 28 10:59:48 user nova-compute[74994]:       </nova:owner>
Nov 28 10:59:48 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 10:59:48 user nova-compute[74994]:       <nova:ports>
Nov 28 10:59:48 user nova-compute[74994]:         <nova:port uuid="fd853050-2e07-4e5b-9dfc-b10bf3af51e7">
Nov 28 10:59:48 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 10:59:48 user nova-compute[74994]:         </nova:port>
Nov 28 10:59:48 user nova-compute[74994]:       </nova:ports>
Nov 28 10:59:48 user nova-compute[74994]:     </nova:instance>
Nov 28 10:59:48 user nova-compute[74994]:   </metadata>
Nov 28 10:59:48 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 10:59:48 user nova-compute[74994]:     <system>
Nov 28 10:59:48 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 10:59:48 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 10:59:48 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 10:59:48 user nova-compute[74994]:       <entry name="serial">14ab0a02-7432-4630-8758-df82d6a17ef8</entry>
Nov 28 10:59:48 user nova-compute[74994]:       <entry name="uuid">14ab0a02-7432-4630-8758-df82d6a17ef8</entry>
Nov 28 10:59:48 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 10:59:48 user nova-compute[74994]:     </system>
Nov 28 10:59:48 user nova-compute[74994]:   </sysinfo>
Nov 28 10:59:48 user nova-compute[74994]:   <os>
Nov 28 10:59:48 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 10:59:48 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 10:59:48 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 10:59:48 user nova-compute[74994]:   </os>
Nov 28 10:59:48 user nova-compute[74994]:   <features>
Nov 28 10:59:48 user nova-compute[74994]:     <acpi/>
Nov 28 10:59:48 user nova-compute[74994]:     <apic/>
Nov 28 10:59:48 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 10:59:48 user nova-compute[74994]:   </features>
Nov 28 10:59:48 user nova-compute[74994]:   <clock offset="utc">
Nov 28 10:59:48 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 10:59:48 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 10:59:48 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 10:59:48 user nova-compute[74994]:   </clock>
Nov 28 10:59:48 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 10:59:48 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 10:59:48 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 10:59:48 user nova-compute[74994]:   </cpu>
Nov 28 10:59:48 user nova-compute[74994]:   <devices>
Nov 28 10:59:48 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 10:59:48 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 10:59:48 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/14ab0a02-7432-4630-8758-df82d6a17ef8/disk"/>
Nov 28 10:59:48 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 10:59:48 user nova-compute[74994]:     </disk>
Nov 28 10:59:48 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 10:59:48 user nova-compute[74994]:       <mac address="fa:16:3e:b2:d1:5c"/>
Nov 28 10:59:48 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:59:48 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 10:59:48 user nova-compute[74994]:       <target dev="tapfd853050-2e"/>
Nov 28 10:59:48 user nova-compute[74994]:     </interface>
Nov 28 10:59:48 user nova-compute[74994]:     <serial type="pty">
Nov 28 10:59:48 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/14ab0a02-7432-4630-8758-df82d6a17ef8/console.log" append="off"/>
Nov 28 10:59:48 user nova-compute[74994]:     </serial>
Nov 28 10:59:48 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 10:59:48 user nova-compute[74994]:     <video>
Nov 28 10:59:48 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:59:48 user nova-compute[74994]:     </video>
Nov 28 10:59:48 user nova-compute[74994]:     <rng model="virtio">
Nov 28 10:59:48 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 10:59:48 user nova-compute[74994]:     </rng>
Nov 28 10:59:48 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 10:59:48 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 10:59:48 user nova-compute[74994]:       <stats period="10"/>
Nov 28 10:59:48 user nova-compute[74994]:     </memballoon>
Nov 28 10:59:48 user nova-compute[74994]:   </devices>
Nov 28 10:59:48 user nova-compute[74994]: </domain>
Nov 28 10:59:48 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 10:59:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:59:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1834467843',display_name='tempest-AttachVolumeNegativeTest-server-1834467843',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1834467843',id=28,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOci8O+B2cMqcmA6KutXpveM/McooapU0kTF2RLLqGuRlPJoZhRCMw3muU1qRbkoMbD+utKDzsNoO6WcCPJWtfjKSfnpALF0poFjiZmHHV3mM7UO8Uh+O5fQUuyb14Mmw==',key_name='tempest-keypair-600162787',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='636fa9a1f046425e9332cc3807f8fb46',ramdisk_id='',reservation_id='r-3xdmet7a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-3431122',owner_user_name='tempest-AttachVolumeNegativeTest-3431122-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:59:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa362c35530641a687a33182012c2332',uuid=14ab0a02-7432-4630-8758-df82d6a17ef8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd853050-2e07-4e5b-9dfc-b10bf3af51e7", "address": "fa:16:3e:b2:d1:5c", "network": {"id": "d9bcdec6-69e0-4e65-8a26-1af1f8232365", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1227861580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "636fa9a1f046425e9332cc3807f8fb46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd853050-2e", "ovs_interfaceid": "fd853050-2e07-4e5b-9dfc-b10bf3af51e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 10:59:48 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Converting VIF {"id": "fd853050-2e07-4e5b-9dfc-b10bf3af51e7", "address": "fa:16:3e:b2:d1:5c", "network": {"id": "d9bcdec6-69e0-4e65-8a26-1af1f8232365", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1227861580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "636fa9a1f046425e9332cc3807f8fb46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd853050-2e", "ovs_interfaceid": "fd853050-2e07-4e5b-9dfc-b10bf3af51e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:59:48 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:d1:5c,bridge_name='br-int',has_traffic_filtering=True,id=fd853050-2e07-4e5b-9dfc-b10bf3af51e7,network=Network(d9bcdec6-69e0-4e65-8a26-1af1f8232365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd853050-2e') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:59:48 user nova-compute[74994]: DEBUG os_vif [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:d1:5c,bridge_name='br-int',has_traffic_filtering=True,id=fd853050-2e07-4e5b-9dfc-b10bf3af51e7,network=Network(d9bcdec6-69e0-4e65-8a26-1af1f8232365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd853050-2e') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 10:59:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:59:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 10:59:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4ebc9d4a-924b-52b8-9264-39010208a328', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:59:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd853050-2e, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:59:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfd853050-2e, col_values=(('qos', UUID('f9038be9-819c-45d5-8c45-aa3438221a7f')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:59:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfd853050-2e, col_values=(('external_ids', {'iface-id': 'fd853050-2e07-4e5b-9dfc-b10bf3af51e7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:d1:5c', 'vm-uuid': '14ab0a02-7432-4630-8758-df82d6a17ef8'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:59:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:59:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:48 user nova-compute[74994]: INFO os_vif [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:d1:5c,bridge_name='br-int',has_traffic_filtering=True,id=fd853050-2e07-4e5b-9dfc-b10bf3af51e7,network=Network(d9bcdec6-69e0-4e65-8a26-1af1f8232365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd853050-2e')
Nov 28 10:59:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:59:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] No VIF found with MAC fa:16:3e:b2:d1:5c, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:59:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:49 user nova-compute[74994]: DEBUG nova.compute.manager [req-33e257a2-748b-454f-9914-6e8a92790b39 req-3fec9d86-824c-4c48-a010-a5e757263a52 service nova] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Received event network-changed-fd853050-2e07-4e5b-9dfc-b10bf3af51e7 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:59:49 user nova-compute[74994]: DEBUG nova.compute.manager [req-33e257a2-748b-454f-9914-6e8a92790b39 req-3fec9d86-824c-4c48-a010-a5e757263a52 service nova] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Refreshing instance network info cache due to event network-changed-fd853050-2e07-4e5b-9dfc-b10bf3af51e7. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:59:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-33e257a2-748b-454f-9914-6e8a92790b39 req-3fec9d86-824c-4c48-a010-a5e757263a52 service nova] Acquiring lock "refresh_cache-14ab0a02-7432-4630-8758-df82d6a17ef8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:59:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-33e257a2-748b-454f-9914-6e8a92790b39 req-3fec9d86-824c-4c48-a010-a5e757263a52 service nova] Acquired lock "refresh_cache-14ab0a02-7432-4630-8758-df82d6a17ef8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:59:49 user nova-compute[74994]: DEBUG nova.network.neutron [req-33e257a2-748b-454f-9914-6e8a92790b39 req-3fec9d86-824c-4c48-a010-a5e757263a52 service nova] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Refreshing network info cache for port fd853050-2e07-4e5b-9dfc-b10bf3af51e7 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:59:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 10:59:49 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Creating image(s)
Nov 28 10:59:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "/opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:59:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "/opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:59:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "/opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:59:49 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.282s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG nova.network.neutron [req-33e257a2-748b-454f-9914-6e8a92790b39 req-3fec9d86-824c-4c48-a010-a5e757263a52 service nova] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Updated VIF entry in instance network info cache for port fd853050-2e07-4e5b-9dfc-b10bf3af51e7. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG nova.network.neutron [req-33e257a2-748b-454f-9914-6e8a92790b39 req-3fec9d86-824c-4c48-a010-a5e757263a52 service nova] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Updating instance_info_cache with network_info: [{"id": "fd853050-2e07-4e5b-9dfc-b10bf3af51e7", "address": "fa:16:3e:b2:d1:5c", "network": {"id": "d9bcdec6-69e0-4e65-8a26-1af1f8232365", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1227861580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "636fa9a1f046425e9332cc3807f8fb46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd853050-2e", "ovs_interfaceid": "fd853050-2e07-4e5b-9dfc-b10bf3af51e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.230s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8/disk 1073741824 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-33e257a2-748b-454f-9914-6e8a92790b39 req-3fec9d86-824c-4c48-a010-a5e757263a52 service nova] Releasing lock "refresh_cache-14ab0a02-7432-4630-8758-df82d6a17ef8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8/disk 1073741824" returned: 0 in 0.069s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.306s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.269s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Checking if we can resize image /opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8/disk. size=1073741824 {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG nova.compute.manager [req-d78dacfb-e478-4bce-9940-c480b71c8583 req-f4ef63a0-7340-403d-8aa2-fa5fba59abfa service nova] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Received event network-vif-plugged-fd853050-2e07-4e5b-9dfc-b10bf3af51e7 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d78dacfb-e478-4bce-9940-c480b71c8583 req-f4ef63a0-7340-403d-8aa2-fa5fba59abfa service nova] Acquiring lock "14ab0a02-7432-4630-8758-df82d6a17ef8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d78dacfb-e478-4bce-9940-c480b71c8583 req-f4ef63a0-7340-403d-8aa2-fa5fba59abfa service nova] Lock "14ab0a02-7432-4630-8758-df82d6a17ef8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d78dacfb-e478-4bce-9940-c480b71c8583 req-f4ef63a0-7340-403d-8aa2-fa5fba59abfa service nova] Lock "14ab0a02-7432-4630-8758-df82d6a17ef8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG nova.compute.manager [req-d78dacfb-e478-4bce-9940-c480b71c8583 req-f4ef63a0-7340-403d-8aa2-fa5fba59abfa service nova] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] No waiting events found dispatching network-vif-plugged-fd853050-2e07-4e5b-9dfc-b10bf3af51e7 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:59:50 user nova-compute[74994]: WARNING nova.compute.manager [req-d78dacfb-e478-4bce-9940-c480b71c8583 req-f4ef63a0-7340-403d-8aa2-fa5fba59abfa service nova] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Received unexpected event network-vif-plugged-fd853050-2e07-4e5b-9dfc-b10bf3af51e7 for instance with vm_state building and task_state spawning.
Nov 28 10:59:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Cannot resize image /opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8/disk to a smaller size. {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Created local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Ensure instance console log exists: /opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Start _get_guest_xml network_info=[{"id": "2b0693da-4e7d-4fb9-b7f0-adcb89d64f08", "address": "fa:16:3e:af:ea:62", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b0693da-4e", "ovs_interfaceid": "2b0693da-4e7d-4fb9-b7f0-adcb89d64f08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'aa939d1b-b8a6-4391-935b-0191bf5ccd0a'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HVFaUfcy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '20605acb-092a-4214-a114-750f145d7af8', 'attached_at': '', 'detached_at': '', 'volume_id': 'd070c683-4fcf-429a-a848-14db7a1e046b', 'serial': 'd070c683-4fcf-429a-a848-14db7a1e046b'}, 'attachment_id': 'b5fb50b2-4194-4b51-9722-a55ce3569258', 'boot_index': None, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:50 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 28 10:59:50 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 28 10:59:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG nova.objects.instance [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lazy-loading 'vcpu_model' on Instance uuid 20605acb-092a-4214-a114-750f145d7af8 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HVFaUfcy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 10:59:50 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 10:59:50 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:59:50 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 10:59:50 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 10:59:50 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 10:59:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c94c0d-5eaf-4516-83ac-203c5c9b4f16]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 10:59:50 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:50 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[890fa522-9a9a-4dc8-aac4-5e73eccb7ed5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b] added
Nov 28 10:59:51 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:59:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[863da60a-2fac-4670-8b19-d9644351a658]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:59:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6d6482-1d4d-46f9-aa88-e0714cf37bb1]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:59:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HVFaUfcy {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HVFaUfcy" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4185054e-18c3-4c40-a5d9-988d23083a4e]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HVFaUfcy'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:59:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[313ee193-6f8b-4b7e-b66a-8186a135b549]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:59:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[94df14ac-9aef-4346-b4c1-cf4b40d5687d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:59:51 user nova-compute[74994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 10:59:51 user nova-compute[74994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)
Nov 28 10:59:51 user nova-compute[74994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)
Nov 28 10:59:51 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:59:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:59:51 user nova-compute[74994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 10:59:51 user nova-compute[74994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)
Nov 28 10:59:51 user nova-compute[74994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)
Nov 28 10:59:51 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:59:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbce905-d12a-474a-90db-ee621318badc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b, portal: 172.16.0.220,3260]
Nov 28 10:59:51 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b, portal: 172.16.0.220,3260] successful.
Nov 28 10:59:51 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:59:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d345c0-177a-4c9b-8520-bf275c195c19]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 10:59:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[71aca67a-c0d5-4332-8804-139efd3d2b4f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:59:51 user nova-compute[74994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 10:59:51 user nova-compute[74994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)
Nov 28 10:59:51 user nova-compute[74994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)
Nov 28 10:59:51 user nova-compute[74994]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)
Nov 28 10:59:51 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 10:59:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 10:59:51 user nova-compute[74994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 10:59:51 user nova-compute[74994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)
Nov 28 10:59:51 user nova-compute[74994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)
Nov 28 10:59:51 user nova-compute[74994]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)
Nov 28 10:59:51 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 10:59:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:59:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 10:59:51 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] HCTL ('36', '-', '-', 0) found on session 30 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 10:59:51 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 10:59:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 10:59:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 10:59:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ed4541-e980-4fdb-ab2a-35830652550d]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 10:59:51 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 10:59:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HVFaUfcy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 10:59:52 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.413s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 10:59:52 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] <== connect_volume: return (1414ms) {'type': 'block', 'scsi_wwn': '23433356435396433', 'path': '/dev/sde'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 10:59:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433356435396433', 'path': '/dev/sde'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 10:59:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T10:57:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-893238339',display_name='tempest-ServerActionsTestOtherA-server-431726265',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-893238339',id=24,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBOY+NutkPemiyHeMnQLSk9aaZJeDN6wgP5qBeYjN7xZFqVw9TdQeE9oS3N1LsgeVKLYADzySBGVghLSJNwEz9H04AB8Wq7t5ky4d6BMahksF1kPbZitdOiyTWwqobeQw==',key_name='tempest-keypair-2025261715',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:57:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5eb43a8fc7bd47728600741762f71112',ramdisk_id='',reservation_id='r-qwz39s5c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1927948343',owner_user_name='tempest-ServerActionsTestOtherA-1927948343-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:59:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d51be473c7284977a6533756a1f677f9',uuid=20605acb-092a-4214-a114-750f145d7af8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b0693da-4e7d-4fb9-b7f0-adcb89d64f08", "address": "fa:16:3e:af:ea:62", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b0693da-4e", "ovs_interfaceid": "2b0693da-4e7d-4fb9-b7f0-adcb89d64f08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 10:59:52 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Converting VIF {"id": "2b0693da-4e7d-4fb9-b7f0-adcb89d64f08", "address": "fa:16:3e:af:ea:62", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b0693da-4e", "ovs_interfaceid": "2b0693da-4e7d-4fb9-b7f0-adcb89d64f08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:59:52 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:ea:62,bridge_name='br-int',has_traffic_filtering=True,id=2b0693da-4e7d-4fb9-b7f0-adcb89d64f08,network=Network(16dd32cd-5a00-4111-92e2-283e7635540f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b0693da-4e') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:59:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] End _get_guest_xml xml=<domain type="kvm">
Nov 28 10:59:52 user nova-compute[74994]:   <uuid>20605acb-092a-4214-a114-750f145d7af8</uuid>
Nov 28 10:59:52 user nova-compute[74994]:   <name>instance-00000018</name>
Nov 28 10:59:52 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 10:59:52 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 10:59:52 user nova-compute[74994]:   <metadata>
Nov 28 10:59:52 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 10:59:52 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 10:59:52 user nova-compute[74994]:       <nova:name>tempest-ServerActionsTestOtherA-server-431726265</nova:name>
Nov 28 10:59:52 user nova-compute[74994]:       <nova:creationTime>2023-11-28 10:59:50</nova:creationTime>
Nov 28 10:59:52 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 10:59:52 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 10:59:52 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 10:59:52 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 10:59:52 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 10:59:52 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 10:59:52 user nova-compute[74994]:       </nova:flavor>
Nov 28 10:59:52 user nova-compute[74994]:       <nova:owner>
Nov 28 10:59:52 user nova-compute[74994]:         <nova:user uuid="d51be473c7284977a6533756a1f677f9">tempest-ServerActionsTestOtherA-1927948343-project-member</nova:user>
Nov 28 10:59:52 user nova-compute[74994]:         <nova:project uuid="5eb43a8fc7bd47728600741762f71112">tempest-ServerActionsTestOtherA-1927948343</nova:project>
Nov 28 10:59:52 user nova-compute[74994]:       </nova:owner>
Nov 28 10:59:52 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 10:59:52 user nova-compute[74994]:       <nova:ports>
Nov 28 10:59:52 user nova-compute[74994]:         <nova:port uuid="2b0693da-4e7d-4fb9-b7f0-adcb89d64f08">
Nov 28 10:59:52 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 10:59:52 user nova-compute[74994]:         </nova:port>
Nov 28 10:59:52 user nova-compute[74994]:       </nova:ports>
Nov 28 10:59:52 user nova-compute[74994]:     </nova:instance>
Nov 28 10:59:52 user nova-compute[74994]:   </metadata>
Nov 28 10:59:52 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 10:59:52 user nova-compute[74994]:     <system>
Nov 28 10:59:52 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 10:59:52 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 10:59:52 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 10:59:52 user nova-compute[74994]:       <entry name="serial">20605acb-092a-4214-a114-750f145d7af8</entry>
Nov 28 10:59:52 user nova-compute[74994]:       <entry name="uuid">20605acb-092a-4214-a114-750f145d7af8</entry>
Nov 28 10:59:52 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 10:59:52 user nova-compute[74994]:     </system>
Nov 28 10:59:52 user nova-compute[74994]:   </sysinfo>
Nov 28 10:59:52 user nova-compute[74994]:   <os>
Nov 28 10:59:52 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 10:59:52 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 10:59:52 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 10:59:52 user nova-compute[74994]:   </os>
Nov 28 10:59:52 user nova-compute[74994]:   <features>
Nov 28 10:59:52 user nova-compute[74994]:     <acpi/>
Nov 28 10:59:52 user nova-compute[74994]:     <apic/>
Nov 28 10:59:52 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 10:59:52 user nova-compute[74994]:   </features>
Nov 28 10:59:52 user nova-compute[74994]:   <clock offset="utc">
Nov 28 10:59:52 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 10:59:52 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 10:59:52 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 10:59:52 user nova-compute[74994]:   </clock>
Nov 28 10:59:52 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 10:59:52 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 10:59:52 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 10:59:52 user nova-compute[74994]:   </cpu>
Nov 28 10:59:52 user nova-compute[74994]:   <devices>
Nov 28 10:59:52 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 10:59:52 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 10:59:52 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8/disk"/>
Nov 28 10:59:52 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 10:59:52 user nova-compute[74994]:     </disk>
Nov 28 10:59:52 user nova-compute[74994]:     <disk type="block" device="disk">
Nov 28 10:59:52 user nova-compute[74994]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 10:59:52 user nova-compute[74994]:       <source dev="/dev/sde"/>
Nov 28 10:59:52 user nova-compute[74994]:       <target dev="vdb" bus="virtio"/>
Nov 28 10:59:52 user nova-compute[74994]:       <serial>d070c683-4fcf-429a-a848-14db7a1e046b</serial>
Nov 28 10:59:52 user nova-compute[74994]:     </disk>
Nov 28 10:59:52 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 10:59:52 user nova-compute[74994]:       <mac address="fa:16:3e:af:ea:62"/>
Nov 28 10:59:52 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:59:52 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 10:59:52 user nova-compute[74994]:       <target dev="tap2b0693da-4e"/>
Nov 28 10:59:52 user nova-compute[74994]:     </interface>
Nov 28 10:59:52 user nova-compute[74994]:     <serial type="pty">
Nov 28 10:59:52 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8/console.log" append="off"/>
Nov 28 10:59:52 user nova-compute[74994]:     </serial>
Nov 28 10:59:52 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 10:59:52 user nova-compute[74994]:     <video>
Nov 28 10:59:52 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 10:59:52 user nova-compute[74994]:     </video>
Nov 28 10:59:52 user nova-compute[74994]:     <rng model="virtio">
Nov 28 10:59:52 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 10:59:52 user nova-compute[74994]:     </rng>
Nov 28 10:59:52 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 10:59:52 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 10:59:52 user nova-compute[74994]:       <stats period="10"/>
Nov 28 10:59:52 user nova-compute[74994]:     </memballoon>
Nov 28 10:59:52 user nova-compute[74994]:   </devices>
Nov 28 10:59:52 user nova-compute[74994]: </domain>
Nov 28 10:59:52 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 10:59:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T10:57:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-893238339',display_name='tempest-ServerActionsTestOtherA-server-431726265',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-893238339',id=24,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBOY+NutkPemiyHeMnQLSk9aaZJeDN6wgP5qBeYjN7xZFqVw9TdQeE9oS3N1LsgeVKLYADzySBGVghLSJNwEz9H04AB8Wq7t5ky4d6BMahksF1kPbZitdOiyTWwqobeQw==',key_name='tempest-keypair-2025261715',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:57:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5eb43a8fc7bd47728600741762f71112',ramdisk_id='',reservation_id='r-qwz39s5c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1927948343',owner_user_name='tempest-ServerActionsTestOtherA-1927948343-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T10:59:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d51be473c7284977a6533756a1f677f9',uuid=20605acb-092a-4214-a114-750f145d7af8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b0693da-4e7d-4fb9-b7f0-adcb89d64f08", "address": "fa:16:3e:af:ea:62", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b0693da-4e", "ovs_interfaceid": "2b0693da-4e7d-4fb9-b7f0-adcb89d64f08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 10:59:52 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Converting VIF {"id": "2b0693da-4e7d-4fb9-b7f0-adcb89d64f08", "address": "fa:16:3e:af:ea:62", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b0693da-4e", "ovs_interfaceid": "2b0693da-4e7d-4fb9-b7f0-adcb89d64f08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 10:59:52 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:ea:62,bridge_name='br-int',has_traffic_filtering=True,id=2b0693da-4e7d-4fb9-b7f0-adcb89d64f08,network=Network(16dd32cd-5a00-4111-92e2-283e7635540f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b0693da-4e') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 10:59:52 user nova-compute[74994]: DEBUG os_vif [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:ea:62,bridge_name='br-int',has_traffic_filtering=True,id=2b0693da-4e7d-4fb9-b7f0-adcb89d64f08,network=Network(16dd32cd-5a00-4111-92e2-283e7635540f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b0693da-4e') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 10:59:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:59:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 10:59:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7a23f22e-2ff9-5461-8012-746eff0f8409', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:59:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:59:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b0693da-4e, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:59:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2b0693da-4e, col_values=(('qos', UUID('03cb4050-5234-45ca-9dab-1e5066765552')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:59:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2b0693da-4e, col_values=(('external_ids', {'iface-id': '2b0693da-4e7d-4fb9-b7f0-adcb89d64f08', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:ea:62', 'vm-uuid': '20605acb-092a-4214-a114-750f145d7af8'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 10:59:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 10:59:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:52 user nova-compute[74994]: INFO os_vif [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:ea:62,bridge_name='br-int',has_traffic_filtering=True,id=2b0693da-4e7d-4fb9-b7f0-adcb89d64f08,network=Network(16dd32cd-5a00-4111-92e2-283e7635540f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b0693da-4e')
Nov 28 10:59:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:59:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 10:59:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] No VIF found with MAC fa:16:3e:af:ea:62, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 10:59:52 user nova-compute[74994]: DEBUG nova.compute.manager [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 10:59:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 10:59:52 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Instance spawned successfully.
Nov 28 10:59:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 10:59:52 user nova-compute[74994]: DEBUG nova.compute.manager [req-3a846a0a-bccc-4a33-89b5-56783203cbe6 req-36550595-7cd6-4f84-b712-98bc6dfc4a03 service nova] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Received event network-vif-plugged-fd853050-2e07-4e5b-9dfc-b10bf3af51e7 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:59:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-3a846a0a-bccc-4a33-89b5-56783203cbe6 req-36550595-7cd6-4f84-b712-98bc6dfc4a03 service nova] Acquiring lock "14ab0a02-7432-4630-8758-df82d6a17ef8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:59:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-3a846a0a-bccc-4a33-89b5-56783203cbe6 req-36550595-7cd6-4f84-b712-98bc6dfc4a03 service nova] Lock "14ab0a02-7432-4630-8758-df82d6a17ef8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:59:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-3a846a0a-bccc-4a33-89b5-56783203cbe6 req-36550595-7cd6-4f84-b712-98bc6dfc4a03 service nova] Lock "14ab0a02-7432-4630-8758-df82d6a17ef8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:59:52 user nova-compute[74994]: DEBUG nova.compute.manager [req-3a846a0a-bccc-4a33-89b5-56783203cbe6 req-36550595-7cd6-4f84-b712-98bc6dfc4a03 service nova] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] No waiting events found dispatching network-vif-plugged-fd853050-2e07-4e5b-9dfc-b10bf3af51e7 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:59:52 user nova-compute[74994]: WARNING nova.compute.manager [req-3a846a0a-bccc-4a33-89b5-56783203cbe6 req-36550595-7cd6-4f84-b712-98bc6dfc4a03 service nova] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Received unexpected event network-vif-plugged-fd853050-2e07-4e5b-9dfc-b10bf3af51e7 for instance with vm_state building and task_state spawning.
Nov 28 10:59:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:59:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:59:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:59:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:59:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:59:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:59:52 user nova-compute[74994]: INFO nova.compute.manager [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Took 6.73 seconds to spawn the instance on the hypervisor.
Nov 28 10:59:52 user nova-compute[74994]: DEBUG nova.compute.manager [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 10:59:52 user nova-compute[74994]: INFO nova.compute.manager [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Took 7.80 seconds to build instance.
Nov 28 10:59:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ba678e5f-054b-4d24-8df1-c17ce564fb6f tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "14ab0a02-7432-4630-8758-df82d6a17ef8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.054s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:59:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:54 user nova-compute[74994]: DEBUG nova.compute.manager [req-8f8286af-74db-4666-b897-d7dd0b730b29 req-b4544a52-2749-48aa-b954-273375151d51 service nova] [instance: 20605acb-092a-4214-a114-750f145d7af8] Received event network-vif-plugged-2b0693da-4e7d-4fb9-b7f0-adcb89d64f08 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:59:54 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8f8286af-74db-4666-b897-d7dd0b730b29 req-b4544a52-2749-48aa-b954-273375151d51 service nova] Acquiring lock "20605acb-092a-4214-a114-750f145d7af8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:59:54 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8f8286af-74db-4666-b897-d7dd0b730b29 req-b4544a52-2749-48aa-b954-273375151d51 service nova] Lock "20605acb-092a-4214-a114-750f145d7af8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:59:54 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8f8286af-74db-4666-b897-d7dd0b730b29 req-b4544a52-2749-48aa-b954-273375151d51 service nova] Lock "20605acb-092a-4214-a114-750f145d7af8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:59:54 user nova-compute[74994]: DEBUG nova.compute.manager [req-8f8286af-74db-4666-b897-d7dd0b730b29 req-b4544a52-2749-48aa-b954-273375151d51 service nova] [instance: 20605acb-092a-4214-a114-750f145d7af8] No waiting events found dispatching network-vif-plugged-2b0693da-4e7d-4fb9-b7f0-adcb89d64f08 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:59:54 user nova-compute[74994]: WARNING nova.compute.manager [req-8f8286af-74db-4666-b897-d7dd0b730b29 req-b4544a52-2749-48aa-b954-273375151d51 service nova] [instance: 20605acb-092a-4214-a114-750f145d7af8] Received unexpected event network-vif-plugged-2b0693da-4e7d-4fb9-b7f0-adcb89d64f08 for instance with vm_state active and task_state rebuild_spawning.
Nov 28 10:59:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:56 user nova-compute[74994]: DEBUG nova.compute.manager [req-d798e2b4-7e91-4921-806c-00df547071c6 req-d6623435-a529-46de-8b47-76e7136d412d service nova] [instance: 20605acb-092a-4214-a114-750f145d7af8] Received event network-vif-plugged-2b0693da-4e7d-4fb9-b7f0-adcb89d64f08 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:59:56 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d798e2b4-7e91-4921-806c-00df547071c6 req-d6623435-a529-46de-8b47-76e7136d412d service nova] Acquiring lock "20605acb-092a-4214-a114-750f145d7af8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:59:56 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d798e2b4-7e91-4921-806c-00df547071c6 req-d6623435-a529-46de-8b47-76e7136d412d service nova] Lock "20605acb-092a-4214-a114-750f145d7af8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:59:56 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d798e2b4-7e91-4921-806c-00df547071c6 req-d6623435-a529-46de-8b47-76e7136d412d service nova] Lock "20605acb-092a-4214-a114-750f145d7af8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:59:56 user nova-compute[74994]: DEBUG nova.compute.manager [req-d798e2b4-7e91-4921-806c-00df547071c6 req-d6623435-a529-46de-8b47-76e7136d412d service nova] [instance: 20605acb-092a-4214-a114-750f145d7af8] No waiting events found dispatching network-vif-plugged-2b0693da-4e7d-4fb9-b7f0-adcb89d64f08 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 10:59:56 user nova-compute[74994]: WARNING nova.compute.manager [req-d798e2b4-7e91-4921-806c-00df547071c6 req-d6623435-a529-46de-8b47-76e7136d412d service nova] [instance: 20605acb-092a-4214-a114-750f145d7af8] Received unexpected event network-vif-plugged-2b0693da-4e7d-4fb9-b7f0-adcb89d64f08 for instance with vm_state active and task_state rebuild_spawning.
Nov 28 10:59:56 user nova-compute[74994]: DEBUG nova.compute.manager [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 10:59:56 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 10:59:56 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 20605acb-092a-4214-a114-750f145d7af8] Instance spawned successfully.
Nov 28 10:59:56 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 10:59:56 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:59:56 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:59:56 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:59:56 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:59:56 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:59:56 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 10:59:56 user nova-compute[74994]: DEBUG nova.compute.manager [req-8685463d-1794-4f5f-8eaa-db352fa49e0c req-895e7134-ecd9-4cb1-9cde-4b05362a2b20 service nova] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Received event network-changed-017867da-26d5-4fff-9eb9-eb8686888b55 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 10:59:56 user nova-compute[74994]: DEBUG nova.compute.manager [req-8685463d-1794-4f5f-8eaa-db352fa49e0c req-895e7134-ecd9-4cb1-9cde-4b05362a2b20 service nova] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Refreshing instance network info cache due to event network-changed-017867da-26d5-4fff-9eb9-eb8686888b55. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 10:59:56 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8685463d-1794-4f5f-8eaa-db352fa49e0c req-895e7134-ecd9-4cb1-9cde-4b05362a2b20 service nova] Acquiring lock "refresh_cache-3cf241c8-e888-4e47-8213-3c83c045e4a3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 10:59:56 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8685463d-1794-4f5f-8eaa-db352fa49e0c req-895e7134-ecd9-4cb1-9cde-4b05362a2b20 service nova] Acquired lock "refresh_cache-3cf241c8-e888-4e47-8213-3c83c045e4a3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 10:59:56 user nova-compute[74994]: DEBUG nova.network.neutron [req-8685463d-1794-4f5f-8eaa-db352fa49e0c req-895e7134-ecd9-4cb1-9cde-4b05362a2b20 service nova] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Refreshing network info cache for port 017867da-26d5-4fff-9eb9-eb8686888b55 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 10:59:56 user nova-compute[74994]: DEBUG nova.compute.manager [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 10:59:56 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 10:59:56 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.003s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 10:59:56 user nova-compute[74994]: DEBUG nova.objects.instance [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74994) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 28 10:59:56 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-38a33d4c-fa5c-4cfb-9bec-5bf49d545e99 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.197s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 10:59:57 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 10:59:57 user nova-compute[74994]: DEBUG nova.network.neutron [req-8685463d-1794-4f5f-8eaa-db352fa49e0c req-895e7134-ecd9-4cb1-9cde-4b05362a2b20 service nova] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Updated VIF entry in instance network info cache for port 017867da-26d5-4fff-9eb9-eb8686888b55. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 10:59:57 user nova-compute[74994]: DEBUG nova.network.neutron [req-8685463d-1794-4f5f-8eaa-db352fa49e0c req-895e7134-ecd9-4cb1-9cde-4b05362a2b20 service nova] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Updating instance_info_cache with network_info: [{"id": "017867da-26d5-4fff-9eb9-eb8686888b55", "address": "fa:16:3e:8f:30:5e", "network": {"id": "d46e72ec-d7d5-45f7-951a-b4381f0b472b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-179057367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a4dcdeafd6420d8606b37673e3255f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017867da-26", "ovs_interfaceid": "017867da-26d5-4fff-9eb9-eb8686888b55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 10:59:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8685463d-1794-4f5f-8eaa-db352fa49e0c req-895e7134-ecd9-4cb1-9cde-4b05362a2b20 service nova] Releasing lock "refresh_cache-3cf241c8-e888-4e47-8213-3c83c045e4a3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 10:59:59 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:00 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3c60063a-adfb-43f4-8568-9431d94bbe6d tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Acquiring lock "3cf241c8-e888-4e47-8213-3c83c045e4a3" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:00:01 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3c60063a-adfb-43f4-8568-9431d94bbe6d tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "3cf241c8-e888-4e47-8213-3c83c045e4a3" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:00:01 user nova-compute[74994]: INFO nova.compute.manager [None req-3c60063a-adfb-43f4-8568-9431d94bbe6d tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Shelving
Nov 28 11:00:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:01 user nova-compute[74994]: DEBUG nova.compute.manager [req-8de3c37c-87d1-4917-87ed-93264d21a793 req-c0635647-c1a5-4722-a234-a62e2b8f2bae service nova] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Received event network-vif-unplugged-017867da-26d5-4fff-9eb9-eb8686888b55 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:00:01 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8de3c37c-87d1-4917-87ed-93264d21a793 req-c0635647-c1a5-4722-a234-a62e2b8f2bae service nova] Acquiring lock "3cf241c8-e888-4e47-8213-3c83c045e4a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:00:01 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8de3c37c-87d1-4917-87ed-93264d21a793 req-c0635647-c1a5-4722-a234-a62e2b8f2bae service nova] Lock "3cf241c8-e888-4e47-8213-3c83c045e4a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:00:01 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8de3c37c-87d1-4917-87ed-93264d21a793 req-c0635647-c1a5-4722-a234-a62e2b8f2bae service nova] Lock "3cf241c8-e888-4e47-8213-3c83c045e4a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:00:01 user nova-compute[74994]: DEBUG nova.compute.manager [req-8de3c37c-87d1-4917-87ed-93264d21a793 req-c0635647-c1a5-4722-a234-a62e2b8f2bae service nova] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] No waiting events found dispatching network-vif-unplugged-017867da-26d5-4fff-9eb9-eb8686888b55 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:00:01 user nova-compute[74994]: WARNING nova.compute.manager [req-8de3c37c-87d1-4917-87ed-93264d21a793 req-c0635647-c1a5-4722-a234-a62e2b8f2bae service nova] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Received unexpected event network-vif-unplugged-017867da-26d5-4fff-9eb9-eb8686888b55 for instance with vm_state active and task_state shelving.
Nov 28 11:00:01 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Instance destroyed successfully.
Nov 28 11:00:02 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-3c60063a-adfb-43f4-8568-9431d94bbe6d tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Beginning cold snapshot process
Nov 28 11:00:02 user nova-compute[74994]: DEBUG nova.privsep.utils [None req-3c60063a-adfb-43f4-8568-9431d94bbe6d tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74994) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 11:00:02 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-3c60063a-adfb-43f4-8568-9431d94bbe6d tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/3cf241c8-e888-4e47-8213-3c83c045e4a3/disk /opt/stack/data/nova/instances/snapshots/tmplonq8dkm/7d7bf14e7c12477d9715f30ed2713ce0 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:02 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:03 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-3c60063a-adfb-43f4-8568-9431d94bbe6d tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/3cf241c8-e888-4e47-8213-3c83c045e4a3/disk /opt/stack/data/nova/instances/snapshots/tmplonq8dkm/7d7bf14e7c12477d9715f30ed2713ce0" returned: 0 in 0.957s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:03 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-3c60063a-adfb-43f4-8568-9431d94bbe6d tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Snapshot extracted, beginning image upload
Nov 28 11:00:03 user nova-compute[74994]: DEBUG nova.compute.manager [req-71412d16-0d47-4a0e-95ea-9f6e3333b4b6 req-9b25d348-995a-4bb1-9b50-55a3eb40f890 service nova] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Received event network-vif-plugged-017867da-26d5-4fff-9eb9-eb8686888b55 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:00:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-71412d16-0d47-4a0e-95ea-9f6e3333b4b6 req-9b25d348-995a-4bb1-9b50-55a3eb40f890 service nova] Acquiring lock "3cf241c8-e888-4e47-8213-3c83c045e4a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:00:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-71412d16-0d47-4a0e-95ea-9f6e3333b4b6 req-9b25d348-995a-4bb1-9b50-55a3eb40f890 service nova] Lock "3cf241c8-e888-4e47-8213-3c83c045e4a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:00:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-71412d16-0d47-4a0e-95ea-9f6e3333b4b6 req-9b25d348-995a-4bb1-9b50-55a3eb40f890 service nova] Lock "3cf241c8-e888-4e47-8213-3c83c045e4a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:00:03 user nova-compute[74994]: DEBUG nova.compute.manager [req-71412d16-0d47-4a0e-95ea-9f6e3333b4b6 req-9b25d348-995a-4bb1-9b50-55a3eb40f890 service nova] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] No waiting events found dispatching network-vif-plugged-017867da-26d5-4fff-9eb9-eb8686888b55 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:00:03 user nova-compute[74994]: WARNING nova.compute.manager [req-71412d16-0d47-4a0e-95ea-9f6e3333b4b6 req-9b25d348-995a-4bb1-9b50-55a3eb40f890 service nova] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Received unexpected event network-vif-plugged-017867da-26d5-4fff-9eb9-eb8686888b55 for instance with vm_state active and task_state shelving_image_uploading.
Nov 28 11:00:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:05 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:00:05 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74994) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 11:00:05 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:00:06 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-3c60063a-adfb-43f4-8568-9431d94bbe6d tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Snapshot image upload complete
Nov 28 11:00:06 user nova-compute[74994]: DEBUG nova.compute.manager [None req-3c60063a-adfb-43f4-8568-9431d94bbe6d tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 11:00:06 user nova-compute[74994]: INFO nova.compute.manager [None req-3c60063a-adfb-43f4-8568-9431d94bbe6d tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Shelve offloading
Nov 28 11:00:06 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Instance destroyed successfully.
Nov 28 11:00:06 user nova-compute[74994]: DEBUG nova.compute.manager [None req-3c60063a-adfb-43f4-8568-9431d94bbe6d tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 11:00:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3c60063a-adfb-43f4-8568-9431d94bbe6d tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Acquiring lock "refresh_cache-3cf241c8-e888-4e47-8213-3c83c045e4a3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:00:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3c60063a-adfb-43f4-8568-9431d94bbe6d tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Acquired lock "refresh_cache-3cf241c8-e888-4e47-8213-3c83c045e4a3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:00:06 user nova-compute[74994]: DEBUG nova.network.neutron [None req-3c60063a-adfb-43f4-8568-9431d94bbe6d tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 11:00:07 user nova-compute[74994]: DEBUG nova.network.neutron [None req-3c60063a-adfb-43f4-8568-9431d94bbe6d tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Updating instance_info_cache with network_info: [{"id": "017867da-26d5-4fff-9eb9-eb8686888b55", "address": "fa:16:3e:8f:30:5e", "network": {"id": "d46e72ec-d7d5-45f7-951a-b4381f0b472b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-179057367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a4dcdeafd6420d8606b37673e3255f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017867da-26", "ovs_interfaceid": "017867da-26d5-4fff-9eb9-eb8686888b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:00:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3c60063a-adfb-43f4-8568-9431d94bbe6d tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Releasing lock "refresh_cache-3cf241c8-e888-4e47-8213-3c83c045e4a3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:00:07 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:08 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:00:08 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Instance destroyed successfully.
Nov 28 11:00:08 user nova-compute[74994]: DEBUG nova.objects.instance [None req-3c60063a-adfb-43f4-8568-9431d94bbe6d tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lazy-loading 'resources' on Instance uuid 3cf241c8-e888-4e47-8213-3c83c045e4a3 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:00:08 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-3c60063a-adfb-43f4-8568-9431d94bbe6d tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:58:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1735278754',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1735278754',id=27,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmqmu20KDfDBzBY6oASozowL+3S5vdHl8okXBPig0+AxtHwGAkdyi4k3S1Z/tCjZiCbxQI9z+EmWbdqY++IX2p/emffftg2gvlyMhSRLFVHnD/cO28qJSWLbeC6Cv/mew==',key_name='tempest-keypair-2137635767',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:58:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d3a4dcdeafd6420d8606b37673e3255f',ramdisk_id='',reservation_id='r-8cjiqvp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1700061593',owner_user_name='tempest-AttachVolumeShelveTestJSON-1700061593-project-member',shelved_at='2023-11-28T11:00:06.422487',shelved_host='user',shelved_image_id='b9ff9d55-350a-4c86-8690-9ab88b8ab0df'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T11:00:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4e1257b844940bebdeab3061c3e0ab4',uuid=3cf241c8-e888-4e47-8213-3c83c045e4a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "017867da-26d5-4fff-9eb9-eb8686888b55", "address": "fa:16:3e:8f:30:5e", "network": {"id": "d46e72ec-d7d5-45f7-951a-b4381f0b472b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-179057367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a4dcdeafd6420d8606b37673e3255f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017867da-26", "ovs_interfaceid": "017867da-26d5-4fff-9eb9-eb8686888b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 11:00:08 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-3c60063a-adfb-43f4-8568-9431d94bbe6d tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Converting VIF {"id": "017867da-26d5-4fff-9eb9-eb8686888b55", "address": "fa:16:3e:8f:30:5e", "network": {"id": "d46e72ec-d7d5-45f7-951a-b4381f0b472b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-179057367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a4dcdeafd6420d8606b37673e3255f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017867da-26", "ovs_interfaceid": "017867da-26d5-4fff-9eb9-eb8686888b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:00:08 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-3c60063a-adfb-43f4-8568-9431d94bbe6d tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:30:5e,bridge_name='br-int',has_traffic_filtering=True,id=017867da-26d5-4fff-9eb9-eb8686888b55,network=Network(d46e72ec-d7d5-45f7-951a-b4381f0b472b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap017867da-26') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:00:08 user nova-compute[74994]: DEBUG os_vif [None req-3c60063a-adfb-43f4-8568-9431d94bbe6d tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:30:5e,bridge_name='br-int',has_traffic_filtering=True,id=017867da-26d5-4fff-9eb9-eb8686888b55,network=Network(d46e72ec-d7d5-45f7-951a-b4381f0b472b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap017867da-26') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 11:00:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap017867da-26, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:00:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9a635a1c-5869-4679-a443-5d1ca7c4295a) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:00:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:08 user nova-compute[74994]: INFO os_vif [None req-3c60063a-adfb-43f4-8568-9431d94bbe6d tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:30:5e,bridge_name='br-int',has_traffic_filtering=True,id=017867da-26d5-4fff-9eb9-eb8686888b55,network=Network(d46e72ec-d7d5-45f7-951a-b4381f0b472b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap017867da-26')
Nov 28 11:00:08 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-3c60063a-adfb-43f4-8568-9431d94bbe6d tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Deleting instance files /opt/stack/data/nova/instances/3cf241c8-e888-4e47-8213-3c83c045e4a3_del
Nov 28 11:00:09 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-3c60063a-adfb-43f4-8568-9431d94bbe6d tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Deletion of /opt/stack/data/nova/instances/3cf241c8-e888-4e47-8213-3c83c045e4a3_del complete
Nov 28 11:00:09 user nova-compute[74994]: DEBUG nova.compute.manager [req-2e63f15f-0452-4dee-9d6d-133d1380270e req-21f84868-3c7d-45e9-820b-aaffbb692e85 service nova] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Received event network-changed-017867da-26d5-4fff-9eb9-eb8686888b55 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:00:09 user nova-compute[74994]: DEBUG nova.compute.manager [req-2e63f15f-0452-4dee-9d6d-133d1380270e req-21f84868-3c7d-45e9-820b-aaffbb692e85 service nova] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Refreshing instance network info cache due to event network-changed-017867da-26d5-4fff-9eb9-eb8686888b55. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:00:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-2e63f15f-0452-4dee-9d6d-133d1380270e req-21f84868-3c7d-45e9-820b-aaffbb692e85 service nova] Acquiring lock "refresh_cache-3cf241c8-e888-4e47-8213-3c83c045e4a3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:00:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-2e63f15f-0452-4dee-9d6d-133d1380270e req-21f84868-3c7d-45e9-820b-aaffbb692e85 service nova] Acquired lock "refresh_cache-3cf241c8-e888-4e47-8213-3c83c045e4a3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:00:09 user nova-compute[74994]: DEBUG nova.network.neutron [req-2e63f15f-0452-4dee-9d6d-133d1380270e req-21f84868-3c7d-45e9-820b-aaffbb692e85 service nova] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Refreshing network info cache for port 017867da-26d5-4fff-9eb9-eb8686888b55 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:00:09 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-3c60063a-adfb-43f4-8568-9431d94bbe6d tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Deleted allocations for instance 3cf241c8-e888-4e47-8213-3c83c045e4a3
Nov 28 11:00:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3c60063a-adfb-43f4-8568-9431d94bbe6d tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:00:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3c60063a-adfb-43f4-8568-9431d94bbe6d tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:00:09 user nova-compute[74994]: DEBUG nova.objects.instance [None req-3c60063a-adfb-43f4-8568-9431d94bbe6d tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lazy-loading 'numa_topology' on Instance uuid 3cf241c8-e888-4e47-8213-3c83c045e4a3 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:00:09 user nova-compute[74994]: DEBUG nova.objects.base [None req-3c60063a-adfb-43f4-8568-9431d94bbe6d tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Object Instance<3cf241c8-e888-4e47-8213-3c83c045e4a3> lazy-loaded attributes: resources,numa_topology {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 11:00:09 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:00:09 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 11:00:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:09 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-3c60063a-adfb-43f4-8568-9431d94bbe6d tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:00:09 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-3c60063a-adfb-43f4-8568-9431d94bbe6d tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:00:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3c60063a-adfb-43f4-8568-9431d94bbe6d tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.538s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:00:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3c60063a-adfb-43f4-8568-9431d94bbe6d tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "3cf241c8-e888-4e47-8213-3c83c045e4a3" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.910s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:00:09 user nova-compute[74994]: DEBUG nova.network.neutron [req-2e63f15f-0452-4dee-9d6d-133d1380270e req-21f84868-3c7d-45e9-820b-aaffbb692e85 service nova] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Updated VIF entry in instance network info cache for port 017867da-26d5-4fff-9eb9-eb8686888b55. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:00:09 user nova-compute[74994]: DEBUG nova.network.neutron [req-2e63f15f-0452-4dee-9d6d-133d1380270e req-21f84868-3c7d-45e9-820b-aaffbb692e85 service nova] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Updating instance_info_cache with network_info: [{"id": "017867da-26d5-4fff-9eb9-eb8686888b55", "address": "fa:16:3e:8f:30:5e", "network": {"id": "d46e72ec-d7d5-45f7-951a-b4381f0b472b", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-179057367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a4dcdeafd6420d8606b37673e3255f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap017867da-26", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:00:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-2e63f15f-0452-4dee-9d6d-133d1380270e req-21f84868-3c7d-45e9-820b-aaffbb692e85 service nova] Releasing lock "refresh_cache-3cf241c8-e888-4e47-8213-3c83c045e4a3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:00:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:12 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:00:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:14 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:00:14 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:00:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:00:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:00:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:00:14 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 11:00:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123/disk.rescue --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123/disk.rescue --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:16 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /opt/stack/data/nova/instances/4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123/disk (vdb) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:00:16 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:00:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:16 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:00:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:17 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:00:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14ab0a02-7432-4630-8758-df82d6a17ef8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14ab0a02-7432-4630-8758-df82d6a17ef8/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14ab0a02-7432-4630-8758-df82d6a17ef8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-68734c6d-02a6-4681-a6c3-971774c05251 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Acquiring lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:00:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-68734c6d-02a6-4681-a6c3-971774c05251 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:00:17 user nova-compute[74994]: INFO nova.compute.manager [None req-68734c6d-02a6-4681-a6c3-971774c05251 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Detaching volume dbafc9fb-40fc-4788-8115-7bfe2a0c53cb
Nov 28 11:00:18 user nova-compute[74994]: INFO nova.virt.block_device [None req-68734c6d-02a6-4681-a6c3-971774c05251 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Attempting to driver detach volume dbafc9fb-40fc-4788-8115-7bfe2a0c53cb from mountpoint /dev/vdb
Nov 28 11:00:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14ab0a02-7432-4630-8758-df82d6a17ef8/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:18 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-68734c6d-02a6-4681-a6c3-971774c05251 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Attempting to detach device vdb from instance 2f4b631a-46c8-4f9b-b5f9-6e2542484658 from the persistent domain config. {{(pid=74994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 11:00:18 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-68734c6d-02a6-4681-a6c3-971774c05251 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 11:00:18 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:00:18 user nova-compute[74994]:   <source dev="/dev/sdd"/>
Nov 28 11:00:18 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:00:18 user nova-compute[74994]:   <serial>dbafc9fb-40fc-4788-8115-7bfe2a0c53cb</serial>
Nov 28 11:00:18 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 11:00:18 user nova-compute[74994]: </disk>
Nov 28 11:00:18 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 11:00:18 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-68734c6d-02a6-4681-a6c3-971774c05251 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Successfully detached device vdb from instance 2f4b631a-46c8-4f9b-b5f9-6e2542484658 from the persistent domain config.
Nov 28 11:00:18 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-68734c6d-02a6-4681-a6c3-971774c05251 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2f4b631a-46c8-4f9b-b5f9-6e2542484658 from the live domain config. {{(pid=74994) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 11:00:18 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-68734c6d-02a6-4681-a6c3-971774c05251 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 11:00:18 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:00:18 user nova-compute[74994]:   <source dev="/dev/sdd"/>
Nov 28 11:00:18 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:00:18 user nova-compute[74994]:   <serial>dbafc9fb-40fc-4788-8115-7bfe2a0c53cb</serial>
Nov 28 11:00:18 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 11:00:18 user nova-compute[74994]: </disk>
Nov 28 11:00:18 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 11:00:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:18 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-68734c6d-02a6-4681-a6c3-971774c05251 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2f4b631a-46c8-4f9b-b5f9-6e2542484658 {{(pid=74994) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 11:00:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:18 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:00:19 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:19 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:00:19 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:00:19 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=7467MB free_disk=25.115421295166016GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 11:00:19 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:00:19 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:00:19 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:19 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:00:19 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance bf357856-2d97-42e8-928d-71d0378f48c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:00:19 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 279e1c4c-36f9-492f-ab3f-1b587347eadd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:00:19 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 759fbcfd-ab13-438f-b860-6393a97d1205 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:00:19 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 20716905-c56a-4729-8c5b-9188502dc477 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:00:19 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 2f4b631a-46c8-4f9b-b5f9-6e2542484658 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:00:19 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance c608eb72-4375-4e2a-aae8-a03d086b72e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:00:19 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 20605acb-092a-4214-a114-750f145d7af8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:00:19 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance b743c491-ece8-4781-9530-b2f38ffc1079 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:00:19 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:00:19 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 14ab0a02-7432-4630-8758-df82d6a17ef8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:00:19 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 11:00:19 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 11:00:19 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Refreshing inventories for resource provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 11:00:19 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Updating ProviderTree inventory for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 11:00:19 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Updating inventory in ProviderTree for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 11:00:19 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Refreshing aggregate associations for resource provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a, aggregates: None {{(pid=74994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 11:00:19 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Refreshing trait associations for resource provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=74994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 11:00:20 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:00:20 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:00:20 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 11:00:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.972s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:00:20 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:00:20 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Cleaning up deleted instances {{(pid=74994) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 11:00:20 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] There are 0 instances to clean {{(pid=74994) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 11:00:21 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Acquiring lock "d1de4238-c33e-48a6-bb4f-240e91e81ea3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:00:21 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "d1de4238-c33e-48a6-bb4f-240e91e81ea3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:00:21 user nova-compute[74994]: DEBUG nova.compute.manager [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 11:00:21 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:00:21 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:00:21 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 11:00:21 user nova-compute[74994]: INFO nova.compute.claims [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Claim successful on node user
Nov 28 11:00:22 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:00:22 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:00:22 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 11:00:22 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:00:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "refresh_cache-759fbcfd-ab13-438f-b860-6393a97d1205" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:00:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquired lock "refresh_cache-759fbcfd-ab13-438f-b860-6393a97d1205" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:00:22 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Forcefully refreshing network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 11:00:22 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:00:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.534s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:00:22 user nova-compute[74994]: DEBUG nova.compute.manager [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 11:00:22 user nova-compute[74994]: DEBUG nova.compute.manager [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 11:00:22 user nova-compute[74994]: DEBUG nova.network.neutron [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 11:00:22 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 11:00:22 user nova-compute[74994]: DEBUG nova.compute.manager [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 11:00:22 user nova-compute[74994]: DEBUG nova.policy [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '18ba016046ac42599094e626d3fdd860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9670a509ac14f41a9f44d7299fd2f30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 11:00:22 user nova-compute[74994]: DEBUG nova.compute.manager [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 11:00:22 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 11:00:22 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Creating image(s)
Nov 28 11:00:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Acquiring lock "/opt/stack/data/nova/instances/d1de4238-c33e-48a6-bb4f-240e91e81ea3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:00:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "/opt/stack/data/nova/instances/d1de4238-c33e-48a6-bb4f-240e91e81ea3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:00:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "/opt/stack/data/nova/instances/d1de4238-c33e-48a6-bb4f-240e91e81ea3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:00:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Acquiring lock "90726bcf004a6699817d06d6d5f3a981dee9e56d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:00:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "90726bcf004a6699817d06d6d5f3a981dee9e56d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:00:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/90726bcf004a6699817d06d6d5f3a981dee9e56d.part --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:23 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Updating instance_info_cache with network_info: [{"id": "7d4a82ba-d222-44bb-baac-6642f24b9528", "address": "fa:16:3e:4f:75:25", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d4a82ba-d2", "ovs_interfaceid": "7d4a82ba-d222-44bb-baac-6642f24b9528", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:00:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Releasing lock "refresh_cache-759fbcfd-ab13-438f-b860-6393a97d1205" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:00:23 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Updated the network info_cache for instance {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 11:00:23 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:00:23 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:00:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/90726bcf004a6699817d06d6d5f3a981dee9e56d.part --force-share --output=json" returned: 0 in 0.199s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:23 user nova-compute[74994]: DEBUG nova.virt.images [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] 72081665-97f0-4d07-85e6-e93aff963a9d was qcow2, converting to raw {{(pid=74994) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 11:00:23 user nova-compute[74994]: DEBUG nova.privsep.utils [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74994) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 11:00:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/90726bcf004a6699817d06d6d5f3a981dee9e56d.part /opt/stack/data/nova/instances/_base/90726bcf004a6699817d06d6d5f3a981dee9e56d.converted {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:23 user nova-compute[74994]: DEBUG nova.network.neutron [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Successfully created port: e3ec524f-0e85-40e1-8817-b9d4b75f9966 {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 11:00:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/90726bcf004a6699817d06d6d5f3a981dee9e56d.part /opt/stack/data/nova/instances/_base/90726bcf004a6699817d06d6d5f3a981dee9e56d.converted" returned: 0 in 0.276s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/90726bcf004a6699817d06d6d5f3a981dee9e56d.converted --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/90726bcf004a6699817d06d6d5f3a981dee9e56d.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "90726bcf004a6699817d06d6d5f3a981dee9e56d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.162s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:00:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/90726bcf004a6699817d06d6d5f3a981dee9e56d --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-eff92cc9-77db-4545-add1-e080fc94b1a6 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Acquiring lock "c608eb72-4375-4e2a-aae8-a03d086b72e8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-eff92cc9-77db-4545-add1-e080fc94b1a6 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Lock "c608eb72-4375-4e2a-aae8-a03d086b72e8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-eff92cc9-77db-4545-add1-e080fc94b1a6 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Acquiring lock "c608eb72-4375-4e2a-aae8-a03d086b72e8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-eff92cc9-77db-4545-add1-e080fc94b1a6 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Lock "c608eb72-4375-4e2a-aae8-a03d086b72e8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-eff92cc9-77db-4545-add1-e080fc94b1a6 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Lock "c608eb72-4375-4e2a-aae8-a03d086b72e8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:00:24 user nova-compute[74994]: INFO nova.compute.manager [None req-eff92cc9-77db-4545-add1-e080fc94b1a6 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Terminating instance
Nov 28 11:00:24 user nova-compute[74994]: DEBUG nova.compute.manager [None req-eff92cc9-77db-4545-add1-e080fc94b1a6 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/90726bcf004a6699817d06d6d5f3a981dee9e56d --force-share --output=json" returned: 0 in 0.238s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Acquiring lock "90726bcf004a6699817d06d6d5f3a981dee9e56d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "90726bcf004a6699817d06d6d5f3a981dee9e56d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/90726bcf004a6699817d06d6d5f3a981dee9e56d --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG nova.network.neutron [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Successfully updated port: e3ec524f-0e85-40e1-8817-b9d4b75f9966 {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Acquiring lock "refresh_cache-d1de4238-c33e-48a6-bb4f-240e91e81ea3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Acquired lock "refresh_cache-d1de4238-c33e-48a6-bb4f-240e91e81ea3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG nova.network.neutron [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG nova.compute.manager [req-3d51407a-fd63-4501-b119-20bd5d15bd89 req-87d4b100-e67b-4e64-812e-1d05a11953c4 service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Received event network-changed-e3ec524f-0e85-40e1-8817-b9d4b75f9966 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG nova.compute.manager [req-3d51407a-fd63-4501-b119-20bd5d15bd89 req-87d4b100-e67b-4e64-812e-1d05a11953c4 service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Refreshing instance network info cache due to event network-changed-e3ec524f-0e85-40e1-8817-b9d4b75f9966. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-3d51407a-fd63-4501-b119-20bd5d15bd89 req-87d4b100-e67b-4e64-812e-1d05a11953c4 service nova] Acquiring lock "refresh_cache-d1de4238-c33e-48a6-bb4f-240e91e81ea3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/90726bcf004a6699817d06d6d5f3a981dee9e56d --force-share --output=json" returned: 0 in 0.232s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/90726bcf004a6699817d06d6d5f3a981dee9e56d,backing_fmt=raw /opt/stack/data/nova/instances/d1de4238-c33e-48a6-bb4f-240e91e81ea3/disk 1073741824 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/90726bcf004a6699817d06d6d5f3a981dee9e56d,backing_fmt=raw /opt/stack/data/nova/instances/d1de4238-c33e-48a6-bb4f-240e91e81ea3/disk 1073741824" returned: 0 in 0.052s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "90726bcf004a6699817d06d6d5f3a981dee9e56d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/90726bcf004a6699817d06d6d5f3a981dee9e56d --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG nova.network.neutron [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/90726bcf004a6699817d06d6d5f3a981dee9e56d --force-share --output=json" returned: 0 in 0.204s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d1de4238-c33e-48a6-bb4f-240e91e81ea3/disk. size=1073741824 {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1de4238-c33e-48a6-bb4f-240e91e81ea3/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG nova.network.neutron [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Updating instance_info_cache with network_info: [{"id": "e3ec524f-0e85-40e1-8817-b9d4b75f9966", "address": "fa:16:3e:99:ce:ce", "network": {"id": "89f2b906-9ef3-4e31-87e5-3e0cd23e8695", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2005181920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9670a509ac14f41a9f44d7299fd2f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3ec524f-0e", "ovs_interfaceid": "e3ec524f-0e85-40e1-8817-b9d4b75f9966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Releasing lock "refresh_cache-d1de4238-c33e-48a6-bb4f-240e91e81ea3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG nova.compute.manager [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Instance network_info: |[{"id": "e3ec524f-0e85-40e1-8817-b9d4b75f9966", "address": "fa:16:3e:99:ce:ce", "network": {"id": "89f2b906-9ef3-4e31-87e5-3e0cd23e8695", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2005181920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9670a509ac14f41a9f44d7299fd2f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3ec524f-0e", "ovs_interfaceid": "e3ec524f-0e85-40e1-8817-b9d4b75f9966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-3d51407a-fd63-4501-b119-20bd5d15bd89 req-87d4b100-e67b-4e64-812e-1d05a11953c4 service nova] Acquired lock "refresh_cache-d1de4238-c33e-48a6-bb4f-240e91e81ea3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG nova.network.neutron [req-3d51407a-fd63-4501-b119-20bd5d15bd89 req-87d4b100-e67b-4e64-812e-1d05a11953c4 service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Refreshing network info cache for port e3ec524f-0e85-40e1-8817-b9d4b75f9966 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1de4238-c33e-48a6-bb4f-240e91e81ea3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Cannot resize image /opt/stack/data/nova/instances/d1de4238-c33e-48a6-bb4f-240e91e81ea3/disk to a smaller size. {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Created local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Ensure instance console log exists: /opt/stack/data/nova/instances/d1de4238-c33e-48a6-bb4f-240e91e81ea3/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Start _get_guest_xml network_info=[{"id": "e3ec524f-0e85-40e1-8817-b9d4b75f9966", "address": "fa:16:3e:99:ce:ce", "network": {"id": "89f2b906-9ef3-4e31-87e5-3e0cd23e8695", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2005181920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9670a509ac14f41a9f44d7299fd2f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3ec524f-0e", "ovs_interfaceid": "e3ec524f-0e85-40e1-8817-b9d4b75f9966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T11:00:19Z,direct_url=<?>,disk_format='qcow2',id=72081665-97f0-4d07-85e6-e93aff963a9d,min_disk=0,min_ram=0,name='tempest-scenario-img--1794239749',owner='b9670a509ac14f41a9f44d7299fd2f30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T11:00:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '72081665-97f0-4d07-85e6-e93aff963a9d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 11:00:24 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Instance destroyed successfully.
Nov 28 11:00:24 user nova-compute[74994]: DEBUG nova.objects.instance [None req-eff92cc9-77db-4545-add1-e080fc94b1a6 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Lazy-loading 'resources' on Instance uuid c608eb72-4375-4e2a-aae8-a03d086b72e8 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:00:24 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:00:24 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:00:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-eff92cc9-77db-4545-add1-e080fc94b1a6 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T10:56:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2008816957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1331166102',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsPFcHXuCq3kbGJDtMMmhIV4dbLKEKBvccID7JXVRtX2m0hXUtB+UaF2Z44+Aof8FA3hDVjNSG6/8w3Oy5AFwAhAf7X79exeFfPY7JAvpS4tXuC4Ysn2gqz/3KAQRfb2w==',key_name='tempest-keypair-1144255784',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:59:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f56f0f99bee04f7baace9d7aa22cffa8',ramdisk_id='',reservation_id='r-f0it11pn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1394089599',owner_user_name='tempest-ServerActionsV293TestJSON-1394089599-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T10:59:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='564e6983bd92417a81d0ec2b5e6253b3',uuid=c608eb72-4375-4e2a-aae8-a03d086b72e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32f4f44f-44b7-47f0-9c06-bd33d3a48216", "address": "fa:16:3e:12:e4:7a", "network": {"id": "d339a2cb-dddd-4921-9ac8-bde483746df2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1820767196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56f0f99bee04f7baace9d7aa22cffa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32f4f44f-44", "ovs_interfaceid": "32f4f44f-44b7-47f0-9c06-bd33d3a48216", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-eff92cc9-77db-4545-add1-e080fc94b1a6 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Converting VIF {"id": "32f4f44f-44b7-47f0-9c06-bd33d3a48216", "address": "fa:16:3e:12:e4:7a", "network": {"id": "d339a2cb-dddd-4921-9ac8-bde483746df2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1820767196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56f0f99bee04f7baace9d7aa22cffa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32f4f44f-44", "ovs_interfaceid": "32f4f44f-44b7-47f0-9c06-bd33d3a48216", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-eff92cc9-77db-4545-add1-e080fc94b1a6 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:e4:7a,bridge_name='br-int',has_traffic_filtering=True,id=32f4f44f-44b7-47f0-9c06-bd33d3a48216,network=Network(d339a2cb-dddd-4921-9ac8-bde483746df2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32f4f44f-44') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG os_vif [None req-eff92cc9-77db-4545-add1-e080fc94b1a6 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:e4:7a,bridge_name='br-int',has_traffic_filtering=True,id=32f4f44f-44b7-47f0-9c06-bd33d3a48216,network=Network(d339a2cb-dddd-4921-9ac8-bde483746df2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32f4f44f-44') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T11:00:19Z,direct_url=<?>,disk_format='qcow2',id=72081665-97f0-4d07-85e6-e93aff963a9d,min_disk=0,min_ram=0,name='tempest-scenario-img--1794239749',owner='b9670a509ac14f41a9f44d7299fd2f30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T11:00:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:00:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-342030530',display_name='tempest-TestMinimumBasicScenario-server-342030530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-342030530',id=29,image_ref='72081665-97f0-4d07-85e6-e93aff963a9d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyVQMduM13BgMZJIMtke6rN9ybjpOOFWz20TU2DvJ+OA7UvylvkmeAOhXrqzo0DECLS+nqoTXK7yvdL4DWRjTgwl0mH1+2xXyPyunJt/UXv2mIQhL1IpGRflfXkBiMUuw==',key_name='tempest-TestMinimumBasicScenario-928079813',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9670a509ac14f41a9f44d7299fd2f30',ramdisk_id='',reservation_id='r-soytlw4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='72081665-97f0-4d07-85e6-e93aff963a9d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-756572202',owner_user_name='tempest-TestMinimumBasicScenario-756572202-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:00:23Z,user_data=None,user_id='18ba016046ac42599094e626d3fdd860',uuid=d1de4238-c33e-48a6-bb4f-240e91e81ea3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3ec524f-0e85-40e1-8817-b9d4b75f9966", "address": "fa:16:3e:99:ce:ce", "network": {"id": "89f2b906-9ef3-4e31-87e5-3e0cd23e8695", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2005181920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9670a509ac14f41a9f44d7299fd2f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3ec524f-0e", "ovs_interfaceid": "e3ec524f-0e85-40e1-8817-b9d4b75f9966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Converting VIF {"id": "e3ec524f-0e85-40e1-8817-b9d4b75f9966", "address": "fa:16:3e:99:ce:ce", "network": {"id": "89f2b906-9ef3-4e31-87e5-3e0cd23e8695", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2005181920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9670a509ac14f41a9f44d7299fd2f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3ec524f-0e", "ovs_interfaceid": "e3ec524f-0e85-40e1-8817-b9d4b75f9966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:ce:ce,bridge_name='br-int',has_traffic_filtering=True,id=e3ec524f-0e85-40e1-8817-b9d4b75f9966,network=Network(89f2b906-9ef3-4e31-87e5-3e0cd23e8695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3ec524f-0e') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:00:24 user nova-compute[74994]: DEBUG nova.objects.instance [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lazy-loading 'pci_devices' on Instance uuid d1de4238-c33e-48a6-bb4f-240e91e81ea3 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap32f4f44f-44, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] End _get_guest_xml xml=<domain type="kvm">
Nov 28 11:00:25 user nova-compute[74994]:   <uuid>d1de4238-c33e-48a6-bb4f-240e91e81ea3</uuid>
Nov 28 11:00:25 user nova-compute[74994]:   <name>instance-0000001d</name>
Nov 28 11:00:25 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 11:00:25 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 11:00:25 user nova-compute[74994]:   <metadata>
Nov 28 11:00:25 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 11:00:25 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 11:00:25 user nova-compute[74994]:       <nova:name>tempest-TestMinimumBasicScenario-server-342030530</nova:name>
Nov 28 11:00:25 user nova-compute[74994]:       <nova:creationTime>2023-11-28 11:00:24</nova:creationTime>
Nov 28 11:00:25 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 11:00:25 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 11:00:25 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 11:00:25 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 11:00:25 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 11:00:25 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 11:00:25 user nova-compute[74994]:       </nova:flavor>
Nov 28 11:00:25 user nova-compute[74994]:       <nova:owner>
Nov 28 11:00:25 user nova-compute[74994]:         <nova:user uuid="18ba016046ac42599094e626d3fdd860">tempest-TestMinimumBasicScenario-756572202-project-member</nova:user>
Nov 28 11:00:25 user nova-compute[74994]:         <nova:project uuid="b9670a509ac14f41a9f44d7299fd2f30">tempest-TestMinimumBasicScenario-756572202</nova:project>
Nov 28 11:00:25 user nova-compute[74994]:       </nova:owner>
Nov 28 11:00:25 user nova-compute[74994]:       <nova:root type="image" uuid="72081665-97f0-4d07-85e6-e93aff963a9d"/>
Nov 28 11:00:25 user nova-compute[74994]:       <nova:ports>
Nov 28 11:00:25 user nova-compute[74994]:         <nova:port uuid="e3ec524f-0e85-40e1-8817-b9d4b75f9966">
Nov 28 11:00:25 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 11:00:25 user nova-compute[74994]:         </nova:port>
Nov 28 11:00:25 user nova-compute[74994]:       </nova:ports>
Nov 28 11:00:25 user nova-compute[74994]:     </nova:instance>
Nov 28 11:00:25 user nova-compute[74994]:   </metadata>
Nov 28 11:00:25 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 11:00:25 user nova-compute[74994]:     <system>
Nov 28 11:00:25 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 11:00:25 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 11:00:25 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 11:00:25 user nova-compute[74994]:       <entry name="serial">d1de4238-c33e-48a6-bb4f-240e91e81ea3</entry>
Nov 28 11:00:25 user nova-compute[74994]:       <entry name="uuid">d1de4238-c33e-48a6-bb4f-240e91e81ea3</entry>
Nov 28 11:00:25 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 11:00:25 user nova-compute[74994]:     </system>
Nov 28 11:00:25 user nova-compute[74994]:   </sysinfo>
Nov 28 11:00:25 user nova-compute[74994]:   <os>
Nov 28 11:00:25 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 11:00:25 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 11:00:25 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 11:00:25 user nova-compute[74994]:   </os>
Nov 28 11:00:25 user nova-compute[74994]:   <features>
Nov 28 11:00:25 user nova-compute[74994]:     <acpi/>
Nov 28 11:00:25 user nova-compute[74994]:     <apic/>
Nov 28 11:00:25 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 11:00:25 user nova-compute[74994]:   </features>
Nov 28 11:00:25 user nova-compute[74994]:   <clock offset="utc">
Nov 28 11:00:25 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 11:00:25 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 11:00:25 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 11:00:25 user nova-compute[74994]:   </clock>
Nov 28 11:00:25 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 11:00:25 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 11:00:25 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 11:00:25 user nova-compute[74994]:   </cpu>
Nov 28 11:00:25 user nova-compute[74994]:   <devices>
Nov 28 11:00:25 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 11:00:25 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 11:00:25 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/d1de4238-c33e-48a6-bb4f-240e91e81ea3/disk"/>
Nov 28 11:00:25 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 11:00:25 user nova-compute[74994]:     </disk>
Nov 28 11:00:25 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 11:00:25 user nova-compute[74994]:       <mac address="fa:16:3e:99:ce:ce"/>
Nov 28 11:00:25 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:00:25 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 11:00:25 user nova-compute[74994]:       <target dev="tape3ec524f-0e"/>
Nov 28 11:00:25 user nova-compute[74994]:     </interface>
Nov 28 11:00:25 user nova-compute[74994]:     <serial type="pty">
Nov 28 11:00:25 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/d1de4238-c33e-48a6-bb4f-240e91e81ea3/console.log" append="off"/>
Nov 28 11:00:25 user nova-compute[74994]:     </serial>
Nov 28 11:00:25 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 11:00:25 user nova-compute[74994]:     <video>
Nov 28 11:00:25 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:00:25 user nova-compute[74994]:     </video>
Nov 28 11:00:25 user nova-compute[74994]:     <rng model="virtio">
Nov 28 11:00:25 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 11:00:25 user nova-compute[74994]:     </rng>
Nov 28 11:00:25 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 11:00:25 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 11:00:25 user nova-compute[74994]:       <stats period="10"/>
Nov 28 11:00:25 user nova-compute[74994]:     </memballoon>
Nov 28 11:00:25 user nova-compute[74994]:   </devices>
Nov 28 11:00:25 user nova-compute[74994]: </domain>
Nov 28 11:00:25 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:00:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-342030530',display_name='tempest-TestMinimumBasicScenario-server-342030530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-342030530',id=29,image_ref='72081665-97f0-4d07-85e6-e93aff963a9d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyVQMduM13BgMZJIMtke6rN9ybjpOOFWz20TU2DvJ+OA7UvylvkmeAOhXrqzo0DECLS+nqoTXK7yvdL4DWRjTgwl0mH1+2xXyPyunJt/UXv2mIQhL1IpGRflfXkBiMUuw==',key_name='tempest-TestMinimumBasicScenario-928079813',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9670a509ac14f41a9f44d7299fd2f30',ramdisk_id='',reservation_id='r-soytlw4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='72081665-97f0-4d07-85e6-e93aff963a9d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-756572202',owner_user_name='tempest-TestMinimumBasicScenario-756572202-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:00:23Z,user_data=None,user_id='18ba016046ac42599094e626d3fdd860',uuid=d1de4238-c33e-48a6-bb4f-240e91e81ea3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3ec524f-0e85-40e1-8817-b9d4b75f9966", "address": "fa:16:3e:99:ce:ce", "network": {"id": "89f2b906-9ef3-4e31-87e5-3e0cd23e8695", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2005181920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9670a509ac14f41a9f44d7299fd2f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3ec524f-0e", "ovs_interfaceid": "e3ec524f-0e85-40e1-8817-b9d4b75f9966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Converting VIF {"id": "e3ec524f-0e85-40e1-8817-b9d4b75f9966", "address": "fa:16:3e:99:ce:ce", "network": {"id": "89f2b906-9ef3-4e31-87e5-3e0cd23e8695", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2005181920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9670a509ac14f41a9f44d7299fd2f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3ec524f-0e", "ovs_interfaceid": "e3ec524f-0e85-40e1-8817-b9d4b75f9966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:ce:ce,bridge_name='br-int',has_traffic_filtering=True,id=e3ec524f-0e85-40e1-8817-b9d4b75f9966,network=Network(89f2b906-9ef3-4e31-87e5-3e0cd23e8695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3ec524f-0e') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG os_vif [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:ce:ce,bridge_name='br-int',has_traffic_filtering=True,id=e3ec524f-0e85-40e1-8817-b9d4b75f9966,network=Network(89f2b906-9ef3-4e31-87e5-3e0cd23e8695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3ec524f-0e') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ff2c6ae4-8b80-4ed0-a1aa-10360a4cd779) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '352fb7fa-1cd9-5d64-ab72-810b9f4b2484', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:25 user nova-compute[74994]: INFO os_vif [None req-eff92cc9-77db-4545-add1-e080fc94b1a6 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:e4:7a,bridge_name='br-int',has_traffic_filtering=True,id=32f4f44f-44b7-47f0-9c06-bd33d3a48216,network=Network(d339a2cb-dddd-4921-9ac8-bde483746df2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32f4f44f-44')
Nov 28 11:00:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eff92cc9-77db-4545-add1-e080fc94b1a6 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff92cc9-77db-4545-add1-e080fc94b1a6 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FuvdZRiP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:00:25 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-eff92cc9-77db-4545-add1-e080fc94b1a6 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:00:25 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-eff92cc9-77db-4545-add1-e080fc94b1a6 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-eff92cc9-77db-4545-add1-e080fc94b1a6 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape3ec524f-0e, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape3ec524f-0e, col_values=(('qos', UUID('d33168ac-c9b3-469e-9f2b-132fde2e90fd')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape3ec524f-0e, col_values=(('external_ids', {'iface-id': 'e3ec524f-0e85-40e1-8817-b9d4b75f9966', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:ce:ce', 'vm-uuid': 'd1de4238-c33e-48a6-bb4f-240e91e81ea3'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:25 user nova-compute[74994]: INFO os_vif [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:ce:ce,bridge_name='br-int',has_traffic_filtering=True,id=e3ec524f-0e85-40e1-8817-b9d4b75f9966,network=Network(89f2b906-9ef3-4e31-87e5-3e0cd23e8695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3ec524f-0e')
Nov 28 11:00:25 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa32255-5c74-4c25-b27c-1756fcbcb01b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff92cc9-77db-4545-add1-e080fc94b1a6 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 11:00:25 user nova-compute[74994]: No targets found.
Nov 28 11:00:25 user nova-compute[74994]: iSNS:
Nov 28 11:00:25 user nova-compute[74994]: No targets found.
Nov 28 11:00:25 user nova-compute[74994]: STATIC:
Nov 28 11:00:25 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2
Nov 28 11:00:25 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:00:25 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:00:25 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb
Nov 28 11:00:25 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:00:25 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:00:25 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b
Nov 28 11:00:25 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:00:25 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:00:25 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8
Nov 28 11:00:25 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:00:25 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:00:25 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de
Nov 28 11:00:25 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:00:25 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:00:25 user nova-compute[74994]: FIRMWARE:
Nov 28 11:00:25 user nova-compute[74994]: No targets found.
Nov 28 11:00:25 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff92cc9-77db-4545-add1-e080fc94b1a6 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 11:00:25 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 11:00:25 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff92cc9-77db-4545-add1-e080fc94b1a6 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1ace12-7e0e-43c4-9535-e2117d58c1b3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d705d3d3-1640-4ed4-8e68-7a77426af10b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff92cc9-77db-4545-add1-e080fc94b1a6 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:00:25 user nova-compute[74994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 11:00:25 user nova-compute[74994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)
Nov 28 11:00:25 user nova-compute[74994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)
Nov 28 11:00:25 user nova-compute[74994]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)
Nov 28 11:00:25 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff92cc9-77db-4545-add1-e080fc94b1a6 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:00:25 user nova-compute[74994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 11:00:25 user nova-compute[74994]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 (non-flash)
Nov 28 11:00:25 user nova-compute[74994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)
Nov 28 11:00:25 user nova-compute[74994]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)
Nov 28 11:00:25 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff92cc9-77db-4545-add1-e080fc94b1a6 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9444d41f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8'): ({'sdc'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-eff92cc9-77db-4545-add1-e080fc94b1a6 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Removing single pathed devices sdc {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] No VIF found with MAC fa:16:3e:99:ce:ce, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[92cc7d9b-63a4-48bc-ae17-b7077143aae9]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[62436363-84eb-432b-bcf8-fd0c7c7f8d46]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-eff92cc9-77db-4545-add1-e080fc94b1a6 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Flushing IO for device /dev/sdc {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4cba907-0638-459b-8697-8f4fd7463f80]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-eff92cc9-77db-4545-add1-e080fc94b1a6 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.063s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd2370c-152f-4395-a1b1-d5b003e84786]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-eff92cc9-77db-4545-add1-e080fc94b1a6 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-eff92cc9-77db-4545-add1-e080fc94b1a6 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] SCSI volumes sdc have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff92cc9-77db-4545-add1-e080fc94b1a6 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fab3e5a-90c2-475e-bb29-9a86681e169e]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff92cc9-77db-4545-add1-e080fc94b1a6 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG nova.network.neutron [req-3d51407a-fd63-4501-b119-20bd5d15bd89 req-87d4b100-e67b-4e64-812e-1d05a11953c4 service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Updated VIF entry in instance network info cache for port e3ec524f-0e85-40e1-8817-b9d4b75f9966. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG nova.network.neutron [req-3d51407a-fd63-4501-b119-20bd5d15bd89 req-87d4b100-e67b-4e64-812e-1d05a11953c4 service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Updating instance_info_cache with network_info: [{"id": "e3ec524f-0e85-40e1-8817-b9d4b75f9966", "address": "fa:16:3e:99:ce:ce", "network": {"id": "89f2b906-9ef3-4e31-87e5-3e0cd23e8695", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2005181920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9670a509ac14f41a9f44d7299fd2f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3ec524f-0e", "ovs_interfaceid": "e3ec524f-0e85-40e1-8817-b9d4b75f9966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d10578-e547-4ffd-aa57-b7e28e7f2efb]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff92cc9-77db-4545-add1-e080fc94b1a6 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8, portal: 172.16.0.220,3260]
Nov 28 11:00:25 user nova-compute[74994]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8, portal: 172.16.0.220,3260] successful.
Nov 28 11:00:25 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-3d51407a-fd63-4501-b119-20bd5d15bd89 req-87d4b100-e67b-4e64-812e-1d05a11953c4 service nova] Releasing lock "refresh_cache-d1de4238-c33e-48a6-bb4f-240e91e81ea3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86619b11-b935-4f21-a4e1-f6d121626ef8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d013cf1a-52f4-48df-85b9-fb7584df17ab]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff92cc9-77db-4545-add1-e080fc94b1a6 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-eff92cc9-77db-4545-add1-e080fc94b1a6 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff92cc9-77db-4545-add1-e080fc94b1a6 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] <== disconnect_volume: return (368ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eff92cc9-77db-4545-add1-e080fc94b1a6 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 11:00:25 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-eff92cc9-77db-4545-add1-e080fc94b1a6 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Deleting instance files /opt/stack/data/nova/instances/c608eb72-4375-4e2a-aae8-a03d086b72e8_del
Nov 28 11:00:25 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-eff92cc9-77db-4545-add1-e080fc94b1a6 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Deletion of /opt/stack/data/nova/instances/c608eb72-4375-4e2a-aae8-a03d086b72e8_del complete
Nov 28 11:00:25 user nova-compute[74994]: INFO nova.compute.manager [None req-eff92cc9-77db-4545-add1-e080fc94b1a6 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Took 1.34 seconds to destroy the instance on the hypervisor.
Nov 28 11:00:25 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-eff92cc9-77db-4545-add1-e080fc94b1a6 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 11:00:25 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 11:00:26 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:00:26 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Took 0.78 seconds to deallocate network for instance.
Nov 28 11:00:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:26 user nova-compute[74994]: DEBUG nova.compute.manager [req-da378513-8314-4a4a-9b99-38e5d0a73fab req-cf7f4c4d-c11f-4397-986d-b7c1481b245f service nova] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Received event network-vif-unplugged-32f4f44f-44b7-47f0-9c06-bd33d3a48216 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:00:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-da378513-8314-4a4a-9b99-38e5d0a73fab req-cf7f4c4d-c11f-4397-986d-b7c1481b245f service nova] Acquiring lock "c608eb72-4375-4e2a-aae8-a03d086b72e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:00:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-da378513-8314-4a4a-9b99-38e5d0a73fab req-cf7f4c4d-c11f-4397-986d-b7c1481b245f service nova] Lock "c608eb72-4375-4e2a-aae8-a03d086b72e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:00:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-da378513-8314-4a4a-9b99-38e5d0a73fab req-cf7f4c4d-c11f-4397-986d-b7c1481b245f service nova] Lock "c608eb72-4375-4e2a-aae8-a03d086b72e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:00:26 user nova-compute[74994]: DEBUG nova.compute.manager [req-da378513-8314-4a4a-9b99-38e5d0a73fab req-cf7f4c4d-c11f-4397-986d-b7c1481b245f service nova] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] No waiting events found dispatching network-vif-unplugged-32f4f44f-44b7-47f0-9c06-bd33d3a48216 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:00:26 user nova-compute[74994]: DEBUG nova.compute.manager [req-da378513-8314-4a4a-9b99-38e5d0a73fab req-cf7f4c4d-c11f-4397-986d-b7c1481b245f service nova] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Received event network-vif-unplugged-32f4f44f-44b7-47f0-9c06-bd33d3a48216 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 11:00:26 user nova-compute[74994]: DEBUG nova.compute.manager [req-da378513-8314-4a4a-9b99-38e5d0a73fab req-cf7f4c4d-c11f-4397-986d-b7c1481b245f service nova] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Received event network-vif-plugged-32f4f44f-44b7-47f0-9c06-bd33d3a48216 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:00:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-da378513-8314-4a4a-9b99-38e5d0a73fab req-cf7f4c4d-c11f-4397-986d-b7c1481b245f service nova] Acquiring lock "c608eb72-4375-4e2a-aae8-a03d086b72e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:00:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-da378513-8314-4a4a-9b99-38e5d0a73fab req-cf7f4c4d-c11f-4397-986d-b7c1481b245f service nova] Lock "c608eb72-4375-4e2a-aae8-a03d086b72e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:00:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-da378513-8314-4a4a-9b99-38e5d0a73fab req-cf7f4c4d-c11f-4397-986d-b7c1481b245f service nova] Lock "c608eb72-4375-4e2a-aae8-a03d086b72e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:00:26 user nova-compute[74994]: DEBUG nova.compute.manager [req-da378513-8314-4a4a-9b99-38e5d0a73fab req-cf7f4c4d-c11f-4397-986d-b7c1481b245f service nova] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] No waiting events found dispatching network-vif-plugged-32f4f44f-44b7-47f0-9c06-bd33d3a48216 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:00:26 user nova-compute[74994]: WARNING nova.compute.manager [req-da378513-8314-4a4a-9b99-38e5d0a73fab req-cf7f4c4d-c11f-4397-986d-b7c1481b245f service nova] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Received unexpected event network-vif-plugged-32f4f44f-44b7-47f0-9c06-bd33d3a48216 for instance with vm_state active and task_state deleting.
Nov 28 11:00:26 user nova-compute[74994]: DEBUG nova.compute.manager [req-da378513-8314-4a4a-9b99-38e5d0a73fab req-cf7f4c4d-c11f-4397-986d-b7c1481b245f service nova] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Received event network-vif-deleted-32f4f44f-44b7-47f0-9c06-bd33d3a48216 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:00:27 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:27 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:27 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:28 user nova-compute[74994]: DEBUG nova.compute.manager [req-65491acb-b010-46b0-8e70-5a8ba8ff4a24 req-0991089b-800d-4482-86fa-5114bb246e0c service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Received event network-vif-plugged-e3ec524f-0e85-40e1-8817-b9d4b75f9966 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:00:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-65491acb-b010-46b0-8e70-5a8ba8ff4a24 req-0991089b-800d-4482-86fa-5114bb246e0c service nova] Acquiring lock "d1de4238-c33e-48a6-bb4f-240e91e81ea3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:00:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-65491acb-b010-46b0-8e70-5a8ba8ff4a24 req-0991089b-800d-4482-86fa-5114bb246e0c service nova] Lock "d1de4238-c33e-48a6-bb4f-240e91e81ea3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:00:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-65491acb-b010-46b0-8e70-5a8ba8ff4a24 req-0991089b-800d-4482-86fa-5114bb246e0c service nova] Lock "d1de4238-c33e-48a6-bb4f-240e91e81ea3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:00:28 user nova-compute[74994]: DEBUG nova.compute.manager [req-65491acb-b010-46b0-8e70-5a8ba8ff4a24 req-0991089b-800d-4482-86fa-5114bb246e0c service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] No waiting events found dispatching network-vif-plugged-e3ec524f-0e85-40e1-8817-b9d4b75f9966 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:00:28 user nova-compute[74994]: WARNING nova.compute.manager [req-65491acb-b010-46b0-8e70-5a8ba8ff4a24 req-0991089b-800d-4482-86fa-5114bb246e0c service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Received unexpected event network-vif-plugged-e3ec524f-0e85-40e1-8817-b9d4b75f9966 for instance with vm_state building and task_state spawning.
Nov 28 11:00:28 user nova-compute[74994]: DEBUG nova.compute.manager [req-65491acb-b010-46b0-8e70-5a8ba8ff4a24 req-0991089b-800d-4482-86fa-5114bb246e0c service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Received event network-vif-plugged-e3ec524f-0e85-40e1-8817-b9d4b75f9966 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:00:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-65491acb-b010-46b0-8e70-5a8ba8ff4a24 req-0991089b-800d-4482-86fa-5114bb246e0c service nova] Acquiring lock "d1de4238-c33e-48a6-bb4f-240e91e81ea3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:00:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-65491acb-b010-46b0-8e70-5a8ba8ff4a24 req-0991089b-800d-4482-86fa-5114bb246e0c service nova] Lock "d1de4238-c33e-48a6-bb4f-240e91e81ea3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:00:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-65491acb-b010-46b0-8e70-5a8ba8ff4a24 req-0991089b-800d-4482-86fa-5114bb246e0c service nova] Lock "d1de4238-c33e-48a6-bb4f-240e91e81ea3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:00:28 user nova-compute[74994]: DEBUG nova.compute.manager [req-65491acb-b010-46b0-8e70-5a8ba8ff4a24 req-0991089b-800d-4482-86fa-5114bb246e0c service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] No waiting events found dispatching network-vif-plugged-e3ec524f-0e85-40e1-8817-b9d4b75f9966 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:00:28 user nova-compute[74994]: WARNING nova.compute.manager [req-65491acb-b010-46b0-8e70-5a8ba8ff4a24 req-0991089b-800d-4482-86fa-5114bb246e0c service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Received unexpected event network-vif-plugged-e3ec524f-0e85-40e1-8817-b9d4b75f9966 for instance with vm_state building and task_state spawning.
Nov 28 11:00:28 user nova-compute[74994]: DEBUG nova.compute.manager [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 11:00:28 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 11:00:28 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Instance spawned successfully.
Nov 28 11:00:28 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 11:00:28 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:00:28 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:00:28 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:00:28 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:00:28 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:00:28 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:00:28 user nova-compute[74994]: INFO nova.compute.manager [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Took 6.05 seconds to spawn the instance on the hypervisor.
Nov 28 11:00:28 user nova-compute[74994]: DEBUG nova.compute.manager [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 11:00:28 user nova-compute[74994]: INFO nova.compute.manager [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Took 7.04 seconds to build instance.
Nov 28 11:00:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4f1b24e6-929d-4165-8c87-f1a8209b8fce tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "d1de4238-c33e-48a6-bb4f-240e91e81ea3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.132s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:00:29 user nova-compute[74994]: INFO nova.compute.manager [None req-eff92cc9-77db-4545-add1-e080fc94b1a6 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Took 2.94 seconds to detach 1 volumes for instance.
Nov 28 11:00:29 user nova-compute[74994]: DEBUG nova.compute.manager [None req-eff92cc9-77db-4545-add1-e080fc94b1a6 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] [instance: c608eb72-4375-4e2a-aae8-a03d086b72e8] Deleting volume: 86619b11-b935-4f21-a4e1-f6d121626ef8 {{(pid=74994) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 11:00:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-eff92cc9-77db-4545-add1-e080fc94b1a6 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:00:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-eff92cc9-77db-4545-add1-e080fc94b1a6 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:00:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:29 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-eff92cc9-77db-4545-add1-e080fc94b1a6 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:00:29 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-eff92cc9-77db-4545-add1-e080fc94b1a6 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:00:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-eff92cc9-77db-4545-add1-e080fc94b1a6 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.603s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:00:30 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-eff92cc9-77db-4545-add1-e080fc94b1a6 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Deleted allocations for instance c608eb72-4375-4e2a-aae8-a03d086b72e8
Nov 28 11:00:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-eff92cc9-77db-4545-add1-e080fc94b1a6 tempest-ServerActionsV293TestJSON-1394089599 tempest-ServerActionsV293TestJSON-1394089599-project-member] Lock "c608eb72-4375-4e2a-aae8-a03d086b72e8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.988s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:00:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "7e67fb47-500c-4e85-b384-27408ec622a9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:00:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "7e67fb47-500c-4e85-b384-27408ec622a9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:00:37 user nova-compute[74994]: DEBUG nova.compute.manager [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 11:00:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:00:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:00:37 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 11:00:37 user nova-compute[74994]: INFO nova.compute.claims [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Claim successful on node user
Nov 28 11:00:37 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:00:37 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:00:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.503s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:00:37 user nova-compute[74994]: DEBUG nova.compute.manager [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 11:00:37 user nova-compute[74994]: DEBUG nova.compute.manager [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 11:00:37 user nova-compute[74994]: DEBUG nova.network.neutron [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 11:00:37 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 11:00:37 user nova-compute[74994]: DEBUG nova.compute.manager [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 11:00:37 user nova-compute[74994]: DEBUG nova.policy [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c49cba00cff4c4b80080c5f917b4176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '612ae9ec21ad40a4b68e0926843874ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 11:00:37 user nova-compute[74994]: INFO nova.virt.block_device [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Booting with volume-backed-image aa939d1b-b8a6-4391-935b-0191bf5ccd0a at /dev/vda
Nov 28 11:00:38 user nova-compute[74994]: DEBUG nova.network.neutron [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Successfully created port: 3787892f-48da-4e39-8c41-8fdb94950e59 {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 11:00:38 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-68734c6d-02a6-4681-a6c3-971774c05251 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2f4b631a-46c8-4f9b-b5f9-6e2542484658 is timed out.
Nov 28 11:00:38 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-68734c6d-02a6-4681-a6c3-971774c05251 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Successfully detached device vdb from instance 2f4b631a-46c8-4f9b-b5f9-6e2542484658 from the live domain config.
Nov 28 11:00:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68734c6d-02a6-4681-a6c3-971774c05251 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 11:00:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-68734c6d-02a6-4681-a6c3-971774c05251 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXFPpJyM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:00:38 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-68734c6d-02a6-4681-a6c3-971774c05251 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:00:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-68734c6d-02a6-4681-a6c3-971774c05251 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:00:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-68734c6d-02a6-4681-a6c3-971774c05251 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:00:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:38 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8eb1e8-e618-4880-8922-7169d2985755]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:00:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-68734c6d-02a6-4681-a6c3-971774c05251 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 11:00:38 user nova-compute[74994]: No targets found.
Nov 28 11:00:38 user nova-compute[74994]: iSNS:
Nov 28 11:00:38 user nova-compute[74994]: No targets found.
Nov 28 11:00:38 user nova-compute[74994]: STATIC:
Nov 28 11:00:38 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2
Nov 28 11:00:38 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:00:38 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:00:38 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb
Nov 28 11:00:38 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:00:38 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:00:38 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b
Nov 28 11:00:38 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:00:38 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:00:38 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de
Nov 28 11:00:38 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:00:38 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:00:38 user nova-compute[74994]: FIRMWARE:
Nov 28 11:00:38 user nova-compute[74994]: No targets found.
Nov 28 11:00:38 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:00:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-68734c6d-02a6-4681-a6c3-971774c05251 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 11:00:38 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 11:00:38 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 11:00:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-68734c6d-02a6-4681-a6c3-971774c05251 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 11:00:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:38 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[de98d017-fa4c-4faa-b2d1-b83c42a85182]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:00:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:38 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9f1b82-1fb4-4a19-aae1-ffa36754bdab]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:00:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-68734c6d-02a6-4681-a6c3-971774c05251 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:00:38 user nova-compute[74994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 11:00:38 user nova-compute[74994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)
Nov 28 11:00:38 user nova-compute[74994]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)
Nov 28 11:00:38 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:00:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-68734c6d-02a6-4681-a6c3-971774c05251 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:00:38 user nova-compute[74994]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb (non-flash)
Nov 28 11:00:38 user nova-compute[74994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)
Nov 28 11:00:38 user nova-compute[74994]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)
Nov 28 11:00:38 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:00:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-68734c6d-02a6-4681-a6c3-971774c05251 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb94447f7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb'): ({'sdd'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 11:00:38 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-68734c6d-02a6-4681-a6c3-971774c05251 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Removing single pathed devices sdd {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 11:00:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:38 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef23a1e-1fa9-4038-83d5-ba476ed64928]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:00:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:38 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4c7a4f-68bd-4b21-a97c-a15cae26e3e9]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:00:38 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-68734c6d-02a6-4681-a6c3-971774c05251 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Flushing IO for device /dev/sdd {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 11:00:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:38 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ec6f96-cb96-4322-ac11-f5244edabf05]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:00:38 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-68734c6d-02a6-4681-a6c3-971774c05251 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 11:00:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:38 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8914fa-c458-46ff-b7a9-5438571c0b25]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:00:38 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-68734c6d-02a6-4681-a6c3-971774c05251 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 11:00:38 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-68734c6d-02a6-4681-a6c3-971774c05251 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] SCSI volumes sdd have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 11:00:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-68734c6d-02a6-4681-a6c3-971774c05251 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 11:00:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:38 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[35db8768-da46-41ba-9320-390d108733cd]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:00:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-68734c6d-02a6-4681-a6c3-971774c05251 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:00:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:38 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f641fc28-b281-419f-8334-ff5b3afa0ac8]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:00:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-68734c6d-02a6-4681-a6c3-971774c05251 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb, portal: 172.16.0.220,3260]
Nov 28 11:00:38 user nova-compute[74994]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb, portal: 172.16.0.220,3260] successful.
Nov 28 11:00:38 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:00:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbafc9fb-40fc-4788-8115-7bfe2a0c53cb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:38 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8dd8e4f-0483-483d-86e1-a16e22c60f94]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:00:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-68734c6d-02a6-4681-a6c3-971774c05251 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:00:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-68734c6d-02a6-4681-a6c3-971774c05251 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:00:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-68734c6d-02a6-4681-a6c3-971774c05251 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] <== disconnect_volume: return (350ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:00:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68734c6d-02a6-4681-a6c3-971774c05251 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 11:00:39 user nova-compute[74994]: DEBUG nova.network.neutron [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Successfully updated port: 3787892f-48da-4e39-8c41-8fdb94950e59 {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 11:00:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "refresh_cache-7e67fb47-500c-4e85-b384-27408ec622a9" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:00:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquired lock "refresh_cache-7e67fb47-500c-4e85-b384-27408ec622a9" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:00:39 user nova-compute[74994]: DEBUG nova.network.neutron [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 11:00:39 user nova-compute[74994]: DEBUG nova.compute.manager [req-66206fc2-ffad-4360-b889-e3437c16d2e5 req-9fcc2386-5827-439c-8a0b-1709bd8fc2b7 service nova] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Received event network-changed-3787892f-48da-4e39-8c41-8fdb94950e59 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:00:39 user nova-compute[74994]: DEBUG nova.compute.manager [req-66206fc2-ffad-4360-b889-e3437c16d2e5 req-9fcc2386-5827-439c-8a0b-1709bd8fc2b7 service nova] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Refreshing instance network info cache due to event network-changed-3787892f-48da-4e39-8c41-8fdb94950e59. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:00:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-66206fc2-ffad-4360-b889-e3437c16d2e5 req-9fcc2386-5827-439c-8a0b-1709bd8fc2b7 service nova] Acquiring lock "refresh_cache-7e67fb47-500c-4e85-b384-27408ec622a9" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:00:39 user nova-compute[74994]: DEBUG nova.network.neutron [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 11:00:39 user nova-compute[74994]: DEBUG nova.network.neutron [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Updating instance_info_cache with network_info: [{"id": "3787892f-48da-4e39-8c41-8fdb94950e59", "address": "fa:16:3e:75:4f:64", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3787892f-48", "ovs_interfaceid": "3787892f-48da-4e39-8c41-8fdb94950e59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:00:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Releasing lock "refresh_cache-7e67fb47-500c-4e85-b384-27408ec622a9" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:00:39 user nova-compute[74994]: DEBUG nova.compute.manager [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Instance network_info: |[{"id": "3787892f-48da-4e39-8c41-8fdb94950e59", "address": "fa:16:3e:75:4f:64", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3787892f-48", "ovs_interfaceid": "3787892f-48da-4e39-8c41-8fdb94950e59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 11:00:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-66206fc2-ffad-4360-b889-e3437c16d2e5 req-9fcc2386-5827-439c-8a0b-1709bd8fc2b7 service nova] Acquired lock "refresh_cache-7e67fb47-500c-4e85-b384-27408ec622a9" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:00:39 user nova-compute[74994]: DEBUG nova.network.neutron [req-66206fc2-ffad-4360-b889-e3437c16d2e5 req-9fcc2386-5827-439c-8a0b-1709bd8fc2b7 service nova] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Refreshing network info cache for port 3787892f-48da-4e39-8c41-8fdb94950e59 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:00:39 user nova-compute[74994]: DEBUG nova.network.neutron [req-66206fc2-ffad-4360-b889-e3437c16d2e5 req-9fcc2386-5827-439c-8a0b-1709bd8fc2b7 service nova] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Updated VIF entry in instance network info cache for port 3787892f-48da-4e39-8c41-8fdb94950e59. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:00:39 user nova-compute[74994]: DEBUG nova.network.neutron [req-66206fc2-ffad-4360-b889-e3437c16d2e5 req-9fcc2386-5827-439c-8a0b-1709bd8fc2b7 service nova] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Updating instance_info_cache with network_info: [{"id": "3787892f-48da-4e39-8c41-8fdb94950e59", "address": "fa:16:3e:75:4f:64", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3787892f-48", "ovs_interfaceid": "3787892f-48da-4e39-8c41-8fdb94950e59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:00:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-66206fc2-ffad-4360-b889-e3437c16d2e5 req-9fcc2386-5827-439c-8a0b-1709bd8fc2b7 service nova] Releasing lock "refresh_cache-7e67fb47-500c-4e85-b384-27408ec622a9" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:00:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:00:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:00:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:00:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:00:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:43 user nova-compute[74994]: DEBUG nova.objects.instance [None req-68734c6d-02a6-4681-a6c3-971774c05251 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lazy-loading 'flavor' on Instance uuid 2f4b631a-46c8-4f9b-b5f9-6e2542484658 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:00:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-68734c6d-02a6-4681-a6c3-971774c05251 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 25.397s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:00:43 user nova-compute[74994]: DEBUG os_brick.utils [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:00:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:43 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[57043469-007d-41d0-b2ad-2128d48a7831]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:00:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:43 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[faff9e66-4fc4-4129-9554-bda311e04661]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:00:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:43 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ab2336-4852-4b22-a8d7-9d07bb10b0fd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:00:43 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[655bb13b-3cf3-4291-b655-1e15152b0f7a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:00:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:00:43 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 11:00:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:00:43 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 11:00:43 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[36264768-3279-42e6-b625-128efae9bd9f]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:00:43 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 11:00:43 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 11:00:43 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 11:00:43 user nova-compute[74994]: DEBUG os_brick.utils [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:00:43 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Updating existing volume attachment record: ca68914b-3353-4125-8e65-aab022316dd6 {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 11:00:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-fae0725e-a44b-44e8-b07f-7aa0ffb5bf5c tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Acquiring lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:00:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-fae0725e-a44b-44e8-b07f-7aa0ffb5bf5c tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:00:43 user nova-compute[74994]: DEBUG nova.compute.manager [None req-fae0725e-a44b-44e8-b07f-7aa0ffb5bf5c tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 11:00:43 user nova-compute[74994]: DEBUG nova.compute.manager [None req-fae0725e-a44b-44e8-b07f-7aa0ffb5bf5c tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74994) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 28 11:00:43 user nova-compute[74994]: DEBUG nova.objects.instance [None req-fae0725e-a44b-44e8-b07f-7aa0ffb5bf5c tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lazy-loading 'flavor' on Instance uuid 2f4b631a-46c8-4f9b-b5f9-6e2542484658 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:00:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:44 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:44 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:44 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:44 user nova-compute[74994]: DEBUG nova.compute.manager [req-098afbbd-ac89-4d0d-9513-aae7d5bcc8a8 req-e0e9cc71-d47f-4859-865f-a4fe5f348756 service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Received event network-vif-unplugged-068080a2-5847-4053-a463-9fc29cb64bb4 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:00:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-098afbbd-ac89-4d0d-9513-aae7d5bcc8a8 req-e0e9cc71-d47f-4859-865f-a4fe5f348756 service nova] Acquiring lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:00:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-098afbbd-ac89-4d0d-9513-aae7d5bcc8a8 req-e0e9cc71-d47f-4859-865f-a4fe5f348756 service nova] Lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:00:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-098afbbd-ac89-4d0d-9513-aae7d5bcc8a8 req-e0e9cc71-d47f-4859-865f-a4fe5f348756 service nova] Lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:00:44 user nova-compute[74994]: DEBUG nova.compute.manager [req-098afbbd-ac89-4d0d-9513-aae7d5bcc8a8 req-e0e9cc71-d47f-4859-865f-a4fe5f348756 service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] No waiting events found dispatching network-vif-unplugged-068080a2-5847-4053-a463-9fc29cb64bb4 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:00:44 user nova-compute[74994]: WARNING nova.compute.manager [req-098afbbd-ac89-4d0d-9513-aae7d5bcc8a8 req-e0e9cc71-d47f-4859-865f-a4fe5f348756 service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Received unexpected event network-vif-unplugged-068080a2-5847-4053-a463-9fc29cb64bb4 for instance with vm_state active and task_state powering-off.
Nov 28 11:00:44 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:44 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:44 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Instance destroyed successfully.
Nov 28 11:00:44 user nova-compute[74994]: DEBUG nova.compute.manager [None req-fae0725e-a44b-44e8-b07f-7aa0ffb5bf5c tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 11:00:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-fae0725e-a44b-44e8-b07f-7aa0ffb5bf5c tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.851s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:00:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:46 user nova-compute[74994]: DEBUG nova.compute.manager [req-45613bbb-f0b7-470b-9b47-df9745876a75 req-6fdf5ffa-bb9c-4eae-afc4-81433ce31a10 service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Received event network-vif-plugged-068080a2-5847-4053-a463-9fc29cb64bb4 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:00:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-45613bbb-f0b7-470b-9b47-df9745876a75 req-6fdf5ffa-bb9c-4eae-afc4-81433ce31a10 service nova] Acquiring lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:00:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-45613bbb-f0b7-470b-9b47-df9745876a75 req-6fdf5ffa-bb9c-4eae-afc4-81433ce31a10 service nova] Lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:00:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-45613bbb-f0b7-470b-9b47-df9745876a75 req-6fdf5ffa-bb9c-4eae-afc4-81433ce31a10 service nova] Lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:00:46 user nova-compute[74994]: DEBUG nova.compute.manager [req-45613bbb-f0b7-470b-9b47-df9745876a75 req-6fdf5ffa-bb9c-4eae-afc4-81433ce31a10 service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] No waiting events found dispatching network-vif-plugged-068080a2-5847-4053-a463-9fc29cb64bb4 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:00:46 user nova-compute[74994]: WARNING nova.compute.manager [req-45613bbb-f0b7-470b-9b47-df9745876a75 req-6fdf5ffa-bb9c-4eae-afc4-81433ce31a10 service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Received unexpected event network-vif-plugged-068080a2-5847-4053-a463-9fc29cb64bb4 for instance with vm_state stopped and task_state None.
Nov 28 11:00:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG nova.compute.manager [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 11:00:51 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Creating image(s)
Nov 28 11:00:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Did not create local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Ensure instance console log exists: /opt/stack/data/nova/instances/7e67fb47-500c-4e85-b384-27408ec622a9/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Start _get_guest_xml network_info=[{"id": "3787892f-48da-4e39-8c41-8fdb94950e59", "address": "fa:16:3e:75:4f:64", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3787892f-48", "ovs_interfaceid": "3787892f-48da-4e39-8c41-8fdb94950e59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zNJeKmhr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7e67fb47-500c-4e85-b384-27408ec622a9', 'attached_at': '', 'detached_at': '', 'volume_id': '8e5e838a-f84b-4636-86e1-86a3de5fd7dd', 'serial': '8e5e838a-f84b-4636-86e1-86a3de5fd7dd'}, 'attachment_id': 'ca68914b-3353-4125-8e65-aab022316dd6', 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 11:00:51 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:00:51 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:00:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zNJeKmhr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:00:51 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:00:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:00:51 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:00:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:00:51 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 11:00:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf60ced-861b-4b5f-b6d3-97ada44162fb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 11:00:51 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[327b9614-e6fc-4c3b-8487-974c3c745d3a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd] added
Nov 28 11:00:51 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bcdd483-ab68-4324-9490-f5cabdea9aa3]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3b0e87-808d-4b39-8acd-7abc5077fe1c]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zNJeKmhr {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zNJeKmhr" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[487e4257-aba2-4300-8305-2f0de0921303]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zNJeKmhr'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[308141ae-a9d6-45db-a6c0-9056a6c95edc]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7759c85b-a9ce-414c-ae8d-16734be5ebf0]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7c98822-718e-4277-bce3-d7f4f07500e4 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:00:51 user nova-compute[74994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)
Nov 28 11:00:51 user nova-compute[74994]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)
Nov 28 11:00:51 user nova-compute[74994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7c98822-718e-4277-bce3-d7f4f07500e4 (non-flash)
Nov 28 11:00:51 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:00:51 user nova-compute[74994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)
Nov 28 11:00:51 user nova-compute[74994]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)
Nov 28 11:00:51 user nova-compute[74994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7c98822-718e-4277-bce3-d7f4f07500e4 (non-flash)
Nov 28 11:00:51 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8dc90e0-34bb-48c2-b6d7-86b9fb2ff8cc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd, portal: 172.16.0.220,3260]
Nov 28 11:00:51 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd, portal: 172.16.0.220,3260] successful.
Nov 28 11:00:51 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6707ebfe-2bd8-40d1-934a-fc1fafccc969]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[952a66f9-86a4-4fa9-a84b-d0d8d6b56963]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7c98822-718e-4277-bce3-d7f4f07500e4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:00:51 user nova-compute[74994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)
Nov 28 11:00:51 user nova-compute[74994]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)
Nov 28 11:00:51 user nova-compute[74994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7c98822-718e-4277-bce3-d7f4f07500e4 (non-flash)
Nov 28 11:00:51 user nova-compute[74994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)
Nov 28 11:00:51 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:00:51 user nova-compute[74994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)
Nov 28 11:00:51 user nova-compute[74994]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)
Nov 28 11:00:51 user nova-compute[74994]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7c98822-718e-4277-bce3-d7f4f07500e4 (non-flash)
Nov 28 11:00:51 user nova-compute[74994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)
Nov 28 11:00:51 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] HCTL ('35', '-', '-', 0) found on session 32 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9512c78f-431e-4738-841b-047e3c4b5ad8]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:00:51 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: None {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 11:00:52 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 11:00:52 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zNJeKmhr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 11:00:52 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:00:52 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '26363313065616137', 'path': '/dev/sdd'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:00:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363313065616137', 'path': '/dev/sdd'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 11:00:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1778676797',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1778676797',id=30,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='612ae9ec21ad40a4b68e0926843874ae',ramdisk_id='',reservation_id='r-bqvy1wtv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-332508527',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:00:38Z,user_data=None,user_id='6c49cba00cff4c4b80080c5f917b4176',uuid=7e67fb47-500c-4e85-b384-27408ec622a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3787892f-48da-4e39-8c41-8fdb94950e59", "address": "fa:16:3e:75:4f:64", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3787892f-48", "ovs_interfaceid": "3787892f-48da-4e39-8c41-8fdb94950e59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 11:00:52 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Converting VIF {"id": "3787892f-48da-4e39-8c41-8fdb94950e59", "address": "fa:16:3e:75:4f:64", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3787892f-48", "ovs_interfaceid": "3787892f-48da-4e39-8c41-8fdb94950e59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:00:52 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:4f:64,bridge_name='br-int',has_traffic_filtering=True,id=3787892f-48da-4e39-8c41-8fdb94950e59,network=Network(a1692a13-d1d7-4df6-bfc0-54f231846889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3787892f-48') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:00:52 user nova-compute[74994]: DEBUG nova.objects.instance [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e67fb47-500c-4e85-b384-27408ec622a9 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:00:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] End _get_guest_xml xml=<domain type="kvm">
Nov 28 11:00:52 user nova-compute[74994]:   <uuid>7e67fb47-500c-4e85-b384-27408ec622a9</uuid>
Nov 28 11:00:52 user nova-compute[74994]:   <name>instance-0000001e</name>
Nov 28 11:00:52 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 11:00:52 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 11:00:52 user nova-compute[74994]:   <metadata>
Nov 28 11:00:52 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 11:00:52 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 11:00:52 user nova-compute[74994]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1778676797</nova:name>
Nov 28 11:00:52 user nova-compute[74994]:       <nova:creationTime>2023-11-28 11:00:51</nova:creationTime>
Nov 28 11:00:52 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 11:00:52 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 11:00:52 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 11:00:52 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 11:00:52 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 11:00:52 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 11:00:52 user nova-compute[74994]:       </nova:flavor>
Nov 28 11:00:52 user nova-compute[74994]:       <nova:owner>
Nov 28 11:00:52 user nova-compute[74994]:         <nova:user uuid="6c49cba00cff4c4b80080c5f917b4176">tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member</nova:user>
Nov 28 11:00:52 user nova-compute[74994]:         <nova:project uuid="612ae9ec21ad40a4b68e0926843874ae">tempest-ServerBootFromVolumeStableRescueTest-332508527</nova:project>
Nov 28 11:00:52 user nova-compute[74994]:       </nova:owner>
Nov 28 11:00:52 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 11:00:52 user nova-compute[74994]:       <nova:ports>
Nov 28 11:00:52 user nova-compute[74994]:         <nova:port uuid="3787892f-48da-4e39-8c41-8fdb94950e59">
Nov 28 11:00:52 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 11:00:52 user nova-compute[74994]:         </nova:port>
Nov 28 11:00:52 user nova-compute[74994]:       </nova:ports>
Nov 28 11:00:52 user nova-compute[74994]:     </nova:instance>
Nov 28 11:00:52 user nova-compute[74994]:   </metadata>
Nov 28 11:00:52 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 11:00:52 user nova-compute[74994]:     <system>
Nov 28 11:00:52 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 11:00:52 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 11:00:52 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 11:00:52 user nova-compute[74994]:       <entry name="serial">7e67fb47-500c-4e85-b384-27408ec622a9</entry>
Nov 28 11:00:52 user nova-compute[74994]:       <entry name="uuid">7e67fb47-500c-4e85-b384-27408ec622a9</entry>
Nov 28 11:00:52 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 11:00:52 user nova-compute[74994]:     </system>
Nov 28 11:00:52 user nova-compute[74994]:   </sysinfo>
Nov 28 11:00:52 user nova-compute[74994]:   <os>
Nov 28 11:00:52 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 11:00:52 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 11:00:52 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 11:00:52 user nova-compute[74994]:   </os>
Nov 28 11:00:52 user nova-compute[74994]:   <features>
Nov 28 11:00:52 user nova-compute[74994]:     <acpi/>
Nov 28 11:00:52 user nova-compute[74994]:     <apic/>
Nov 28 11:00:52 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 11:00:52 user nova-compute[74994]:   </features>
Nov 28 11:00:52 user nova-compute[74994]:   <clock offset="utc">
Nov 28 11:00:52 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 11:00:52 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 11:00:52 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 11:00:52 user nova-compute[74994]:   </clock>
Nov 28 11:00:52 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 11:00:52 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 11:00:52 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 11:00:52 user nova-compute[74994]:   </cpu>
Nov 28 11:00:52 user nova-compute[74994]:   <devices>
Nov 28 11:00:52 user nova-compute[74994]:     <disk type="block" device="disk">
Nov 28 11:00:52 user nova-compute[74994]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:00:52 user nova-compute[74994]:       <source dev="/dev/sdd"/>
Nov 28 11:00:52 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 11:00:52 user nova-compute[74994]:       <serial>8e5e838a-f84b-4636-86e1-86a3de5fd7dd</serial>
Nov 28 11:00:52 user nova-compute[74994]:     </disk>
Nov 28 11:00:52 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 11:00:52 user nova-compute[74994]:       <mac address="fa:16:3e:75:4f:64"/>
Nov 28 11:00:52 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:00:52 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 11:00:52 user nova-compute[74994]:       <target dev="tap3787892f-48"/>
Nov 28 11:00:52 user nova-compute[74994]:     </interface>
Nov 28 11:00:52 user nova-compute[74994]:     <serial type="pty">
Nov 28 11:00:52 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/7e67fb47-500c-4e85-b384-27408ec622a9/console.log" append="off"/>
Nov 28 11:00:52 user nova-compute[74994]:     </serial>
Nov 28 11:00:52 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 11:00:52 user nova-compute[74994]:     <video>
Nov 28 11:00:52 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:00:52 user nova-compute[74994]:     </video>
Nov 28 11:00:52 user nova-compute[74994]:     <rng model="virtio">
Nov 28 11:00:52 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 11:00:52 user nova-compute[74994]:     </rng>
Nov 28 11:00:52 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 11:00:52 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 11:00:52 user nova-compute[74994]:       <stats period="10"/>
Nov 28 11:00:52 user nova-compute[74994]:     </memballoon>
Nov 28 11:00:52 user nova-compute[74994]:   </devices>
Nov 28 11:00:52 user nova-compute[74994]: </domain>
Nov 28 11:00:52 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 11:00:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1778676797',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1778676797',id=30,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='612ae9ec21ad40a4b68e0926843874ae',ramdisk_id='',reservation_id='r-bqvy1wtv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-332508527',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:00:38Z,user_data=None,user_id='6c49cba00cff4c4b80080c5f917b4176',uuid=7e67fb47-500c-4e85-b384-27408ec622a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3787892f-48da-4e39-8c41-8fdb94950e59", "address": "fa:16:3e:75:4f:64", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3787892f-48", "ovs_interfaceid": "3787892f-48da-4e39-8c41-8fdb94950e59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 11:00:52 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Converting VIF {"id": "3787892f-48da-4e39-8c41-8fdb94950e59", "address": "fa:16:3e:75:4f:64", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3787892f-48", "ovs_interfaceid": "3787892f-48da-4e39-8c41-8fdb94950e59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:00:52 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:4f:64,bridge_name='br-int',has_traffic_filtering=True,id=3787892f-48da-4e39-8c41-8fdb94950e59,network=Network(a1692a13-d1d7-4df6-bfc0-54f231846889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3787892f-48') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:00:52 user nova-compute[74994]: DEBUG os_vif [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:4f:64,bridge_name='br-int',has_traffic_filtering=True,id=3787892f-48da-4e39-8c41-8fdb94950e59,network=Network(a1692a13-d1d7-4df6-bfc0-54f231846889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3787892f-48') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 11:00:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:00:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 11:00:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'be399d43-23a8-5a76-8208-fc94557e8bf3', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:00:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:00:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3787892f-48, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:00:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3787892f-48, col_values=(('qos', UUID('dd90c079-e7b2-42f9-963f-53d157a9a39c')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:00:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3787892f-48, col_values=(('external_ids', {'iface-id': '3787892f-48da-4e39-8c41-8fdb94950e59', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:4f:64', 'vm-uuid': '7e67fb47-500c-4e85-b384-27408ec622a9'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:00:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:00:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:52 user nova-compute[74994]: INFO os_vif [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:4f:64,bridge_name='br-int',has_traffic_filtering=True,id=3787892f-48da-4e39-8c41-8fdb94950e59,network=Network(a1692a13-d1d7-4df6-bfc0-54f231846889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3787892f-48')
Nov 28 11:00:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:00:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] No VIF found with MAC fa:16:3e:75:4f:64, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:00:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:54 user nova-compute[74994]: DEBUG nova.compute.manager [req-db474673-70ed-41de-82c0-be60da94458f req-b86b3427-25a8-4c74-b566-c6d3341d41d2 service nova] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Received event network-vif-plugged-3787892f-48da-4e39-8c41-8fdb94950e59 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:00:54 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-db474673-70ed-41de-82c0-be60da94458f req-b86b3427-25a8-4c74-b566-c6d3341d41d2 service nova] Acquiring lock "7e67fb47-500c-4e85-b384-27408ec622a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:00:54 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-db474673-70ed-41de-82c0-be60da94458f req-b86b3427-25a8-4c74-b566-c6d3341d41d2 service nova] Lock "7e67fb47-500c-4e85-b384-27408ec622a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:00:54 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-db474673-70ed-41de-82c0-be60da94458f req-b86b3427-25a8-4c74-b566-c6d3341d41d2 service nova] Lock "7e67fb47-500c-4e85-b384-27408ec622a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:00:54 user nova-compute[74994]: DEBUG nova.compute.manager [req-db474673-70ed-41de-82c0-be60da94458f req-b86b3427-25a8-4c74-b566-c6d3341d41d2 service nova] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] No waiting events found dispatching network-vif-plugged-3787892f-48da-4e39-8c41-8fdb94950e59 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:00:54 user nova-compute[74994]: WARNING nova.compute.manager [req-db474673-70ed-41de-82c0-be60da94458f req-b86b3427-25a8-4c74-b566-c6d3341d41d2 service nova] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Received unexpected event network-vif-plugged-3787892f-48da-4e39-8c41-8fdb94950e59 for instance with vm_state building and task_state spawning.
Nov 28 11:00:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:56 user nova-compute[74994]: DEBUG nova.compute.manager [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 11:00:56 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 11:00:56 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Instance spawned successfully.
Nov 28 11:00:56 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 11:00:56 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:00:56 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:00:56 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:00:56 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:00:56 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:00:56 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:00:56 user nova-compute[74994]: INFO nova.compute.manager [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Took 4.90 seconds to spawn the instance on the hypervisor.
Nov 28 11:00:56 user nova-compute[74994]: DEBUG nova.compute.manager [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 11:00:56 user nova-compute[74994]: INFO nova.compute.manager [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Took 19.00 seconds to build instance.
Nov 28 11:00:56 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-2bd61811-5e99-4abb-b8db-d5b7d44e76b8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "7e67fb47-500c-4e85-b384-27408ec622a9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.120s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:00:56 user nova-compute[74994]: DEBUG nova.compute.manager [req-871ef9a2-3899-406e-8acd-12457ab9e4d5 req-e3525508-3ee7-4f47-90e6-8ee97a34e492 service nova] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Received event network-vif-plugged-3787892f-48da-4e39-8c41-8fdb94950e59 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:00:56 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-871ef9a2-3899-406e-8acd-12457ab9e4d5 req-e3525508-3ee7-4f47-90e6-8ee97a34e492 service nova] Acquiring lock "7e67fb47-500c-4e85-b384-27408ec622a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:00:56 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-871ef9a2-3899-406e-8acd-12457ab9e4d5 req-e3525508-3ee7-4f47-90e6-8ee97a34e492 service nova] Lock "7e67fb47-500c-4e85-b384-27408ec622a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:00:56 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-871ef9a2-3899-406e-8acd-12457ab9e4d5 req-e3525508-3ee7-4f47-90e6-8ee97a34e492 service nova] Lock "7e67fb47-500c-4e85-b384-27408ec622a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:00:56 user nova-compute[74994]: DEBUG nova.compute.manager [req-871ef9a2-3899-406e-8acd-12457ab9e4d5 req-e3525508-3ee7-4f47-90e6-8ee97a34e492 service nova] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] No waiting events found dispatching network-vif-plugged-3787892f-48da-4e39-8c41-8fdb94950e59 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:00:56 user nova-compute[74994]: WARNING nova.compute.manager [req-871ef9a2-3899-406e-8acd-12457ab9e4d5 req-e3525508-3ee7-4f47-90e6-8ee97a34e492 service nova] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Received unexpected event network-vif-plugged-3787892f-48da-4e39-8c41-8fdb94950e59 for instance with vm_state active and task_state None.
Nov 28 11:00:57 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:00:59 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:01:02 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:01:07 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:01:09 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:01:09 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:01:09 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 11:01:12 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:01:14 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:01:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:01:16 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:01:16 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:01:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:01:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:01:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:01:16 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 11:01:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:01:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:01:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:01:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:01:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:01:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:01:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:01:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:01:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:01:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:01:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:01:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:01:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:01:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:01:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123/disk.rescue --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:01:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:01:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123/disk.rescue --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:01:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:01:18 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /opt/stack/data/nova/instances/4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123/disk (vdb) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:01:18 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:01:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:01:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:01:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:01:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:01:18 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:01:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:01:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:01:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:01:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:01:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:01:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:01:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:01:19 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:01:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:01:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1de4238-c33e-48a6-bb4f-240e91e81ea3/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:01:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1de4238-c33e-48a6-bb4f-240e91e81ea3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:01:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1de4238-c33e-48a6-bb4f-240e91e81ea3/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:01:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1de4238-c33e-48a6-bb4f-240e91e81ea3/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:01:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14ab0a02-7432-4630-8758-df82d6a17ef8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:01:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14ab0a02-7432-4630-8758-df82d6a17ef8/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:01:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14ab0a02-7432-4630-8758-df82d6a17ef8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:01:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14ab0a02-7432-4630-8758-df82d6a17ef8/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:01:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:01:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:01:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:01:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:01:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:01:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:01:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:01:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:01:21 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:01:21 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:01:21 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:01:21 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=7558MB free_disk=25.01111602783203GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 11:01:21 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:01:21 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:01:21 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:01:21 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance bf357856-2d97-42e8-928d-71d0378f48c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:01:21 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 279e1c4c-36f9-492f-ab3f-1b587347eadd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:01:21 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 759fbcfd-ab13-438f-b860-6393a97d1205 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:01:21 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 20716905-c56a-4729-8c5b-9188502dc477 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:01:21 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 2f4b631a-46c8-4f9b-b5f9-6e2542484658 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:01:21 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 20605acb-092a-4214-a114-750f145d7af8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:01:21 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance b743c491-ece8-4781-9530-b2f38ffc1079 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:01:21 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:01:21 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 14ab0a02-7432-4630-8758-df82d6a17ef8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:01:21 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance d1de4238-c33e-48a6-bb4f-240e91e81ea3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:01:21 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 7e67fb47-500c-4e85-b384-27408ec622a9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:01:21 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 11:01:21 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 11:01:22 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:01:22 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:01:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 11:01:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.520s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:01:22 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:01:23 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:01:23 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:01:23 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:01:23 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 11:01:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "refresh_cache-20716905-c56a-4729-8c5b-9188502dc477" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:01:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquired lock "refresh_cache-20716905-c56a-4729-8c5b-9188502dc477" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:01:23 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Forcefully refreshing network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 11:01:23 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Updating instance_info_cache with network_info: [{"id": "10b84648-2b56-4451-b4f3-3ec4ad7b7771", "address": "fa:16:3e:96:e0:ac", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b84648-2b", "ovs_interfaceid": "10b84648-2b56-4451-b4f3-3ec4ad7b7771", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:01:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Releasing lock "refresh_cache-20716905-c56a-4729-8c5b-9188502dc477" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:01:23 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Updated the network info_cache for instance {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 11:01:23 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:01:23 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:01:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:01:27 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:01:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:01:32 user nova-compute[74994]: INFO nova.compute.manager [None req-430f26ac-7a8c-4358-98dd-c0a4c8943405 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Unrescuing
Nov 28 11:01:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-430f26ac-7a8c-4358-98dd-c0a4c8943405 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquiring lock "refresh_cache-4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:01:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-430f26ac-7a8c-4358-98dd-c0a4c8943405 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquired lock "refresh_cache-4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:01:32 user nova-compute[74994]: DEBUG nova.network.neutron [None req-430f26ac-7a8c-4358-98dd-c0a4c8943405 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 11:01:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:01:33 user nova-compute[74994]: DEBUG nova.network.neutron [None req-430f26ac-7a8c-4358-98dd-c0a4c8943405 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Updating instance_info_cache with network_info: [{"id": "a20ff85b-6e1c-4430-ab03-696b8521b056", "address": "fa:16:3e:95:4c:68", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20ff85b-6e", "ovs_interfaceid": "a20ff85b-6e1c-4430-ab03-696b8521b056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:01:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-430f26ac-7a8c-4358-98dd-c0a4c8943405 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Releasing lock "refresh_cache-4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:01:33 user nova-compute[74994]: DEBUG nova.objects.instance [None req-430f26ac-7a8c-4358-98dd-c0a4c8943405 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lazy-loading 'flavor' on Instance uuid 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:01:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:01:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:01:33 user nova-compute[74994]: DEBUG nova.compute.manager [req-13c2e52b-ed7c-44e1-afb0-2de57139ccb4 req-0e6ba12c-4e68-453b-bd28-b0f04ae048e1 service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Received event network-vif-unplugged-a20ff85b-6e1c-4430-ab03-696b8521b056 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:01:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-13c2e52b-ed7c-44e1-afb0-2de57139ccb4 req-0e6ba12c-4e68-453b-bd28-b0f04ae048e1 service nova] Acquiring lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:01:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-13c2e52b-ed7c-44e1-afb0-2de57139ccb4 req-0e6ba12c-4e68-453b-bd28-b0f04ae048e1 service nova] Lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:01:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-13c2e52b-ed7c-44e1-afb0-2de57139ccb4 req-0e6ba12c-4e68-453b-bd28-b0f04ae048e1 service nova] Lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:01:33 user nova-compute[74994]: DEBUG nova.compute.manager [req-13c2e52b-ed7c-44e1-afb0-2de57139ccb4 req-0e6ba12c-4e68-453b-bd28-b0f04ae048e1 service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] No waiting events found dispatching network-vif-unplugged-a20ff85b-6e1c-4430-ab03-696b8521b056 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:01:33 user nova-compute[74994]: WARNING nova.compute.manager [req-13c2e52b-ed7c-44e1-afb0-2de57139ccb4 req-0e6ba12c-4e68-453b-bd28-b0f04ae048e1 service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Received unexpected event network-vif-unplugged-a20ff85b-6e1c-4430-ab03-696b8521b056 for instance with vm_state rescued and task_state unrescuing.
Nov 28 11:01:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:01:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:01:33 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Instance destroyed successfully.
Nov 28 11:01:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:01:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:01:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:01:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:01:35 user nova-compute[74994]: DEBUG nova.compute.manager [req-bb2a4872-10e1-4f3c-adf2-a0e041579249 req-9bbdd8c9-6c68-4844-b2f0-b13309188541 service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Received event network-vif-plugged-a20ff85b-6e1c-4430-ab03-696b8521b056 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:01:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bb2a4872-10e1-4f3c-adf2-a0e041579249 req-9bbdd8c9-6c68-4844-b2f0-b13309188541 service nova] Acquiring lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:01:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bb2a4872-10e1-4f3c-adf2-a0e041579249 req-9bbdd8c9-6c68-4844-b2f0-b13309188541 service nova] Lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:01:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bb2a4872-10e1-4f3c-adf2-a0e041579249 req-9bbdd8c9-6c68-4844-b2f0-b13309188541 service nova] Lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:01:35 user nova-compute[74994]: DEBUG nova.compute.manager [req-bb2a4872-10e1-4f3c-adf2-a0e041579249 req-9bbdd8c9-6c68-4844-b2f0-b13309188541 service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] No waiting events found dispatching network-vif-plugged-a20ff85b-6e1c-4430-ab03-696b8521b056 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:01:35 user nova-compute[74994]: WARNING nova.compute.manager [req-bb2a4872-10e1-4f3c-adf2-a0e041579249 req-9bbdd8c9-6c68-4844-b2f0-b13309188541 service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Received unexpected event network-vif-plugged-a20ff85b-6e1c-4430-ab03-696b8521b056 for instance with vm_state rescued and task_state unrescuing.
Nov 28 11:01:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:01:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:01:35 user nova-compute[74994]: DEBUG nova.compute.manager [req-ae4dad2b-bd70-498e-b887-9db70a6f783d req-4c741fdc-847a-44e7-a0a7-0e4478bd1173 service nova] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Received event network-changed-fd853050-2e07-4e5b-9dfc-b10bf3af51e7 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:01:35 user nova-compute[74994]: DEBUG nova.compute.manager [req-ae4dad2b-bd70-498e-b887-9db70a6f783d req-4c741fdc-847a-44e7-a0a7-0e4478bd1173 service nova] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Refreshing instance network info cache due to event network-changed-fd853050-2e07-4e5b-9dfc-b10bf3af51e7. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:01:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ae4dad2b-bd70-498e-b887-9db70a6f783d req-4c741fdc-847a-44e7-a0a7-0e4478bd1173 service nova] Acquiring lock "refresh_cache-14ab0a02-7432-4630-8758-df82d6a17ef8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:01:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ae4dad2b-bd70-498e-b887-9db70a6f783d req-4c741fdc-847a-44e7-a0a7-0e4478bd1173 service nova] Acquired lock "refresh_cache-14ab0a02-7432-4630-8758-df82d6a17ef8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:01:35 user nova-compute[74994]: DEBUG nova.network.neutron [req-ae4dad2b-bd70-498e-b887-9db70a6f783d req-4c741fdc-847a-44e7-a0a7-0e4478bd1173 service nova] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Refreshing network info cache for port fd853050-2e07-4e5b-9dfc-b10bf3af51e7 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:01:36 user nova-compute[74994]: DEBUG nova.network.neutron [req-ae4dad2b-bd70-498e-b887-9db70a6f783d req-4c741fdc-847a-44e7-a0a7-0e4478bd1173 service nova] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Updated VIF entry in instance network info cache for port fd853050-2e07-4e5b-9dfc-b10bf3af51e7. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:01:36 user nova-compute[74994]: DEBUG nova.network.neutron [req-ae4dad2b-bd70-498e-b887-9db70a6f783d req-4c741fdc-847a-44e7-a0a7-0e4478bd1173 service nova] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Updating instance_info_cache with network_info: [{"id": "fd853050-2e07-4e5b-9dfc-b10bf3af51e7", "address": "fa:16:3e:b2:d1:5c", "network": {"id": "d9bcdec6-69e0-4e65-8a26-1af1f8232365", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1227861580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "636fa9a1f046425e9332cc3807f8fb46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd853050-2e", "ovs_interfaceid": "fd853050-2e07-4e5b-9dfc-b10bf3af51e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:01:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ae4dad2b-bd70-498e-b887-9db70a6f783d req-4c741fdc-847a-44e7-a0a7-0e4478bd1173 service nova] Releasing lock "refresh_cache-14ab0a02-7432-4630-8758-df82d6a17ef8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:01:37 user nova-compute[74994]: DEBUG nova.compute.manager [req-c8e728b8-223d-441e-bb80-f0fd10bdf22c req-d864c4c2-2e32-4f2c-8aa6-a0881f85f0f5 service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Received event network-vif-plugged-a20ff85b-6e1c-4430-ab03-696b8521b056 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:01:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c8e728b8-223d-441e-bb80-f0fd10bdf22c req-d864c4c2-2e32-4f2c-8aa6-a0881f85f0f5 service nova] Acquiring lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:01:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c8e728b8-223d-441e-bb80-f0fd10bdf22c req-d864c4c2-2e32-4f2c-8aa6-a0881f85f0f5 service nova] Lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:01:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c8e728b8-223d-441e-bb80-f0fd10bdf22c req-d864c4c2-2e32-4f2c-8aa6-a0881f85f0f5 service nova] Lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:01:37 user nova-compute[74994]: DEBUG nova.compute.manager [req-c8e728b8-223d-441e-bb80-f0fd10bdf22c req-d864c4c2-2e32-4f2c-8aa6-a0881f85f0f5 service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] No waiting events found dispatching network-vif-plugged-a20ff85b-6e1c-4430-ab03-696b8521b056 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:01:37 user nova-compute[74994]: WARNING nova.compute.manager [req-c8e728b8-223d-441e-bb80-f0fd10bdf22c req-d864c4c2-2e32-4f2c-8aa6-a0881f85f0f5 service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Received unexpected event network-vif-plugged-a20ff85b-6e1c-4430-ab03-696b8521b056 for instance with vm_state rescued and task_state unrescuing.
Nov 28 11:01:37 user nova-compute[74994]: DEBUG nova.compute.manager [req-c8e728b8-223d-441e-bb80-f0fd10bdf22c req-d864c4c2-2e32-4f2c-8aa6-a0881f85f0f5 service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Received event network-vif-plugged-a20ff85b-6e1c-4430-ab03-696b8521b056 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:01:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c8e728b8-223d-441e-bb80-f0fd10bdf22c req-d864c4c2-2e32-4f2c-8aa6-a0881f85f0f5 service nova] Acquiring lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:01:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c8e728b8-223d-441e-bb80-f0fd10bdf22c req-d864c4c2-2e32-4f2c-8aa6-a0881f85f0f5 service nova] Lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:01:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c8e728b8-223d-441e-bb80-f0fd10bdf22c req-d864c4c2-2e32-4f2c-8aa6-a0881f85f0f5 service nova] Lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:01:37 user nova-compute[74994]: DEBUG nova.compute.manager [req-c8e728b8-223d-441e-bb80-f0fd10bdf22c req-d864c4c2-2e32-4f2c-8aa6-a0881f85f0f5 service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] No waiting events found dispatching network-vif-plugged-a20ff85b-6e1c-4430-ab03-696b8521b056 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:01:37 user nova-compute[74994]: WARNING nova.compute.manager [req-c8e728b8-223d-441e-bb80-f0fd10bdf22c req-d864c4c2-2e32-4f2c-8aa6-a0881f85f0f5 service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Received unexpected event network-vif-plugged-a20ff85b-6e1c-4430-ab03-696b8521b056 for instance with vm_state rescued and task_state unrescuing.
Nov 28 11:01:37 user nova-compute[74994]: DEBUG nova.compute.manager [None req-430f26ac-7a8c-4358-98dd-c0a4c8943405 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 11:01:37 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:01:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "14ab0a02-7432-4630-8758-df82d6a17ef8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:01:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "14ab0a02-7432-4630-8758-df82d6a17ef8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:01:38 user nova-compute[74994]: DEBUG nova.objects.instance [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lazy-loading 'flavor' on Instance uuid 14ab0a02-7432-4630-8758-df82d6a17ef8 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:01:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "14ab0a02-7432-4630-8758-df82d6a17ef8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:01:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "14ab0a02-7432-4630-8758-df82d6a17ef8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:01:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "14ab0a02-7432-4630-8758-df82d6a17ef8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:01:38 user nova-compute[74994]: INFO nova.compute.manager [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Attaching volume 8d65cb85-bc2b-49b9-81ee-a46a8ae2c631 to /dev/vdb
Nov 28 11:01:38 user nova-compute[74994]: DEBUG os_brick.utils [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:01:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:01:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:01:38 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7f37dc-f220-4823-93f0-69310f1a59f8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:01:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:01:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:01:38 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[939807fd-41d2-4213-af82-a2da2ce79e02]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:01:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:01:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:01:38 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e352799-7a40-46df-8ef2-d1310658af5a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:01:38 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[71696407-56aa-4828-8855-5150ec6e0cf0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:01:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:01:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:01:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 11:01:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:01:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:01:38 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 11:01:38 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9209bddb-6235-4c12-8c46-63db281efc4f]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:01:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 11:01:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 11:01:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 11:01:38 user nova-compute[74994]: DEBUG os_brick.utils [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:01:38 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Updating existing volume attachment record: c232e47c-e254-4fd3-8312-c0549385c654 {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 11:01:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:01:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:01:44 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:01:44 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zUbFxAYn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:01:46 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:01:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:01:46 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:01:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:01:46 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 11:01:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631 -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60e16fd-1e17-4a39-a309-7837ab465b7c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 11:01:46 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631 -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3ee204-29b2-42e6-8891-41fa3dc2831f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631] added
Nov 28 11:01:46 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe2a0da-be6d-4eec-8bfd-c55f2e7474f4]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[453e9e79-f090-446e-8183-f45776061e88]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zUbFxAYn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zUbFxAYn" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4c8731-b826-4f0c-a578-80d9a4f490b2]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zUbFxAYn'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a12de2-bdfd-4ad1-aace-ae809d3d5b76]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5c2e12-9d7e-44af-995e-492e8d389bef]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:01:46 user nova-compute[74994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)
Nov 28 11:01:46 user nova-compute[74994]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)
Nov 28 11:01:46 user nova-compute[74994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)
Nov 28 11:01:46 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:01:46 user nova-compute[74994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)
Nov 28 11:01:46 user nova-compute[74994]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)
Nov 28 11:01:46 user nova-compute[74994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)
Nov 28 11:01:46 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631 -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea454b0-e36f-443f-b02b-6b308933ee6f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631, portal: 172.16.0.220,3260]
Nov 28 11:01:46 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631, portal: 172.16.0.220,3260] successful.
Nov 28 11:01:46 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60895d4-00c3-4b9d-93e4-d1c04211e111]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[336b5977-88e4-4048-b536-d2ba1094f35b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:01:46 user nova-compute[74994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)
Nov 28 11:01:46 user nova-compute[74994]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)
Nov 28 11:01:46 user nova-compute[74994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)
Nov 28 11:01:46 user nova-compute[74994]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631 (non-flash)
Nov 28 11:01:46 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:01:46 user nova-compute[74994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)
Nov 28 11:01:46 user nova-compute[74994]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)
Nov 28 11:01:46 user nova-compute[74994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)
Nov 28 11:01:46 user nova-compute[74994]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631 (non-flash)
Nov 28 11:01:46 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] HCTL ('34', '-', '-', 0) found on session 34 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ace1ae-5d91-403d-88e4-45dff98398fb]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 11:01:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zUbFxAYn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 11:01:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:01:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '23634623634306337', 'path': '/dev/sdc'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:01:47 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634623634306337', 'path': '/dev/sdc'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 11:01:47 user nova-compute[74994]: DEBUG nova.objects.instance [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lazy-loading 'flavor' on Instance uuid 14ab0a02-7432-4630-8758-df82d6a17ef8 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:01:47 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 11:01:47 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:01:47 user nova-compute[74994]:   <source dev="/dev/sdc"/>
Nov 28 11:01:47 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:01:47 user nova-compute[74994]:   <serial>8d65cb85-bc2b-49b9-81ee-a46a8ae2c631</serial>
Nov 28 11:01:47 user nova-compute[74994]: </disk>
Nov 28 11:01:47 user nova-compute[74994]:  {{(pid=74994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 11:01:47 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:01:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:01:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:01:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] No VIF found with MAC fa:16:3e:b2:d1:5c, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:01:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c734f41a-a81f-46c6-af33-041941c6f9be tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "14ab0a02-7432-4630-8758-df82d6a17ef8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.669s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:01:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f7042a3b-f933-485d-bcb8-73b131f351d7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "14ab0a02-7432-4630-8758-df82d6a17ef8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:01:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f7042a3b-f933-485d-bcb8-73b131f351d7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "14ab0a02-7432-4630-8758-df82d6a17ef8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:01:49 user nova-compute[74994]: INFO nova.compute.manager [None req-f7042a3b-f933-485d-bcb8-73b131f351d7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Detaching volume 8d65cb85-bc2b-49b9-81ee-a46a8ae2c631
Nov 28 11:01:49 user nova-compute[74994]: INFO nova.virt.block_device [None req-f7042a3b-f933-485d-bcb8-73b131f351d7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Attempting to driver detach volume 8d65cb85-bc2b-49b9-81ee-a46a8ae2c631 from mountpoint /dev/vdb
Nov 28 11:01:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f7042a3b-f933-485d-bcb8-73b131f351d7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Attempting to detach device vdb from instance 14ab0a02-7432-4630-8758-df82d6a17ef8 from the persistent domain config. {{(pid=74994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 11:01:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-f7042a3b-f933-485d-bcb8-73b131f351d7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 11:01:49 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:01:49 user nova-compute[74994]:   <source dev="/dev/sdc"/>
Nov 28 11:01:49 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:01:49 user nova-compute[74994]:   <serial>8d65cb85-bc2b-49b9-81ee-a46a8ae2c631</serial>
Nov 28 11:01:49 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 11:01:49 user nova-compute[74994]: </disk>
Nov 28 11:01:49 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 11:01:49 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-f7042a3b-f933-485d-bcb8-73b131f351d7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Successfully detached device vdb from instance 14ab0a02-7432-4630-8758-df82d6a17ef8 from the persistent domain config.
Nov 28 11:01:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f7042a3b-f933-485d-bcb8-73b131f351d7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 14ab0a02-7432-4630-8758-df82d6a17ef8 from the live domain config. {{(pid=74994) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 11:01:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-f7042a3b-f933-485d-bcb8-73b131f351d7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 11:01:49 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:01:49 user nova-compute[74994]:   <source dev="/dev/sdc"/>
Nov 28 11:01:49 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:01:49 user nova-compute[74994]:   <serial>8d65cb85-bc2b-49b9-81ee-a46a8ae2c631</serial>
Nov 28 11:01:49 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 11:01:49 user nova-compute[74994]: </disk>
Nov 28 11:01:49 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 11:01:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f7042a3b-f933-485d-bcb8-73b131f351d7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 14ab0a02-7432-4630-8758-df82d6a17ef8 {{(pid=74994) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 11:01:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:01:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:01:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:01:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:01:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:01:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:01:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Acquiring lock "3cf241c8-e888-4e47-8213-3c83c045e4a3" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:01:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "3cf241c8-e888-4e47-8213-3c83c045e4a3" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:01:53 user nova-compute[74994]: INFO nova.compute.manager [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Unshelving
Nov 28 11:01:53 user nova-compute[74994]: INFO nova.virt.block_device [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Booting with volume 711ad168-0a6f-45f3-9396-cdedcec63988 at /dev/vdc
Nov 28 11:01:53 user nova-compute[74994]: DEBUG os_brick.utils [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:01:53 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:01:53 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:01:53 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16b3756-fe53-4375-a743-5e2580cdb617]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:01:53 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:01:53 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:01:53 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1008c4-8cd6-45a2-8479-73fd9ec19780]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:01:53 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:01:53 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:01:53 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[888a0eab-d4b1-42cf-9c2d-16ed50f1d12f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:01:53 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9780666-a53d-484b-95ac-b01f13d551c0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:01:53 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:01:53 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:01:53 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 11:01:53 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:01:53 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:01:53 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 11:01:53 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afae73f-ed24-4262-8cbb-90fa8e9e908c]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:01:53 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 11:01:53 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 11:01:53 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 11:01:53 user nova-compute[74994]: DEBUG os_brick.utils [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:01:53 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Updating existing volume attachment record: 1358ba28-18ac-4e5d-a67f-fadd4dde602a {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 11:01:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:01:57 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:01:59 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:01 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:02:01 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:02:01 user nova-compute[74994]: DEBUG nova.objects.instance [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lazy-loading 'pci_requests' on Instance uuid 3cf241c8-e888-4e47-8213-3c83c045e4a3 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:02:01 user nova-compute[74994]: DEBUG nova.objects.instance [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lazy-loading 'numa_topology' on Instance uuid 3cf241c8-e888-4e47-8213-3c83c045e4a3 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:02:01 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 11:02:01 user nova-compute[74994]: INFO nova.compute.claims [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Claim successful on node user
Nov 28 11:02:01 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:02:01 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:02:01 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.494s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:02:01 user nova-compute[74994]: INFO nova.network.neutron [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Updating port 017867da-26d5-4fff-9eb9-eb8686888b55 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 28 11:02:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Acquiring lock "refresh_cache-3cf241c8-e888-4e47-8213-3c83c045e4a3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:02:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Acquired lock "refresh_cache-3cf241c8-e888-4e47-8213-3c83c045e4a3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:02:02 user nova-compute[74994]: DEBUG nova.network.neutron [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 11:02:02 user nova-compute[74994]: DEBUG nova.compute.manager [req-d969cb28-1b72-432c-834f-ff83b3925c9b req-ba6484e4-81e3-4acd-9cf4-41aae44592cd service nova] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Received event network-changed-017867da-26d5-4fff-9eb9-eb8686888b55 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:02:02 user nova-compute[74994]: DEBUG nova.compute.manager [req-d969cb28-1b72-432c-834f-ff83b3925c9b req-ba6484e4-81e3-4acd-9cf4-41aae44592cd service nova] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Refreshing instance network info cache due to event network-changed-017867da-26d5-4fff-9eb9-eb8686888b55. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:02:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d969cb28-1b72-432c-834f-ff83b3925c9b req-ba6484e4-81e3-4acd-9cf4-41aae44592cd service nova] Acquiring lock "refresh_cache-3cf241c8-e888-4e47-8213-3c83c045e4a3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:02:02 user nova-compute[74994]: DEBUG nova.network.neutron [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Updating instance_info_cache with network_info: [{"id": "017867da-26d5-4fff-9eb9-eb8686888b55", "address": "fa:16:3e:8f:30:5e", "network": {"id": "d46e72ec-d7d5-45f7-951a-b4381f0b472b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-179057367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a4dcdeafd6420d8606b37673e3255f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017867da-26", "ovs_interfaceid": "017867da-26d5-4fff-9eb9-eb8686888b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:02:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Releasing lock "refresh_cache-3cf241c8-e888-4e47-8213-3c83c045e4a3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:02:02 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 11:02:02 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Creating image(s)
Nov 28 11:02:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Acquiring lock "/opt/stack/data/nova/instances/3cf241c8-e888-4e47-8213-3c83c045e4a3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:02:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "/opt/stack/data/nova/instances/3cf241c8-e888-4e47-8213-3c83c045e4a3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:02:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "/opt/stack/data/nova/instances/3cf241c8-e888-4e47-8213-3c83c045e4a3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:02:02 user nova-compute[74994]: DEBUG nova.objects.instance [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3cf241c8-e888-4e47-8213-3c83c045e4a3 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:02:02 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d969cb28-1b72-432c-834f-ff83b3925c9b req-ba6484e4-81e3-4acd-9cf4-41aae44592cd service nova] Acquired lock "refresh_cache-3cf241c8-e888-4e47-8213-3c83c045e4a3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:02:02 user nova-compute[74994]: DEBUG nova.network.neutron [req-d969cb28-1b72-432c-834f-ff83b3925c9b req-ba6484e4-81e3-4acd-9cf4-41aae44592cd service nova] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Refreshing network info cache for port 017867da-26d5-4fff-9eb9-eb8686888b55 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:02:02 user nova-compute[74994]: DEBUG nova.objects.base [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Object Instance<3cf241c8-e888-4e47-8213-3c83c045e4a3> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 11:02:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Acquiring lock "3d87999ed529ac500c57b9759f9e222d260301b8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:02:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "3d87999ed529ac500c57b9759f9e222d260301b8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:02:03 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d87999ed529ac500c57b9759f9e222d260301b8.part --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d87999ed529ac500c57b9759f9e222d260301b8.part --force-share --output=json" returned: 0 in 0.185s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:04 user nova-compute[74994]: DEBUG nova.virt.images [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] b9ff9d55-350a-4c86-8690-9ab88b8ab0df was qcow2, converting to raw {{(pid=74994) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 11:02:04 user nova-compute[74994]: DEBUG nova.privsep.utils [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74994) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 11:02:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3d87999ed529ac500c57b9759f9e222d260301b8.part /opt/stack/data/nova/instances/_base/3d87999ed529ac500c57b9759f9e222d260301b8.converted {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:04 user nova-compute[74994]: DEBUG nova.network.neutron [req-d969cb28-1b72-432c-834f-ff83b3925c9b req-ba6484e4-81e3-4acd-9cf4-41aae44592cd service nova] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Updated VIF entry in instance network info cache for port 017867da-26d5-4fff-9eb9-eb8686888b55. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:02:04 user nova-compute[74994]: DEBUG nova.network.neutron [req-d969cb28-1b72-432c-834f-ff83b3925c9b req-ba6484e4-81e3-4acd-9cf4-41aae44592cd service nova] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Updating instance_info_cache with network_info: [{"id": "017867da-26d5-4fff-9eb9-eb8686888b55", "address": "fa:16:3e:8f:30:5e", "network": {"id": "d46e72ec-d7d5-45f7-951a-b4381f0b472b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-179057367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a4dcdeafd6420d8606b37673e3255f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017867da-26", "ovs_interfaceid": "017867da-26d5-4fff-9eb9-eb8686888b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:02:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d969cb28-1b72-432c-834f-ff83b3925c9b req-ba6484e4-81e3-4acd-9cf4-41aae44592cd service nova] Releasing lock "refresh_cache-3cf241c8-e888-4e47-8213-3c83c045e4a3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:02:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3d87999ed529ac500c57b9759f9e222d260301b8.part /opt/stack/data/nova/instances/_base/3d87999ed529ac500c57b9759f9e222d260301b8.converted" returned: 0 in 0.250s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d87999ed529ac500c57b9759f9e222d260301b8.converted --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d87999ed529ac500c57b9759f9e222d260301b8.converted --force-share --output=json" returned: 0 in 0.175s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "3d87999ed529ac500c57b9759f9e222d260301b8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.721s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:02:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d87999ed529ac500c57b9759f9e222d260301b8 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d87999ed529ac500c57b9759f9e222d260301b8 --force-share --output=json" returned: 0 in 0.173s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Acquiring lock "3d87999ed529ac500c57b9759f9e222d260301b8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:02:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "3d87999ed529ac500c57b9759f9e222d260301b8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:02:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d87999ed529ac500c57b9759f9e222d260301b8 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d87999ed529ac500c57b9759f9e222d260301b8 --force-share --output=json" returned: 0 in 0.189s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3d87999ed529ac500c57b9759f9e222d260301b8,backing_fmt=raw /opt/stack/data/nova/instances/3cf241c8-e888-4e47-8213-3c83c045e4a3/disk 1073741824 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3d87999ed529ac500c57b9759f9e222d260301b8,backing_fmt=raw /opt/stack/data/nova/instances/3cf241c8-e888-4e47-8213-3c83c045e4a3/disk 1073741824" returned: 0 in 0.051s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "3d87999ed529ac500c57b9759f9e222d260301b8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:02:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d87999ed529ac500c57b9759f9e222d260301b8 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d87999ed529ac500c57b9759f9e222d260301b8 --force-share --output=json" returned: 0 in 0.174s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:05 user nova-compute[74994]: DEBUG nova.objects.instance [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lazy-loading 'migration_context' on Instance uuid 3cf241c8-e888-4e47-8213-3c83c045e4a3 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:02:05 user nova-compute[74994]: DEBUG nova.objects.base [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Object Instance<3cf241c8-e888-4e47-8213-3c83c045e4a3> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 11:02:05 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Rebasing disk image.
Nov 28 11:02:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.182s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 -F raw /opt/stack/data/nova/instances/3cf241c8-e888-4e47-8213-3c83c045e4a3/disk {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 -F raw /opt/stack/data/nova/instances/3cf241c8-e888-4e47-8213-3c83c045e4a3/disk" returned: 0 in 2.329s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:07 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Created local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 11:02:07 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Ensure instance console log exists: /opt/stack/data/nova/instances/3cf241c8-e888-4e47-8213-3c83c045e4a3/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 11:02:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:02:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:02:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:02:07 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Start _get_guest_xml network_info=[{"id": "017867da-26d5-4fff-9eb9-eb8686888b55", "address": "fa:16:3e:8f:30:5e", "network": {"id": "d46e72ec-d7d5-45f7-951a-b4381f0b472b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-179057367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a4dcdeafd6420d8606b37673e3255f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017867da-26", "ovs_interfaceid": "017867da-26d5-4fff-9eb9-eb8686888b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='46d9e79ed414aaa0c333a50eb45b9113',container_format='bare',created_at=2023-11-28T11:00:01Z,direct_url=<?>,disk_format='qcow2',id=b9ff9d55-350a-4c86-8690-9ab88b8ab0df,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1735278754-shelved',owner='d3a4dcdeafd6420d8606b37673e3255f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-28T11:00:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'aa939d1b-b8a6-4391-935b-0191bf5ccd0a'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ykHdFbmB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '3cf241c8-e888-4e47-8213-3c83c045e4a3', 'attached_at': '', 'detached_at': '', 'volume_id': '711ad168-0a6f-45f3-9396-cdedcec63988', 'serial': '711ad168-0a6f-45f3-9396-cdedcec63988'}, 'attachment_id': '1358ba28-18ac-4e5d-a67f-fadd4dde602a', 'boot_index': None, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 11:02:07 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:07 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:02:07 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:02:07 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 11:02:07 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 11:02:07 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 11:02:07 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 11:02:07 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 11:02:07 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='46d9e79ed414aaa0c333a50eb45b9113',container_format='bare',created_at=2023-11-28T11:00:01Z,direct_url=<?>,disk_format='qcow2',id=b9ff9d55-350a-4c86-8690-9ab88b8ab0df,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1735278754-shelved',owner='d3a4dcdeafd6420d8606b37673e3255f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-28T11:00:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 11:02:07 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 11:02:07 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 11:02:07 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 11:02:07 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 11:02:07 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 11:02:07 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 11:02:07 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 11:02:07 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 11:02:07 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 11:02:07 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 11:02:07 user nova-compute[74994]: DEBUG nova.objects.instance [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3cf241c8-e888-4e47-8213-3c83c045e4a3 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:02:07 user nova-compute[74994]: DEBUG nova.objects.base [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Object Instance<3cf241c8-e888-4e47-8213-3c83c045e4a3> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 11:02:07 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 11:02:07 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ykHdFbmB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:02:07 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:02:07 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:02:07 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:02:07 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:02:07 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:02:07 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:02:07 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 11:02:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 -p 172.16.0.220:3260" returned: 21 in 0.058s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:07 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdccf754-3bd8-49b8-9fe2-7d3de38c8e8f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:07 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 11:02:07 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:02:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:07 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b3b22b-c3b4-46c0-a603-1c850214708c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:07 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988] added
Nov 28 11:02:07 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:02:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:08 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b7d535-5f3f-481e-b8af-2a08d6da79d7]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:02:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:08 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5c631a-3580-4c5d-a5a6-309f608ba893]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:02:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ykHdFbmB {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ykHdFbmB" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:08 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[88327def-1c2e-4a2a-b75a-a1a238c98534]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ykHdFbmB'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:02:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:08 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c617cb5d-877b-4a1f-9b22-e6cd92ab3882]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:02:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:08 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5822da50-a2b9-4963-898a-9b5b32a651ff]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:02:08 user nova-compute[74994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)
Nov 28 11:02:08 user nova-compute[74994]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)
Nov 28 11:02:08 user nova-compute[74994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)
Nov 28 11:02:08 user nova-compute[74994]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631 (non-flash)
Nov 28 11:02:08 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:02:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:02:08 user nova-compute[74994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)
Nov 28 11:02:08 user nova-compute[74994]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)
Nov 28 11:02:08 user nova-compute[74994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)
Nov 28 11:02:08 user nova-compute[74994]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631 (non-flash)
Nov 28 11:02:08 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:02:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:08 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca52e72-267e-4457-9d9f-8f7efb2cdd7c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988, portal: 172.16.0.220,3260]
Nov 28 11:02:08 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988, portal: 172.16.0.220,3260] successful.
Nov 28 11:02:08 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:02:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:08 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b659c578-d8f6-4b0b-b79a-75cd474a18b4]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:02:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:08 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d969e4-e684-42bc-b392-0035be537c06]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:02:08 user nova-compute[74994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)
Nov 28 11:02:08 user nova-compute[74994]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)
Nov 28 11:02:08 user nova-compute[74994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)
Nov 28 11:02:08 user nova-compute[74994]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631 (non-flash)
Nov 28 11:02:08 user nova-compute[74994]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 (non-flash)
Nov 28 11:02:08 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:02:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:02:08 user nova-compute[74994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)
Nov 28 11:02:08 user nova-compute[74994]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)
Nov 28 11:02:08 user nova-compute[74994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)
Nov 28 11:02:08 user nova-compute[74994]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631 (non-flash)
Nov 28 11:02:08 user nova-compute[74994]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 (non-flash)
Nov 28 11:02:08 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:02:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:02:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 11:02:08 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] HCTL ('38', '-', '-', 0) found on session 35 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 11:02:08 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 11:02:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:08 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3299dd8-1705-4075-9a4a-06587cce162e]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:08 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Searching for a device in session 35 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 11:02:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ykHdFbmB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 11:02:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:02:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '23736653431636262', 'path': '/dev/sdg'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:02:09 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736653431636262', 'path': '/dev/sdg'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 11:02:09 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T10:58:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1735278754',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1735278754',id=27,image_ref='b9ff9d55-350a-4c86-8690-9ab88b8ab0df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2137635767',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:58:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d3a4dcdeafd6420d8606b37673e3255f',ramdisk_id='',reservation_id='r-8cjiqvp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1700061593',owner_user_name='tempest-AttachVolumeShelveTestJSON-1700061593-project-member',shelved_at='2023-11-28T11:00:06.422487',shelved_host='user',shelved_image_id='b9ff9d55-350a-4c86-8690-9ab88b8ab0df'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:01:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4e1257b844940bebdeab3061c3e0ab4',uuid=3cf241c8-e888-4e47-8213-3c83c045e4a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "017867da-26d5-4fff-9eb9-eb8686888b55", "address": "fa:16:3e:8f:30:5e", "network": {"id": "d46e72ec-d7d5-45f7-951a-b4381f0b472b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-179057367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a4dcdeafd6420d8606b37673e3255f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017867da-26", "ovs_interfaceid": "017867da-26d5-4fff-9eb9-eb8686888b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 11:02:09 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Converting VIF {"id": "017867da-26d5-4fff-9eb9-eb8686888b55", "address": "fa:16:3e:8f:30:5e", "network": {"id": "d46e72ec-d7d5-45f7-951a-b4381f0b472b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-179057367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a4dcdeafd6420d8606b37673e3255f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017867da-26", "ovs_interfaceid": "017867da-26d5-4fff-9eb9-eb8686888b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:02:09 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:30:5e,bridge_name='br-int',has_traffic_filtering=True,id=017867da-26d5-4fff-9eb9-eb8686888b55,network=Network(d46e72ec-d7d5-45f7-951a-b4381f0b472b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap017867da-26') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:02:09 user nova-compute[74994]: DEBUG nova.objects.instance [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lazy-loading 'pci_devices' on Instance uuid 3cf241c8-e888-4e47-8213-3c83c045e4a3 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:02:09 user nova-compute[74994]: DEBUG nova.objects.base [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Object Instance<3cf241c8-e888-4e47-8213-3c83c045e4a3> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 11:02:09 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] End _get_guest_xml xml=<domain type="kvm">
Nov 28 11:02:09 user nova-compute[74994]:   <uuid>3cf241c8-e888-4e47-8213-3c83c045e4a3</uuid>
Nov 28 11:02:09 user nova-compute[74994]:   <name>instance-0000001b</name>
Nov 28 11:02:09 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 11:02:09 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 11:02:09 user nova-compute[74994]:   <metadata>
Nov 28 11:02:09 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 11:02:09 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 11:02:09 user nova-compute[74994]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1735278754</nova:name>
Nov 28 11:02:09 user nova-compute[74994]:       <nova:creationTime>2023-11-28 11:02:07</nova:creationTime>
Nov 28 11:02:09 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 11:02:09 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 11:02:09 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 11:02:09 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 11:02:09 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 11:02:09 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 11:02:09 user nova-compute[74994]:       </nova:flavor>
Nov 28 11:02:09 user nova-compute[74994]:       <nova:owner>
Nov 28 11:02:09 user nova-compute[74994]:         <nova:user uuid="c4e1257b844940bebdeab3061c3e0ab4">tempest-AttachVolumeShelveTestJSON-1700061593-project-member</nova:user>
Nov 28 11:02:09 user nova-compute[74994]:         <nova:project uuid="d3a4dcdeafd6420d8606b37673e3255f">tempest-AttachVolumeShelveTestJSON-1700061593</nova:project>
Nov 28 11:02:09 user nova-compute[74994]:       </nova:owner>
Nov 28 11:02:09 user nova-compute[74994]:       <nova:root type="image" uuid="b9ff9d55-350a-4c86-8690-9ab88b8ab0df"/>
Nov 28 11:02:09 user nova-compute[74994]:       <nova:ports>
Nov 28 11:02:09 user nova-compute[74994]:         <nova:port uuid="017867da-26d5-4fff-9eb9-eb8686888b55">
Nov 28 11:02:09 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 11:02:09 user nova-compute[74994]:         </nova:port>
Nov 28 11:02:09 user nova-compute[74994]:       </nova:ports>
Nov 28 11:02:09 user nova-compute[74994]:     </nova:instance>
Nov 28 11:02:09 user nova-compute[74994]:   </metadata>
Nov 28 11:02:09 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 11:02:09 user nova-compute[74994]:     <system>
Nov 28 11:02:09 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 11:02:09 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 11:02:09 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 11:02:09 user nova-compute[74994]:       <entry name="serial">3cf241c8-e888-4e47-8213-3c83c045e4a3</entry>
Nov 28 11:02:09 user nova-compute[74994]:       <entry name="uuid">3cf241c8-e888-4e47-8213-3c83c045e4a3</entry>
Nov 28 11:02:09 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 11:02:09 user nova-compute[74994]:     </system>
Nov 28 11:02:09 user nova-compute[74994]:   </sysinfo>
Nov 28 11:02:09 user nova-compute[74994]:   <os>
Nov 28 11:02:09 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 11:02:09 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 11:02:09 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 11:02:09 user nova-compute[74994]:   </os>
Nov 28 11:02:09 user nova-compute[74994]:   <features>
Nov 28 11:02:09 user nova-compute[74994]:     <acpi/>
Nov 28 11:02:09 user nova-compute[74994]:     <apic/>
Nov 28 11:02:09 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 11:02:09 user nova-compute[74994]:   </features>
Nov 28 11:02:09 user nova-compute[74994]:   <clock offset="utc">
Nov 28 11:02:09 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 11:02:09 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 11:02:09 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 11:02:09 user nova-compute[74994]:   </clock>
Nov 28 11:02:09 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 11:02:09 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 11:02:09 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 11:02:09 user nova-compute[74994]:   </cpu>
Nov 28 11:02:09 user nova-compute[74994]:   <devices>
Nov 28 11:02:09 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 11:02:09 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 11:02:09 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/3cf241c8-e888-4e47-8213-3c83c045e4a3/disk"/>
Nov 28 11:02:09 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 11:02:09 user nova-compute[74994]:     </disk>
Nov 28 11:02:09 user nova-compute[74994]:     <disk type="block" device="disk">
Nov 28 11:02:09 user nova-compute[74994]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:02:09 user nova-compute[74994]:       <source dev="/dev/sdg"/>
Nov 28 11:02:09 user nova-compute[74994]:       <target dev="vdc" bus="virtio"/>
Nov 28 11:02:09 user nova-compute[74994]:       <serial>711ad168-0a6f-45f3-9396-cdedcec63988</serial>
Nov 28 11:02:09 user nova-compute[74994]:     </disk>
Nov 28 11:02:09 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 11:02:09 user nova-compute[74994]:       <mac address="fa:16:3e:8f:30:5e"/>
Nov 28 11:02:09 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:02:09 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 11:02:09 user nova-compute[74994]:       <target dev="tap017867da-26"/>
Nov 28 11:02:09 user nova-compute[74994]:     </interface>
Nov 28 11:02:09 user nova-compute[74994]:     <serial type="pty">
Nov 28 11:02:09 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/3cf241c8-e888-4e47-8213-3c83c045e4a3/console.log" append="off"/>
Nov 28 11:02:09 user nova-compute[74994]:     </serial>
Nov 28 11:02:09 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 11:02:09 user nova-compute[74994]:     <video>
Nov 28 11:02:09 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:02:09 user nova-compute[74994]:     </video>
Nov 28 11:02:09 user nova-compute[74994]:     <rng model="virtio">
Nov 28 11:02:09 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 11:02:09 user nova-compute[74994]:     </rng>
Nov 28 11:02:09 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 11:02:09 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 11:02:09 user nova-compute[74994]:       <stats period="10"/>
Nov 28 11:02:09 user nova-compute[74994]:     </memballoon>
Nov 28 11:02:09 user nova-compute[74994]:   </devices>
Nov 28 11:02:09 user nova-compute[74994]: </domain>
Nov 28 11:02:09 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 11:02:09 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T10:58:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1735278754',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1735278754',id=27,image_ref='b9ff9d55-350a-4c86-8690-9ab88b8ab0df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2137635767',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:58:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d3a4dcdeafd6420d8606b37673e3255f',ramdisk_id='',reservation_id='r-8cjiqvp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1700061593',owner_user_name='tempest-AttachVolumeShelveTestJSON-1700061593-project-member',shelved_at='2023-11-28T11:00:06.422487',shelved_host='user',shelved_image_id='b9ff9d55-350a-4c86-8690-9ab88b8ab0df'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:01:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4e1257b844940bebdeab3061c3e0ab4',uuid=3cf241c8-e888-4e47-8213-3c83c045e4a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "017867da-26d5-4fff-9eb9-eb8686888b55", "address": "fa:16:3e:8f:30:5e", "network": {"id": "d46e72ec-d7d5-45f7-951a-b4381f0b472b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-179057367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a4dcdeafd6420d8606b37673e3255f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017867da-26", "ovs_interfaceid": "017867da-26d5-4fff-9eb9-eb8686888b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 11:02:09 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Converting VIF {"id": "017867da-26d5-4fff-9eb9-eb8686888b55", "address": "fa:16:3e:8f:30:5e", "network": {"id": "d46e72ec-d7d5-45f7-951a-b4381f0b472b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-179057367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a4dcdeafd6420d8606b37673e3255f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017867da-26", "ovs_interfaceid": "017867da-26d5-4fff-9eb9-eb8686888b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:02:09 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:30:5e,bridge_name='br-int',has_traffic_filtering=True,id=017867da-26d5-4fff-9eb9-eb8686888b55,network=Network(d46e72ec-d7d5-45f7-951a-b4381f0b472b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap017867da-26') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:02:09 user nova-compute[74994]: DEBUG os_vif [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:30:5e,bridge_name='br-int',has_traffic_filtering=True,id=017867da-26d5-4fff-9eb9-eb8686888b55,network=Network(d46e72ec-d7d5-45f7-951a-b4381f0b472b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap017867da-26') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 11:02:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:02:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 11:02:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3c26ab80-119f-58fd-a1fe-39a634e3bd4c', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:02:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:02:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap017867da-26, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:02:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap017867da-26, col_values=(('qos', UUID('bee21327-a573-4566-a3aa-d44705148564')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:02:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap017867da-26, col_values=(('external_ids', {'iface-id': '017867da-26d5-4fff-9eb9-eb8686888b55', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:30:5e', 'vm-uuid': '3cf241c8-e888-4e47-8213-3c83c045e4a3'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:02:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:02:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:09 user nova-compute[74994]: INFO os_vif [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:30:5e,bridge_name='br-int',has_traffic_filtering=True,id=017867da-26d5-4fff-9eb9-eb8686888b55,network=Network(d46e72ec-d7d5-45f7-951a-b4381f0b472b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap017867da-26')
Nov 28 11:02:09 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:02:09 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:02:09 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] No VIF found with MAC fa:16:3e:8f:30:5e, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:02:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:10 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-f7042a3b-f933-485d-bcb8-73b131f351d7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 14ab0a02-7432-4630-8758-df82d6a17ef8 is timed out.
Nov 28 11:02:10 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-f7042a3b-f933-485d-bcb8-73b131f351d7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Successfully detached device vdb from instance 14ab0a02-7432-4630-8758-df82d6a17ef8 from the live domain config.
Nov 28 11:02:10 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7042a3b-f933-485d-bcb8-73b131f351d7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7042a3b-f933-485d-bcb8-73b131f351d7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zUbFxAYn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:02:10 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-f7042a3b-f933-485d-bcb8-73b131f351d7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:02:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-f7042a3b-f933-485d-bcb8-73b131f351d7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-f7042a3b-f933-485d-bcb8-73b131f351d7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50d6447-7e06-4367-b205-c12cea39a6a7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7042a3b-f933-485d-bcb8-73b131f351d7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 11:02:10 user nova-compute[74994]: No targets found.
Nov 28 11:02:10 user nova-compute[74994]: iSNS:
Nov 28 11:02:10 user nova-compute[74994]: No targets found.
Nov 28 11:02:10 user nova-compute[74994]: STATIC:
Nov 28 11:02:10 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2
Nov 28 11:02:10 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:02:10 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:02:10 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631
Nov 28 11:02:10 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:02:10 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:02:10 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd
Nov 28 11:02:10 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:02:10 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:02:10 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b
Nov 28 11:02:10 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:02:10 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:02:10 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988
Nov 28 11:02:10 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:02:10 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:02:10 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de
Nov 28 11:02:10 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:02:10 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:02:10 user nova-compute[74994]: FIRMWARE:
Nov 28 11:02:10 user nova-compute[74994]: No targets found.
Nov 28 11:02:10 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7042a3b-f933-485d-bcb8-73b131f351d7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 11:02:10 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 11:02:10 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7042a3b-f933-485d-bcb8-73b131f351d7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd24e77-f62b-4a5c-a486-363e636a52a1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b6569b-6b0f-4649-9402-b52b8f183ee9]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7042a3b-f933-485d-bcb8-73b131f351d7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:02:10 user nova-compute[74994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)
Nov 28 11:02:10 user nova-compute[74994]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)
Nov 28 11:02:10 user nova-compute[74994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)
Nov 28 11:02:10 user nova-compute[74994]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631 (non-flash)
Nov 28 11:02:10 user nova-compute[74994]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 (non-flash)
Nov 28 11:02:10 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7042a3b-f933-485d-bcb8-73b131f351d7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:02:10 user nova-compute[74994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)
Nov 28 11:02:10 user nova-compute[74994]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)
Nov 28 11:02:10 user nova-compute[74994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)
Nov 28 11:02:10 user nova-compute[74994]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631 (non-flash)
Nov 28 11:02:10 user nova-compute[74994]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 (non-flash)
Nov 28 11:02:10 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7042a3b-f933-485d-bcb8-73b131f351d7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb944714ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631'): ({'sdc'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-f7042a3b-f933-485d-bcb8-73b131f351d7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Removing single pathed devices sdc {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[536f8768-f4f4-4d12-a26e-4dca02905b56]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2728cfc0-7e0c-4595-bdec-0377693aaf89]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-f7042a3b-f933-485d-bcb8-73b131f351d7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Flushing IO for device /dev/sdc {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e953ba40-446e-4e8a-ac91-adf29159198d]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-f7042a3b-f933-485d-bcb8-73b131f351d7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa53324-658a-4d96-b84e-e63664703c25]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-f7042a3b-f933-485d-bcb8-73b131f351d7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-f7042a3b-f933-485d-bcb8-73b131f351d7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] SCSI volumes sdc have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7042a3b-f933-485d-bcb8-73b131f351d7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a97e2c7-b1d8-4c59-9e1a-13eff4eeca29]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7042a3b-f933-485d-bcb8-73b131f351d7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631 -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fb7403-ce88-4738-8d8b-30b28d706717]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7042a3b-f933-485d-bcb8-73b131f351d7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631, portal: 172.16.0.220,3260]
Nov 28 11:02:10 user nova-compute[74994]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631, portal: 172.16.0.220,3260] successful.
Nov 28 11:02:10 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631 -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d65cb85-bc2b-49b9-81ee-a46a8ae2c631 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4deeb71-8098-4ef0-bbea-5fad320305d8]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7042a3b-f933-485d-bcb8-73b131f351d7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-f7042a3b-f933-485d-bcb8-73b131f351d7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7042a3b-f933-485d-bcb8-73b131f351d7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] <== disconnect_volume: return (310ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7042a3b-f933-485d-bcb8-73b131f351d7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:11 user nova-compute[74994]: DEBUG nova.compute.manager [req-c7994e5d-be95-41cf-bc46-5578ee872c53 req-50baf65b-ff91-4786-8427-fcfb0f342ae3 service nova] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Received event network-vif-plugged-017867da-26d5-4fff-9eb9-eb8686888b55 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:02:11 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c7994e5d-be95-41cf-bc46-5578ee872c53 req-50baf65b-ff91-4786-8427-fcfb0f342ae3 service nova] Acquiring lock "3cf241c8-e888-4e47-8213-3c83c045e4a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:02:11 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c7994e5d-be95-41cf-bc46-5578ee872c53 req-50baf65b-ff91-4786-8427-fcfb0f342ae3 service nova] Lock "3cf241c8-e888-4e47-8213-3c83c045e4a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:02:11 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c7994e5d-be95-41cf-bc46-5578ee872c53 req-50baf65b-ff91-4786-8427-fcfb0f342ae3 service nova] Lock "3cf241c8-e888-4e47-8213-3c83c045e4a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:02:11 user nova-compute[74994]: DEBUG nova.compute.manager [req-c7994e5d-be95-41cf-bc46-5578ee872c53 req-50baf65b-ff91-4786-8427-fcfb0f342ae3 service nova] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] No waiting events found dispatching network-vif-plugged-017867da-26d5-4fff-9eb9-eb8686888b55 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:02:11 user nova-compute[74994]: WARNING nova.compute.manager [req-c7994e5d-be95-41cf-bc46-5578ee872c53 req-50baf65b-ff91-4786-8427-fcfb0f342ae3 service nova] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Received unexpected event network-vif-plugged-017867da-26d5-4fff-9eb9-eb8686888b55 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 28 11:02:11 user nova-compute[74994]: DEBUG nova.objects.instance [None req-f7042a3b-f933-485d-bcb8-73b131f351d7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lazy-loading 'flavor' on Instance uuid 14ab0a02-7432-4630-8758-df82d6a17ef8 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:02:11 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f7042a3b-f933-485d-bcb8-73b131f351d7 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "14ab0a02-7432-4630-8758-df82d6a17ef8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.705s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:02:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:13 user nova-compute[74994]: DEBUG nova.compute.manager [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 11:02:13 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 11:02:13 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Instance spawned successfully.
Nov 28 11:02:13 user nova-compute[74994]: DEBUG nova.compute.manager [req-c2081439-aa5b-476d-82c1-426332e13c96 req-8666eb25-f7f7-4479-a6db-c6fca106ed31 service nova] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Received event network-vif-plugged-017867da-26d5-4fff-9eb9-eb8686888b55 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:02:13 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c2081439-aa5b-476d-82c1-426332e13c96 req-8666eb25-f7f7-4479-a6db-c6fca106ed31 service nova] Acquiring lock "3cf241c8-e888-4e47-8213-3c83c045e4a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:02:13 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c2081439-aa5b-476d-82c1-426332e13c96 req-8666eb25-f7f7-4479-a6db-c6fca106ed31 service nova] Lock "3cf241c8-e888-4e47-8213-3c83c045e4a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:02:13 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c2081439-aa5b-476d-82c1-426332e13c96 req-8666eb25-f7f7-4479-a6db-c6fca106ed31 service nova] Lock "3cf241c8-e888-4e47-8213-3c83c045e4a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:02:13 user nova-compute[74994]: DEBUG nova.compute.manager [req-c2081439-aa5b-476d-82c1-426332e13c96 req-8666eb25-f7f7-4479-a6db-c6fca106ed31 service nova] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] No waiting events found dispatching network-vif-plugged-017867da-26d5-4fff-9eb9-eb8686888b55 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:02:13 user nova-compute[74994]: WARNING nova.compute.manager [req-c2081439-aa5b-476d-82c1-426332e13c96 req-8666eb25-f7f7-4479-a6db-c6fca106ed31 service nova] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Received unexpected event network-vif-plugged-017867da-26d5-4fff-9eb9-eb8686888b55 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 28 11:02:13 user nova-compute[74994]: DEBUG nova.compute.manager [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 11:02:13 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f84bb8b5-69d7-4fff-9bcd-bf221313d45a tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "3cf241c8-e888-4e47-8213-3c83c045e4a3" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 19.926s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:02:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Acquiring lock "d1de4238-c33e-48a6-bb4f-240e91e81ea3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:02:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "d1de4238-c33e-48a6-bb4f-240e91e81ea3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:02:15 user nova-compute[74994]: DEBUG nova.objects.instance [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lazy-loading 'flavor' on Instance uuid d1de4238-c33e-48a6-bb4f-240e91e81ea3 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:02:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "d1de4238-c33e-48a6-bb4f-240e91e81ea3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:02:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Acquiring lock "d1de4238-c33e-48a6-bb4f-240e91e81ea3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:02:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "d1de4238-c33e-48a6-bb4f-240e91e81ea3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:02:15 user nova-compute[74994]: INFO nova.compute.manager [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Attaching volume 13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 to /dev/vdb
Nov 28 11:02:15 user nova-compute[74994]: DEBUG os_brick.utils [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:02:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:15 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45605c4-c347-4652-84d8-030c8bbab5f9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:15 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcaaf862-e970-44c8-9fad-e6c000d0e924]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.058s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:15 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[492455ef-8eee-45c4-a000-f43b98b4c918]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:15 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29f59d9-51c2-4232-ae7b-fe9c54e248c6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:02:15 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 11:02:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:02:15 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 11:02:15 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f53734-0dac-455d-88ef-7eaa69f38ba0]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:15 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 11:02:15 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 11:02:15 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 11:02:15 user nova-compute[74994]: DEBUG os_brick.utils [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:02:15 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Updating existing volume attachment record: af9c3f23-df58-458a-ae92-97f1664af938 {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 11:02:16 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:02:16 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:02:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:02:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:02:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:02:16 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 11:02:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:18 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:02:18 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:02:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:18 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:02:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:19 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf241c8-e888-4e47-8213-3c83c045e4a3/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf241c8-e888-4e47-8213-3c83c045e4a3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf241c8-e888-4e47-8213-3c83c045e4a3/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf241c8-e888-4e47-8213-3c83c045e4a3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:19 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:02:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1de4238-c33e-48a6-bb4f-240e91e81ea3/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1de4238-c33e-48a6-bb4f-240e91e81ea3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1de4238-c33e-48a6-bb4f-240e91e81ea3/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1de4238-c33e-48a6-bb4f-240e91e81ea3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14ab0a02-7432-4630-8758-df82d6a17ef8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14ab0a02-7432-4630-8758-df82d6a17ef8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14ab0a02-7432-4630-8758-df82d6a17ef8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14ab0a02-7432-4630-8758-df82d6a17ef8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json" returned: 0 in 0.252s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:21 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:02:22 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:02:22 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:02:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=7565MB free_disk=24.972801208496094GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 11:02:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:02:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:02:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:02:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance bf357856-2d97-42e8-928d-71d0378f48c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:02:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 279e1c4c-36f9-492f-ab3f-1b587347eadd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:02:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 759fbcfd-ab13-438f-b860-6393a97d1205 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:02:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 20716905-c56a-4729-8c5b-9188502dc477 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:02:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 2f4b631a-46c8-4f9b-b5f9-6e2542484658 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:02:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 20605acb-092a-4214-a114-750f145d7af8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:02:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance b743c491-ece8-4781-9530-b2f38ffc1079 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:02:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:02:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 14ab0a02-7432-4630-8758-df82d6a17ef8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:02:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance d1de4238-c33e-48a6-bb4f-240e91e81ea3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:02:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 7e67fb47-500c-4e85-b384-27408ec622a9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:02:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 3cf241c8-e888-4e47-8213-3c83c045e4a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:02:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 11:02:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 11:02:22 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:02:22 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:02:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 11:02:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.768s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:02:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:23 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 11:02:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AgKYCRiP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:02:23 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:02:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:02:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:02:23 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:02:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:02:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:02:23 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 11:02:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed4021c-53c2-4a24-9f58-9a5f76e63ea1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 11:02:23 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:02:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd150d71-190f-469f-9d84-85f26f6864cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7] added
Nov 28 11:02:23 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:02:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f8cc52-c591-48c8-8715-4f103c36dc9f]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:02:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[495e2cd9-6cb4-4260-82d2-d16682e6359f]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:02:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AgKYCRiP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AgKYCRiP" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[349c1f5c-2623-4b37-a03f-c3b98092fddb]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AgKYCRiP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:02:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36e02f7-3d32-4b16-9bf5-0b18ee7a0ec7]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:02:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[450ec090-5e0a-4649-96c4-37ca47ca7803]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:02:23 user nova-compute[74994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)
Nov 28 11:02:23 user nova-compute[74994]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)
Nov 28 11:02:23 user nova-compute[74994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)
Nov 28 11:02:23 user nova-compute[74994]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 (non-flash)
Nov 28 11:02:23 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:02:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:02:23 user nova-compute[74994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)
Nov 28 11:02:23 user nova-compute[74994]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)
Nov 28 11:02:23 user nova-compute[74994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)
Nov 28 11:02:23 user nova-compute[74994]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 (non-flash)
Nov 28 11:02:23 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:02:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de880b7-7e14-4728-a4a8-ac2eed219bb0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7, portal: 172.16.0.220,3260]
Nov 28 11:02:23 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7, portal: 172.16.0.220,3260] successful.
Nov 28 11:02:23 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:02:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db9a3c6-323f-4d93-abdc-1be04e54a31e]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:02:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:24 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2146b9b-eccc-49fb-ae8a-dbea5220bb4a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:02:24 user nova-compute[74994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)
Nov 28 11:02:24 user nova-compute[74994]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)
Nov 28 11:02:24 user nova-compute[74994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)
Nov 28 11:02:24 user nova-compute[74994]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 (non-flash)
Nov 28 11:02:24 user nova-compute[74994]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 (non-flash)
Nov 28 11:02:24 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:02:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:02:24 user nova-compute[74994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)
Nov 28 11:02:24 user nova-compute[74994]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)
Nov 28 11:02:24 user nova-compute[74994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)
Nov 28 11:02:24 user nova-compute[74994]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 (non-flash)
Nov 28 11:02:24 user nova-compute[74994]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 (non-flash)
Nov 28 11:02:24 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:02:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:02:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 11:02:24 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 11:02:24 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 11:02:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:24 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a4f41c-25dc-4532-96f3-f46a2526c138]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:24 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 11:02:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AgKYCRiP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 11:02:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:24 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:02:24 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:02:24 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 11:02:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "refresh_cache-2f4b631a-46c8-4f9b-b5f9-6e2542484658" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:02:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquired lock "refresh_cache-2f4b631a-46c8-4f9b-b5f9-6e2542484658" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:02:24 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Forcefully refreshing network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 11:02:25 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:02:25 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '26163303436363939', 'path': '/dev/sdc'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:02:25 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163303436363939', 'path': '/dev/sdc'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 11:02:25 user nova-compute[74994]: DEBUG nova.objects.instance [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lazy-loading 'flavor' on Instance uuid d1de4238-c33e-48a6-bb4f-240e91e81ea3 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:02:25 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 11:02:25 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:02:25 user nova-compute[74994]:   <source dev="/dev/sdc"/>
Nov 28 11:02:25 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:02:25 user nova-compute[74994]:   <serial>13b829e7-d2df-4c8c-9bc6-119c06a4c5d7</serial>
Nov 28 11:02:25 user nova-compute[74994]: </disk>
Nov 28 11:02:25 user nova-compute[74994]:  {{(pid=74994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 11:02:25 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:02:25 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:02:25 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] No VIF found with MAC fa:16:3e:99:ce:ce, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:02:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-727fc486-9523-48e8-a880-4c5ced6363fb tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "d1de4238-c33e-48a6-bb4f-240e91e81ea3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.087s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:02:25 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Updating instance_info_cache with network_info: [{"id": "068080a2-5847-4053-a463-9fc29cb64bb4", "address": "fa:16:3e:21:e9:f5", "network": {"id": "844b3eab-57f3-4582-9fcc-04594e44081b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-233988918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33727b28c7d94b7bbe8987c1301eec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068080a2-58", "ovs_interfaceid": "068080a2-5847-4053-a463-9fc29cb64bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:02:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Releasing lock "refresh_cache-2f4b631a-46c8-4f9b-b5f9-6e2542484658" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:02:25 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Updated the network info_cache for instance {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 11:02:25 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:02:25 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:02:25 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:02:27 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:28 user nova-compute[74994]: INFO nova.compute.manager [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Rescuing
Nov 28 11:02:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "refresh_cache-7e67fb47-500c-4e85-b384-27408ec622a9" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:02:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquired lock "refresh_cache-7e67fb47-500c-4e85-b384-27408ec622a9" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:02:28 user nova-compute[74994]: DEBUG nova.network.neutron [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 11:02:28 user nova-compute[74994]: DEBUG nova.network.neutron [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Updating instance_info_cache with network_info: [{"id": "3787892f-48da-4e39-8c41-8fdb94950e59", "address": "fa:16:3e:75:4f:64", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3787892f-48", "ovs_interfaceid": "3787892f-48da-4e39-8c41-8fdb94950e59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:02:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Releasing lock "refresh_cache-7e67fb47-500c-4e85-b384-27408ec622a9" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:02:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:29 user nova-compute[74994]: DEBUG nova.compute.manager [req-eeebc717-a306-495f-b6e1-17d8f06feb3f req-f13b3094-9d20-4534-bf80-82af21a1c9c1 service nova] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Received event network-vif-unplugged-3787892f-48da-4e39-8c41-8fdb94950e59 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:02:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-eeebc717-a306-495f-b6e1-17d8f06feb3f req-f13b3094-9d20-4534-bf80-82af21a1c9c1 service nova] Acquiring lock "7e67fb47-500c-4e85-b384-27408ec622a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:02:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-eeebc717-a306-495f-b6e1-17d8f06feb3f req-f13b3094-9d20-4534-bf80-82af21a1c9c1 service nova] Lock "7e67fb47-500c-4e85-b384-27408ec622a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:02:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-eeebc717-a306-495f-b6e1-17d8f06feb3f req-f13b3094-9d20-4534-bf80-82af21a1c9c1 service nova] Lock "7e67fb47-500c-4e85-b384-27408ec622a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:02:29 user nova-compute[74994]: DEBUG nova.compute.manager [req-eeebc717-a306-495f-b6e1-17d8f06feb3f req-f13b3094-9d20-4534-bf80-82af21a1c9c1 service nova] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] No waiting events found dispatching network-vif-unplugged-3787892f-48da-4e39-8c41-8fdb94950e59 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:02:29 user nova-compute[74994]: WARNING nova.compute.manager [req-eeebc717-a306-495f-b6e1-17d8f06feb3f req-f13b3094-9d20-4534-bf80-82af21a1c9c1 service nova] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Received unexpected event network-vif-unplugged-3787892f-48da-4e39-8c41-8fdb94950e59 for instance with vm_state active and task_state rescuing.
Nov 28 11:02:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-809920a3-13cf-43c8-8515-e9dca438479f tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "20605acb-092a-4214-a114-750f145d7af8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:02:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-809920a3-13cf-43c8-8515-e9dca438479f tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "20605acb-092a-4214-a114-750f145d7af8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:02:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:29 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Instance destroyed successfully.
Nov 28 11:02:29 user nova-compute[74994]: INFO nova.compute.manager [None req-809920a3-13cf-43c8-8515-e9dca438479f tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Detaching volume d070c683-4fcf-429a-a848-14db7a1e046b
Nov 28 11:02:29 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Attempting a stable device rescue
Nov 28 11:02:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74994) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 11:02:29 user nova-compute[74994]: INFO nova.virt.block_device [None req-809920a3-13cf-43c8-8515-e9dca438479f tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Attempting to driver detach volume d070c683-4fcf-429a-a848-14db7a1e046b from mountpoint /dev/vdb
Nov 28 11:02:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Instance directory exists: not creating {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 11:02:29 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Creating image(s)
Nov 28 11:02:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "/opt/stack/data/nova/instances/7e67fb47-500c-4e85-b384-27408ec622a9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:02:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "/opt/stack/data/nova/instances/7e67fb47-500c-4e85-b384-27408ec622a9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:02:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "/opt/stack/data/nova/instances/7e67fb47-500c-4e85-b384-27408ec622a9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:02:29 user nova-compute[74994]: DEBUG nova.objects.instance [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7e67fb47-500c-4e85-b384-27408ec622a9 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:02:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-809920a3-13cf-43c8-8515-e9dca438479f tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Attempting to detach device vdb from instance 20605acb-092a-4214-a114-750f145d7af8 from the persistent domain config. {{(pid=74994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 11:02:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-809920a3-13cf-43c8-8515-e9dca438479f tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 11:02:29 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:02:29 user nova-compute[74994]:   <source dev="/dev/sde"/>
Nov 28 11:02:29 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:02:29 user nova-compute[74994]:   <serial>d070c683-4fcf-429a-a848-14db7a1e046b</serial>
Nov 28 11:02:29 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 11:02:29 user nova-compute[74994]: </disk>
Nov 28 11:02:29 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 11:02:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "33a2f7b22edd69dfc429c2b7a2481070f6fc69aa" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:02:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "33a2f7b22edd69dfc429c2b7a2481070f6fc69aa" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:02:30 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-809920a3-13cf-43c8-8515-e9dca438479f tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Successfully detached device vdb from instance 20605acb-092a-4214-a114-750f145d7af8 from the persistent domain config.
Nov 28 11:02:30 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-809920a3-13cf-43c8-8515-e9dca438479f tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 20605acb-092a-4214-a114-750f145d7af8 from the live domain config. {{(pid=74994) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 11:02:30 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-809920a3-13cf-43c8-8515-e9dca438479f tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 11:02:30 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:02:30 user nova-compute[74994]:   <source dev="/dev/sde"/>
Nov 28 11:02:30 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:02:30 user nova-compute[74994]:   <serial>d070c683-4fcf-429a-a848-14db7a1e046b</serial>
Nov 28 11:02:30 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 11:02:30 user nova-compute[74994]: </disk>
Nov 28 11:02:30 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 11:02:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a2f7b22edd69dfc429c2b7a2481070f6fc69aa.part --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:31 user nova-compute[74994]: DEBUG nova.compute.manager [req-b4e55059-d2f6-48d8-bc7b-eb6b281ff05c req-85a8aa19-f3ad-4d8a-ae4e-2e5b2460ec96 service nova] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Received event network-vif-plugged-3787892f-48da-4e39-8c41-8fdb94950e59 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:02:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-b4e55059-d2f6-48d8-bc7b-eb6b281ff05c req-85a8aa19-f3ad-4d8a-ae4e-2e5b2460ec96 service nova] Acquiring lock "7e67fb47-500c-4e85-b384-27408ec622a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:02:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-b4e55059-d2f6-48d8-bc7b-eb6b281ff05c req-85a8aa19-f3ad-4d8a-ae4e-2e5b2460ec96 service nova] Lock "7e67fb47-500c-4e85-b384-27408ec622a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:02:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-b4e55059-d2f6-48d8-bc7b-eb6b281ff05c req-85a8aa19-f3ad-4d8a-ae4e-2e5b2460ec96 service nova] Lock "7e67fb47-500c-4e85-b384-27408ec622a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:02:31 user nova-compute[74994]: DEBUG nova.compute.manager [req-b4e55059-d2f6-48d8-bc7b-eb6b281ff05c req-85a8aa19-f3ad-4d8a-ae4e-2e5b2460ec96 service nova] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] No waiting events found dispatching network-vif-plugged-3787892f-48da-4e39-8c41-8fdb94950e59 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:02:31 user nova-compute[74994]: WARNING nova.compute.manager [req-b4e55059-d2f6-48d8-bc7b-eb6b281ff05c req-85a8aa19-f3ad-4d8a-ae4e-2e5b2460ec96 service nova] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Received unexpected event network-vif-plugged-3787892f-48da-4e39-8c41-8fdb94950e59 for instance with vm_state active and task_state rescuing.
Nov 28 11:02:31 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-809920a3-13cf-43c8-8515-e9dca438479f tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 20605acb-092a-4214-a114-750f145d7af8 {{(pid=74994) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 11:02:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a2f7b22edd69dfc429c2b7a2481070f6fc69aa.part --force-share --output=json" returned: 0 in 0.219s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:31 user nova-compute[74994]: DEBUG nova.virt.images [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] d5c540bb-34a2-41f4-80ee-a488f51a23d1 was qcow2, converting to raw {{(pid=74994) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 11:02:31 user nova-compute[74994]: DEBUG nova.privsep.utils [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74994) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 11:02:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/33a2f7b22edd69dfc429c2b7a2481070f6fc69aa.part /opt/stack/data/nova/instances/_base/33a2f7b22edd69dfc429c2b7a2481070f6fc69aa.converted {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/33a2f7b22edd69dfc429c2b7a2481070f6fc69aa.part /opt/stack/data/nova/instances/_base/33a2f7b22edd69dfc429c2b7a2481070f6fc69aa.converted" returned: 0 in 0.539s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a2f7b22edd69dfc429c2b7a2481070f6fc69aa.converted --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a2f7b22edd69dfc429c2b7a2481070f6fc69aa.converted --force-share --output=json" returned: 0 in 0.205s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "33a2f7b22edd69dfc429c2b7a2481070f6fc69aa" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.374s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "33a2f7b22edd69dfc429c2b7a2481070f6fc69aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "33a2f7b22edd69dfc429c2b7a2481070f6fc69aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a2f7b22edd69dfc429c2b7a2481070f6fc69aa --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a2f7b22edd69dfc429c2b7a2481070f6fc69aa --force-share --output=json" returned: 0 in 0.194s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a2f7b22edd69dfc429c2b7a2481070f6fc69aa,backing_fmt=raw /opt/stack/data/nova/instances/7e67fb47-500c-4e85-b384-27408ec622a9/disk.rescue {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a2f7b22edd69dfc429c2b7a2481070f6fc69aa,backing_fmt=raw /opt/stack/data/nova/instances/7e67fb47-500c-4e85-b384-27408ec622a9/disk.rescue" returned: 0 in 0.059s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "33a2f7b22edd69dfc429c2b7a2481070f6fc69aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG nova.objects.instance [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lazy-loading 'migration_context' on Instance uuid 7e67fb47-500c-4e85-b384-27408ec622a9 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG nova.objects.base [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Object Instance<7e67fb47-500c-4e85-b384-27408ec622a9> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Created local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Start _get_guest_xml network_info=[{"id": "3787892f-48da-4e39-8c41-8fdb94950e59", "address": "fa:16:3e:75:4f:64", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "vif_mac": "fa:16:3e:75:4f:64"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3787892f-48", "ovs_interfaceid": "3787892f-48da-4e39-8c41-8fdb94950e59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd5c540bb-34a2-41f4-80ee-a488f51a23d1', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zNJeKmhr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '7e67fb47-500c-4e85-b384-27408ec622a9', 'attached_at': '', 'detached_at': '', 'volume_id': '8e5e838a-f84b-4636-86e1-86a3de5fd7dd', 'serial': '8e5e838a-f84b-4636-86e1-86a3de5fd7dd'}, 'attachment_id': 'ca68914b-3353-4125-8e65-aab022316dd6', 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG nova.objects.instance [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lazy-loading 'resources' on Instance uuid 7e67fb47-500c-4e85-b384-27408ec622a9 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG nova.objects.base [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Object Instance<7e67fb47-500c-4e85-b384-27408ec622a9> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG nova.objects.instance [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lazy-loading 'numa_topology' on Instance uuid 7e67fb47-500c-4e85-b384-27408ec622a9 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG nova.objects.base [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Object Instance<7e67fb47-500c-4e85-b384-27408ec622a9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 11:02:32 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:02:32 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:02:32 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG nova.objects.instance [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7e67fb47-500c-4e85-b384-27408ec622a9 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG nova.objects.base [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Object Instance<7e67fb47-500c-4e85-b384-27408ec622a9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zNJeKmhr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:02:32 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:02:32 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:02:32 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:02:32 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:02:32 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 11:02:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd -p 172.16.0.220:3260" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49e5739-8435-4575-bbfc-5315c17100ee]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = zNJeKmhr\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 28 11:02:32 user nova-compute[74994]: node.name = iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd
Nov 28 11:02:32 user nova-compute[74994]: node.tpgt = -1
Nov 28 11:02:32 user nova-compute[74994]: node.startup = automatic
Nov 28 11:02:32 user nova-compute[74994]: node.leading_login = No
Nov 28 11:02:32 user nova-compute[74994]: iface.iscsi_ifacename = default
Nov 28 11:02:32 user nova-compute[74994]: iface.net_ifacename = <empty>
Nov 28 11:02:32 user nova-compute[74994]: iface.ipaddress = <empty>
Nov 28 11:02:32 user nova-compute[74994]: iface.prefix_len = 0
Nov 28 11:02:32 user nova-compute[74994]: iface.hwaddress = <empty>
Nov 28 11:02:32 user nova-compute[74994]: iface.transport_name = tcp
Nov 28 11:02:32 user nova-compute[74994]: iface.initiatorname = <empty>
Nov 28 11:02:32 user nova-compute[74994]: iface.state = <empty>
Nov 28 11:02:32 user nova-compute[74994]: iface.vlan_id = 0
Nov 28 11:02:32 user nova-compute[74994]: iface.vlan_priority = 0
Nov 28 11:02:32 user nova-compute[74994]: iface.vlan_state = <empty>
Nov 28 11:02:32 user nova-compute[74994]: iface.iface_num = 0
Nov 28 11:02:32 user nova-compute[74994]: iface.mtu = 0
Nov 28 11:02:32 user nova-compute[74994]: iface.port = 0
Nov 28 11:02:32 user nova-compute[74994]: iface.bootproto = <empty>
Nov 28 11:02:32 user nova-compute[74994]: iface.subnet_mask = <empty>
Nov 28 11:02:32 user nova-compute[74994]: iface.gateway = <empty>
Nov 28 11:02:32 user nova-compute[74994]: iface.dhcp_alt_client_id_state = <empty>
Nov 28 11:02:32 user nova-compute[74994]: iface.dhcp_alt_client_id = <empty>
Nov 28 11:02:32 user nova-compute[74994]: iface.dhcp_dns = <empty>
Nov 28 11:02:32 user nova-compute[74994]: iface.dhcp_learn_iqn = <empty>
Nov 28 11:02:32 user nova-compute[74994]: iface.dhcp_req_vendor_id_state = <empty>
Nov 28 11:02:32 user nova-compute[74994]: iface.dhcp_vendor_id_state = <empty>
Nov 28 11:02:32 user nova-compute[74994]: iface.dhcp_vendor_id = <empty>
Nov 28 11:02:32 user nova-compute[74994]: iface.dhcp_slp_da = <empty>
Nov 28 11:02:32 user nova-compute[74994]: iface.fragmentation = <empty>
Nov 28 11:02:32 user nova-compute[74994]: iface.gratuitous_arp = <empty>
Nov 28 11:02:32 user nova-compute[74994]: iface.incoming_forwarding = <empty>
Nov 28 11:02:32 user nova-compute[74994]: iface.tos_state = <empty>
Nov 28 11:02:32 user nova-compute[74994]: iface.tos = 0
Nov 28 11:02:32 user nova-compute[74994]: iface.ttl = 0
Nov 28 11:02:32 user nova-compute[74994]: iface.delayed_ack = <empty>
Nov 28 11:02:32 user nova-compute[74994]: iface.tcp_nagle = <empty>
Nov 28 11:02:32 user nova-compute[74994]: iface.tcp_wsf_state = <empty>
Nov 28 11:02:32 user nova-compute[74994]: iface.tcp_wsf = 0
Nov 28 11:02:32 user nova-compute[74994]: iface.tcp_timer_scale = 0
Nov 28 11:02:32 user nova-compute[74994]: iface.tcp_timestamp = <empty>
Nov 28 11:02:32 user nova-compute[74994]: iface.redirect = <empty>
Nov 28 11:02:32 user nova-compute[74994]: iface.def_task_mgmt_timeout = 0
Nov 28 11:02:32 user nova-compute[74994]: iface.header_digest = <empty>
Nov 28 11:02:32 user nova-compute[74994]: iface.data_digest = <empty>
Nov 28 11:02:32 user nova-compute[74994]: iface.immediate_data = <empty>
Nov 28 11:02:32 user nova-compute[74994]: iface.initial_r2t = <empty>
Nov 28 11:02:32 user nova-compute[74994]: iface.data_seq_inorder = <empty>
Nov 28 11:02:32 user nova-compute[74994]: iface.data_pdu_inorder = <empty>
Nov 28 11:02:32 user nova-compute[74994]: iface.erl = 0
Nov 28 11:02:32 user nova-compute[74994]: iface.max_receive_data_len = 0
Nov 28 11:02:32 user nova-compute[74994]: iface.first_burst_len = 0
Nov 28 11:02:32 user nova-compute[74994]: iface.max_outstanding_r2t = 0
Nov 28 11:02:32 user nova-compute[74994]: iface.max_burst_len = 0
Nov 28 11:02:32 user nova-compute[74994]: iface.chap_auth = <empty>
Nov 28 11:02:32 user nova-compute[74994]: iface.bidi_chap = <empty>
Nov 28 11:02:32 user nova-compute[74994]: iface.strict_login_compliance = <empty>
Nov 28 11:02:32 user nova-compute[74994]: iface.discovery_auth = <empty>
Nov 28 11:02:32 user nova-compute[74994]: iface.discovery_logout = <empty>
Nov 28 11:02:32 user nova-compute[74994]: node.discovery_address = <empty>
Nov 28 11:02:32 user nova-compute[74994]: node.discovery_port = 0
Nov 28 11:02:32 user nova-compute[74994]: node.discovery_type = static
Nov 28 11:02:32 user nova-compute[74994]: node.session.initial_cmdsn = 0
Nov 28 11:02:32 user nova-compute[74994]: node.session.initial_login_retry_max = 8
Nov 28 11:02:32 user nova-compute[74994]: node.session.xmit_thread_priority = -20
Nov 28 11:02:32 user nova-compute[74994]: node.session.cmds_max = 128
Nov 28 11:02:32 user nova-compute[74994]: node.session.queue_depth = 32
Nov 28 11:02:32 user nova-compute[74994]: node.session.nr_sessions = 1
Nov 28 11:02:32 user nova-compute[74994]: node.session.auth.authmethod = CHAP
Nov 28 11:02:32 user nova-compute[74994]: node.session.auth.username = zNJeKmhr
Nov 28 11:02:32 user nova-compute[74994]: node.session.auth.password = ***
Nov 28 11:02:32 user nova-compute[74994]: node.session.auth.username_in = <empty>
Nov 28 11:02:32 user nova-compute[74994]: node.session.auth.password_in = <empty>
Nov 28 11:02:32 user nova-compute[74994]: node.session.auth.chap_algs = MD5
Nov 28 11:02:32 user nova-compute[74994]: node.session.timeo.replacement_timeout = 120
Nov 28 11:02:32 user nova-compute[74994]: node.session.err_timeo.abort_timeout = 15
Nov 28 11:02:32 user nova-compute[74994]: node.session.err_timeo.lu_reset_timeout = 30
Nov 28 11:02:32 user nova-compute[74994]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 28 11:02:32 user nova-compute[74994]: node.session.err_timeo.host_reset_timeout = 60
Nov 28 11:02:32 user nova-compute[74994]: node.session.iscsi.FastAbort = Yes
Nov 28 11:02:32 user nova-compute[74994]: node.session.iscsi.InitialR2T = No
Nov 28 11:02:32 user nova-compute[74994]: node.session.iscsi.ImmediateData = Yes
Nov 28 11:02:32 user nova-compute[74994]: node.session.iscsi.FirstBurstLength = 262144
Nov 28 11:02:32 user nova-compute[74994]: node.session.iscsi.MaxBurstLength = 16776192
Nov 28 11:02:32 user nova-compute[74994]: node.session.iscsi.DefaultTime2Retain = 0
Nov 28 11:02:32 user nova-compute[74994]: node.session.iscsi.DefaultTime2Wait = 2
Nov 28 11:02:32 user nova-compute[74994]: node.session.iscsi.MaxConnections = 1
Nov 28 11:02:32 user nova-compute[74994]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 28 11:02:32 user nova-compute[74994]: node.session.iscsi.ERL = 0
Nov 28 11:02:32 user nova-compute[74994]: node.session.scan = manual
Nov 28 11:02:32 user nova-compute[74994]: node.session.reopen_max = 0
Nov 28 11:02:32 user nova-compute[74994]: node.conn[0].address = 172.16.0.220
Nov 28 11:02:32 user nova-compute[74994]: node.conn[0].port = 3260
Nov 28 11:02:32 user nova-compute[74994]: node.conn[0].startup = manual
Nov 28 11:02:32 user nova-compute[74994]: node.conn[0].tcp.window_size = 524288
Nov 28 11:02:32 user nova-compute[74994]: node.conn[0].tcp.type_of_service = 0
Nov 28 11:02:32 user nova-compute[74994]: node.conn[0].timeo.logout_timeout = 15
Nov 28 11:02:32 user nova-compute[74994]: node.conn[0].timeo.login_timeout = 15
Nov 28 11:02:32 user nova-compute[74994]: node.conn[0].timeo.auth_timeout = 45
Nov 28 11:02:32 user nova-compute[74994]: node.conn[0].timeo.noop_out_interval = 5
Nov 28 11:02:32 user nova-compute[74994]: node.conn[0].timeo.noop_out_timeout = 5
Nov 28 11:02:32 user nova-compute[74994]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 28 11:02:32 user nova-compute[74994]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 28 11:02:32 user nova-compute[74994]: node.conn[0].iscsi.HeaderDigest = None
Nov 28 11:02:32 user nova-compute[74994]: node.conn[0].iscsi.DataDigest = None
Nov 28 11:02:32 user nova-compute[74994]: node.conn[0].iscsi.IFMarker = No
Nov 28 11:02:32 user nova-compute[74994]: node.conn[0].iscsi.OFMarker = No
Nov 28 11:02:32 user nova-compute[74994]: # END RECORD
Nov 28 11:02:32 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[24342e3c-0d22-451e-83c2-f8fc5d351b88]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a991e94-f2fb-4a5b-ba7d-9f5c3587fbd2]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:02:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zNJeKmhr {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zNJeKmhr" returned: 0 in 0.059s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:33 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ebddbd-11ff-4875-a9c1-6ade8b775215]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zNJeKmhr'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:02:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:33 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b22a461-37cd-46a4-811e-b63e3784d655]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:02:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:33 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74cdec3-a540-41a0-b35b-0958727834db]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:02:33 user nova-compute[74994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)
Nov 28 11:02:33 user nova-compute[74994]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)
Nov 28 11:02:33 user nova-compute[74994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)
Nov 28 11:02:33 user nova-compute[74994]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 (non-flash)
Nov 28 11:02:33 user nova-compute[74994]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 (non-flash)
Nov 28 11:02:33 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:02:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:02:33 user nova-compute[74994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)
Nov 28 11:02:33 user nova-compute[74994]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)
Nov 28 11:02:33 user nova-compute[74994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)
Nov 28 11:02:33 user nova-compute[74994]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 (non-flash)
Nov 28 11:02:33 user nova-compute[74994]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 (non-flash)
Nov 28 11:02:33 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:02:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.214s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:02:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 11:02:33 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] HCTL ('35', '0', '0', 0) found on session 32 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 11:02:33 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 11:02:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:33 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f61b4c-a5b9-41ea-9db4-18b0cf9cf62b]: (4, ('0 0 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:33 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Searching for a device in session 32 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 11:02:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zNJeKmhr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 11:02:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.242s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:02:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] <== connect_volume: return (243ms) {'type': 'block', 'scsi_wwn': '26363313065616137', 'path': '/dev/sdd'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:02:33 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363313065616137', 'path': '/dev/sdd'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 11:02:33 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1778676797',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1778676797',id=30,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T11:00:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='612ae9ec21ad40a4b68e0926843874ae',ramdisk_id='',reservation_id='r-bqvy1wtv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-332508527',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:00:56Z,user_data=None,user_id='6c49cba00cff4c4b80080c5f917b4176',uuid=7e67fb47-500c-4e85-b384-27408ec622a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3787892f-48da-4e39-8c41-8fdb94950e59", "address": "fa:16:3e:75:4f:64", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "vif_mac": "fa:16:3e:75:4f:64"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3787892f-48", "ovs_interfaceid": "3787892f-48da-4e39-8c41-8fdb94950e59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 11:02:33 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Converting VIF {"id": "3787892f-48da-4e39-8c41-8fdb94950e59", "address": "fa:16:3e:75:4f:64", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "vif_mac": "fa:16:3e:75:4f:64"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3787892f-48", "ovs_interfaceid": "3787892f-48da-4e39-8c41-8fdb94950e59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:02:33 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:4f:64,bridge_name='br-int',has_traffic_filtering=True,id=3787892f-48da-4e39-8c41-8fdb94950e59,network=Network(a1692a13-d1d7-4df6-bfc0-54f231846889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3787892f-48') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:02:33 user nova-compute[74994]: DEBUG nova.objects.instance [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e67fb47-500c-4e85-b384-27408ec622a9 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:02:33 user nova-compute[74994]: DEBUG nova.objects.base [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Object Instance<7e67fb47-500c-4e85-b384-27408ec622a9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 11:02:33 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] End _get_guest_xml xml=<domain type="kvm">
Nov 28 11:02:33 user nova-compute[74994]:   <uuid>7e67fb47-500c-4e85-b384-27408ec622a9</uuid>
Nov 28 11:02:33 user nova-compute[74994]:   <name>instance-0000001e</name>
Nov 28 11:02:33 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 11:02:33 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 11:02:33 user nova-compute[74994]:   <metadata>
Nov 28 11:02:33 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 11:02:33 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 11:02:33 user nova-compute[74994]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1778676797</nova:name>
Nov 28 11:02:33 user nova-compute[74994]:       <nova:creationTime>2023-11-28 11:02:32</nova:creationTime>
Nov 28 11:02:33 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 11:02:33 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 11:02:33 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 11:02:33 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 11:02:33 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 11:02:33 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 11:02:33 user nova-compute[74994]:       </nova:flavor>
Nov 28 11:02:33 user nova-compute[74994]:       <nova:owner>
Nov 28 11:02:33 user nova-compute[74994]:         <nova:user uuid="6c49cba00cff4c4b80080c5f917b4176">tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member</nova:user>
Nov 28 11:02:33 user nova-compute[74994]:         <nova:project uuid="612ae9ec21ad40a4b68e0926843874ae">tempest-ServerBootFromVolumeStableRescueTest-332508527</nova:project>
Nov 28 11:02:33 user nova-compute[74994]:       </nova:owner>
Nov 28 11:02:33 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 11:02:33 user nova-compute[74994]:       <nova:ports>
Nov 28 11:02:33 user nova-compute[74994]:         <nova:port uuid="3787892f-48da-4e39-8c41-8fdb94950e59">
Nov 28 11:02:33 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 11:02:33 user nova-compute[74994]:         </nova:port>
Nov 28 11:02:33 user nova-compute[74994]:       </nova:ports>
Nov 28 11:02:33 user nova-compute[74994]:     </nova:instance>
Nov 28 11:02:33 user nova-compute[74994]:   </metadata>
Nov 28 11:02:33 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 11:02:33 user nova-compute[74994]:     <system>
Nov 28 11:02:33 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 11:02:33 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 11:02:33 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 11:02:33 user nova-compute[74994]:       <entry name="serial">7e67fb47-500c-4e85-b384-27408ec622a9</entry>
Nov 28 11:02:33 user nova-compute[74994]:       <entry name="uuid">7e67fb47-500c-4e85-b384-27408ec622a9</entry>
Nov 28 11:02:33 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 11:02:33 user nova-compute[74994]:     </system>
Nov 28 11:02:33 user nova-compute[74994]:   </sysinfo>
Nov 28 11:02:33 user nova-compute[74994]:   <os>
Nov 28 11:02:33 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 11:02:33 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 11:02:33 user nova-compute[74994]:   </os>
Nov 28 11:02:33 user nova-compute[74994]:   <features>
Nov 28 11:02:33 user nova-compute[74994]:     <acpi/>
Nov 28 11:02:33 user nova-compute[74994]:     <apic/>
Nov 28 11:02:33 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 11:02:33 user nova-compute[74994]:   </features>
Nov 28 11:02:33 user nova-compute[74994]:   <clock offset="utc">
Nov 28 11:02:33 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 11:02:33 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 11:02:33 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 11:02:33 user nova-compute[74994]:   </clock>
Nov 28 11:02:33 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 11:02:33 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 11:02:33 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 11:02:33 user nova-compute[74994]:   </cpu>
Nov 28 11:02:33 user nova-compute[74994]:   <devices>
Nov 28 11:02:33 user nova-compute[74994]:     <disk type="block" device="disk">
Nov 28 11:02:33 user nova-compute[74994]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:02:33 user nova-compute[74994]:       <source dev="/dev/sdd"/>
Nov 28 11:02:33 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 11:02:33 user nova-compute[74994]:       <serial>8e5e838a-f84b-4636-86e1-86a3de5fd7dd</serial>
Nov 28 11:02:33 user nova-compute[74994]:     </disk>
Nov 28 11:02:33 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 11:02:33 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 11:02:33 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/7e67fb47-500c-4e85-b384-27408ec622a9/disk.rescue"/>
Nov 28 11:02:33 user nova-compute[74994]:       <target dev="vdb" bus="virtio"/>
Nov 28 11:02:33 user nova-compute[74994]:       <boot order="1"/>
Nov 28 11:02:33 user nova-compute[74994]:     </disk>
Nov 28 11:02:33 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 11:02:33 user nova-compute[74994]:       <mac address="fa:16:3e:75:4f:64"/>
Nov 28 11:02:33 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:02:33 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 11:02:33 user nova-compute[74994]:       <target dev="tap3787892f-48"/>
Nov 28 11:02:33 user nova-compute[74994]:     </interface>
Nov 28 11:02:33 user nova-compute[74994]:     <serial type="pty">
Nov 28 11:02:33 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/7e67fb47-500c-4e85-b384-27408ec622a9/console.log" append="off"/>
Nov 28 11:02:33 user nova-compute[74994]:     </serial>
Nov 28 11:02:33 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 11:02:33 user nova-compute[74994]:     <video>
Nov 28 11:02:33 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:02:33 user nova-compute[74994]:     </video>
Nov 28 11:02:33 user nova-compute[74994]:     <rng model="virtio">
Nov 28 11:02:33 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 11:02:33 user nova-compute[74994]:     </rng>
Nov 28 11:02:33 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 11:02:33 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 11:02:33 user nova-compute[74994]:       <stats period="10"/>
Nov 28 11:02:33 user nova-compute[74994]:     </memballoon>
Nov 28 11:02:33 user nova-compute[74994]:   </devices>
Nov 28 11:02:33 user nova-compute[74994]: </domain>
Nov 28 11:02:33 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 11:02:33 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Instance destroyed successfully.
Nov 28 11:02:33 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:02:33 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:02:33 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] No VIF found with MAC fa:16:3e:75:4f:64, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:02:33 user nova-compute[74994]: DEBUG nova.compute.manager [req-7777156b-f1f7-4583-9b6c-80945190c8b7 req-0e069d7c-244b-4056-b17a-cbd3d1b4c97f service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Received event network-changed-e3ec524f-0e85-40e1-8817-b9d4b75f9966 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:02:33 user nova-compute[74994]: DEBUG nova.compute.manager [req-7777156b-f1f7-4583-9b6c-80945190c8b7 req-0e069d7c-244b-4056-b17a-cbd3d1b4c97f service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Refreshing instance network info cache due to event network-changed-e3ec524f-0e85-40e1-8817-b9d4b75f9966. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:02:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-7777156b-f1f7-4583-9b6c-80945190c8b7 req-0e069d7c-244b-4056-b17a-cbd3d1b4c97f service nova] Acquiring lock "refresh_cache-d1de4238-c33e-48a6-bb4f-240e91e81ea3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:02:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-7777156b-f1f7-4583-9b6c-80945190c8b7 req-0e069d7c-244b-4056-b17a-cbd3d1b4c97f service nova] Acquired lock "refresh_cache-d1de4238-c33e-48a6-bb4f-240e91e81ea3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:02:33 user nova-compute[74994]: DEBUG nova.network.neutron [req-7777156b-f1f7-4583-9b6c-80945190c8b7 req-0e069d7c-244b-4056-b17a-cbd3d1b4c97f service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Refreshing network info cache for port e3ec524f-0e85-40e1-8817-b9d4b75f9966 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:02:34 user nova-compute[74994]: DEBUG nova.network.neutron [req-7777156b-f1f7-4583-9b6c-80945190c8b7 req-0e069d7c-244b-4056-b17a-cbd3d1b4c97f service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Updated VIF entry in instance network info cache for port e3ec524f-0e85-40e1-8817-b9d4b75f9966. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:02:34 user nova-compute[74994]: DEBUG nova.network.neutron [req-7777156b-f1f7-4583-9b6c-80945190c8b7 req-0e069d7c-244b-4056-b17a-cbd3d1b4c97f service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Updating instance_info_cache with network_info: [{"id": "e3ec524f-0e85-40e1-8817-b9d4b75f9966", "address": "fa:16:3e:99:ce:ce", "network": {"id": "89f2b906-9ef3-4e31-87e5-3e0cd23e8695", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2005181920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9670a509ac14f41a9f44d7299fd2f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3ec524f-0e", "ovs_interfaceid": "e3ec524f-0e85-40e1-8817-b9d4b75f9966", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:02:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-7777156b-f1f7-4583-9b6c-80945190c8b7 req-0e069d7c-244b-4056-b17a-cbd3d1b4c97f service nova] Releasing lock "refresh_cache-d1de4238-c33e-48a6-bb4f-240e91e81ea3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:02:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:34 user nova-compute[74994]: DEBUG nova.objects.instance [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lazy-loading 'flavor' on Instance uuid 2f4b631a-46c8-4f9b-b5f9-6e2542484658 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:02:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Acquiring lock "refresh_cache-2f4b631a-46c8-4f9b-b5f9-6e2542484658" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:02:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Acquired lock "refresh_cache-2f4b631a-46c8-4f9b-b5f9-6e2542484658" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:02:34 user nova-compute[74994]: DEBUG nova.network.neutron [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 11:02:34 user nova-compute[74994]: DEBUG nova.objects.instance [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lazy-loading 'info_cache' on Instance uuid 2f4b631a-46c8-4f9b-b5f9-6e2542484658 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:02:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:34 user nova-compute[74994]: DEBUG nova.objects.base [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Object Instance<2f4b631a-46c8-4f9b-b5f9-6e2542484658> lazy-loaded attributes: flavor,info_cache {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 11:02:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Acquiring lock "cdc5adf9-5a73-4d7d-b53d-849354a3a053" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:02:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Lock "cdc5adf9-5a73-4d7d-b53d-849354a3a053" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:02:34 user nova-compute[74994]: DEBUG nova.compute.manager [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 11:02:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:02:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:02:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 11:02:34 user nova-compute[74994]: INFO nova.compute.claims [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Claim successful on node user
Nov 28 11:02:35 user nova-compute[74994]: DEBUG nova.network.neutron [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Updating instance_info_cache with network_info: [{"id": "068080a2-5847-4053-a463-9fc29cb64bb4", "address": "fa:16:3e:21:e9:f5", "network": {"id": "844b3eab-57f3-4582-9fcc-04594e44081b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-233988918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33727b28c7d94b7bbe8987c1301eec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068080a2-58", "ovs_interfaceid": "068080a2-5847-4053-a463-9fc29cb64bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Releasing lock "refresh_cache-2f4b631a-46c8-4f9b-b5f9-6e2542484658" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:02:35 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Instance destroyed successfully.
Nov 28 11:02:35 user nova-compute[74994]: DEBUG nova.objects.instance [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lazy-loading 'resources' on Instance uuid 2f4b631a-46c8-4f9b-b5f9-6e2542484658 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG nova.objects.base [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Object Instance<2f4b631a-46c8-4f9b-b5f9-6e2542484658> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:54:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-107367549',display_name='tempest-AttachVolumeTestJSON-server-107367549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-107367549',id=20,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPaObEUIaQ+CDNwt47CPRXIZ7eFISJE/iAezjV3I0JL+MYNy2O/xy+BPGpqSlurI4jnHrFjLiC5c/eman9PMAcvN7snGFvVpuVRua1rqVAVoDQMEJZ1527ex29ZklUbnQ==',key_name='tempest-keypair-1250905933',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:54:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='33727b28c7d94b7bbe8987c1301eec04',ramdisk_id='',reservation_id='r-5ou66u0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-565652019',owner_user_name='tempest-AttachVolumeTestJSON-565652019-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T11:00:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44e7cead5a1a4ed09ee100e9b7a4968d',uuid=2f4b631a-46c8-4f9b-b5f9-6e2542484658,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "068080a2-5847-4053-a463-9fc29cb64bb4", "address": "fa:16:3e:21:e9:f5", "network": {"id": "844b3eab-57f3-4582-9fcc-04594e44081b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-233988918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33727b28c7d94b7bbe8987c1301eec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068080a2-58", "ovs_interfaceid": "068080a2-5847-4053-a463-9fc29cb64bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Converting VIF {"id": "068080a2-5847-4053-a463-9fc29cb64bb4", "address": "fa:16:3e:21:e9:f5", "network": {"id": "844b3eab-57f3-4582-9fcc-04594e44081b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-233988918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33727b28c7d94b7bbe8987c1301eec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068080a2-58", "ovs_interfaceid": "068080a2-5847-4053-a463-9fc29cb64bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:e9:f5,bridge_name='br-int',has_traffic_filtering=True,id=068080a2-5847-4053-a463-9fc29cb64bb4,network=Network(844b3eab-57f3-4582-9fcc-04594e44081b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068080a2-58') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG os_vif [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:e9:f5,bridge_name='br-int',has_traffic_filtering=True,id=068080a2-5847-4053-a463-9fc29cb64bb4,network=Network(844b3eab-57f3-4582-9fcc-04594e44081b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068080a2-58') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap068080a2-58, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bb7402a4-dd7e-40b9-87e2-c82f626d0e1d) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:35 user nova-compute[74994]: INFO os_vif [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:e9:f5,bridge_name='br-int',has_traffic_filtering=True,id=068080a2-5847-4053-a463-9fc29cb64bb4,network=Network(844b3eab-57f3-4582-9fcc-04594e44081b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068080a2-58')
Nov 28 11:02:35 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Start _get_guest_xml network_info=[{"id": "068080a2-5847-4053-a463-9fc29cb64bb4", "address": "fa:16:3e:21:e9:f5", "network": {"id": "844b3eab-57f3-4582-9fcc-04594e44081b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-233988918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33727b28c7d94b7bbe8987c1301eec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068080a2-58", "ovs_interfaceid": "068080a2-5847-4053-a463-9fc29cb64bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'aa939d1b-b8a6-4391-935b-0191bf5ccd0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG nova.objects.instance [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lazy-loading 'numa_topology' on Instance uuid 2f4b631a-46c8-4f9b-b5f9-6e2542484658 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG nova.objects.base [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Object Instance<2f4b631a-46c8-4f9b-b5f9-6e2542484658> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 11:02:35 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:02:35 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:02:35 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG nova.objects.instance [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2f4b631a-46c8-4f9b-b5f9-6e2542484658 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG nova.objects.base [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Object Instance<2f4b631a-46c8-4f9b-b5f9-6e2542484658> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:54:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-107367549',display_name='tempest-AttachVolumeTestJSON-server-107367549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-107367549',id=20,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPaObEUIaQ+CDNwt47CPRXIZ7eFISJE/iAezjV3I0JL+MYNy2O/xy+BPGpqSlurI4jnHrFjLiC5c/eman9PMAcvN7snGFvVpuVRua1rqVAVoDQMEJZ1527ex29ZklUbnQ==',key_name='tempest-keypair-1250905933',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:54:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='33727b28c7d94b7bbe8987c1301eec04',ramdisk_id='',reservation_id='r-5ou66u0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-565652019',owner_user_name='tempest-AttachVolumeTestJSON-565652019-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T11:00:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44e7cead5a1a4ed09ee100e9b7a4968d',uuid=2f4b631a-46c8-4f9b-b5f9-6e2542484658,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "068080a2-5847-4053-a463-9fc29cb64bb4", "address": "fa:16:3e:21:e9:f5", "network": {"id": "844b3eab-57f3-4582-9fcc-04594e44081b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-233988918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33727b28c7d94b7bbe8987c1301eec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068080a2-58", "ovs_interfaceid": "068080a2-5847-4053-a463-9fc29cb64bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Converting VIF {"id": "068080a2-5847-4053-a463-9fc29cb64bb4", "address": "fa:16:3e:21:e9:f5", "network": {"id": "844b3eab-57f3-4582-9fcc-04594e44081b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-233988918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33727b28c7d94b7bbe8987c1301eec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068080a2-58", "ovs_interfaceid": "068080a2-5847-4053-a463-9fc29cb64bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:e9:f5,bridge_name='br-int',has_traffic_filtering=True,id=068080a2-5847-4053-a463-9fc29cb64bb4,network=Network(844b3eab-57f3-4582-9fcc-04594e44081b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068080a2-58') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG nova.objects.instance [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f4b631a-46c8-4f9b-b5f9-6e2542484658 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG nova.objects.base [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Object Instance<2f4b631a-46c8-4f9b-b5f9-6e2542484658> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] End _get_guest_xml xml=<domain type="kvm">
Nov 28 11:02:35 user nova-compute[74994]:   <uuid>2f4b631a-46c8-4f9b-b5f9-6e2542484658</uuid>
Nov 28 11:02:35 user nova-compute[74994]:   <name>instance-00000014</name>
Nov 28 11:02:35 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 11:02:35 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 11:02:35 user nova-compute[74994]:   <metadata>
Nov 28 11:02:35 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 11:02:35 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 11:02:35 user nova-compute[74994]:       <nova:name>tempest-AttachVolumeTestJSON-server-107367549</nova:name>
Nov 28 11:02:35 user nova-compute[74994]:       <nova:creationTime>2023-11-28 11:02:35</nova:creationTime>
Nov 28 11:02:35 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 11:02:35 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 11:02:35 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 11:02:35 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 11:02:35 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 11:02:35 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 11:02:35 user nova-compute[74994]:       </nova:flavor>
Nov 28 11:02:35 user nova-compute[74994]:       <nova:owner>
Nov 28 11:02:35 user nova-compute[74994]:         <nova:user uuid="44e7cead5a1a4ed09ee100e9b7a4968d">tempest-AttachVolumeTestJSON-565652019-project-member</nova:user>
Nov 28 11:02:35 user nova-compute[74994]:         <nova:project uuid="33727b28c7d94b7bbe8987c1301eec04">tempest-AttachVolumeTestJSON-565652019</nova:project>
Nov 28 11:02:35 user nova-compute[74994]:       </nova:owner>
Nov 28 11:02:35 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 11:02:35 user nova-compute[74994]:       <nova:ports>
Nov 28 11:02:35 user nova-compute[74994]:         <nova:port uuid="068080a2-5847-4053-a463-9fc29cb64bb4">
Nov 28 11:02:35 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 28 11:02:35 user nova-compute[74994]:         </nova:port>
Nov 28 11:02:35 user nova-compute[74994]:       </nova:ports>
Nov 28 11:02:35 user nova-compute[74994]:     </nova:instance>
Nov 28 11:02:35 user nova-compute[74994]:   </metadata>
Nov 28 11:02:35 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 11:02:35 user nova-compute[74994]:     <system>
Nov 28 11:02:35 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 11:02:35 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 11:02:35 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 11:02:35 user nova-compute[74994]:       <entry name="serial">2f4b631a-46c8-4f9b-b5f9-6e2542484658</entry>
Nov 28 11:02:35 user nova-compute[74994]:       <entry name="uuid">2f4b631a-46c8-4f9b-b5f9-6e2542484658</entry>
Nov 28 11:02:35 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 11:02:35 user nova-compute[74994]:     </system>
Nov 28 11:02:35 user nova-compute[74994]:   </sysinfo>
Nov 28 11:02:35 user nova-compute[74994]:   <os>
Nov 28 11:02:35 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 11:02:35 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 11:02:35 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 11:02:35 user nova-compute[74994]:   </os>
Nov 28 11:02:35 user nova-compute[74994]:   <features>
Nov 28 11:02:35 user nova-compute[74994]:     <acpi/>
Nov 28 11:02:35 user nova-compute[74994]:     <apic/>
Nov 28 11:02:35 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 11:02:35 user nova-compute[74994]:   </features>
Nov 28 11:02:35 user nova-compute[74994]:   <clock offset="utc">
Nov 28 11:02:35 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 11:02:35 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 11:02:35 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 11:02:35 user nova-compute[74994]:   </clock>
Nov 28 11:02:35 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 11:02:35 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 11:02:35 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 11:02:35 user nova-compute[74994]:   </cpu>
Nov 28 11:02:35 user nova-compute[74994]:   <devices>
Nov 28 11:02:35 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 11:02:35 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 11:02:35 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk"/>
Nov 28 11:02:35 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 11:02:35 user nova-compute[74994]:     </disk>
Nov 28 11:02:35 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 11:02:35 user nova-compute[74994]:       <mac address="fa:16:3e:21:e9:f5"/>
Nov 28 11:02:35 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:02:35 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 11:02:35 user nova-compute[74994]:       <target dev="tap068080a2-58"/>
Nov 28 11:02:35 user nova-compute[74994]:     </interface>
Nov 28 11:02:35 user nova-compute[74994]:     <serial type="pty">
Nov 28 11:02:35 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/console.log" append="off"/>
Nov 28 11:02:35 user nova-compute[74994]:     </serial>
Nov 28 11:02:35 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 11:02:35 user nova-compute[74994]:     <video>
Nov 28 11:02:35 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:02:35 user nova-compute[74994]:     </video>
Nov 28 11:02:35 user nova-compute[74994]:     <rng model="virtio">
Nov 28 11:02:35 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 11:02:35 user nova-compute[74994]:     </rng>
Nov 28 11:02:35 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 11:02:35 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 11:02:35 user nova-compute[74994]:       <stats period="10"/>
Nov 28 11:02:35 user nova-compute[74994]:     </memballoon>
Nov 28 11:02:35 user nova-compute[74994]:   </devices>
Nov 28 11:02:35 user nova-compute[74994]: </domain>
Nov 28 11:02:35 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG nova.compute.manager [req-522d20f5-fc80-47a9-95ea-22ceff9ae619 req-9d442dad-0c73-471f-be81-6fe426f7c8fd service nova] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Received event network-vif-plugged-3787892f-48da-4e39-8c41-8fdb94950e59 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-522d20f5-fc80-47a9-95ea-22ceff9ae619 req-9d442dad-0c73-471f-be81-6fe426f7c8fd service nova] Acquiring lock "7e67fb47-500c-4e85-b384-27408ec622a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-522d20f5-fc80-47a9-95ea-22ceff9ae619 req-9d442dad-0c73-471f-be81-6fe426f7c8fd service nova] Lock "7e67fb47-500c-4e85-b384-27408ec622a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-522d20f5-fc80-47a9-95ea-22ceff9ae619 req-9d442dad-0c73-471f-be81-6fe426f7c8fd service nova] Lock "7e67fb47-500c-4e85-b384-27408ec622a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG nova.compute.manager [req-522d20f5-fc80-47a9-95ea-22ceff9ae619 req-9d442dad-0c73-471f-be81-6fe426f7c8fd service nova] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] No waiting events found dispatching network-vif-plugged-3787892f-48da-4e39-8c41-8fdb94950e59 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:02:35 user nova-compute[74994]: WARNING nova.compute.manager [req-522d20f5-fc80-47a9-95ea-22ceff9ae619 req-9d442dad-0c73-471f-be81-6fe426f7c8fd service nova] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Received unexpected event network-vif-plugged-3787892f-48da-4e39-8c41-8fdb94950e59 for instance with vm_state active and task_state rescuing.
Nov 28 11:02:35 user nova-compute[74994]: DEBUG nova.compute.manager [req-522d20f5-fc80-47a9-95ea-22ceff9ae619 req-9d442dad-0c73-471f-be81-6fe426f7c8fd service nova] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Received event network-vif-plugged-3787892f-48da-4e39-8c41-8fdb94950e59 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-522d20f5-fc80-47a9-95ea-22ceff9ae619 req-9d442dad-0c73-471f-be81-6fe426f7c8fd service nova] Acquiring lock "7e67fb47-500c-4e85-b384-27408ec622a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-522d20f5-fc80-47a9-95ea-22ceff9ae619 req-9d442dad-0c73-471f-be81-6fe426f7c8fd service nova] Lock "7e67fb47-500c-4e85-b384-27408ec622a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-522d20f5-fc80-47a9-95ea-22ceff9ae619 req-9d442dad-0c73-471f-be81-6fe426f7c8fd service nova] Lock "7e67fb47-500c-4e85-b384-27408ec622a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG nova.compute.manager [req-522d20f5-fc80-47a9-95ea-22ceff9ae619 req-9d442dad-0c73-471f-be81-6fe426f7c8fd service nova] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] No waiting events found dispatching network-vif-plugged-3787892f-48da-4e39-8c41-8fdb94950e59 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:02:35 user nova-compute[74994]: WARNING nova.compute.manager [req-522d20f5-fc80-47a9-95ea-22ceff9ae619 req-9d442dad-0c73-471f-be81-6fe426f7c8fd service nova] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Received unexpected event network-vif-plugged-3787892f-48da-4e39-8c41-8fdb94950e59 for instance with vm_state active and task_state rescuing.
Nov 28 11:02:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.727s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG nova.compute.manager [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG nova.objects.instance [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2f4b631a-46c8-4f9b-b5f9-6e2542484658 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG nova.compute.manager [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG nova.network.neutron [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG nova.objects.base [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Object Instance<2f4b631a-46c8-4f9b-b5f9-6e2542484658> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:35 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 11:02:35 user nova-compute[74994]: DEBUG nova.compute.manager [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG nova.policy [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9affb276780046279c51abc15f9a8e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768cbb3a27d142b2a1e8b521894df120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.183s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk. size=1073741824 {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG nova.compute.manager [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 11:02:35 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Creating image(s)
Nov 28 11:02:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Acquiring lock "/opt/stack/data/nova/instances/cdc5adf9-5a73-4d7d-b53d-849354a3a053/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Lock "/opt/stack/data/nova/instances/cdc5adf9-5a73-4d7d-b53d-849354a3a053/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Lock "/opt/stack/data/nova/instances/cdc5adf9-5a73-4d7d-b53d-849354a3a053/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:02:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:36 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:36 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Cannot resize image /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk to a smaller size. {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 11:02:36 user nova-compute[74994]: DEBUG nova.objects.instance [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lazy-loading 'migration_context' on Instance uuid 2f4b631a-46c8-4f9b-b5f9-6e2542484658 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:02:36 user nova-compute[74994]: DEBUG nova.objects.base [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Object Instance<2f4b631a-46c8-4f9b-b5f9-6e2542484658> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 11:02:36 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:54:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-107367549',display_name='tempest-AttachVolumeTestJSON-server-107367549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-107367549',id=20,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPaObEUIaQ+CDNwt47CPRXIZ7eFISJE/iAezjV3I0JL+MYNy2O/xy+BPGpqSlurI4jnHrFjLiC5c/eman9PMAcvN7snGFvVpuVRua1rqVAVoDQMEJZ1527ex29ZklUbnQ==',key_name='tempest-keypair-1250905933',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:54:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='33727b28c7d94b7bbe8987c1301eec04',ramdisk_id='',reservation_id='r-5ou66u0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-565652019',owner_user_name='tempest-AttachVolumeTestJSON-565652019-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:00:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44e7cead5a1a4ed09ee100e9b7a4968d',uuid=2f4b631a-46c8-4f9b-b5f9-6e2542484658,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "068080a2-5847-4053-a463-9fc29cb64bb4", "address": "fa:16:3e:21:e9:f5", "network": {"id": "844b3eab-57f3-4582-9fcc-04594e44081b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-233988918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33727b28c7d94b7bbe8987c1301eec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068080a2-58", "ovs_interfaceid": "068080a2-5847-4053-a463-9fc29cb64bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 11:02:36 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Converting VIF {"id": "068080a2-5847-4053-a463-9fc29cb64bb4", "address": "fa:16:3e:21:e9:f5", "network": {"id": "844b3eab-57f3-4582-9fcc-04594e44081b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-233988918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33727b28c7d94b7bbe8987c1301eec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068080a2-58", "ovs_interfaceid": "068080a2-5847-4053-a463-9fc29cb64bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:02:36 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:e9:f5,bridge_name='br-int',has_traffic_filtering=True,id=068080a2-5847-4053-a463-9fc29cb64bb4,network=Network(844b3eab-57f3-4582-9fcc-04594e44081b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068080a2-58') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:02:36 user nova-compute[74994]: DEBUG os_vif [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:e9:f5,bridge_name='br-int',has_traffic_filtering=True,id=068080a2-5847-4053-a463-9fc29cb64bb4,network=Network(844b3eab-57f3-4582-9fcc-04594e44081b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068080a2-58') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 11:02:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:02:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 11:02:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5676dbdb-86ff-5262-ad33-dca06f2d9f0f', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:02:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:02:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap068080a2-58, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:02:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap068080a2-58, col_values=(('qos', UUID('ad1fe185-9ada-4764-8148-4305c33ef0f3')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:02:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap068080a2-58, col_values=(('external_ids', {'iface-id': '068080a2-5847-4053-a463-9fc29cb64bb4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:e9:f5', 'vm-uuid': '2f4b631a-46c8-4f9b-b5f9-6e2542484658'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:02:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:02:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:36 user nova-compute[74994]: INFO os_vif [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:e9:f5,bridge_name='br-int',has_traffic_filtering=True,id=068080a2-5847-4053-a463-9fc29cb64bb4,network=Network(844b3eab-57f3-4582-9fcc-04594e44081b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068080a2-58')
Nov 28 11:02:36 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.199s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Acquiring lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:02:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:02:36 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:36 user nova-compute[74994]: DEBUG nova.compute.manager [req-aee99f00-cce1-4c0b-afa9-ef17a2cf48d0 req-e27497ae-f055-4e97-b181-9b1881509c17 service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Received event network-changed-e3ec524f-0e85-40e1-8817-b9d4b75f9966 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:02:36 user nova-compute[74994]: DEBUG nova.compute.manager [req-aee99f00-cce1-4c0b-afa9-ef17a2cf48d0 req-e27497ae-f055-4e97-b181-9b1881509c17 service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Refreshing instance network info cache due to event network-changed-e3ec524f-0e85-40e1-8817-b9d4b75f9966. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:02:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-aee99f00-cce1-4c0b-afa9-ef17a2cf48d0 req-e27497ae-f055-4e97-b181-9b1881509c17 service nova] Acquiring lock "refresh_cache-d1de4238-c33e-48a6-bb4f-240e91e81ea3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:02:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-aee99f00-cce1-4c0b-afa9-ef17a2cf48d0 req-e27497ae-f055-4e97-b181-9b1881509c17 service nova] Acquired lock "refresh_cache-d1de4238-c33e-48a6-bb4f-240e91e81ea3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:02:36 user nova-compute[74994]: DEBUG nova.network.neutron [req-aee99f00-cce1-4c0b-afa9-ef17a2cf48d0 req-e27497ae-f055-4e97-b181-9b1881509c17 service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Refreshing network info cache for port e3ec524f-0e85-40e1-8817-b9d4b75f9966 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:02:36 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.183s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:36 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/cdc5adf9-5a73-4d7d-b53d-849354a3a053/disk 1073741824 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:36 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/cdc5adf9-5a73-4d7d-b53d-849354a3a053/disk 1073741824" returned: 0 in 0.058s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:02:36 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:36 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.190s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:36 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cdc5adf9-5a73-4d7d-b53d-849354a3a053/disk. size=1073741824 {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 11:02:36 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc5adf9-5a73-4d7d-b53d-849354a3a053/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:36 user nova-compute[74994]: DEBUG nova.network.neutron [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Successfully created port: 02fa284c-6c0a-4ace-8b7d-0a5adf50cce0 {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 11:02:36 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc5adf9-5a73-4d7d-b53d-849354a3a053/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:36 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Cannot resize image /opt/stack/data/nova/instances/cdc5adf9-5a73-4d7d-b53d-849354a3a053/disk to a smaller size. {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 11:02:36 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Created local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 11:02:36 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Ensure instance console log exists: /opt/stack/data/nova/instances/cdc5adf9-5a73-4d7d-b53d-849354a3a053/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 11:02:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:02:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:02:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:02:36 user nova-compute[74994]: DEBUG nova.network.neutron [req-aee99f00-cce1-4c0b-afa9-ef17a2cf48d0 req-e27497ae-f055-4e97-b181-9b1881509c17 service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Updated VIF entry in instance network info cache for port e3ec524f-0e85-40e1-8817-b9d4b75f9966. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:02:36 user nova-compute[74994]: DEBUG nova.network.neutron [req-aee99f00-cce1-4c0b-afa9-ef17a2cf48d0 req-e27497ae-f055-4e97-b181-9b1881509c17 service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Updating instance_info_cache with network_info: [{"id": "e3ec524f-0e85-40e1-8817-b9d4b75f9966", "address": "fa:16:3e:99:ce:ce", "network": {"id": "89f2b906-9ef3-4e31-87e5-3e0cd23e8695", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2005181920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9670a509ac14f41a9f44d7299fd2f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3ec524f-0e", "ovs_interfaceid": "e3ec524f-0e85-40e1-8817-b9d4b75f9966", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:02:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-aee99f00-cce1-4c0b-afa9-ef17a2cf48d0 req-e27497ae-f055-4e97-b181-9b1881509c17 service nova] Releasing lock "refresh_cache-d1de4238-c33e-48a6-bb4f-240e91e81ea3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:02:36 user nova-compute[74994]: DEBUG nova.compute.manager [None req-bef9d2ac-2dc4-4f38-adf4-2621d049aa2f tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 11:02:37 user nova-compute[74994]: DEBUG nova.network.neutron [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Successfully updated port: 02fa284c-6c0a-4ace-8b7d-0a5adf50cce0 {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 11:02:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Acquiring lock "refresh_cache-cdc5adf9-5a73-4d7d-b53d-849354a3a053" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:02:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Acquired lock "refresh_cache-cdc5adf9-5a73-4d7d-b53d-849354a3a053" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:02:37 user nova-compute[74994]: DEBUG nova.network.neutron [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 11:02:37 user nova-compute[74994]: DEBUG nova.network.neutron [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 11:02:37 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:37 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:37 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:37 user nova-compute[74994]: DEBUG nova.compute.manager [req-e1f917d9-3995-456a-8e63-b5482c89d310 req-0776a965-3ebc-4f1f-b0b1-d029494a9e8c service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Received event network-vif-plugged-068080a2-5847-4053-a463-9fc29cb64bb4 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:02:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-e1f917d9-3995-456a-8e63-b5482c89d310 req-0776a965-3ebc-4f1f-b0b1-d029494a9e8c service nova] Acquiring lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:02:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-e1f917d9-3995-456a-8e63-b5482c89d310 req-0776a965-3ebc-4f1f-b0b1-d029494a9e8c service nova] Lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:02:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-e1f917d9-3995-456a-8e63-b5482c89d310 req-0776a965-3ebc-4f1f-b0b1-d029494a9e8c service nova] Lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:02:37 user nova-compute[74994]: DEBUG nova.compute.manager [req-e1f917d9-3995-456a-8e63-b5482c89d310 req-0776a965-3ebc-4f1f-b0b1-d029494a9e8c service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] No waiting events found dispatching network-vif-plugged-068080a2-5847-4053-a463-9fc29cb64bb4 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:02:37 user nova-compute[74994]: WARNING nova.compute.manager [req-e1f917d9-3995-456a-8e63-b5482c89d310 req-0776a965-3ebc-4f1f-b0b1-d029494a9e8c service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Received unexpected event network-vif-plugged-068080a2-5847-4053-a463-9fc29cb64bb4 for instance with vm_state stopped and task_state powering-on.
Nov 28 11:02:38 user nova-compute[74994]: DEBUG nova.network.neutron [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Updating instance_info_cache with network_info: [{"id": "02fa284c-6c0a-4ace-8b7d-0a5adf50cce0", "address": "fa:16:3e:6d:8e:f7", "network": {"id": "3691c6f1-1485-481c-8f01-e7a4a40f0d50", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2021818422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "768cbb3a27d142b2a1e8b521894df120", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02fa284c-6c", "ovs_interfaceid": "02fa284c-6c0a-4ace-8b7d-0a5adf50cce0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Releasing lock "refresh_cache-cdc5adf9-5a73-4d7d-b53d-849354a3a053" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG nova.compute.manager [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Instance network_info: |[{"id": "02fa284c-6c0a-4ace-8b7d-0a5adf50cce0", "address": "fa:16:3e:6d:8e:f7", "network": {"id": "3691c6f1-1485-481c-8f01-e7a4a40f0d50", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2021818422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "768cbb3a27d142b2a1e8b521894df120", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02fa284c-6c", "ovs_interfaceid": "02fa284c-6c0a-4ace-8b7d-0a5adf50cce0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Start _get_guest_xml network_info=[{"id": "02fa284c-6c0a-4ace-8b7d-0a5adf50cce0", "address": "fa:16:3e:6d:8e:f7", "network": {"id": "3691c6f1-1485-481c-8f01-e7a4a40f0d50", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2021818422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "768cbb3a27d142b2a1e8b521894df120", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02fa284c-6c", "ovs_interfaceid": "02fa284c-6c0a-4ace-8b7d-0a5adf50cce0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'aa939d1b-b8a6-4391-935b-0191bf5ccd0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 11:02:38 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:02:38 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:02:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:02:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-952578661',display_name='tempest-TestServerVolumeAttachmentScenario-server-952578661',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-952578661',id=31,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCN7IW+z7FvU29yvDdvFUQR00K0HW90nLrXJ4ku8x0B0xfQwVKHF8aQFoF2xcce7kz4/nwrNwhLSOoVU4Mx7rqVLYBw6Z6XTWPsEvNuWzagO/5ds0AKwO6nb99ndvOhxQ==',key_name='tempest-keypair-325096278',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='768cbb3a27d142b2a1e8b521894df120',ramdisk_id='',reservation_id='r-2nou5c6o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1027967726',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1027967726-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:02:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9affb276780046279c51abc15f9a8e29',uuid=cdc5adf9-5a73-4d7d-b53d-849354a3a053,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02fa284c-6c0a-4ace-8b7d-0a5adf50cce0", "address": "fa:16:3e:6d:8e:f7", "network": {"id": "3691c6f1-1485-481c-8f01-e7a4a40f0d50", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2021818422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "768cbb3a27d142b2a1e8b521894df120", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02fa284c-6c", "ovs_interfaceid": "02fa284c-6c0a-4ace-8b7d-0a5adf50cce0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Converting VIF {"id": "02fa284c-6c0a-4ace-8b7d-0a5adf50cce0", "address": "fa:16:3e:6d:8e:f7", "network": {"id": "3691c6f1-1485-481c-8f01-e7a4a40f0d50", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2021818422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "768cbb3a27d142b2a1e8b521894df120", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02fa284c-6c", "ovs_interfaceid": "02fa284c-6c0a-4ace-8b7d-0a5adf50cce0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:8e:f7,bridge_name='br-int',has_traffic_filtering=True,id=02fa284c-6c0a-4ace-8b7d-0a5adf50cce0,network=Network(3691c6f1-1485-481c-8f01-e7a4a40f0d50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02fa284c-6c') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG nova.objects.instance [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Lazy-loading 'pci_devices' on Instance uuid cdc5adf9-5a73-4d7d-b53d-849354a3a053 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] End _get_guest_xml xml=<domain type="kvm">
Nov 28 11:02:38 user nova-compute[74994]:   <uuid>cdc5adf9-5a73-4d7d-b53d-849354a3a053</uuid>
Nov 28 11:02:38 user nova-compute[74994]:   <name>instance-0000001f</name>
Nov 28 11:02:38 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 11:02:38 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 11:02:38 user nova-compute[74994]:   <metadata>
Nov 28 11:02:38 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 11:02:38 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 11:02:38 user nova-compute[74994]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-952578661</nova:name>
Nov 28 11:02:38 user nova-compute[74994]:       <nova:creationTime>2023-11-28 11:02:38</nova:creationTime>
Nov 28 11:02:38 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 11:02:38 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 11:02:38 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 11:02:38 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 11:02:38 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 11:02:38 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 11:02:38 user nova-compute[74994]:       </nova:flavor>
Nov 28 11:02:38 user nova-compute[74994]:       <nova:owner>
Nov 28 11:02:38 user nova-compute[74994]:         <nova:user uuid="9affb276780046279c51abc15f9a8e29">tempest-TestServerVolumeAttachmentScenario-1027967726-project-member</nova:user>
Nov 28 11:02:38 user nova-compute[74994]:         <nova:project uuid="768cbb3a27d142b2a1e8b521894df120">tempest-TestServerVolumeAttachmentScenario-1027967726</nova:project>
Nov 28 11:02:38 user nova-compute[74994]:       </nova:owner>
Nov 28 11:02:38 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 11:02:38 user nova-compute[74994]:       <nova:ports>
Nov 28 11:02:38 user nova-compute[74994]:         <nova:port uuid="02fa284c-6c0a-4ace-8b7d-0a5adf50cce0">
Nov 28 11:02:38 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 28 11:02:38 user nova-compute[74994]:         </nova:port>
Nov 28 11:02:38 user nova-compute[74994]:       </nova:ports>
Nov 28 11:02:38 user nova-compute[74994]:     </nova:instance>
Nov 28 11:02:38 user nova-compute[74994]:   </metadata>
Nov 28 11:02:38 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 11:02:38 user nova-compute[74994]:     <system>
Nov 28 11:02:38 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 11:02:38 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 11:02:38 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 11:02:38 user nova-compute[74994]:       <entry name="serial">cdc5adf9-5a73-4d7d-b53d-849354a3a053</entry>
Nov 28 11:02:38 user nova-compute[74994]:       <entry name="uuid">cdc5adf9-5a73-4d7d-b53d-849354a3a053</entry>
Nov 28 11:02:38 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 11:02:38 user nova-compute[74994]:     </system>
Nov 28 11:02:38 user nova-compute[74994]:   </sysinfo>
Nov 28 11:02:38 user nova-compute[74994]:   <os>
Nov 28 11:02:38 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 11:02:38 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 11:02:38 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 11:02:38 user nova-compute[74994]:   </os>
Nov 28 11:02:38 user nova-compute[74994]:   <features>
Nov 28 11:02:38 user nova-compute[74994]:     <acpi/>
Nov 28 11:02:38 user nova-compute[74994]:     <apic/>
Nov 28 11:02:38 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 11:02:38 user nova-compute[74994]:   </features>
Nov 28 11:02:38 user nova-compute[74994]:   <clock offset="utc">
Nov 28 11:02:38 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 11:02:38 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 11:02:38 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 11:02:38 user nova-compute[74994]:   </clock>
Nov 28 11:02:38 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 11:02:38 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 11:02:38 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 11:02:38 user nova-compute[74994]:   </cpu>
Nov 28 11:02:38 user nova-compute[74994]:   <devices>
Nov 28 11:02:38 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 11:02:38 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 11:02:38 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/cdc5adf9-5a73-4d7d-b53d-849354a3a053/disk"/>
Nov 28 11:02:38 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 11:02:38 user nova-compute[74994]:     </disk>
Nov 28 11:02:38 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 11:02:38 user nova-compute[74994]:       <mac address="fa:16:3e:6d:8e:f7"/>
Nov 28 11:02:38 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:02:38 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 11:02:38 user nova-compute[74994]:       <target dev="tap02fa284c-6c"/>
Nov 28 11:02:38 user nova-compute[74994]:     </interface>
Nov 28 11:02:38 user nova-compute[74994]:     <serial type="pty">
Nov 28 11:02:38 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/cdc5adf9-5a73-4d7d-b53d-849354a3a053/console.log" append="off"/>
Nov 28 11:02:38 user nova-compute[74994]:     </serial>
Nov 28 11:02:38 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 11:02:38 user nova-compute[74994]:     <video>
Nov 28 11:02:38 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:02:38 user nova-compute[74994]:     </video>
Nov 28 11:02:38 user nova-compute[74994]:     <rng model="virtio">
Nov 28 11:02:38 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 11:02:38 user nova-compute[74994]:     </rng>
Nov 28 11:02:38 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 11:02:38 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 11:02:38 user nova-compute[74994]:       <stats period="10"/>
Nov 28 11:02:38 user nova-compute[74994]:     </memballoon>
Nov 28 11:02:38 user nova-compute[74994]:   </devices>
Nov 28 11:02:38 user nova-compute[74994]: </domain>
Nov 28 11:02:38 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:02:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-952578661',display_name='tempest-TestServerVolumeAttachmentScenario-server-952578661',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-952578661',id=31,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCN7IW+z7FvU29yvDdvFUQR00K0HW90nLrXJ4ku8x0B0xfQwVKHF8aQFoF2xcce7kz4/nwrNwhLSOoVU4Mx7rqVLYBw6Z6XTWPsEvNuWzagO/5ds0AKwO6nb99ndvOhxQ==',key_name='tempest-keypair-325096278',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='768cbb3a27d142b2a1e8b521894df120',ramdisk_id='',reservation_id='r-2nou5c6o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1027967726',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1027967726-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:02:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9affb276780046279c51abc15f9a8e29',uuid=cdc5adf9-5a73-4d7d-b53d-849354a3a053,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02fa284c-6c0a-4ace-8b7d-0a5adf50cce0", "address": "fa:16:3e:6d:8e:f7", "network": {"id": "3691c6f1-1485-481c-8f01-e7a4a40f0d50", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2021818422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "768cbb3a27d142b2a1e8b521894df120", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02fa284c-6c", "ovs_interfaceid": "02fa284c-6c0a-4ace-8b7d-0a5adf50cce0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Converting VIF {"id": "02fa284c-6c0a-4ace-8b7d-0a5adf50cce0", "address": "fa:16:3e:6d:8e:f7", "network": {"id": "3691c6f1-1485-481c-8f01-e7a4a40f0d50", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2021818422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "768cbb3a27d142b2a1e8b521894df120", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02fa284c-6c", "ovs_interfaceid": "02fa284c-6c0a-4ace-8b7d-0a5adf50cce0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:8e:f7,bridge_name='br-int',has_traffic_filtering=True,id=02fa284c-6c0a-4ace-8b7d-0a5adf50cce0,network=Network(3691c6f1-1485-481c-8f01-e7a4a40f0d50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02fa284c-6c') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG os_vif [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:8e:f7,bridge_name='br-int',has_traffic_filtering=True,id=02fa284c-6c0a-4ace-8b7d-0a5adf50cce0,network=Network(3691c6f1-1485-481c-8f01-e7a4a40f0d50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02fa284c-6c') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'efb6a748-a4a2-5241-bb68-5fd302e4f3f8', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap02fa284c-6c, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap02fa284c-6c, col_values=(('qos', UUID('bca15ed1-8ebc-4645-bc4b-3c82a5b9e5f4')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap02fa284c-6c, col_values=(('external_ids', {'iface-id': '02fa284c-6c0a-4ace-8b7d-0a5adf50cce0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:8e:f7', 'vm-uuid': 'cdc5adf9-5a73-4d7d-b53d-849354a3a053'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:38 user nova-compute[74994]: INFO os_vif [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:8e:f7,bridge_name='br-int',has_traffic_filtering=True,id=02fa284c-6c0a-4ace-8b7d-0a5adf50cce0,network=Network(3691c6f1-1485-481c-8f01-e7a4a40f0d50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02fa284c-6c')
Nov 28 11:02:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG nova.compute.manager [req-ff8dad8d-bc1b-44c3-9386-7b73bf99c7db req-71e6833b-84ad-4d9a-8bb9-53ee27625409 service nova] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Received event network-changed-02fa284c-6c0a-4ace-8b7d-0a5adf50cce0 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG nova.compute.manager [req-ff8dad8d-bc1b-44c3-9386-7b73bf99c7db req-71e6833b-84ad-4d9a-8bb9-53ee27625409 service nova] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Refreshing instance network info cache due to event network-changed-02fa284c-6c0a-4ace-8b7d-0a5adf50cce0. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ff8dad8d-bc1b-44c3-9386-7b73bf99c7db req-71e6833b-84ad-4d9a-8bb9-53ee27625409 service nova] Acquiring lock "refresh_cache-cdc5adf9-5a73-4d7d-b53d-849354a3a053" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ff8dad8d-bc1b-44c3-9386-7b73bf99c7db req-71e6833b-84ad-4d9a-8bb9-53ee27625409 service nova] Acquired lock "refresh_cache-cdc5adf9-5a73-4d7d-b53d-849354a3a053" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG nova.network.neutron [req-ff8dad8d-bc1b-44c3-9386-7b73bf99c7db req-71e6833b-84ad-4d9a-8bb9-53ee27625409 service nova] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Refreshing network info cache for port 02fa284c-6c0a-4ace-8b7d-0a5adf50cce0 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] No VIF found with MAC fa:16:3e:6d:8e:f7, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG nova.network.neutron [req-ff8dad8d-bc1b-44c3-9386-7b73bf99c7db req-71e6833b-84ad-4d9a-8bb9-53ee27625409 service nova] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Updated VIF entry in instance network info cache for port 02fa284c-6c0a-4ace-8b7d-0a5adf50cce0. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG nova.network.neutron [req-ff8dad8d-bc1b-44c3-9386-7b73bf99c7db req-71e6833b-84ad-4d9a-8bb9-53ee27625409 service nova] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Updating instance_info_cache with network_info: [{"id": "02fa284c-6c0a-4ace-8b7d-0a5adf50cce0", "address": "fa:16:3e:6d:8e:f7", "network": {"id": "3691c6f1-1485-481c-8f01-e7a4a40f0d50", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2021818422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "768cbb3a27d142b2a1e8b521894df120", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02fa284c-6c", "ovs_interfaceid": "02fa284c-6c0a-4ace-8b7d-0a5adf50cce0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:02:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ff8dad8d-bc1b-44c3-9386-7b73bf99c7db req-71e6833b-84ad-4d9a-8bb9-53ee27625409 service nova] Releasing lock "refresh_cache-cdc5adf9-5a73-4d7d-b53d-849354a3a053" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:02:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:40 user nova-compute[74994]: DEBUG nova.compute.manager [req-8196b811-5184-4c12-af94-2c8438750092 req-39a43b04-097d-458f-86ea-fa880eb5cef1 service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Received event network-vif-plugged-068080a2-5847-4053-a463-9fc29cb64bb4 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:02:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8196b811-5184-4c12-af94-2c8438750092 req-39a43b04-097d-458f-86ea-fa880eb5cef1 service nova] Acquiring lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:02:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8196b811-5184-4c12-af94-2c8438750092 req-39a43b04-097d-458f-86ea-fa880eb5cef1 service nova] Lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:02:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8196b811-5184-4c12-af94-2c8438750092 req-39a43b04-097d-458f-86ea-fa880eb5cef1 service nova] Lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:02:40 user nova-compute[74994]: DEBUG nova.compute.manager [req-8196b811-5184-4c12-af94-2c8438750092 req-39a43b04-097d-458f-86ea-fa880eb5cef1 service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] No waiting events found dispatching network-vif-plugged-068080a2-5847-4053-a463-9fc29cb64bb4 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:02:40 user nova-compute[74994]: WARNING nova.compute.manager [req-8196b811-5184-4c12-af94-2c8438750092 req-39a43b04-097d-458f-86ea-fa880eb5cef1 service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Received unexpected event network-vif-plugged-068080a2-5847-4053-a463-9fc29cb64bb4 for instance with vm_state stopped and task_state powering-on.
Nov 28 11:02:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b3b7231d-5980-44ba-8c72-ae02597cea15 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "14ab0a02-7432-4630-8758-df82d6a17ef8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:02:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b3b7231d-5980-44ba-8c72-ae02597cea15 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "14ab0a02-7432-4630-8758-df82d6a17ef8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:02:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b3b7231d-5980-44ba-8c72-ae02597cea15 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "14ab0a02-7432-4630-8758-df82d6a17ef8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:02:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b3b7231d-5980-44ba-8c72-ae02597cea15 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "14ab0a02-7432-4630-8758-df82d6a17ef8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:02:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b3b7231d-5980-44ba-8c72-ae02597cea15 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "14ab0a02-7432-4630-8758-df82d6a17ef8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:02:40 user nova-compute[74994]: INFO nova.compute.manager [None req-b3b7231d-5980-44ba-8c72-ae02597cea15 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Terminating instance
Nov 28 11:02:40 user nova-compute[74994]: DEBUG nova.compute.manager [None req-b3b7231d-5980-44ba-8c72-ae02597cea15 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 11:02:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:40 user nova-compute[74994]: DEBUG nova.compute.manager [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 11:02:40 user nova-compute[74994]: DEBUG nova.compute.manager [req-1c6e3654-9f4b-406d-92e7-8eba6282dd8c req-d048c1be-3df3-4ffe-ad14-e7924dbbbd58 service nova] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Received event network-vif-plugged-02fa284c-6c0a-4ace-8b7d-0a5adf50cce0 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:02:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-1c6e3654-9f4b-406d-92e7-8eba6282dd8c req-d048c1be-3df3-4ffe-ad14-e7924dbbbd58 service nova] Acquiring lock "cdc5adf9-5a73-4d7d-b53d-849354a3a053-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:02:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-1c6e3654-9f4b-406d-92e7-8eba6282dd8c req-d048c1be-3df3-4ffe-ad14-e7924dbbbd58 service nova] Lock "cdc5adf9-5a73-4d7d-b53d-849354a3a053-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:02:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-1c6e3654-9f4b-406d-92e7-8eba6282dd8c req-d048c1be-3df3-4ffe-ad14-e7924dbbbd58 service nova] Lock "cdc5adf9-5a73-4d7d-b53d-849354a3a053-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:02:40 user nova-compute[74994]: DEBUG nova.compute.manager [req-1c6e3654-9f4b-406d-92e7-8eba6282dd8c req-d048c1be-3df3-4ffe-ad14-e7924dbbbd58 service nova] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] No waiting events found dispatching network-vif-plugged-02fa284c-6c0a-4ace-8b7d-0a5adf50cce0 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:02:40 user nova-compute[74994]: WARNING nova.compute.manager [req-1c6e3654-9f4b-406d-92e7-8eba6282dd8c req-d048c1be-3df3-4ffe-ad14-e7924dbbbd58 service nova] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Received unexpected event network-vif-plugged-02fa284c-6c0a-4ace-8b7d-0a5adf50cce0 for instance with vm_state building and task_state spawning.
Nov 28 11:02:40 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Instance rebooted successfully.
Nov 28 11:02:40 user nova-compute[74994]: DEBUG nova.compute.manager [None req-d104d2fd-f809-4a2a-bed2-98f2db779d63 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 11:02:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:41 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:41 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:41 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:41 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:41 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Instance destroyed successfully.
Nov 28 11:02:41 user nova-compute[74994]: DEBUG nova.objects.instance [None req-b3b7231d-5980-44ba-8c72-ae02597cea15 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lazy-loading 'resources' on Instance uuid 14ab0a02-7432-4630-8758-df82d6a17ef8 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:02:41 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-b3b7231d-5980-44ba-8c72-ae02597cea15 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:59:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1834467843',display_name='tempest-AttachVolumeNegativeTest-server-1834467843',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1834467843',id=28,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOci8O+B2cMqcmA6KutXpveM/McooapU0kTF2RLLqGuRlPJoZhRCMw3muU1qRbkoMbD+utKDzsNoO6WcCPJWtfjKSfnpALF0poFjiZmHHV3mM7UO8Uh+O5fQUuyb14Mmw==',key_name='tempest-keypair-600162787',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:59:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='636fa9a1f046425e9332cc3807f8fb46',ramdisk_id='',reservation_id='r-3xdmet7a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-3431122',owner_user_name='tempest-AttachVolumeNegativeTest-3431122-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T10:59:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa362c35530641a687a33182012c2332',uuid=14ab0a02-7432-4630-8758-df82d6a17ef8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd853050-2e07-4e5b-9dfc-b10bf3af51e7", "address": "fa:16:3e:b2:d1:5c", "network": {"id": "d9bcdec6-69e0-4e65-8a26-1af1f8232365", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1227861580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "636fa9a1f046425e9332cc3807f8fb46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd853050-2e", "ovs_interfaceid": "fd853050-2e07-4e5b-9dfc-b10bf3af51e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 11:02:41 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-b3b7231d-5980-44ba-8c72-ae02597cea15 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Converting VIF {"id": "fd853050-2e07-4e5b-9dfc-b10bf3af51e7", "address": "fa:16:3e:b2:d1:5c", "network": {"id": "d9bcdec6-69e0-4e65-8a26-1af1f8232365", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1227861580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "636fa9a1f046425e9332cc3807f8fb46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd853050-2e", "ovs_interfaceid": "fd853050-2e07-4e5b-9dfc-b10bf3af51e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:02:41 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-b3b7231d-5980-44ba-8c72-ae02597cea15 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:d1:5c,bridge_name='br-int',has_traffic_filtering=True,id=fd853050-2e07-4e5b-9dfc-b10bf3af51e7,network=Network(d9bcdec6-69e0-4e65-8a26-1af1f8232365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd853050-2e') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:02:41 user nova-compute[74994]: DEBUG os_vif [None req-b3b7231d-5980-44ba-8c72-ae02597cea15 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:d1:5c,bridge_name='br-int',has_traffic_filtering=True,id=fd853050-2e07-4e5b-9dfc-b10bf3af51e7,network=Network(d9bcdec6-69e0-4e65-8a26-1af1f8232365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd853050-2e') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 11:02:41 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:41 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd853050-2e, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:02:41 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:41 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:02:41 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:41 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f9038be9-819c-45d5-8c45-aa3438221a7f) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:02:41 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:41 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:02:41 user nova-compute[74994]: INFO os_vif [None req-b3b7231d-5980-44ba-8c72-ae02597cea15 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:d1:5c,bridge_name='br-int',has_traffic_filtering=True,id=fd853050-2e07-4e5b-9dfc-b10bf3af51e7,network=Network(d9bcdec6-69e0-4e65-8a26-1af1f8232365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd853050-2e')
Nov 28 11:02:41 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-b3b7231d-5980-44ba-8c72-ae02597cea15 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Deleting instance files /opt/stack/data/nova/instances/14ab0a02-7432-4630-8758-df82d6a17ef8_del
Nov 28 11:02:41 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-b3b7231d-5980-44ba-8c72-ae02597cea15 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Deletion of /opt/stack/data/nova/instances/14ab0a02-7432-4630-8758-df82d6a17ef8_del complete
Nov 28 11:02:41 user nova-compute[74994]: INFO nova.compute.manager [None req-b3b7231d-5980-44ba-8c72-ae02597cea15 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 28 11:02:41 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-b3b7231d-5980-44ba-8c72-ae02597cea15 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 11:02:41 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 11:02:41 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 11:02:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Acquiring lock "d1de4238-c33e-48a6-bb4f-240e91e81ea3" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:02:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "d1de4238-c33e-48a6-bb4f-240e91e81ea3" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:02:41 user nova-compute[74994]: INFO nova.compute.manager [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Rebooting instance
Nov 28 11:02:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Acquiring lock "refresh_cache-d1de4238-c33e-48a6-bb4f-240e91e81ea3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:02:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Acquired lock "refresh_cache-d1de4238-c33e-48a6-bb4f-240e91e81ea3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:02:41 user nova-compute[74994]: DEBUG nova.network.neutron [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 11:02:42 user nova-compute[74994]: DEBUG nova.network.neutron [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Updating instance_info_cache with network_info: [{"id": "e3ec524f-0e85-40e1-8817-b9d4b75f9966", "address": "fa:16:3e:99:ce:ce", "network": {"id": "89f2b906-9ef3-4e31-87e5-3e0cd23e8695", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2005181920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9670a509ac14f41a9f44d7299fd2f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3ec524f-0e", "ovs_interfaceid": "e3ec524f-0e85-40e1-8817-b9d4b75f9966", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:02:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Releasing lock "refresh_cache-d1de4238-c33e-48a6-bb4f-240e91e81ea3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:02:42 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:02:42 user nova-compute[74994]: DEBUG nova.compute.manager [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 11:02:42 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Took 1.11 seconds to deallocate network for instance.
Nov 28 11:02:42 user nova-compute[74994]: DEBUG nova.compute.manager [req-a4947f52-07be-4b92-ba60-40a43e2fa5fa req-961ffac9-4f90-46e5-ae55-a0253b7dd82f service nova] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Received event network-vif-plugged-02fa284c-6c0a-4ace-8b7d-0a5adf50cce0 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:02:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a4947f52-07be-4b92-ba60-40a43e2fa5fa req-961ffac9-4f90-46e5-ae55-a0253b7dd82f service nova] Acquiring lock "cdc5adf9-5a73-4d7d-b53d-849354a3a053-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:02:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a4947f52-07be-4b92-ba60-40a43e2fa5fa req-961ffac9-4f90-46e5-ae55-a0253b7dd82f service nova] Lock "cdc5adf9-5a73-4d7d-b53d-849354a3a053-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:02:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a4947f52-07be-4b92-ba60-40a43e2fa5fa req-961ffac9-4f90-46e5-ae55-a0253b7dd82f service nova] Lock "cdc5adf9-5a73-4d7d-b53d-849354a3a053-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:02:42 user nova-compute[74994]: DEBUG nova.compute.manager [req-a4947f52-07be-4b92-ba60-40a43e2fa5fa req-961ffac9-4f90-46e5-ae55-a0253b7dd82f service nova] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] No waiting events found dispatching network-vif-plugged-02fa284c-6c0a-4ace-8b7d-0a5adf50cce0 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:02:42 user nova-compute[74994]: WARNING nova.compute.manager [req-a4947f52-07be-4b92-ba60-40a43e2fa5fa req-961ffac9-4f90-46e5-ae55-a0253b7dd82f service nova] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Received unexpected event network-vif-plugged-02fa284c-6c0a-4ace-8b7d-0a5adf50cce0 for instance with vm_state building and task_state spawning.
Nov 28 11:02:42 user nova-compute[74994]: DEBUG nova.compute.manager [req-a4947f52-07be-4b92-ba60-40a43e2fa5fa req-961ffac9-4f90-46e5-ae55-a0253b7dd82f service nova] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Received event network-vif-unplugged-fd853050-2e07-4e5b-9dfc-b10bf3af51e7 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:02:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a4947f52-07be-4b92-ba60-40a43e2fa5fa req-961ffac9-4f90-46e5-ae55-a0253b7dd82f service nova] Acquiring lock "14ab0a02-7432-4630-8758-df82d6a17ef8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:02:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a4947f52-07be-4b92-ba60-40a43e2fa5fa req-961ffac9-4f90-46e5-ae55-a0253b7dd82f service nova] Lock "14ab0a02-7432-4630-8758-df82d6a17ef8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:02:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a4947f52-07be-4b92-ba60-40a43e2fa5fa req-961ffac9-4f90-46e5-ae55-a0253b7dd82f service nova] Lock "14ab0a02-7432-4630-8758-df82d6a17ef8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:02:42 user nova-compute[74994]: DEBUG nova.compute.manager [req-a4947f52-07be-4b92-ba60-40a43e2fa5fa req-961ffac9-4f90-46e5-ae55-a0253b7dd82f service nova] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] No waiting events found dispatching network-vif-unplugged-fd853050-2e07-4e5b-9dfc-b10bf3af51e7 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:02:42 user nova-compute[74994]: DEBUG nova.compute.manager [req-a4947f52-07be-4b92-ba60-40a43e2fa5fa req-961ffac9-4f90-46e5-ae55-a0253b7dd82f service nova] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Received event network-vif-unplugged-fd853050-2e07-4e5b-9dfc-b10bf3af51e7 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 11:02:42 user nova-compute[74994]: DEBUG nova.compute.manager [req-a4947f52-07be-4b92-ba60-40a43e2fa5fa req-961ffac9-4f90-46e5-ae55-a0253b7dd82f service nova] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Received event network-vif-plugged-fd853050-2e07-4e5b-9dfc-b10bf3af51e7 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:02:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a4947f52-07be-4b92-ba60-40a43e2fa5fa req-961ffac9-4f90-46e5-ae55-a0253b7dd82f service nova] Acquiring lock "14ab0a02-7432-4630-8758-df82d6a17ef8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:02:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a4947f52-07be-4b92-ba60-40a43e2fa5fa req-961ffac9-4f90-46e5-ae55-a0253b7dd82f service nova] Lock "14ab0a02-7432-4630-8758-df82d6a17ef8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:02:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a4947f52-07be-4b92-ba60-40a43e2fa5fa req-961ffac9-4f90-46e5-ae55-a0253b7dd82f service nova] Lock "14ab0a02-7432-4630-8758-df82d6a17ef8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:02:42 user nova-compute[74994]: DEBUG nova.compute.manager [req-a4947f52-07be-4b92-ba60-40a43e2fa5fa req-961ffac9-4f90-46e5-ae55-a0253b7dd82f service nova] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] No waiting events found dispatching network-vif-plugged-fd853050-2e07-4e5b-9dfc-b10bf3af51e7 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:02:42 user nova-compute[74994]: WARNING nova.compute.manager [req-a4947f52-07be-4b92-ba60-40a43e2fa5fa req-961ffac9-4f90-46e5-ae55-a0253b7dd82f service nova] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Received unexpected event network-vif-plugged-fd853050-2e07-4e5b-9dfc-b10bf3af51e7 for instance with vm_state active and task_state deleting.
Nov 28 11:02:42 user nova-compute[74994]: DEBUG nova.compute.manager [req-a4947f52-07be-4b92-ba60-40a43e2fa5fa req-961ffac9-4f90-46e5-ae55-a0253b7dd82f service nova] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Received event network-vif-plugged-fd853050-2e07-4e5b-9dfc-b10bf3af51e7 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:02:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a4947f52-07be-4b92-ba60-40a43e2fa5fa req-961ffac9-4f90-46e5-ae55-a0253b7dd82f service nova] Acquiring lock "14ab0a02-7432-4630-8758-df82d6a17ef8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:02:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a4947f52-07be-4b92-ba60-40a43e2fa5fa req-961ffac9-4f90-46e5-ae55-a0253b7dd82f service nova] Lock "14ab0a02-7432-4630-8758-df82d6a17ef8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:02:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a4947f52-07be-4b92-ba60-40a43e2fa5fa req-961ffac9-4f90-46e5-ae55-a0253b7dd82f service nova] Lock "14ab0a02-7432-4630-8758-df82d6a17ef8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:02:42 user nova-compute[74994]: DEBUG nova.compute.manager [req-a4947f52-07be-4b92-ba60-40a43e2fa5fa req-961ffac9-4f90-46e5-ae55-a0253b7dd82f service nova] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] No waiting events found dispatching network-vif-plugged-fd853050-2e07-4e5b-9dfc-b10bf3af51e7 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:02:42 user nova-compute[74994]: WARNING nova.compute.manager [req-a4947f52-07be-4b92-ba60-40a43e2fa5fa req-961ffac9-4f90-46e5-ae55-a0253b7dd82f service nova] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Received unexpected event network-vif-plugged-fd853050-2e07-4e5b-9dfc-b10bf3af51e7 for instance with vm_state active and task_state deleting.
Nov 28 11:02:42 user nova-compute[74994]: DEBUG nova.compute.manager [req-a4947f52-07be-4b92-ba60-40a43e2fa5fa req-961ffac9-4f90-46e5-ae55-a0253b7dd82f service nova] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Received event network-vif-plugged-fd853050-2e07-4e5b-9dfc-b10bf3af51e7 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:02:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a4947f52-07be-4b92-ba60-40a43e2fa5fa req-961ffac9-4f90-46e5-ae55-a0253b7dd82f service nova] Acquiring lock "14ab0a02-7432-4630-8758-df82d6a17ef8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:02:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a4947f52-07be-4b92-ba60-40a43e2fa5fa req-961ffac9-4f90-46e5-ae55-a0253b7dd82f service nova] Lock "14ab0a02-7432-4630-8758-df82d6a17ef8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:02:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a4947f52-07be-4b92-ba60-40a43e2fa5fa req-961ffac9-4f90-46e5-ae55-a0253b7dd82f service nova] Lock "14ab0a02-7432-4630-8758-df82d6a17ef8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:02:42 user nova-compute[74994]: DEBUG nova.compute.manager [req-a4947f52-07be-4b92-ba60-40a43e2fa5fa req-961ffac9-4f90-46e5-ae55-a0253b7dd82f service nova] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] No waiting events found dispatching network-vif-plugged-fd853050-2e07-4e5b-9dfc-b10bf3af51e7 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:02:42 user nova-compute[74994]: WARNING nova.compute.manager [req-a4947f52-07be-4b92-ba60-40a43e2fa5fa req-961ffac9-4f90-46e5-ae55-a0253b7dd82f service nova] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Received unexpected event network-vif-plugged-fd853050-2e07-4e5b-9dfc-b10bf3af51e7 for instance with vm_state active and task_state deleting.
Nov 28 11:02:42 user nova-compute[74994]: DEBUG nova.compute.manager [req-a4947f52-07be-4b92-ba60-40a43e2fa5fa req-961ffac9-4f90-46e5-ae55-a0253b7dd82f service nova] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Received event network-vif-plugged-fd853050-2e07-4e5b-9dfc-b10bf3af51e7 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:02:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a4947f52-07be-4b92-ba60-40a43e2fa5fa req-961ffac9-4f90-46e5-ae55-a0253b7dd82f service nova] Acquiring lock "14ab0a02-7432-4630-8758-df82d6a17ef8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:02:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a4947f52-07be-4b92-ba60-40a43e2fa5fa req-961ffac9-4f90-46e5-ae55-a0253b7dd82f service nova] Lock "14ab0a02-7432-4630-8758-df82d6a17ef8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:02:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a4947f52-07be-4b92-ba60-40a43e2fa5fa req-961ffac9-4f90-46e5-ae55-a0253b7dd82f service nova] Lock "14ab0a02-7432-4630-8758-df82d6a17ef8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:02:42 user nova-compute[74994]: DEBUG nova.compute.manager [req-a4947f52-07be-4b92-ba60-40a43e2fa5fa req-961ffac9-4f90-46e5-ae55-a0253b7dd82f service nova] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] No waiting events found dispatching network-vif-plugged-fd853050-2e07-4e5b-9dfc-b10bf3af51e7 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:02:42 user nova-compute[74994]: WARNING nova.compute.manager [req-a4947f52-07be-4b92-ba60-40a43e2fa5fa req-961ffac9-4f90-46e5-ae55-a0253b7dd82f service nova] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Received unexpected event network-vif-plugged-fd853050-2e07-4e5b-9dfc-b10bf3af51e7 for instance with vm_state active and task_state deleting.
Nov 28 11:02:42 user nova-compute[74994]: DEBUG nova.compute.manager [req-a4947f52-07be-4b92-ba60-40a43e2fa5fa req-961ffac9-4f90-46e5-ae55-a0253b7dd82f service nova] [instance: 14ab0a02-7432-4630-8758-df82d6a17ef8] Received event network-vif-deleted-fd853050-2e07-4e5b-9dfc-b10bf3af51e7 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:02:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b3b7231d-5980-44ba-8c72-ae02597cea15 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:02:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b3b7231d-5980-44ba-8c72-ae02597cea15 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:02:42 user nova-compute[74994]: DEBUG nova.compute.manager [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 11:02:42 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 11:02:42 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Instance spawned successfully.
Nov 28 11:02:42 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 11:02:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:42 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:02:42 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:02:42 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:02:42 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:02:42 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:02:42 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:02:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:42 user nova-compute[74994]: INFO nova.compute.manager [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Took 6.85 seconds to spawn the instance on the hypervisor.
Nov 28 11:02:42 user nova-compute[74994]: DEBUG nova.compute.manager [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 11:02:42 user nova-compute[74994]: INFO nova.compute.manager [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Took 8.04 seconds to build instance.
Nov 28 11:02:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c8f95b18-1698-4f3e-995e-c0cc4ef61d38 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Lock "cdc5adf9-5a73-4d7d-b53d-849354a3a053" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.178s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-b3b7231d-5980-44ba-8c72-ae02597cea15 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-b3b7231d-5980-44ba-8c72-ae02597cea15 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b3b7231d-5980-44ba-8c72-ae02597cea15 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.694s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:02:43 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-b3b7231d-5980-44ba-8c72-ae02597cea15 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Deleted allocations for instance 14ab0a02-7432-4630-8758-df82d6a17ef8
Nov 28 11:02:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b3b7231d-5980-44ba-8c72-ae02597cea15 tempest-AttachVolumeNegativeTest-3431122 tempest-AttachVolumeNegativeTest-3431122-project-member] Lock "14ab0a02-7432-4630-8758-df82d6a17ef8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.230s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:02:43 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Instance destroyed successfully.
Nov 28 11:02:43 user nova-compute[74994]: DEBUG nova.objects.instance [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lazy-loading 'resources' on Instance uuid d1de4238-c33e-48a6-bb4f-240e91e81ea3 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:00:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-342030530',display_name='tempest-TestMinimumBasicScenario-server-342030530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-342030530',id=29,image_ref='72081665-97f0-4d07-85e6-e93aff963a9d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyVQMduM13BgMZJIMtke6rN9ybjpOOFWz20TU2DvJ+OA7UvylvkmeAOhXrqzo0DECLS+nqoTXK7yvdL4DWRjTgwl0mH1+2xXyPyunJt/UXv2mIQhL1IpGRflfXkBiMUuw==',key_name='tempest-TestMinimumBasicScenario-928079813',keypairs=<?>,launch_index=0,launched_at=2023-11-28T11:00:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9670a509ac14f41a9f44d7299fd2f30',ramdisk_id='',reservation_id='r-soytlw4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='72081665-97f0-4d07-85e6-e93aff963a9d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-756572202',owner_user_name='tempest-TestMinimumBasicScenario-756572202-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T11:02:42Z,user_data=None,user_id='18ba016046ac42599094e626d3fdd860',uuid=d1de4238-c33e-48a6-bb4f-240e91e81ea3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e3ec524f-0e85-40e1-8817-b9d4b75f9966", "address": "fa:16:3e:99:ce:ce", "network": {"id": "89f2b906-9ef3-4e31-87e5-3e0cd23e8695", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2005181920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9670a509ac14f41a9f44d7299fd2f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3ec524f-0e", "ovs_interfaceid": "e3ec524f-0e85-40e1-8817-b9d4b75f9966", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Converting VIF {"id": "e3ec524f-0e85-40e1-8817-b9d4b75f9966", "address": "fa:16:3e:99:ce:ce", "network": {"id": "89f2b906-9ef3-4e31-87e5-3e0cd23e8695", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2005181920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9670a509ac14f41a9f44d7299fd2f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3ec524f-0e", "ovs_interfaceid": "e3ec524f-0e85-40e1-8817-b9d4b75f9966", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:ce:ce,bridge_name='br-int',has_traffic_filtering=True,id=e3ec524f-0e85-40e1-8817-b9d4b75f9966,network=Network(89f2b906-9ef3-4e31-87e5-3e0cd23e8695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3ec524f-0e') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG os_vif [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:ce:ce,bridge_name='br-int',has_traffic_filtering=True,id=e3ec524f-0e85-40e1-8817-b9d4b75f9966,network=Network(89f2b906-9ef3-4e31-87e5-3e0cd23e8695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3ec524f-0e') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape3ec524f-0e, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d33168ac-c9b3-469e-9f2b-132fde2e90fd) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:43 user nova-compute[74994]: INFO os_vif [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:ce:ce,bridge_name='br-int',has_traffic_filtering=True,id=e3ec524f-0e85-40e1-8817-b9d4b75f9966,network=Network(89f2b906-9ef3-4e31-87e5-3e0cd23e8695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3ec524f-0e')
Nov 28 11:02:43 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AgKYCRiP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:02:43 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:02:43 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[025bb53f-9436-4624-8d8b-d341900bd58c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 11:02:43 user nova-compute[74994]: No targets found.
Nov 28 11:02:43 user nova-compute[74994]: iSNS:
Nov 28 11:02:43 user nova-compute[74994]: No targets found.
Nov 28 11:02:43 user nova-compute[74994]: STATIC:
Nov 28 11:02:43 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2
Nov 28 11:02:43 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:02:43 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:02:43 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd
Nov 28 11:02:43 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:02:43 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:02:43 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b
Nov 28 11:02:43 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:02:43 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:02:43 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988
Nov 28 11:02:43 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:02:43 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:02:43 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de
Nov 28 11:02:43 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:02:43 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:02:43 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7
Nov 28 11:02:43 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:02:43 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:02:43 user nova-compute[74994]: FIRMWARE:
Nov 28 11:02:43 user nova-compute[74994]: No targets found.
Nov 28 11:02:43 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 11:02:43 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 11:02:43 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44ab4ae-bef8-4152-a732-6579db1052f4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cff49c3-1b7b-4d0b-a022-7371c18f3f0e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:02:43 user nova-compute[74994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)
Nov 28 11:02:43 user nova-compute[74994]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)
Nov 28 11:02:43 user nova-compute[74994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)
Nov 28 11:02:43 user nova-compute[74994]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 (non-flash)
Nov 28 11:02:43 user nova-compute[74994]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 (non-flash)
Nov 28 11:02:43 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:02:43 user nova-compute[74994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)
Nov 28 11:02:43 user nova-compute[74994]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)
Nov 28 11:02:43 user nova-compute[74994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)
Nov 28 11:02:43 user nova-compute[74994]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 (non-flash)
Nov 28 11:02:43 user nova-compute[74994]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 (non-flash)
Nov 28 11:02:43 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9206b8940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7'): ({'sdc'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Removing single pathed devices sdc {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7016d6c8-975c-478b-aff6-a9877012b0cc]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[987a646b-b301-42ff-bf5a-097225406183]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Flushing IO for device /dev/sdc {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5bfc86b-083e-4b01-89f8-cb3fb313a559]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c67d252-5718-4cfa-9dd5-2973a531e1f5]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] SCSI volumes sdc have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e6a5e9-b4a6-406b-84fc-851451364a2a]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.095s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9591f0-7849-46c5-acb0-30c454fd3618]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7, portal: 172.16.0.220,3260]
Nov 28 11:02:43 user nova-compute[74994]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7, portal: 172.16.0.220,3260] successful.
Nov 28 11:02:43 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c846b981-d6a9-4f67-bf7c-3d633b1479ea]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] <== disconnect_volume: return (364ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Start _get_guest_xml network_info=[{"id": "e3ec524f-0e85-40e1-8817-b9d4b75f9966", "address": "fa:16:3e:99:ce:ce", "network": {"id": "89f2b906-9ef3-4e31-87e5-3e0cd23e8695", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2005181920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9670a509ac14f41a9f44d7299fd2f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3ec524f-0e", "ovs_interfaceid": "e3ec524f-0e85-40e1-8817-b9d4b75f9966", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=72081665-97f0-4d07-85e6-e93aff963a9d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '72081665-97f0-4d07-85e6-e93aff963a9d'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AgKYCRiP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'd1de4238-c33e-48a6-bb4f-240e91e81ea3', 'attached_at': '', 'detached_at': '', 'volume_id': '13b829e7-d2df-4c8c-9bc6-119c06a4c5d7', 'serial': '13b829e7-d2df-4c8c-9bc6-119c06a4c5d7'}, 'attachment_id': 'af9c3f23-df58-458a-ae92-97f1664af938', 'boot_index': None, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 11:02:43 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:02:43 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:02:43 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=72081665-97f0-4d07-85e6-e93aff963a9d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG nova.objects.instance [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lazy-loading 'vcpu_model' on Instance uuid d1de4238-c33e-48a6-bb4f-240e91e81ea3 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG nova.objects.base [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Object Instance<d1de4238-c33e-48a6-bb4f-240e91e81ea3> lazy-loaded attributes: resources,vcpu_model {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AgKYCRiP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:02:43 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:02:43 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:02:43 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:02:43 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:02:43 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 11:02:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6714274f-3569-4161-a4dc-fa5d41b8fbc3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 11:02:43 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebe233f-30be-480e-8267-b8c8b43504bd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7] added
Nov 28 11:02:43 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa106309-206c-4be2-9288-f04bab898acd]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b87d67-34d0-4673-b584-6f7537ada4d6]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:02:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AgKYCRiP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AgKYCRiP" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:44 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5badf9-146c-4597-aa58-7d3e83b729e9]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AgKYCRiP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:02:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:44 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e115165-41f7-4384-9eb6-772311829bd4]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:02:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:44 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0f4e41-ba20-4cd5-89e7-5f0f9e47e591]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:02:44 user nova-compute[74994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)
Nov 28 11:02:44 user nova-compute[74994]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)
Nov 28 11:02:44 user nova-compute[74994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)
Nov 28 11:02:44 user nova-compute[74994]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 (non-flash)
Nov 28 11:02:44 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:02:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:02:44 user nova-compute[74994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)
Nov 28 11:02:44 user nova-compute[74994]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)
Nov 28 11:02:44 user nova-compute[74994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)
Nov 28 11:02:44 user nova-compute[74994]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 (non-flash)
Nov 28 11:02:44 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:02:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:44 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5929bd-00b7-4d85-b532-013e8709eca3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7, portal: 172.16.0.220,3260]
Nov 28 11:02:44 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7, portal: 172.16.0.220,3260] successful.
Nov 28 11:02:44 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:02:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:44 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d624a17-52aa-4636-8674-cee7ef5a5654]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:02:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:44 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e067f62-99e3-4ca8-880d-a4da14b28a4e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:02:44 user nova-compute[74994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)
Nov 28 11:02:44 user nova-compute[74994]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)
Nov 28 11:02:44 user nova-compute[74994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)
Nov 28 11:02:44 user nova-compute[74994]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 (non-flash)
Nov 28 11:02:44 user nova-compute[74994]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 (non-flash)
Nov 28 11:02:44 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:02:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:02:44 user nova-compute[74994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)
Nov 28 11:02:44 user nova-compute[74994]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)
Nov 28 11:02:44 user nova-compute[74994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)
Nov 28 11:02:44 user nova-compute[74994]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 (non-flash)
Nov 28 11:02:44 user nova-compute[74994]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 (non-flash)
Nov 28 11:02:44 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:02:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:02:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 11:02:44 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] HCTL ('34', '-', '-', 0) found on session 37 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 11:02:44 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 11:02:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:44 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4b99ba-c987-459d-a393-95fd0d23d60d]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:44 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 11:02:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AgKYCRiP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 11:02:44 user nova-compute[74994]: DEBUG nova.compute.manager [req-bbc4abeb-c14c-4cba-8e5e-ef957be47e83 req-047fa18e-6359-4ac3-9e29-fe772a884995 service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Received event network-vif-unplugged-e3ec524f-0e85-40e1-8817-b9d4b75f9966 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:02:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bbc4abeb-c14c-4cba-8e5e-ef957be47e83 req-047fa18e-6359-4ac3-9e29-fe772a884995 service nova] Acquiring lock "d1de4238-c33e-48a6-bb4f-240e91e81ea3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:02:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bbc4abeb-c14c-4cba-8e5e-ef957be47e83 req-047fa18e-6359-4ac3-9e29-fe772a884995 service nova] Lock "d1de4238-c33e-48a6-bb4f-240e91e81ea3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:02:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bbc4abeb-c14c-4cba-8e5e-ef957be47e83 req-047fa18e-6359-4ac3-9e29-fe772a884995 service nova] Lock "d1de4238-c33e-48a6-bb4f-240e91e81ea3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:02:44 user nova-compute[74994]: DEBUG nova.compute.manager [req-bbc4abeb-c14c-4cba-8e5e-ef957be47e83 req-047fa18e-6359-4ac3-9e29-fe772a884995 service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] No waiting events found dispatching network-vif-unplugged-e3ec524f-0e85-40e1-8817-b9d4b75f9966 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:02:44 user nova-compute[74994]: WARNING nova.compute.manager [req-bbc4abeb-c14c-4cba-8e5e-ef957be47e83 req-047fa18e-6359-4ac3-9e29-fe772a884995 service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Received unexpected event network-vif-unplugged-e3ec524f-0e85-40e1-8817-b9d4b75f9966 for instance with vm_state active and task_state reboot_started_hard.
Nov 28 11:02:44 user nova-compute[74994]: DEBUG nova.compute.manager [req-bbc4abeb-c14c-4cba-8e5e-ef957be47e83 req-047fa18e-6359-4ac3-9e29-fe772a884995 service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Received event network-vif-plugged-e3ec524f-0e85-40e1-8817-b9d4b75f9966 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:02:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bbc4abeb-c14c-4cba-8e5e-ef957be47e83 req-047fa18e-6359-4ac3-9e29-fe772a884995 service nova] Acquiring lock "d1de4238-c33e-48a6-bb4f-240e91e81ea3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:02:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bbc4abeb-c14c-4cba-8e5e-ef957be47e83 req-047fa18e-6359-4ac3-9e29-fe772a884995 service nova] Lock "d1de4238-c33e-48a6-bb4f-240e91e81ea3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:02:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bbc4abeb-c14c-4cba-8e5e-ef957be47e83 req-047fa18e-6359-4ac3-9e29-fe772a884995 service nova] Lock "d1de4238-c33e-48a6-bb4f-240e91e81ea3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:02:44 user nova-compute[74994]: DEBUG nova.compute.manager [req-bbc4abeb-c14c-4cba-8e5e-ef957be47e83 req-047fa18e-6359-4ac3-9e29-fe772a884995 service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] No waiting events found dispatching network-vif-plugged-e3ec524f-0e85-40e1-8817-b9d4b75f9966 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:02:44 user nova-compute[74994]: WARNING nova.compute.manager [req-bbc4abeb-c14c-4cba-8e5e-ef957be47e83 req-047fa18e-6359-4ac3-9e29-fe772a884995 service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Received unexpected event network-vif-plugged-e3ec524f-0e85-40e1-8817-b9d4b75f9966 for instance with vm_state active and task_state reboot_started_hard.
Nov 28 11:02:44 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:02:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '26163303436363939', 'path': '/dev/sdc'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:02:45 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163303436363939', 'path': '/dev/sdc'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 11:02:45 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:00:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-342030530',display_name='tempest-TestMinimumBasicScenario-server-342030530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-342030530',id=29,image_ref='72081665-97f0-4d07-85e6-e93aff963a9d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyVQMduM13BgMZJIMtke6rN9ybjpOOFWz20TU2DvJ+OA7UvylvkmeAOhXrqzo0DECLS+nqoTXK7yvdL4DWRjTgwl0mH1+2xXyPyunJt/UXv2mIQhL1IpGRflfXkBiMUuw==',key_name='tempest-TestMinimumBasicScenario-928079813',keypairs=<?>,launch_index=0,launched_at=2023-11-28T11:00:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9670a509ac14f41a9f44d7299fd2f30',ramdisk_id='',reservation_id='r-soytlw4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='72081665-97f0-4d07-85e6-e93aff963a9d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-756572202',owner_user_name='tempest-TestMinimumBasicScenario-756572202-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T11:02:42Z,user_data=None,user_id='18ba016046ac42599094e626d3fdd860',uuid=d1de4238-c33e-48a6-bb4f-240e91e81ea3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e3ec524f-0e85-40e1-8817-b9d4b75f9966", "address": "fa:16:3e:99:ce:ce", "network": {"id": "89f2b906-9ef3-4e31-87e5-3e0cd23e8695", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2005181920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9670a509ac14f41a9f44d7299fd2f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3ec524f-0e", "ovs_interfaceid": "e3ec524f-0e85-40e1-8817-b9d4b75f9966", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 11:02:45 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Converting VIF {"id": "e3ec524f-0e85-40e1-8817-b9d4b75f9966", "address": "fa:16:3e:99:ce:ce", "network": {"id": "89f2b906-9ef3-4e31-87e5-3e0cd23e8695", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2005181920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9670a509ac14f41a9f44d7299fd2f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3ec524f-0e", "ovs_interfaceid": "e3ec524f-0e85-40e1-8817-b9d4b75f9966", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:02:45 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:ce:ce,bridge_name='br-int',has_traffic_filtering=True,id=e3ec524f-0e85-40e1-8817-b9d4b75f9966,network=Network(89f2b906-9ef3-4e31-87e5-3e0cd23e8695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3ec524f-0e') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:02:45 user nova-compute[74994]: DEBUG nova.objects.instance [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lazy-loading 'pci_devices' on Instance uuid d1de4238-c33e-48a6-bb4f-240e91e81ea3 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:02:45 user nova-compute[74994]: DEBUG nova.objects.base [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Object Instance<d1de4238-c33e-48a6-bb4f-240e91e81ea3> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 11:02:45 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] End _get_guest_xml xml=<domain type="kvm">
Nov 28 11:02:45 user nova-compute[74994]:   <uuid>d1de4238-c33e-48a6-bb4f-240e91e81ea3</uuid>
Nov 28 11:02:45 user nova-compute[74994]:   <name>instance-0000001d</name>
Nov 28 11:02:45 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 11:02:45 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 11:02:45 user nova-compute[74994]:   <metadata>
Nov 28 11:02:45 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 11:02:45 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 11:02:45 user nova-compute[74994]:       <nova:name>tempest-TestMinimumBasicScenario-server-342030530</nova:name>
Nov 28 11:02:45 user nova-compute[74994]:       <nova:creationTime>2023-11-28 11:02:43</nova:creationTime>
Nov 28 11:02:45 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 11:02:45 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 11:02:45 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 11:02:45 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 11:02:45 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 11:02:45 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 11:02:45 user nova-compute[74994]:       </nova:flavor>
Nov 28 11:02:45 user nova-compute[74994]:       <nova:owner>
Nov 28 11:02:45 user nova-compute[74994]:         <nova:user uuid="18ba016046ac42599094e626d3fdd860">tempest-TestMinimumBasicScenario-756572202-project-member</nova:user>
Nov 28 11:02:45 user nova-compute[74994]:         <nova:project uuid="b9670a509ac14f41a9f44d7299fd2f30">tempest-TestMinimumBasicScenario-756572202</nova:project>
Nov 28 11:02:45 user nova-compute[74994]:       </nova:owner>
Nov 28 11:02:45 user nova-compute[74994]:       <nova:root type="image" uuid="72081665-97f0-4d07-85e6-e93aff963a9d"/>
Nov 28 11:02:45 user nova-compute[74994]:       <nova:ports>
Nov 28 11:02:45 user nova-compute[74994]:         <nova:port uuid="e3ec524f-0e85-40e1-8817-b9d4b75f9966">
Nov 28 11:02:45 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 11:02:45 user nova-compute[74994]:         </nova:port>
Nov 28 11:02:45 user nova-compute[74994]:       </nova:ports>
Nov 28 11:02:45 user nova-compute[74994]:     </nova:instance>
Nov 28 11:02:45 user nova-compute[74994]:   </metadata>
Nov 28 11:02:45 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 11:02:45 user nova-compute[74994]:     <system>
Nov 28 11:02:45 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 11:02:45 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 11:02:45 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 11:02:45 user nova-compute[74994]:       <entry name="serial">d1de4238-c33e-48a6-bb4f-240e91e81ea3</entry>
Nov 28 11:02:45 user nova-compute[74994]:       <entry name="uuid">d1de4238-c33e-48a6-bb4f-240e91e81ea3</entry>
Nov 28 11:02:45 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 11:02:45 user nova-compute[74994]:     </system>
Nov 28 11:02:45 user nova-compute[74994]:   </sysinfo>
Nov 28 11:02:45 user nova-compute[74994]:   <os>
Nov 28 11:02:45 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 11:02:45 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 11:02:45 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 11:02:45 user nova-compute[74994]:   </os>
Nov 28 11:02:45 user nova-compute[74994]:   <features>
Nov 28 11:02:45 user nova-compute[74994]:     <acpi/>
Nov 28 11:02:45 user nova-compute[74994]:     <apic/>
Nov 28 11:02:45 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 11:02:45 user nova-compute[74994]:   </features>
Nov 28 11:02:45 user nova-compute[74994]:   <clock offset="utc">
Nov 28 11:02:45 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 11:02:45 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 11:02:45 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 11:02:45 user nova-compute[74994]:   </clock>
Nov 28 11:02:45 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 11:02:45 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 11:02:45 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 11:02:45 user nova-compute[74994]:   </cpu>
Nov 28 11:02:45 user nova-compute[74994]:   <devices>
Nov 28 11:02:45 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 11:02:45 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 11:02:45 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/d1de4238-c33e-48a6-bb4f-240e91e81ea3/disk"/>
Nov 28 11:02:45 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 11:02:45 user nova-compute[74994]:     </disk>
Nov 28 11:02:45 user nova-compute[74994]:     <disk type="block" device="disk">
Nov 28 11:02:45 user nova-compute[74994]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:02:45 user nova-compute[74994]:       <source dev="/dev/sdc"/>
Nov 28 11:02:45 user nova-compute[74994]:       <target dev="vdb" bus="virtio"/>
Nov 28 11:02:45 user nova-compute[74994]:       <serial>13b829e7-d2df-4c8c-9bc6-119c06a4c5d7</serial>
Nov 28 11:02:45 user nova-compute[74994]:     </disk>
Nov 28 11:02:45 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 11:02:45 user nova-compute[74994]:       <mac address="fa:16:3e:99:ce:ce"/>
Nov 28 11:02:45 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:02:45 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 11:02:45 user nova-compute[74994]:       <target dev="tape3ec524f-0e"/>
Nov 28 11:02:45 user nova-compute[74994]:     </interface>
Nov 28 11:02:45 user nova-compute[74994]:     <serial type="pty">
Nov 28 11:02:45 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/d1de4238-c33e-48a6-bb4f-240e91e81ea3/console.log" append="off"/>
Nov 28 11:02:45 user nova-compute[74994]:     </serial>
Nov 28 11:02:45 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 11:02:45 user nova-compute[74994]:     <video>
Nov 28 11:02:45 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:02:45 user nova-compute[74994]:     </video>
Nov 28 11:02:45 user nova-compute[74994]:     <rng model="virtio">
Nov 28 11:02:45 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 11:02:45 user nova-compute[74994]:     </rng>
Nov 28 11:02:45 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 11:02:45 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 11:02:45 user nova-compute[74994]:       <stats period="10"/>
Nov 28 11:02:45 user nova-compute[74994]:     </memballoon>
Nov 28 11:02:45 user nova-compute[74994]:   </devices>
Nov 28 11:02:45 user nova-compute[74994]: </domain>
Nov 28 11:02:45 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 11:02:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1de4238-c33e-48a6-bb4f-240e91e81ea3/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1de4238-c33e-48a6-bb4f-240e91e81ea3/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1de4238-c33e-48a6-bb4f-240e91e81ea3/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1de4238-c33e-48a6-bb4f-240e91e81ea3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:45 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:02:45 user nova-compute[74994]: DEBUG nova.objects.instance [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lazy-loading 'trusted_certs' on Instance uuid d1de4238-c33e-48a6-bb4f-240e91e81ea3 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:02:45 user nova-compute[74994]: DEBUG nova.objects.base [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Object Instance<d1de4238-c33e-48a6-bb4f-240e91e81ea3> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 11:02:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/90726bcf004a6699817d06d6d5f3a981dee9e56d --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/90726bcf004a6699817d06d6d5f3a981dee9e56d --force-share --output=json" returned: 0 in 0.179s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:45 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d1de4238-c33e-48a6-bb4f-240e91e81ea3/disk. size=1073741824 {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 11:02:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1de4238-c33e-48a6-bb4f-240e91e81ea3/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1de4238-c33e-48a6-bb4f-240e91e81ea3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:46 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Cannot resize image /opt/stack/data/nova/instances/d1de4238-c33e-48a6-bb4f-240e91e81ea3/disk to a smaller size. {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 11:02:46 user nova-compute[74994]: DEBUG nova.objects.instance [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lazy-loading 'migration_context' on Instance uuid d1de4238-c33e-48a6-bb4f-240e91e81ea3 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:02:46 user nova-compute[74994]: DEBUG nova.objects.base [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Object Instance<d1de4238-c33e-48a6-bb4f-240e91e81ea3> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 11:02:46 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:00:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-342030530',display_name='tempest-TestMinimumBasicScenario-server-342030530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-342030530',id=29,image_ref='72081665-97f0-4d07-85e6-e93aff963a9d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyVQMduM13BgMZJIMtke6rN9ybjpOOFWz20TU2DvJ+OA7UvylvkmeAOhXrqzo0DECLS+nqoTXK7yvdL4DWRjTgwl0mH1+2xXyPyunJt/UXv2mIQhL1IpGRflfXkBiMUuw==',key_name='tempest-TestMinimumBasicScenario-928079813',keypairs=<?>,launch_index=0,launched_at=2023-11-28T11:00:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='b9670a509ac14f41a9f44d7299fd2f30',ramdisk_id='',reservation_id='r-soytlw4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='72081665-97f0-4d07-85e6-e93aff963a9d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-756572202',owner_user_name='tempest-TestMinimumBasicScenario-756572202-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:02:42Z,user_data=None,user_id='18ba016046ac42599094e626d3fdd860',uuid=d1de4238-c33e-48a6-bb4f-240e91e81ea3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e3ec524f-0e85-40e1-8817-b9d4b75f9966", "address": "fa:16:3e:99:ce:ce", "network": {"id": "89f2b906-9ef3-4e31-87e5-3e0cd23e8695", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2005181920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9670a509ac14f41a9f44d7299fd2f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3ec524f-0e", "ovs_interfaceid": "e3ec524f-0e85-40e1-8817-b9d4b75f9966", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 11:02:46 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Converting VIF {"id": "e3ec524f-0e85-40e1-8817-b9d4b75f9966", "address": "fa:16:3e:99:ce:ce", "network": {"id": "89f2b906-9ef3-4e31-87e5-3e0cd23e8695", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2005181920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9670a509ac14f41a9f44d7299fd2f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3ec524f-0e", "ovs_interfaceid": "e3ec524f-0e85-40e1-8817-b9d4b75f9966", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:02:46 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:ce:ce,bridge_name='br-int',has_traffic_filtering=True,id=e3ec524f-0e85-40e1-8817-b9d4b75f9966,network=Network(89f2b906-9ef3-4e31-87e5-3e0cd23e8695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3ec524f-0e') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:02:46 user nova-compute[74994]: DEBUG os_vif [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:ce:ce,bridge_name='br-int',has_traffic_filtering=True,id=e3ec524f-0e85-40e1-8817-b9d4b75f9966,network=Network(89f2b906-9ef3-4e31-87e5-3e0cd23e8695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3ec524f-0e') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 11:02:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:02:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 11:02:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '352fb7fa-1cd9-5d64-ab72-810b9f4b2484', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:02:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:02:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape3ec524f-0e, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:02:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape3ec524f-0e, col_values=(('qos', UUID('3864a64a-7478-424f-af05-1aae6e5f3f5d')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:02:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape3ec524f-0e, col_values=(('external_ids', {'iface-id': 'e3ec524f-0e85-40e1-8817-b9d4b75f9966', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:ce:ce', 'vm-uuid': 'd1de4238-c33e-48a6-bb4f-240e91e81ea3'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:02:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:02:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:46 user nova-compute[74994]: INFO os_vif [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:ce:ce,bridge_name='br-int',has_traffic_filtering=True,id=e3ec524f-0e85-40e1-8817-b9d4b75f9966,network=Network(89f2b906-9ef3-4e31-87e5-3e0cd23e8695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3ec524f-0e')
Nov 28 11:02:47 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:47 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:47 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:47 user nova-compute[74994]: DEBUG nova.compute.manager [req-2272e14f-8b48-41fe-adba-363dd0e7e47f req-9c2c648f-1be0-4f43-b67d-ff34108cf5c6 service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Received event network-vif-plugged-e3ec524f-0e85-40e1-8817-b9d4b75f9966 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:02:47 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-2272e14f-8b48-41fe-adba-363dd0e7e47f req-9c2c648f-1be0-4f43-b67d-ff34108cf5c6 service nova] Acquiring lock "d1de4238-c33e-48a6-bb4f-240e91e81ea3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:02:47 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-2272e14f-8b48-41fe-adba-363dd0e7e47f req-9c2c648f-1be0-4f43-b67d-ff34108cf5c6 service nova] Lock "d1de4238-c33e-48a6-bb4f-240e91e81ea3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:02:47 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-2272e14f-8b48-41fe-adba-363dd0e7e47f req-9c2c648f-1be0-4f43-b67d-ff34108cf5c6 service nova] Lock "d1de4238-c33e-48a6-bb4f-240e91e81ea3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:02:47 user nova-compute[74994]: DEBUG nova.compute.manager [req-2272e14f-8b48-41fe-adba-363dd0e7e47f req-9c2c648f-1be0-4f43-b67d-ff34108cf5c6 service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] No waiting events found dispatching network-vif-plugged-e3ec524f-0e85-40e1-8817-b9d4b75f9966 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:02:47 user nova-compute[74994]: WARNING nova.compute.manager [req-2272e14f-8b48-41fe-adba-363dd0e7e47f req-9c2c648f-1be0-4f43-b67d-ff34108cf5c6 service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Received unexpected event network-vif-plugged-e3ec524f-0e85-40e1-8817-b9d4b75f9966 for instance with vm_state active and task_state reboot_started_hard.
Nov 28 11:02:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:49 user nova-compute[74994]: DEBUG nova.compute.manager [req-afe84f59-2e11-46b8-87ae-0933c7b2d5df req-e97c1db7-10c4-4687-bc62-d1e1dc2de471 service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Received event network-vif-plugged-e3ec524f-0e85-40e1-8817-b9d4b75f9966 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:02:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-afe84f59-2e11-46b8-87ae-0933c7b2d5df req-e97c1db7-10c4-4687-bc62-d1e1dc2de471 service nova] Acquiring lock "d1de4238-c33e-48a6-bb4f-240e91e81ea3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:02:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-afe84f59-2e11-46b8-87ae-0933c7b2d5df req-e97c1db7-10c4-4687-bc62-d1e1dc2de471 service nova] Lock "d1de4238-c33e-48a6-bb4f-240e91e81ea3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:02:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-afe84f59-2e11-46b8-87ae-0933c7b2d5df req-e97c1db7-10c4-4687-bc62-d1e1dc2de471 service nova] Lock "d1de4238-c33e-48a6-bb4f-240e91e81ea3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:02:49 user nova-compute[74994]: DEBUG nova.compute.manager [req-afe84f59-2e11-46b8-87ae-0933c7b2d5df req-e97c1db7-10c4-4687-bc62-d1e1dc2de471 service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] No waiting events found dispatching network-vif-plugged-e3ec524f-0e85-40e1-8817-b9d4b75f9966 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:02:49 user nova-compute[74994]: WARNING nova.compute.manager [req-afe84f59-2e11-46b8-87ae-0933c7b2d5df req-e97c1db7-10c4-4687-bc62-d1e1dc2de471 service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Received unexpected event network-vif-plugged-e3ec524f-0e85-40e1-8817-b9d4b75f9966 for instance with vm_state active and task_state reboot_started_hard.
Nov 28 11:02:49 user nova-compute[74994]: DEBUG nova.compute.manager [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 11:02:49 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Instance rebooted successfully.
Nov 28 11:02:49 user nova-compute[74994]: DEBUG nova.compute.manager [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 11:02:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c0ffd39c-d114-45b1-baac-f4c64a2020e0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "d1de4238-c33e-48a6-bb4f-240e91e81ea3" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.330s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:51 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-809920a3-13cf-43c8-8515-e9dca438479f tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 20605acb-092a-4214-a114-750f145d7af8 is timed out.
Nov 28 11:02:51 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-809920a3-13cf-43c8-8515-e9dca438479f tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Successfully detached device vdb from instance 20605acb-092a-4214-a114-750f145d7af8 from the live domain config.
Nov 28 11:02:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-809920a3-13cf-43c8-8515-e9dca438479f tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-809920a3-13cf-43c8-8515-e9dca438479f tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HVFaUfcy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:02:51 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-809920a3-13cf-43c8-8515-e9dca438479f tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:02:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-809920a3-13cf-43c8-8515-e9dca438479f tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-809920a3-13cf-43c8-8515-e9dca438479f tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7190f629-0ed0-40e2-883b-0f34b6349019]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-809920a3-13cf-43c8-8515-e9dca438479f tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 11:02:51 user nova-compute[74994]: No targets found.
Nov 28 11:02:51 user nova-compute[74994]: iSNS:
Nov 28 11:02:51 user nova-compute[74994]: No targets found.
Nov 28 11:02:51 user nova-compute[74994]: STATIC:
Nov 28 11:02:51 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2
Nov 28 11:02:51 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:02:51 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:02:51 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd
Nov 28 11:02:51 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:02:51 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:02:51 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b
Nov 28 11:02:51 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:02:51 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:02:51 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988
Nov 28 11:02:51 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:02:51 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:02:51 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de
Nov 28 11:02:51 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:02:51 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:02:51 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7
Nov 28 11:02:51 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:02:51 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:02:51 user nova-compute[74994]: FIRMWARE:
Nov 28 11:02:51 user nova-compute[74994]: No targets found.
Nov 28 11:02:51 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-809920a3-13cf-43c8-8515-e9dca438479f tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 11:02:51 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 11:02:51 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-809920a3-13cf-43c8-8515-e9dca438479f tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d38e8df-d497-4c20-96fe-e791adf9227b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b93bd3c-8206-4875-846f-6c8e6a3130df]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-809920a3-13cf-43c8-8515-e9dca438479f tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:02:51 user nova-compute[74994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)
Nov 28 11:02:51 user nova-compute[74994]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)
Nov 28 11:02:51 user nova-compute[74994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)
Nov 28 11:02:51 user nova-compute[74994]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 (non-flash)
Nov 28 11:02:51 user nova-compute[74994]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 (non-flash)
Nov 28 11:02:51 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-809920a3-13cf-43c8-8515-e9dca438479f tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:02:51 user nova-compute[74994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)
Nov 28 11:02:51 user nova-compute[74994]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b (non-flash)
Nov 28 11:02:51 user nova-compute[74994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)
Nov 28 11:02:51 user nova-compute[74994]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 (non-flash)
Nov 28 11:02:51 user nova-compute[74994]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 (non-flash)
Nov 28 11:02:51 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-809920a3-13cf-43c8-8515-e9dca438479f tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb95629ff40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b'): ({'sde'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-809920a3-13cf-43c8-8515-e9dca438479f tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Removing single pathed devices sde {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[54762ffd-b50b-4e4e-b8a4-ee10a2ae674c]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[054b6d51-8d25-49df-a08d-6b775f0b4a44]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-809920a3-13cf-43c8-8515-e9dca438479f tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Flushing IO for device /dev/sde {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd810553-83a0-4d9f-82fb-6f31cbd8b388]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-809920a3-13cf-43c8-8515-e9dca438479f tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6404cb43-a96e-4cb3-ae91-a176fb8caed5]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-809920a3-13cf-43c8-8515-e9dca438479f tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-809920a3-13cf-43c8-8515-e9dca438479f tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] SCSI volumes sde have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-809920a3-13cf-43c8-8515-e9dca438479f tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e21eb8-7288-463a-97ad-5e8c32ef4df1]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-809920a3-13cf-43c8-8515-e9dca438479f tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7de7ae-120f-42e7-9889-f450c845e35b]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-809920a3-13cf-43c8-8515-e9dca438479f tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b, portal: 172.16.0.220,3260]
Nov 28 11:02:51 user nova-compute[74994]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b, portal: 172.16.0.220,3260] successful.
Nov 28 11:02:51 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d070c683-4fcf-429a-a848-14db7a1e046b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ce9008-96c5-4916-8354-2f270ac3235f]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-809920a3-13cf-43c8-8515-e9dca438479f tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-809920a3-13cf-43c8-8515-e9dca438479f tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-809920a3-13cf-43c8-8515-e9dca438479f tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] <== disconnect_volume: return (356ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:02:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-809920a3-13cf-43c8-8515-e9dca438479f tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 11:02:52 user nova-compute[74994]: DEBUG nova.objects.instance [None req-809920a3-13cf-43c8-8515-e9dca438479f tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lazy-loading 'flavor' on Instance uuid 20605acb-092a-4214-a114-750f145d7af8 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:02:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-809920a3-13cf-43c8-8515-e9dca438479f tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "20605acb-092a-4214-a114-750f145d7af8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.829s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:02:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:56 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:02:59 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:03:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:03:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:03:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:03:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:03:10 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:03:10 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 11:03:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:03:11 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:03:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:03:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:03:17 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:03:17 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:03:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:03:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:03:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:03:17 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 11:03:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:03:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:03:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:03:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:03:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:03:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:03:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:03:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:03:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:03:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:03:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:03:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:03:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:03:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:03:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:03:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:03:19 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:03:19 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:03:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e67fb47-500c-4e85-b384-27408ec622a9/disk.rescue --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:03:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e67fb47-500c-4e85-b384-27408ec622a9/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:03:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e67fb47-500c-4e85-b384-27408ec622a9/disk.rescue --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:03:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e67fb47-500c-4e85-b384-27408ec622a9/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:03:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc5adf9-5a73-4d7d-b53d-849354a3a053/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:03:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc5adf9-5a73-4d7d-b53d-849354a3a053/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:03:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc5adf9-5a73-4d7d-b53d-849354a3a053/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:03:19 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:03:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc5adf9-5a73-4d7d-b53d-849354a3a053/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:03:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:03:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:03:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:03:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ead56484-23a0-4e9b-9b61-38afca80de55 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "20605acb-092a-4214-a114-750f145d7af8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:03:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ead56484-23a0-4e9b-9b61-38afca80de55 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "20605acb-092a-4214-a114-750f145d7af8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:03:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ead56484-23a0-4e9b-9b61-38afca80de55 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "20605acb-092a-4214-a114-750f145d7af8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:03:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ead56484-23a0-4e9b-9b61-38afca80de55 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "20605acb-092a-4214-a114-750f145d7af8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:03:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ead56484-23a0-4e9b-9b61-38afca80de55 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "20605acb-092a-4214-a114-750f145d7af8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:03:20 user nova-compute[74994]: INFO nova.compute.manager [None req-ead56484-23a0-4e9b-9b61-38afca80de55 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Terminating instance
Nov 28 11:03:20 user nova-compute[74994]: DEBUG nova.compute.manager [None req-ead56484-23a0-4e9b-9b61-38afca80de55 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 11:03:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:03:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:03:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:03:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:03:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:03:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:03:20 user nova-compute[74994]: DEBUG nova.compute.manager [req-2edb2eff-26b4-4b71-9f9e-cb939f66d359 req-311981b7-7919-43ef-8434-d6e07e13c002 service nova] [instance: 20605acb-092a-4214-a114-750f145d7af8] Received event network-vif-unplugged-2b0693da-4e7d-4fb9-b7f0-adcb89d64f08 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:03:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-2edb2eff-26b4-4b71-9f9e-cb939f66d359 req-311981b7-7919-43ef-8434-d6e07e13c002 service nova] Acquiring lock "20605acb-092a-4214-a114-750f145d7af8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:03:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-2edb2eff-26b4-4b71-9f9e-cb939f66d359 req-311981b7-7919-43ef-8434-d6e07e13c002 service nova] Lock "20605acb-092a-4214-a114-750f145d7af8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:03:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-2edb2eff-26b4-4b71-9f9e-cb939f66d359 req-311981b7-7919-43ef-8434-d6e07e13c002 service nova] Lock "20605acb-092a-4214-a114-750f145d7af8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:03:20 user nova-compute[74994]: DEBUG nova.compute.manager [req-2edb2eff-26b4-4b71-9f9e-cb939f66d359 req-311981b7-7919-43ef-8434-d6e07e13c002 service nova] [instance: 20605acb-092a-4214-a114-750f145d7af8] No waiting events found dispatching network-vif-unplugged-2b0693da-4e7d-4fb9-b7f0-adcb89d64f08 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:03:20 user nova-compute[74994]: DEBUG nova.compute.manager [req-2edb2eff-26b4-4b71-9f9e-cb939f66d359 req-311981b7-7919-43ef-8434-d6e07e13c002 service nova] [instance: 20605acb-092a-4214-a114-750f145d7af8] Received event network-vif-unplugged-2b0693da-4e7d-4fb9-b7f0-adcb89d64f08 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 11:03:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:03:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:03:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:03:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:03:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:03:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:03:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:03:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:03:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:03:20 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 20605acb-092a-4214-a114-750f145d7af8] Instance destroyed successfully.
Nov 28 11:03:20 user nova-compute[74994]: DEBUG nova.objects.instance [None req-ead56484-23a0-4e9b-9b61-38afca80de55 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lazy-loading 'resources' on Instance uuid 20605acb-092a-4214-a114-750f145d7af8 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:03:21 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-ead56484-23a0-4e9b-9b61-38afca80de55 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T10:57:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-893238339',display_name='tempest-ServerActionsTestOtherA-server-431726265',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-893238339',id=24,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBOY+NutkPemiyHeMnQLSk9aaZJeDN6wgP5qBeYjN7xZFqVw9TdQeE9oS3N1LsgeVKLYADzySBGVghLSJNwEz9H04AB8Wq7t5ky4d6BMahksF1kPbZitdOiyTWwqobeQw==',key_name='tempest-keypair-2025261715',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:59:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5eb43a8fc7bd47728600741762f71112',ramdisk_id='',reservation_id='r-qwz39s5c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1927948343',owner_user_name='tempest-ServerActionsTestOtherA-1927948343-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T10:59:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d51be473c7284977a6533756a1f677f9',uuid=20605acb-092a-4214-a114-750f145d7af8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b0693da-4e7d-4fb9-b7f0-adcb89d64f08", "address": "fa:16:3e:af:ea:62", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b0693da-4e", "ovs_interfaceid": "2b0693da-4e7d-4fb9-b7f0-adcb89d64f08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 11:03:21 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-ead56484-23a0-4e9b-9b61-38afca80de55 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Converting VIF {"id": "2b0693da-4e7d-4fb9-b7f0-adcb89d64f08", "address": "fa:16:3e:af:ea:62", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b0693da-4e", "ovs_interfaceid": "2b0693da-4e7d-4fb9-b7f0-adcb89d64f08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:03:21 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-ead56484-23a0-4e9b-9b61-38afca80de55 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:ea:62,bridge_name='br-int',has_traffic_filtering=True,id=2b0693da-4e7d-4fb9-b7f0-adcb89d64f08,network=Network(16dd32cd-5a00-4111-92e2-283e7635540f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b0693da-4e') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:03:21 user nova-compute[74994]: DEBUG os_vif [None req-ead56484-23a0-4e9b-9b61-38afca80de55 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:ea:62,bridge_name='br-int',has_traffic_filtering=True,id=2b0693da-4e7d-4fb9-b7f0-adcb89d64f08,network=Network(16dd32cd-5a00-4111-92e2-283e7635540f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b0693da-4e') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 11:03:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:03:21 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:03:21 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b0693da-4e, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:03:21 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:03:21 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:03:21 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:03:21 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=03cb4050-5234-45ca-9dab-1e5066765552) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:03:21 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:03:21 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:03:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf241c8-e888-4e47-8213-3c83c045e4a3/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:03:21 user nova-compute[74994]: INFO os_vif [None req-ead56484-23a0-4e9b-9b61-38afca80de55 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:ea:62,bridge_name='br-int',has_traffic_filtering=True,id=2b0693da-4e7d-4fb9-b7f0-adcb89d64f08,network=Network(16dd32cd-5a00-4111-92e2-283e7635540f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b0693da-4e')
Nov 28 11:03:21 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-ead56484-23a0-4e9b-9b61-38afca80de55 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Deleting instance files /opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8_del
Nov 28 11:03:21 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-ead56484-23a0-4e9b-9b61-38afca80de55 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Deletion of /opt/stack/data/nova/instances/20605acb-092a-4214-a114-750f145d7af8_del complete
Nov 28 11:03:21 user nova-compute[74994]: INFO nova.compute.manager [None req-ead56484-23a0-4e9b-9b61-38afca80de55 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20605acb-092a-4214-a114-750f145d7af8] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 28 11:03:21 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-ead56484-23a0-4e9b-9b61-38afca80de55 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 11:03:21 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: 20605acb-092a-4214-a114-750f145d7af8] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 11:03:21 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 20605acb-092a-4214-a114-750f145d7af8] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 11:03:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf241c8-e888-4e47-8213-3c83c045e4a3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:03:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf241c8-e888-4e47-8213-3c83c045e4a3/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:03:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf241c8-e888-4e47-8213-3c83c045e4a3/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:03:21 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:03:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1de4238-c33e-48a6-bb4f-240e91e81ea3/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:03:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1de4238-c33e-48a6-bb4f-240e91e81ea3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:03:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1de4238-c33e-48a6-bb4f-240e91e81ea3/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:03:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1de4238-c33e-48a6-bb4f-240e91e81ea3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:03:21 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:03:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:03:21 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 20605acb-092a-4214-a114-750f145d7af8] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:03:21 user nova-compute[74994]: DEBUG nova.compute.manager [req-5a0fa58c-a59a-4875-80e6-ed037e154891 req-c3df1357-220c-4659-9bce-bdc0616f5285 service nova] [instance: 20605acb-092a-4214-a114-750f145d7af8] Received event network-vif-deleted-2b0693da-4e7d-4fb9-b7f0-adcb89d64f08 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:03:21 user nova-compute[74994]: INFO nova.compute.manager [req-5a0fa58c-a59a-4875-80e6-ed037e154891 req-c3df1357-220c-4659-9bce-bdc0616f5285 service nova] [instance: 20605acb-092a-4214-a114-750f145d7af8] Neutron deleted interface 2b0693da-4e7d-4fb9-b7f0-adcb89d64f08; detaching it from the instance and deleting it from the info cache
Nov 28 11:03:21 user nova-compute[74994]: DEBUG nova.network.neutron [req-5a0fa58c-a59a-4875-80e6-ed037e154891 req-c3df1357-220c-4659-9bce-bdc0616f5285 service nova] [instance: 20605acb-092a-4214-a114-750f145d7af8] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:03:21 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: 20605acb-092a-4214-a114-750f145d7af8] Took 0.72 seconds to deallocate network for instance.
Nov 28 11:03:21 user nova-compute[74994]: DEBUG nova.compute.manager [req-5a0fa58c-a59a-4875-80e6-ed037e154891 req-c3df1357-220c-4659-9bce-bdc0616f5285 service nova] [instance: 20605acb-092a-4214-a114-750f145d7af8] Detach interface failed, port_id=2b0693da-4e7d-4fb9-b7f0-adcb89d64f08, reason: Instance 20605acb-092a-4214-a114-750f145d7af8 could not be found. {{(pid=74994) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 11:03:21 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ead56484-23a0-4e9b-9b61-38afca80de55 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:03:21 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ead56484-23a0-4e9b-9b61-38afca80de55 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:03:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:03:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:03:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:03:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:03:22 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-ead56484-23a0-4e9b-9b61-38afca80de55 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:03:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:03:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:03:22 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-ead56484-23a0-4e9b-9b61-38afca80de55 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:03:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ead56484-23a0-4e9b-9b61-38afca80de55 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.471s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:03:22 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-ead56484-23a0-4e9b-9b61-38afca80de55 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Deleted allocations for instance 20605acb-092a-4214-a114-750f145d7af8
Nov 28 11:03:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:03:22 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:03:22 user nova-compute[74994]: DEBUG nova.compute.manager [req-a6b81b74-3673-4c0e-8da0-d93191c1cb14 req-f7b59bb6-9cb9-4d7b-b786-b323798cee44 service nova] [instance: 20605acb-092a-4214-a114-750f145d7af8] Received event network-vif-plugged-2b0693da-4e7d-4fb9-b7f0-adcb89d64f08 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:03:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a6b81b74-3673-4c0e-8da0-d93191c1cb14 req-f7b59bb6-9cb9-4d7b-b786-b323798cee44 service nova] Acquiring lock "20605acb-092a-4214-a114-750f145d7af8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:03:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a6b81b74-3673-4c0e-8da0-d93191c1cb14 req-f7b59bb6-9cb9-4d7b-b786-b323798cee44 service nova] Lock "20605acb-092a-4214-a114-750f145d7af8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:03:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a6b81b74-3673-4c0e-8da0-d93191c1cb14 req-f7b59bb6-9cb9-4d7b-b786-b323798cee44 service nova] Lock "20605acb-092a-4214-a114-750f145d7af8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:03:22 user nova-compute[74994]: DEBUG nova.compute.manager [req-a6b81b74-3673-4c0e-8da0-d93191c1cb14 req-f7b59bb6-9cb9-4d7b-b786-b323798cee44 service nova] [instance: 20605acb-092a-4214-a114-750f145d7af8] No waiting events found dispatching network-vif-plugged-2b0693da-4e7d-4fb9-b7f0-adcb89d64f08 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:03:22 user nova-compute[74994]: WARNING nova.compute.manager [req-a6b81b74-3673-4c0e-8da0-d93191c1cb14 req-f7b59bb6-9cb9-4d7b-b786-b323798cee44 service nova] [instance: 20605acb-092a-4214-a114-750f145d7af8] Received unexpected event network-vif-plugged-2b0693da-4e7d-4fb9-b7f0-adcb89d64f08 for instance with vm_state deleted and task_state None.
Nov 28 11:03:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ead56484-23a0-4e9b-9b61-38afca80de55 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "20605acb-092a-4214-a114-750f145d7af8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.360s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:03:22 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:03:22 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:03:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=7326MB free_disk=24.871135711669922GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 11:03:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:03:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:03:23 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:03:23 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance bf357856-2d97-42e8-928d-71d0378f48c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:03:23 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 279e1c4c-36f9-492f-ab3f-1b587347eadd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:03:23 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 759fbcfd-ab13-438f-b860-6393a97d1205 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:03:23 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 20716905-c56a-4729-8c5b-9188502dc477 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:03:23 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 2f4b631a-46c8-4f9b-b5f9-6e2542484658 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:03:23 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance b743c491-ece8-4781-9530-b2f38ffc1079 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:03:23 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:03:23 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance d1de4238-c33e-48a6-bb4f-240e91e81ea3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:03:23 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 7e67fb47-500c-4e85-b384-27408ec622a9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:03:23 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 3cf241c8-e888-4e47-8213-3c83c045e4a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:03:23 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance cdc5adf9-5a73-4d7d-b53d-849354a3a053 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:03:23 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 11:03:23 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 11:03:23 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:03:23 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:03:23 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 11:03:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.522s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:03:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:03:24 user nova-compute[74994]: DEBUG nova.compute.manager [req-2327e58f-17db-44b1-9228-6d6e88954f4d req-7fc311ca-1079-433b-b2b4-48f4ada5c442 service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Received event network-changed-a20ff85b-6e1c-4430-ab03-696b8521b056 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:03:24 user nova-compute[74994]: DEBUG nova.compute.manager [req-2327e58f-17db-44b1-9228-6d6e88954f4d req-7fc311ca-1079-433b-b2b4-48f4ada5c442 service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Refreshing instance network info cache due to event network-changed-a20ff85b-6e1c-4430-ab03-696b8521b056. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:03:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-2327e58f-17db-44b1-9228-6d6e88954f4d req-7fc311ca-1079-433b-b2b4-48f4ada5c442 service nova] Acquiring lock "refresh_cache-4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:03:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-2327e58f-17db-44b1-9228-6d6e88954f4d req-7fc311ca-1079-433b-b2b4-48f4ada5c442 service nova] Acquired lock "refresh_cache-4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:03:24 user nova-compute[74994]: DEBUG nova.network.neutron [req-2327e58f-17db-44b1-9228-6d6e88954f4d req-7fc311ca-1079-433b-b2b4-48f4ada5c442 service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Refreshing network info cache for port a20ff85b-6e1c-4430-ab03-696b8521b056 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:03:25 user nova-compute[74994]: DEBUG nova.network.neutron [req-2327e58f-17db-44b1-9228-6d6e88954f4d req-7fc311ca-1079-433b-b2b4-48f4ada5c442 service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Updated VIF entry in instance network info cache for port a20ff85b-6e1c-4430-ab03-696b8521b056. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:03:25 user nova-compute[74994]: DEBUG nova.network.neutron [req-2327e58f-17db-44b1-9228-6d6e88954f4d req-7fc311ca-1079-433b-b2b4-48f4ada5c442 service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Updating instance_info_cache with network_info: [{"id": "a20ff85b-6e1c-4430-ab03-696b8521b056", "address": "fa:16:3e:95:4c:68", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20ff85b-6e", "ovs_interfaceid": "a20ff85b-6e1c-4430-ab03-696b8521b056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:03:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f1a6b2dc-e2fb-4cff-93c3-c71311744c24 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquiring lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:03:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f1a6b2dc-e2fb-4cff-93c3-c71311744c24 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:03:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-2327e58f-17db-44b1-9228-6d6e88954f4d req-7fc311ca-1079-433b-b2b4-48f4ada5c442 service nova] Releasing lock "refresh_cache-4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:03:25 user nova-compute[74994]: INFO nova.compute.manager [None req-f1a6b2dc-e2fb-4cff-93c3-c71311744c24 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Detaching volume 6566a6d8-83ca-4fef-bfe5-cb67171cd3b2
Nov 28 11:03:25 user nova-compute[74994]: INFO nova.virt.block_device [None req-f1a6b2dc-e2fb-4cff-93c3-c71311744c24 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Attempting to driver detach volume 6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 from mountpoint /dev/vdb
Nov 28 11:03:25 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f1a6b2dc-e2fb-4cff-93c3-c71311744c24 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Attempting to detach device vdb from instance 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123 from the persistent domain config. {{(pid=74994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 11:03:25 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-f1a6b2dc-e2fb-4cff-93c3-c71311744c24 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 11:03:25 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:03:25 user nova-compute[74994]:   <source dev="/dev/sdf"/>
Nov 28 11:03:25 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:03:25 user nova-compute[74994]:   <serial>6566a6d8-83ca-4fef-bfe5-cb67171cd3b2</serial>
Nov 28 11:03:25 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 11:03:25 user nova-compute[74994]: </disk>
Nov 28 11:03:25 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 11:03:25 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-f1a6b2dc-e2fb-4cff-93c3-c71311744c24 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Successfully detached device vdb from instance 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123 from the persistent domain config.
Nov 28 11:03:25 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f1a6b2dc-e2fb-4cff-93c3-c71311744c24 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123 from the live domain config. {{(pid=74994) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 11:03:25 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-f1a6b2dc-e2fb-4cff-93c3-c71311744c24 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 11:03:25 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:03:25 user nova-compute[74994]:   <source dev="/dev/sdf"/>
Nov 28 11:03:25 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:03:25 user nova-compute[74994]:   <serial>6566a6d8-83ca-4fef-bfe5-cb67171cd3b2</serial>
Nov 28 11:03:25 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 11:03:25 user nova-compute[74994]: </disk>
Nov 28 11:03:25 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 11:03:25 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:03:25 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:03:25 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 11:03:25 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Didn't find any instances for network info cache update. {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 11:03:25 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:03:25 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:03:25 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:03:25 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f1a6b2dc-e2fb-4cff-93c3-c71311744c24 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123 {{(pid=74994) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 11:03:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:03:26 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:03:26 user nova-compute[74994]: DEBUG nova.compute.manager [req-9137a0b8-f1bf-4fa2-b7bb-5c21a0167221 req-4d4d9360-0f91-44af-8a6f-a06b75460b43 service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Received event network-changed-a20ff85b-6e1c-4430-ab03-696b8521b056 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:03:26 user nova-compute[74994]: DEBUG nova.compute.manager [req-9137a0b8-f1bf-4fa2-b7bb-5c21a0167221 req-4d4d9360-0f91-44af-8a6f-a06b75460b43 service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Refreshing instance network info cache due to event network-changed-a20ff85b-6e1c-4430-ab03-696b8521b056. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:03:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9137a0b8-f1bf-4fa2-b7bb-5c21a0167221 req-4d4d9360-0f91-44af-8a6f-a06b75460b43 service nova] Acquiring lock "refresh_cache-4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:03:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9137a0b8-f1bf-4fa2-b7bb-5c21a0167221 req-4d4d9360-0f91-44af-8a6f-a06b75460b43 service nova] Acquired lock "refresh_cache-4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:03:26 user nova-compute[74994]: DEBUG nova.network.neutron [req-9137a0b8-f1bf-4fa2-b7bb-5c21a0167221 req-4d4d9360-0f91-44af-8a6f-a06b75460b43 service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Refreshing network info cache for port a20ff85b-6e1c-4430-ab03-696b8521b056 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:03:27 user nova-compute[74994]: DEBUG nova.network.neutron [req-9137a0b8-f1bf-4fa2-b7bb-5c21a0167221 req-4d4d9360-0f91-44af-8a6f-a06b75460b43 service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Updated VIF entry in instance network info cache for port a20ff85b-6e1c-4430-ab03-696b8521b056. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:03:27 user nova-compute[74994]: DEBUG nova.network.neutron [req-9137a0b8-f1bf-4fa2-b7bb-5c21a0167221 req-4d4d9360-0f91-44af-8a6f-a06b75460b43 service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Updating instance_info_cache with network_info: [{"id": "a20ff85b-6e1c-4430-ab03-696b8521b056", "address": "fa:16:3e:95:4c:68", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20ff85b-6e", "ovs_interfaceid": "a20ff85b-6e1c-4430-ab03-696b8521b056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:03:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9137a0b8-f1bf-4fa2-b7bb-5c21a0167221 req-4d4d9360-0f91-44af-8a6f-a06b75460b43 service nova] Releasing lock "refresh_cache-4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:03:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:03:31 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:03:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:03:41 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:03:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b889b8ad-04bd-470b-a986-2d05dfa4ec68 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Acquiring lock "3cf241c8-e888-4e47-8213-3c83c045e4a3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:03:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b889b8ad-04bd-470b-a986-2d05dfa4ec68 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "3cf241c8-e888-4e47-8213-3c83c045e4a3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:03:43 user nova-compute[74994]: INFO nova.compute.manager [None req-b889b8ad-04bd-470b-a986-2d05dfa4ec68 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Detaching volume 711ad168-0a6f-45f3-9396-cdedcec63988
Nov 28 11:03:43 user nova-compute[74994]: INFO nova.virt.block_device [None req-b889b8ad-04bd-470b-a986-2d05dfa4ec68 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Attempting to driver detach volume 711ad168-0a6f-45f3-9396-cdedcec63988 from mountpoint /dev/vdc
Nov 28 11:03:43 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-b889b8ad-04bd-470b-a986-2d05dfa4ec68 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Attempting to detach device vdc from instance 3cf241c8-e888-4e47-8213-3c83c045e4a3 from the persistent domain config. {{(pid=74994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 11:03:43 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-b889b8ad-04bd-470b-a986-2d05dfa4ec68 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 11:03:43 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:03:43 user nova-compute[74994]:   <source dev="/dev/sdg"/>
Nov 28 11:03:43 user nova-compute[74994]:   <target dev="vdc" bus="virtio"/>
Nov 28 11:03:43 user nova-compute[74994]:   <serial>711ad168-0a6f-45f3-9396-cdedcec63988</serial>
Nov 28 11:03:43 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 11:03:43 user nova-compute[74994]: </disk>
Nov 28 11:03:43 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 11:03:43 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-b889b8ad-04bd-470b-a986-2d05dfa4ec68 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Successfully detached device vdc from instance 3cf241c8-e888-4e47-8213-3c83c045e4a3 from the persistent domain config.
Nov 28 11:03:43 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-b889b8ad-04bd-470b-a986-2d05dfa4ec68 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 3cf241c8-e888-4e47-8213-3c83c045e4a3 from the live domain config. {{(pid=74994) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 11:03:43 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-b889b8ad-04bd-470b-a986-2d05dfa4ec68 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 11:03:43 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:03:43 user nova-compute[74994]:   <source dev="/dev/sdg"/>
Nov 28 11:03:43 user nova-compute[74994]:   <target dev="vdc" bus="virtio"/>
Nov 28 11:03:43 user nova-compute[74994]:   <serial>711ad168-0a6f-45f3-9396-cdedcec63988</serial>
Nov 28 11:03:43 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 11:03:43 user nova-compute[74994]: </disk>
Nov 28 11:03:43 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 11:03:44 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-b889b8ad-04bd-470b-a986-2d05dfa4ec68 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 3cf241c8-e888-4e47-8213-3c83c045e4a3 {{(pid=74994) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 11:03:44 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:03:44 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:03:45 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-f1a6b2dc-e2fb-4cff-93c3-c71311744c24 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123 is timed out.
Nov 28 11:03:45 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-f1a6b2dc-e2fb-4cff-93c3-c71311744c24 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Successfully detached device vdb from instance 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123 from the live domain config.
Nov 28 11:03:45 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1a6b2dc-e2fb-4cff-93c3-c71311744c24 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 11:03:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a6b2dc-e2fb-4cff-93c3-c71311744c24 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YoINDARs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:03:45 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-f1a6b2dc-e2fb-4cff-93c3-c71311744c24 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:03:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-f1a6b2dc-e2fb-4cff-93c3-c71311744c24 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:03:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-f1a6b2dc-e2fb-4cff-93c3-c71311744c24 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:03:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:03:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:03:45 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[22827737-3d34-4122-8949-b7315ede36a4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:03:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a6b2dc-e2fb-4cff-93c3-c71311744c24 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 11:03:45 user nova-compute[74994]: No targets found.
Nov 28 11:03:45 user nova-compute[74994]: iSNS:
Nov 28 11:03:45 user nova-compute[74994]: No targets found.
Nov 28 11:03:45 user nova-compute[74994]: STATIC:
Nov 28 11:03:45 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2
Nov 28 11:03:45 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:03:45 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:03:45 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd
Nov 28 11:03:45 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:03:45 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:03:45 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988
Nov 28 11:03:45 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:03:45 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:03:45 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de
Nov 28 11:03:45 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:03:45 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:03:45 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7
Nov 28 11:03:45 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:03:45 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:03:45 user nova-compute[74994]: FIRMWARE:
Nov 28 11:03:45 user nova-compute[74994]: No targets found.
Nov 28 11:03:45 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:03:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a6b2dc-e2fb-4cff-93c3-c71311744c24 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 11:03:45 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 11:03:45 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 11:03:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a6b2dc-e2fb-4cff-93c3-c71311744c24 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 11:03:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:03:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:03:45 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[31521e15-2ab5-406e-86b9-2d440d9feabf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:03:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:03:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:03:45 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c555aa69-cf5b-4735-b705-43ba51338ec4]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:03:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a6b2dc-e2fb-4cff-93c3-c71311744c24 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:03:45 user nova-compute[74994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)
Nov 28 11:03:45 user nova-compute[74994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)
Nov 28 11:03:45 user nova-compute[74994]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 (non-flash)
Nov 28 11:03:45 user nova-compute[74994]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 (non-flash)
Nov 28 11:03:45 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:03:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a6b2dc-e2fb-4cff-93c3-c71311744c24 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:03:45 user nova-compute[74994]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 (non-flash)
Nov 28 11:03:45 user nova-compute[74994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)
Nov 28 11:03:45 user nova-compute[74994]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 (non-flash)
Nov 28 11:03:45 user nova-compute[74994]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 (non-flash)
Nov 28 11:03:45 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:03:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a6b2dc-e2fb-4cff-93c3-c71311744c24 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9206ba170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2'): ({'sdf'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 11:03:45 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-f1a6b2dc-e2fb-4cff-93c3-c71311744c24 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Removing single pathed devices sdf {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 11:03:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:03:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:03:45 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9179f37-215f-4a79-a9a8-b4d3af775e58]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:03:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:03:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:03:45 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7153581-91ad-4d52-93bc-171ec4e8e8fc]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:03:45 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-f1a6b2dc-e2fb-4cff-93c3-c71311744c24 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Flushing IO for device /dev/sdf {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 11:03:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:03:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:03:45 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff7c0a0-d668-44af-aa1f-c4aea246aacd]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:03:45 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-f1a6b2dc-e2fb-4cff-93c3-c71311744c24 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 11:03:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:03:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:03:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec05c21-dcdd-49ac-abed-518cde822b76]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:03:46 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-f1a6b2dc-e2fb-4cff-93c3-c71311744c24 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 11:03:46 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-f1a6b2dc-e2fb-4cff-93c3-c71311744c24 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] SCSI volumes sdf have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 11:03:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a6b2dc-e2fb-4cff-93c3-c71311744c24 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 11:03:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:03:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:03:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:03:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e855973b-81aa-4105-9cb6-7b1f54f53b17]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:03:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a6b2dc-e2fb-4cff-93c3-c71311744c24 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:03:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:03:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:03:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae71ce8-38fe-4ece-83d4-a3b59b8c564b]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:03:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a6b2dc-e2fb-4cff-93c3-c71311744c24 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2, portal: 172.16.0.220,3260]
Nov 28 11:03:46 user nova-compute[74994]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2, portal: 172.16.0.220,3260] successful.
Nov 28 11:03:46 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:03:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:03:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6566a6d8-83ca-4fef-bfe5-cb67171cd3b2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:03:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fba3218-62bc-4a70-b31a-05ef6f1104bc]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:03:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a6b2dc-e2fb-4cff-93c3-c71311744c24 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:03:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-f1a6b2dc-e2fb-4cff-93c3-c71311744c24 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:03:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a6b2dc-e2fb-4cff-93c3-c71311744c24 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] <== disconnect_volume: return (323ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:03:46 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1a6b2dc-e2fb-4cff-93c3-c71311744c24 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 11:03:46 user nova-compute[74994]: DEBUG nova.objects.instance [None req-f1a6b2dc-e2fb-4cff-93c3-c71311744c24 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lazy-loading 'flavor' on Instance uuid 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:03:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f1a6b2dc-e2fb-4cff-93c3-c71311744c24 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.749s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:03:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:03:56 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:04:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:04 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-b889b8ad-04bd-470b-a986-2d05dfa4ec68 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 3cf241c8-e888-4e47-8213-3c83c045e4a3 is timed out.
Nov 28 11:04:04 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-b889b8ad-04bd-470b-a986-2d05dfa4ec68 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Successfully detached device vdc from instance 3cf241c8-e888-4e47-8213-3c83c045e4a3 from the live domain config.
Nov 28 11:04:04 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b889b8ad-04bd-470b-a986-2d05dfa4ec68 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 11:04:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b889b8ad-04bd-470b-a986-2d05dfa4ec68 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ykHdFbmB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:04:04 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-b889b8ad-04bd-470b-a986-2d05dfa4ec68 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:04:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-b889b8ad-04bd-470b-a986-2d05dfa4ec68 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:04:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-b889b8ad-04bd-470b-a986-2d05dfa4ec68 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:04:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:04 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[af95749c-2f86-4dca-b870-0e072b12fc86]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b889b8ad-04bd-470b-a986-2d05dfa4ec68 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 11:04:04 user nova-compute[74994]: No targets found.
Nov 28 11:04:04 user nova-compute[74994]: iSNS:
Nov 28 11:04:04 user nova-compute[74994]: No targets found.
Nov 28 11:04:04 user nova-compute[74994]: STATIC:
Nov 28 11:04:04 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd
Nov 28 11:04:04 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:04:04 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:04:04 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988
Nov 28 11:04:04 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:04:04 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:04:04 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de
Nov 28 11:04:04 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:04:04 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:04:04 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7
Nov 28 11:04:04 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:04:04 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:04:04 user nova-compute[74994]: FIRMWARE:
Nov 28 11:04:04 user nova-compute[74994]: No targets found.
Nov 28 11:04:04 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:04:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b889b8ad-04bd-470b-a986-2d05dfa4ec68 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 11:04:04 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 11:04:04 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 11:04:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b889b8ad-04bd-470b-a986-2d05dfa4ec68 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 11:04:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:04 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[739255d7-8615-459b-aa12-9e19763fb20e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:04 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8988b75e-7108-4453-a02a-db5518422056]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b889b8ad-04bd-470b-a986-2d05dfa4ec68 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:04:04 user nova-compute[74994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)
Nov 28 11:04:04 user nova-compute[74994]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 (non-flash)
Nov 28 11:04:04 user nova-compute[74994]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 (non-flash)
Nov 28 11:04:04 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:04:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b889b8ad-04bd-470b-a986-2d05dfa4ec68 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:04:04 user nova-compute[74994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)
Nov 28 11:04:04 user nova-compute[74994]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 (non-flash)
Nov 28 11:04:04 user nova-compute[74994]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 (non-flash)
Nov 28 11:04:04 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:04:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b889b8ad-04bd-470b-a986-2d05dfa4ec68 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9206b9900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988'): ({'sdg'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 11:04:04 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-b889b8ad-04bd-470b-a986-2d05dfa4ec68 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Removing single pathed devices sdg {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 11:04:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:04 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[689cb561-cc0e-46fd-ae7c-16ddb97b5547]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:04 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8c74fe-47ea-427d-82f4-650aa481badf]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:04 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-b889b8ad-04bd-470b-a986-2d05dfa4ec68 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Flushing IO for device /dev/sdg {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 11:04:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:04 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[737376a8-48fa-4a8a-b138-5d544b36b27a]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:04 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-b889b8ad-04bd-470b-a986-2d05dfa4ec68 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 11:04:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.034s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:04 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f869fe54-ac83-437a-a32a-eec2e67f5357]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:04 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-b889b8ad-04bd-470b-a986-2d05dfa4ec68 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 11:04:04 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-b889b8ad-04bd-470b-a986-2d05dfa4ec68 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] SCSI volumes sdg have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 11:04:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b889b8ad-04bd-470b-a986-2d05dfa4ec68 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 11:04:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:04 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98f1931-c483-4aaa-90a4-db56435fd695]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b889b8ad-04bd-470b-a986-2d05dfa4ec68 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:04:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:04 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d4df89-166e-481a-8dd6-56fe3cba3e3b]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b889b8ad-04bd-470b-a986-2d05dfa4ec68 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988, portal: 172.16.0.220,3260]
Nov 28 11:04:04 user nova-compute[74994]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988, portal: 172.16.0.220,3260] successful.
Nov 28 11:04:04 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:04:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711ad168-0a6f-45f3-9396-cdedcec63988 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:04 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e378c678-4975-4457-8558-877d341aa689]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b889b8ad-04bd-470b-a986-2d05dfa4ec68 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:04:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-b889b8ad-04bd-470b-a986-2d05dfa4ec68 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:04:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b889b8ad-04bd-470b-a986-2d05dfa4ec68 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] <== disconnect_volume: return (296ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:04:04 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b889b8ad-04bd-470b-a986-2d05dfa4ec68 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 11:04:05 user nova-compute[74994]: DEBUG nova.objects.instance [None req-b889b8ad-04bd-470b-a986-2d05dfa4ec68 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lazy-loading 'flavor' on Instance uuid 3cf241c8-e888-4e47-8213-3c83c045e4a3 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:04:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b889b8ad-04bd-470b-a986-2d05dfa4ec68 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "3cf241c8-e888-4e47-8213-3c83c045e4a3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.669s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:04:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:04:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:04:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:04:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:04:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:11 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:04:12 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:04:12 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 11:04:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-27ec9b90-652a-4251-93b8-a5634e16edf2 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquiring lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:04:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-27ec9b90-652a-4251-93b8-a5634e16edf2 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:04:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-27ec9b90-652a-4251-93b8-a5634e16edf2 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquiring lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:04:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-27ec9b90-652a-4251-93b8-a5634e16edf2 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:04:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-27ec9b90-652a-4251-93b8-a5634e16edf2 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:04:15 user nova-compute[74994]: INFO nova.compute.manager [None req-27ec9b90-652a-4251-93b8-a5634e16edf2 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Terminating instance
Nov 28 11:04:15 user nova-compute[74994]: DEBUG nova.compute.manager [None req-27ec9b90-652a-4251-93b8-a5634e16edf2 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 11:04:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:15 user nova-compute[74994]: DEBUG nova.compute.manager [req-c6004bda-bc2b-47c7-9ba3-ff8f697ad016 req-a72498b3-8fda-451a-8fe6-3845c0784a51 service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Received event network-vif-unplugged-a20ff85b-6e1c-4430-ab03-696b8521b056 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:04:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c6004bda-bc2b-47c7-9ba3-ff8f697ad016 req-a72498b3-8fda-451a-8fe6-3845c0784a51 service nova] Acquiring lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:04:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c6004bda-bc2b-47c7-9ba3-ff8f697ad016 req-a72498b3-8fda-451a-8fe6-3845c0784a51 service nova] Lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:04:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c6004bda-bc2b-47c7-9ba3-ff8f697ad016 req-a72498b3-8fda-451a-8fe6-3845c0784a51 service nova] Lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:04:15 user nova-compute[74994]: DEBUG nova.compute.manager [req-c6004bda-bc2b-47c7-9ba3-ff8f697ad016 req-a72498b3-8fda-451a-8fe6-3845c0784a51 service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] No waiting events found dispatching network-vif-unplugged-a20ff85b-6e1c-4430-ab03-696b8521b056 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:04:15 user nova-compute[74994]: DEBUG nova.compute.manager [req-c6004bda-bc2b-47c7-9ba3-ff8f697ad016 req-a72498b3-8fda-451a-8fe6-3845c0784a51 service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Received event network-vif-unplugged-a20ff85b-6e1c-4430-ab03-696b8521b056 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 11:04:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:16 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Instance destroyed successfully.
Nov 28 11:04:16 user nova-compute[74994]: DEBUG nova.objects.instance [None req-27ec9b90-652a-4251-93b8-a5634e16edf2 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lazy-loading 'resources' on Instance uuid 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:04:16 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-27ec9b90-652a-4251-93b8-a5634e16edf2 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:57:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-892718169',display_name='tempest-ServerRescueNegativeTestJSON-server-892718169',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-892718169',id=26,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKf5ESvipQJb0Iy+fLJcCq3i72ZQzalzqaJRpG18kEB0C4ECw8ZCyHCDlbhVhf/3wT65emm8riA8xYo1pzKgniQzaQjG+2hH2XTChDTrJLemP/56rwknIxLY1WAxl8EywQ==',key_name='tempest-keypair-487100257',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:59:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77126f6f39db4a628b74551ea7d0aa21',ramdisk_id='',reservation_id='r-b20q91a0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1900175697',owner_user_name='tempest-ServerRescueNegativeTestJSON-1900175697-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T11:01:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b5c1a1f2efc4a2faf8b82d467681d45',uuid=4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a20ff85b-6e1c-4430-ab03-696b8521b056", "address": "fa:16:3e:95:4c:68", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20ff85b-6e", "ovs_interfaceid": "a20ff85b-6e1c-4430-ab03-696b8521b056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 11:04:16 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-27ec9b90-652a-4251-93b8-a5634e16edf2 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Converting VIF {"id": "a20ff85b-6e1c-4430-ab03-696b8521b056", "address": "fa:16:3e:95:4c:68", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20ff85b-6e", "ovs_interfaceid": "a20ff85b-6e1c-4430-ab03-696b8521b056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:04:16 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-27ec9b90-652a-4251-93b8-a5634e16edf2 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:4c:68,bridge_name='br-int',has_traffic_filtering=True,id=a20ff85b-6e1c-4430-ab03-696b8521b056,network=Network(77bc68aa-1654-4e4d-9c65-7515fe6f4b2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa20ff85b-6e') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:04:16 user nova-compute[74994]: DEBUG os_vif [None req-27ec9b90-652a-4251-93b8-a5634e16edf2 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:4c:68,bridge_name='br-int',has_traffic_filtering=True,id=a20ff85b-6e1c-4430-ab03-696b8521b056,network=Network(77bc68aa-1654-4e4d-9c65-7515fe6f4b2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa20ff85b-6e') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 11:04:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa20ff85b-6e, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:04:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:04:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7e019223-124c-4ad1-b8e3-c731ef62eeae) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:04:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:16 user nova-compute[74994]: INFO os_vif [None req-27ec9b90-652a-4251-93b8-a5634e16edf2 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:4c:68,bridge_name='br-int',has_traffic_filtering=True,id=a20ff85b-6e1c-4430-ab03-696b8521b056,network=Network(77bc68aa-1654-4e4d-9c65-7515fe6f4b2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa20ff85b-6e')
Nov 28 11:04:16 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-27ec9b90-652a-4251-93b8-a5634e16edf2 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Deleting instance files /opt/stack/data/nova/instances/4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123_del
Nov 28 11:04:16 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-27ec9b90-652a-4251-93b8-a5634e16edf2 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Deletion of /opt/stack/data/nova/instances/4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123_del complete
Nov 28 11:04:16 user nova-compute[74994]: INFO nova.compute.manager [None req-27ec9b90-652a-4251-93b8-a5634e16edf2 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 28 11:04:16 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-27ec9b90-652a-4251-93b8-a5634e16edf2 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 11:04:16 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 11:04:16 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 11:04:17 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:04:17 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Took 0.68 seconds to deallocate network for instance.
Nov 28 11:04:17 user nova-compute[74994]: DEBUG nova.compute.manager [req-b2267ab0-aeae-45f8-86f1-85f1c4e44780 req-ef4d2b20-8e48-4be3-8fa4-cf5273632b8e service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Received event network-vif-deleted-a20ff85b-6e1c-4430-ab03-696b8521b056 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:04:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-27ec9b90-652a-4251-93b8-a5634e16edf2 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:04:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-27ec9b90-652a-4251-93b8-a5634e16edf2 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:04:17 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-27ec9b90-652a-4251-93b8-a5634e16edf2 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:04:17 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-27ec9b90-652a-4251-93b8-a5634e16edf2 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:04:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-27ec9b90-652a-4251-93b8-a5634e16edf2 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:04:17 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-27ec9b90-652a-4251-93b8-a5634e16edf2 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Deleted allocations for instance 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123
Nov 28 11:04:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-27ec9b90-652a-4251-93b8-a5634e16edf2 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.093s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:04:18 user nova-compute[74994]: DEBUG nova.compute.manager [req-29d400c5-5107-466c-9c73-2151d6097558 req-170020f1-da8e-4381-8b55-d6d899671647 service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Received event network-vif-plugged-a20ff85b-6e1c-4430-ab03-696b8521b056 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:04:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-29d400c5-5107-466c-9c73-2151d6097558 req-170020f1-da8e-4381-8b55-d6d899671647 service nova] Acquiring lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:04:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-29d400c5-5107-466c-9c73-2151d6097558 req-170020f1-da8e-4381-8b55-d6d899671647 service nova] Lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:04:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-29d400c5-5107-466c-9c73-2151d6097558 req-170020f1-da8e-4381-8b55-d6d899671647 service nova] Lock "4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:04:18 user nova-compute[74994]: DEBUG nova.compute.manager [req-29d400c5-5107-466c-9c73-2151d6097558 req-170020f1-da8e-4381-8b55-d6d899671647 service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] No waiting events found dispatching network-vif-plugged-a20ff85b-6e1c-4430-ab03-696b8521b056 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:04:18 user nova-compute[74994]: WARNING nova.compute.manager [req-29d400c5-5107-466c-9c73-2151d6097558 req-170020f1-da8e-4381-8b55-d6d899671647 service nova] [instance: 4e0a1bd9-1bc1-4f18-8bc1-42460eb6d123] Received unexpected event network-vif-plugged-a20ff85b-6e1c-4430-ab03-696b8521b056 for instance with vm_state deleted and task_state None.
Nov 28 11:04:18 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:04:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:04:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:04:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:04:18 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 11:04:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:19 user nova-compute[74994]: INFO nova.compute.manager [None req-71bc7860-5203-441c-b586-5f8fb4acc069 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Unrescuing
Nov 28 11:04:19 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-71bc7860-5203-441c-b586-5f8fb4acc069 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "refresh_cache-7e67fb47-500c-4e85-b384-27408ec622a9" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:04:19 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-71bc7860-5203-441c-b586-5f8fb4acc069 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquired lock "refresh_cache-7e67fb47-500c-4e85-b384-27408ec622a9" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:04:19 user nova-compute[74994]: DEBUG nova.network.neutron [None req-71bc7860-5203-441c-b586-5f8fb4acc069 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 11:04:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:19 user nova-compute[74994]: DEBUG nova.network.neutron [None req-71bc7860-5203-441c-b586-5f8fb4acc069 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Updating instance_info_cache with network_info: [{"id": "3787892f-48da-4e39-8c41-8fdb94950e59", "address": "fa:16:3e:75:4f:64", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3787892f-48", "ovs_interfaceid": "3787892f-48da-4e39-8c41-8fdb94950e59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:04:19 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-71bc7860-5203-441c-b586-5f8fb4acc069 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Releasing lock "refresh_cache-7e67fb47-500c-4e85-b384-27408ec622a9" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:04:19 user nova-compute[74994]: DEBUG nova.objects.instance [None req-71bc7860-5203-441c-b586-5f8fb4acc069 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lazy-loading 'flavor' on Instance uuid 7e67fb47-500c-4e85-b384-27408ec622a9 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:04:19 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:19 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:19 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:19 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:19 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:04:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e67fb47-500c-4e85-b384-27408ec622a9/disk.rescue --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:20 user nova-compute[74994]: DEBUG nova.compute.manager [req-fa844c0d-589b-42cc-8f88-700f3cc402ee req-1eef30d9-3454-4146-bae4-40aee468079a service nova] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Received event network-vif-unplugged-3787892f-48da-4e39-8c41-8fdb94950e59 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:04:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-fa844c0d-589b-42cc-8f88-700f3cc402ee req-1eef30d9-3454-4146-bae4-40aee468079a service nova] Acquiring lock "7e67fb47-500c-4e85-b384-27408ec622a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:04:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-fa844c0d-589b-42cc-8f88-700f3cc402ee req-1eef30d9-3454-4146-bae4-40aee468079a service nova] Lock "7e67fb47-500c-4e85-b384-27408ec622a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:04:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-fa844c0d-589b-42cc-8f88-700f3cc402ee req-1eef30d9-3454-4146-bae4-40aee468079a service nova] Lock "7e67fb47-500c-4e85-b384-27408ec622a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:04:20 user nova-compute[74994]: DEBUG nova.compute.manager [req-fa844c0d-589b-42cc-8f88-700f3cc402ee req-1eef30d9-3454-4146-bae4-40aee468079a service nova] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] No waiting events found dispatching network-vif-unplugged-3787892f-48da-4e39-8c41-8fdb94950e59 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:04:20 user nova-compute[74994]: WARNING nova.compute.manager [req-fa844c0d-589b-42cc-8f88-700f3cc402ee req-1eef30d9-3454-4146-bae4-40aee468079a service nova] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Received unexpected event network-vif-unplugged-3787892f-48da-4e39-8c41-8fdb94950e59 for instance with vm_state rescued and task_state unrescuing.
Nov 28 11:04:20 user nova-compute[74994]: DEBUG nova.compute.manager [req-fa844c0d-589b-42cc-8f88-700f3cc402ee req-1eef30d9-3454-4146-bae4-40aee468079a service nova] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Received event network-vif-plugged-3787892f-48da-4e39-8c41-8fdb94950e59 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:04:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-fa844c0d-589b-42cc-8f88-700f3cc402ee req-1eef30d9-3454-4146-bae4-40aee468079a service nova] Acquiring lock "7e67fb47-500c-4e85-b384-27408ec622a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:04:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-fa844c0d-589b-42cc-8f88-700f3cc402ee req-1eef30d9-3454-4146-bae4-40aee468079a service nova] Lock "7e67fb47-500c-4e85-b384-27408ec622a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:04:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-fa844c0d-589b-42cc-8f88-700f3cc402ee req-1eef30d9-3454-4146-bae4-40aee468079a service nova] Lock "7e67fb47-500c-4e85-b384-27408ec622a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:04:20 user nova-compute[74994]: DEBUG nova.compute.manager [req-fa844c0d-589b-42cc-8f88-700f3cc402ee req-1eef30d9-3454-4146-bae4-40aee468079a service nova] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] No waiting events found dispatching network-vif-plugged-3787892f-48da-4e39-8c41-8fdb94950e59 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:04:20 user nova-compute[74994]: WARNING nova.compute.manager [req-fa844c0d-589b-42cc-8f88-700f3cc402ee req-1eef30d9-3454-4146-bae4-40aee468079a service nova] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Received unexpected event network-vif-plugged-3787892f-48da-4e39-8c41-8fdb94950e59 for instance with vm_state rescued and task_state unrescuing.
Nov 28 11:04:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e67fb47-500c-4e85-b384-27408ec622a9/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e67fb47-500c-4e85-b384-27408ec622a9/disk.rescue --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e67fb47-500c-4e85-b384-27408ec622a9/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:20 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Instance destroyed successfully.
Nov 28 11:04:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc5adf9-5a73-4d7d-b53d-849354a3a053/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc5adf9-5a73-4d7d-b53d-849354a3a053/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc5adf9-5a73-4d7d-b53d-849354a3a053/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc5adf9-5a73-4d7d-b53d-849354a3a053/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf241c8-e888-4e47-8213-3c83c045e4a3/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:21 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf241c8-e888-4e47-8213-3c83c045e4a3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf241c8-e888-4e47-8213-3c83c045e4a3/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:21 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:21 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:21 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf241c8-e888-4e47-8213-3c83c045e4a3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1de4238-c33e-48a6-bb4f-240e91e81ea3/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:21 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1de4238-c33e-48a6-bb4f-240e91e81ea3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1de4238-c33e-48a6-bb4f-240e91e81ea3/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:22 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:22 user nova-compute[74994]: DEBUG nova.compute.manager [req-0c583696-67b3-44b6-a31c-6b863ec16ed8 req-9a8fedbb-5cb1-49ac-8821-455a0995f8d7 service nova] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Received event network-vif-plugged-3787892f-48da-4e39-8c41-8fdb94950e59 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:04:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-0c583696-67b3-44b6-a31c-6b863ec16ed8 req-9a8fedbb-5cb1-49ac-8821-455a0995f8d7 service nova] Acquiring lock "7e67fb47-500c-4e85-b384-27408ec622a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:04:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-0c583696-67b3-44b6-a31c-6b863ec16ed8 req-9a8fedbb-5cb1-49ac-8821-455a0995f8d7 service nova] Lock "7e67fb47-500c-4e85-b384-27408ec622a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:04:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-0c583696-67b3-44b6-a31c-6b863ec16ed8 req-9a8fedbb-5cb1-49ac-8821-455a0995f8d7 service nova] Lock "7e67fb47-500c-4e85-b384-27408ec622a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:04:22 user nova-compute[74994]: DEBUG nova.compute.manager [req-0c583696-67b3-44b6-a31c-6b863ec16ed8 req-9a8fedbb-5cb1-49ac-8821-455a0995f8d7 service nova] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] No waiting events found dispatching network-vif-plugged-3787892f-48da-4e39-8c41-8fdb94950e59 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:04:22 user nova-compute[74994]: WARNING nova.compute.manager [req-0c583696-67b3-44b6-a31c-6b863ec16ed8 req-9a8fedbb-5cb1-49ac-8821-455a0995f8d7 service nova] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Received unexpected event network-vif-plugged-3787892f-48da-4e39-8c41-8fdb94950e59 for instance with vm_state rescued and task_state unrescuing.
Nov 28 11:04:22 user nova-compute[74994]: DEBUG nova.compute.manager [req-0c583696-67b3-44b6-a31c-6b863ec16ed8 req-9a8fedbb-5cb1-49ac-8821-455a0995f8d7 service nova] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Received event network-vif-plugged-3787892f-48da-4e39-8c41-8fdb94950e59 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:04:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-0c583696-67b3-44b6-a31c-6b863ec16ed8 req-9a8fedbb-5cb1-49ac-8821-455a0995f8d7 service nova] Acquiring lock "7e67fb47-500c-4e85-b384-27408ec622a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:04:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-0c583696-67b3-44b6-a31c-6b863ec16ed8 req-9a8fedbb-5cb1-49ac-8821-455a0995f8d7 service nova] Lock "7e67fb47-500c-4e85-b384-27408ec622a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:04:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-0c583696-67b3-44b6-a31c-6b863ec16ed8 req-9a8fedbb-5cb1-49ac-8821-455a0995f8d7 service nova] Lock "7e67fb47-500c-4e85-b384-27408ec622a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:04:22 user nova-compute[74994]: DEBUG nova.compute.manager [req-0c583696-67b3-44b6-a31c-6b863ec16ed8 req-9a8fedbb-5cb1-49ac-8821-455a0995f8d7 service nova] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] No waiting events found dispatching network-vif-plugged-3787892f-48da-4e39-8c41-8fdb94950e59 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:04:22 user nova-compute[74994]: WARNING nova.compute.manager [req-0c583696-67b3-44b6-a31c-6b863ec16ed8 req-9a8fedbb-5cb1-49ac-8821-455a0995f8d7 service nova] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Received unexpected event network-vif-plugged-3787892f-48da-4e39-8c41-8fdb94950e59 for instance with vm_state rescued and task_state unrescuing.
Nov 28 11:04:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1de4238-c33e-48a6-bb4f-240e91e81ea3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:22 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:04:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:22 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:04:23 user nova-compute[74994]: DEBUG nova.compute.manager [None req-71bc7860-5203-441c-b586-5f8fb4acc069 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 11:04:23 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:04:23 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:04:23 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=7594MB free_disk=24.915592193603516GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 11:04:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:04:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:04:24 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:04:24 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance bf357856-2d97-42e8-928d-71d0378f48c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:04:24 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 279e1c4c-36f9-492f-ab3f-1b587347eadd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:04:24 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 759fbcfd-ab13-438f-b860-6393a97d1205 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:04:24 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 20716905-c56a-4729-8c5b-9188502dc477 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:04:24 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 2f4b631a-46c8-4f9b-b5f9-6e2542484658 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:04:24 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance b743c491-ece8-4781-9530-b2f38ffc1079 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:04:24 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance d1de4238-c33e-48a6-bb4f-240e91e81ea3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:04:24 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 7e67fb47-500c-4e85-b384-27408ec622a9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:04:24 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 3cf241c8-e888-4e47-8213-3c83c045e4a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:04:24 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance cdc5adf9-5a73-4d7d-b53d-849354a3a053 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:04:24 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 11:04:24 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 11:04:24 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:04:24 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:04:24 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 11:04:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.546s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:04:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:25 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:04:25 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:04:25 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 11:04:25 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Rebuilding the list of instances to heal {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 11:04:25 user nova-compute[74994]: DEBUG nova.compute.manager [req-9149701c-15a5-40f6-975b-7a0161598732 req-790bfc0d-2985-44ca-bb48-780a930897b9 service nova] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Received event network-changed-02fa284c-6c0a-4ace-8b7d-0a5adf50cce0 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:04:25 user nova-compute[74994]: DEBUG nova.compute.manager [req-9149701c-15a5-40f6-975b-7a0161598732 req-790bfc0d-2985-44ca-bb48-780a930897b9 service nova] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Refreshing instance network info cache due to event network-changed-02fa284c-6c0a-4ace-8b7d-0a5adf50cce0. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:04:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9149701c-15a5-40f6-975b-7a0161598732 req-790bfc0d-2985-44ca-bb48-780a930897b9 service nova] Acquiring lock "refresh_cache-cdc5adf9-5a73-4d7d-b53d-849354a3a053" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:04:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9149701c-15a5-40f6-975b-7a0161598732 req-790bfc0d-2985-44ca-bb48-780a930897b9 service nova] Acquired lock "refresh_cache-cdc5adf9-5a73-4d7d-b53d-849354a3a053" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:04:25 user nova-compute[74994]: DEBUG nova.network.neutron [req-9149701c-15a5-40f6-975b-7a0161598732 req-790bfc0d-2985-44ca-bb48-780a930897b9 service nova] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Refreshing network info cache for port 02fa284c-6c0a-4ace-8b7d-0a5adf50cce0 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:04:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "refresh_cache-76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:04:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquired lock "refresh_cache-76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:04:25 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Forcefully refreshing network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 11:04:25 user nova-compute[74994]: DEBUG nova.objects.instance [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lazy-loading 'info_cache' on Instance uuid 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:04:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-0eb1cebd-6313-4290-8261-f617078601c1 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Acquiring lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:04:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-0eb1cebd-6313-4290-8261-f617078601c1 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:04:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-0eb1cebd-6313-4290-8261-f617078601c1 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Acquiring lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:04:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-0eb1cebd-6313-4290-8261-f617078601c1 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:04:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-0eb1cebd-6313-4290-8261-f617078601c1 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:04:25 user nova-compute[74994]: INFO nova.compute.manager [None req-0eb1cebd-6313-4290-8261-f617078601c1 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Terminating instance
Nov 28 11:04:25 user nova-compute[74994]: DEBUG nova.compute.manager [None req-0eb1cebd-6313-4290-8261-f617078601c1 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 11:04:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:26 user nova-compute[74994]: DEBUG nova.network.neutron [req-9149701c-15a5-40f6-975b-7a0161598732 req-790bfc0d-2985-44ca-bb48-780a930897b9 service nova] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Updated VIF entry in instance network info cache for port 02fa284c-6c0a-4ace-8b7d-0a5adf50cce0. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:04:26 user nova-compute[74994]: DEBUG nova.network.neutron [req-9149701c-15a5-40f6-975b-7a0161598732 req-790bfc0d-2985-44ca-bb48-780a930897b9 service nova] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Updating instance_info_cache with network_info: [{"id": "02fa284c-6c0a-4ace-8b7d-0a5adf50cce0", "address": "fa:16:3e:6d:8e:f7", "network": {"id": "3691c6f1-1485-481c-8f01-e7a4a40f0d50", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2021818422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "768cbb3a27d142b2a1e8b521894df120", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02fa284c-6c", "ovs_interfaceid": "02fa284c-6c0a-4ace-8b7d-0a5adf50cce0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:04:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9149701c-15a5-40f6-975b-7a0161598732 req-790bfc0d-2985-44ca-bb48-780a930897b9 service nova] Releasing lock "refresh_cache-cdc5adf9-5a73-4d7d-b53d-849354a3a053" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:04:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:26 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Updating instance_info_cache with network_info: [{"id": "6b1a991d-033b-45ab-839c-7b6b98082667", "address": "fa:16:3e:3c:9f:61", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b1a991d-03", "ovs_interfaceid": "6b1a991d-033b-45ab-839c-7b6b98082667", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:04:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Releasing lock "refresh_cache-76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:04:26 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Updated the network info_cache for instance {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 11:04:26 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:04:26 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:04:26 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:04:26 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:04:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Acquiring lock "cdc5adf9-5a73-4d7d-b53d-849354a3a053" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:04:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Lock "cdc5adf9-5a73-4d7d-b53d-849354a3a053" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:04:26 user nova-compute[74994]: DEBUG nova.objects.instance [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Lazy-loading 'flavor' on Instance uuid cdc5adf9-5a73-4d7d-b53d-849354a3a053 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:04:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Lock "cdc5adf9-5a73-4d7d-b53d-849354a3a053" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:04:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:26 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Instance destroyed successfully.
Nov 28 11:04:26 user nova-compute[74994]: DEBUG nova.objects.instance [None req-0eb1cebd-6313-4290-8261-f617078601c1 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lazy-loading 'resources' on Instance uuid 2f4b631a-46c8-4f9b-b5f9-6e2542484658 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:04:26 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-0eb1cebd-6313-4290-8261-f617078601c1 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:54:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-107367549',display_name='tempest-AttachVolumeTestJSON-server-107367549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-107367549',id=20,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPaObEUIaQ+CDNwt47CPRXIZ7eFISJE/iAezjV3I0JL+MYNy2O/xy+BPGpqSlurI4jnHrFjLiC5c/eman9PMAcvN7snGFvVpuVRua1rqVAVoDQMEJZ1527ex29ZklUbnQ==',key_name='tempest-keypair-1250905933',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:54:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='33727b28c7d94b7bbe8987c1301eec04',ramdisk_id='',reservation_id='r-5ou66u0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-565652019',owner_user_name='tempest-AttachVolumeTestJSON-565652019-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T11:02:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44e7cead5a1a4ed09ee100e9b7a4968d',uuid=2f4b631a-46c8-4f9b-b5f9-6e2542484658,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "068080a2-5847-4053-a463-9fc29cb64bb4", "address": "fa:16:3e:21:e9:f5", "network": {"id": "844b3eab-57f3-4582-9fcc-04594e44081b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-233988918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33727b28c7d94b7bbe8987c1301eec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068080a2-58", "ovs_interfaceid": "068080a2-5847-4053-a463-9fc29cb64bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 11:04:26 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-0eb1cebd-6313-4290-8261-f617078601c1 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Converting VIF {"id": "068080a2-5847-4053-a463-9fc29cb64bb4", "address": "fa:16:3e:21:e9:f5", "network": {"id": "844b3eab-57f3-4582-9fcc-04594e44081b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-233988918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33727b28c7d94b7bbe8987c1301eec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068080a2-58", "ovs_interfaceid": "068080a2-5847-4053-a463-9fc29cb64bb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:04:26 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-0eb1cebd-6313-4290-8261-f617078601c1 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:e9:f5,bridge_name='br-int',has_traffic_filtering=True,id=068080a2-5847-4053-a463-9fc29cb64bb4,network=Network(844b3eab-57f3-4582-9fcc-04594e44081b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068080a2-58') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:04:26 user nova-compute[74994]: DEBUG os_vif [None req-0eb1cebd-6313-4290-8261-f617078601c1 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:e9:f5,bridge_name='br-int',has_traffic_filtering=True,id=068080a2-5847-4053-a463-9fc29cb64bb4,network=Network(844b3eab-57f3-4582-9fcc-04594e44081b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068080a2-58') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 11:04:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap068080a2-58, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:04:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:04:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ad1fe185-9ada-4764-8148-4305c33ef0f3) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:04:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:26 user nova-compute[74994]: INFO os_vif [None req-0eb1cebd-6313-4290-8261-f617078601c1 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:e9:f5,bridge_name='br-int',has_traffic_filtering=True,id=068080a2-5847-4053-a463-9fc29cb64bb4,network=Network(844b3eab-57f3-4582-9fcc-04594e44081b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068080a2-58')
Nov 28 11:04:26 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-0eb1cebd-6313-4290-8261-f617078601c1 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Deleting instance files /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658_del
Nov 28 11:04:26 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-0eb1cebd-6313-4290-8261-f617078601c1 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Deletion of /opt/stack/data/nova/instances/2f4b631a-46c8-4f9b-b5f9-6e2542484658_del complete
Nov 28 11:04:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Acquiring lock "cdc5adf9-5a73-4d7d-b53d-849354a3a053" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:04:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Lock "cdc5adf9-5a73-4d7d-b53d-849354a3a053" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:04:26 user nova-compute[74994]: INFO nova.compute.manager [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Attaching volume b071dc55-7012-43ca-a7f2-51d3046d2320 to /dev/vdb
Nov 28 11:04:26 user nova-compute[74994]: INFO nova.compute.manager [None req-0eb1cebd-6313-4290-8261-f617078601c1 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 28 11:04:26 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-0eb1cebd-6313-4290-8261-f617078601c1 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 11:04:26 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 11:04:26 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 11:04:26 user nova-compute[74994]: DEBUG os_brick.utils [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:04:26 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:26 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:26 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[623d6466-a3e2-4ebe-a6a7-39f4f0c0d136]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:26 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d1487f-8a2c-4475-8b0f-3d83bde210b6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b648cc-8811-4ba6-b01f-9a223fd3dff2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9b6590-bba3-460b-a068-59245cc8dd60]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:04:27 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 11:04:27 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2551fc1e-77ed-4d59-86a3-c3e383eb5e37]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG os_brick.utils [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Updating existing volume attachment record: 0bdeee3d-ae9a-4b82-a628-d5cd9ac4e798 {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG nova.compute.manager [req-a1f9d382-4d45-4b81-b43e-41a855507237 req-1260f548-70f5-41e9-81c4-013ddf7a8d45 service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Received event network-vif-deleted-068080a2-5847-4053-a463-9fc29cb64bb4 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:04:27 user nova-compute[74994]: INFO nova.compute.manager [req-a1f9d382-4d45-4b81-b43e-41a855507237 req-1260f548-70f5-41e9-81c4-013ddf7a8d45 service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Neutron deleted interface 068080a2-5847-4053-a463-9fc29cb64bb4; detaching it from the instance and deleting it from the info cache
Nov 28 11:04:27 user nova-compute[74994]: DEBUG nova.network.neutron [req-a1f9d382-4d45-4b81-b43e-41a855507237 req-1260f548-70f5-41e9-81c4-013ddf7a8d45 service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:04:27 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Took 0.84 seconds to deallocate network for instance.
Nov 28 11:04:27 user nova-compute[74994]: DEBUG nova.compute.manager [req-543b3cf0-cee4-4b16-a7d0-0441b384554d req-182c33a2-0d70-4010-9d50-f9ccc85041bc service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Received event network-vif-unplugged-068080a2-5847-4053-a463-9fc29cb64bb4 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-543b3cf0-cee4-4b16-a7d0-0441b384554d req-182c33a2-0d70-4010-9d50-f9ccc85041bc service nova] Acquiring lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-543b3cf0-cee4-4b16-a7d0-0441b384554d req-182c33a2-0d70-4010-9d50-f9ccc85041bc service nova] Lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-543b3cf0-cee4-4b16-a7d0-0441b384554d req-182c33a2-0d70-4010-9d50-f9ccc85041bc service nova] Lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG nova.compute.manager [req-543b3cf0-cee4-4b16-a7d0-0441b384554d req-182c33a2-0d70-4010-9d50-f9ccc85041bc service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] No waiting events found dispatching network-vif-unplugged-068080a2-5847-4053-a463-9fc29cb64bb4 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG nova.compute.manager [req-543b3cf0-cee4-4b16-a7d0-0441b384554d req-182c33a2-0d70-4010-9d50-f9ccc85041bc service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Received event network-vif-unplugged-068080a2-5847-4053-a463-9fc29cb64bb4 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG nova.compute.manager [req-543b3cf0-cee4-4b16-a7d0-0441b384554d req-182c33a2-0d70-4010-9d50-f9ccc85041bc service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Received event network-vif-plugged-068080a2-5847-4053-a463-9fc29cb64bb4 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-543b3cf0-cee4-4b16-a7d0-0441b384554d req-182c33a2-0d70-4010-9d50-f9ccc85041bc service nova] Acquiring lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-543b3cf0-cee4-4b16-a7d0-0441b384554d req-182c33a2-0d70-4010-9d50-f9ccc85041bc service nova] Lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-543b3cf0-cee4-4b16-a7d0-0441b384554d req-182c33a2-0d70-4010-9d50-f9ccc85041bc service nova] Lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG nova.compute.manager [req-543b3cf0-cee4-4b16-a7d0-0441b384554d req-182c33a2-0d70-4010-9d50-f9ccc85041bc service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] No waiting events found dispatching network-vif-plugged-068080a2-5847-4053-a463-9fc29cb64bb4 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:04:27 user nova-compute[74994]: WARNING nova.compute.manager [req-543b3cf0-cee4-4b16-a7d0-0441b384554d req-182c33a2-0d70-4010-9d50-f9ccc85041bc service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Received unexpected event network-vif-plugged-068080a2-5847-4053-a463-9fc29cb64bb4 for instance with vm_state active and task_state deleting.
Nov 28 11:04:27 user nova-compute[74994]: DEBUG nova.compute.manager [req-543b3cf0-cee4-4b16-a7d0-0441b384554d req-182c33a2-0d70-4010-9d50-f9ccc85041bc service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Received event network-vif-plugged-068080a2-5847-4053-a463-9fc29cb64bb4 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-543b3cf0-cee4-4b16-a7d0-0441b384554d req-182c33a2-0d70-4010-9d50-f9ccc85041bc service nova] Acquiring lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-543b3cf0-cee4-4b16-a7d0-0441b384554d req-182c33a2-0d70-4010-9d50-f9ccc85041bc service nova] Lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-543b3cf0-cee4-4b16-a7d0-0441b384554d req-182c33a2-0d70-4010-9d50-f9ccc85041bc service nova] Lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG nova.compute.manager [req-543b3cf0-cee4-4b16-a7d0-0441b384554d req-182c33a2-0d70-4010-9d50-f9ccc85041bc service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] No waiting events found dispatching network-vif-plugged-068080a2-5847-4053-a463-9fc29cb64bb4 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:04:27 user nova-compute[74994]: WARNING nova.compute.manager [req-543b3cf0-cee4-4b16-a7d0-0441b384554d req-182c33a2-0d70-4010-9d50-f9ccc85041bc service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Received unexpected event network-vif-plugged-068080a2-5847-4053-a463-9fc29cb64bb4 for instance with vm_state active and task_state deleting.
Nov 28 11:04:27 user nova-compute[74994]: DEBUG nova.compute.manager [req-543b3cf0-cee4-4b16-a7d0-0441b384554d req-182c33a2-0d70-4010-9d50-f9ccc85041bc service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Received event network-vif-plugged-068080a2-5847-4053-a463-9fc29cb64bb4 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-543b3cf0-cee4-4b16-a7d0-0441b384554d req-182c33a2-0d70-4010-9d50-f9ccc85041bc service nova] Acquiring lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-543b3cf0-cee4-4b16-a7d0-0441b384554d req-182c33a2-0d70-4010-9d50-f9ccc85041bc service nova] Lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-543b3cf0-cee4-4b16-a7d0-0441b384554d req-182c33a2-0d70-4010-9d50-f9ccc85041bc service nova] Lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG nova.compute.manager [req-543b3cf0-cee4-4b16-a7d0-0441b384554d req-182c33a2-0d70-4010-9d50-f9ccc85041bc service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] No waiting events found dispatching network-vif-plugged-068080a2-5847-4053-a463-9fc29cb64bb4 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:04:27 user nova-compute[74994]: WARNING nova.compute.manager [req-543b3cf0-cee4-4b16-a7d0-0441b384554d req-182c33a2-0d70-4010-9d50-f9ccc85041bc service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Received unexpected event network-vif-plugged-068080a2-5847-4053-a463-9fc29cb64bb4 for instance with vm_state active and task_state deleting.
Nov 28 11:04:27 user nova-compute[74994]: DEBUG nova.compute.manager [req-543b3cf0-cee4-4b16-a7d0-0441b384554d req-182c33a2-0d70-4010-9d50-f9ccc85041bc service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Received event network-vif-unplugged-068080a2-5847-4053-a463-9fc29cb64bb4 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-543b3cf0-cee4-4b16-a7d0-0441b384554d req-182c33a2-0d70-4010-9d50-f9ccc85041bc service nova] Acquiring lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-543b3cf0-cee4-4b16-a7d0-0441b384554d req-182c33a2-0d70-4010-9d50-f9ccc85041bc service nova] Lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-543b3cf0-cee4-4b16-a7d0-0441b384554d req-182c33a2-0d70-4010-9d50-f9ccc85041bc service nova] Lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG nova.compute.manager [req-543b3cf0-cee4-4b16-a7d0-0441b384554d req-182c33a2-0d70-4010-9d50-f9ccc85041bc service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] No waiting events found dispatching network-vif-unplugged-068080a2-5847-4053-a463-9fc29cb64bb4 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG nova.compute.manager [req-543b3cf0-cee4-4b16-a7d0-0441b384554d req-182c33a2-0d70-4010-9d50-f9ccc85041bc service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Received event network-vif-unplugged-068080a2-5847-4053-a463-9fc29cb64bb4 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG nova.compute.manager [req-543b3cf0-cee4-4b16-a7d0-0441b384554d req-182c33a2-0d70-4010-9d50-f9ccc85041bc service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Received event network-vif-plugged-068080a2-5847-4053-a463-9fc29cb64bb4 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-543b3cf0-cee4-4b16-a7d0-0441b384554d req-182c33a2-0d70-4010-9d50-f9ccc85041bc service nova] Acquiring lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-543b3cf0-cee4-4b16-a7d0-0441b384554d req-182c33a2-0d70-4010-9d50-f9ccc85041bc service nova] Lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-543b3cf0-cee4-4b16-a7d0-0441b384554d req-182c33a2-0d70-4010-9d50-f9ccc85041bc service nova] Lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG nova.compute.manager [req-543b3cf0-cee4-4b16-a7d0-0441b384554d req-182c33a2-0d70-4010-9d50-f9ccc85041bc service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] No waiting events found dispatching network-vif-plugged-068080a2-5847-4053-a463-9fc29cb64bb4 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:04:27 user nova-compute[74994]: WARNING nova.compute.manager [req-543b3cf0-cee4-4b16-a7d0-0441b384554d req-182c33a2-0d70-4010-9d50-f9ccc85041bc service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Received unexpected event network-vif-plugged-068080a2-5847-4053-a463-9fc29cb64bb4 for instance with vm_state active and task_state deleting.
Nov 28 11:04:27 user nova-compute[74994]: DEBUG nova.compute.manager [req-a1f9d382-4d45-4b81-b43e-41a855507237 req-1260f548-70f5-41e9-81c4-013ddf7a8d45 service nova] [instance: 2f4b631a-46c8-4f9b-b5f9-6e2542484658] Detach interface failed, port_id=068080a2-5847-4053-a463-9fc29cb64bb4, reason: Instance 2f4b631a-46c8-4f9b-b5f9-6e2542484658 could not be found. {{(pid=74994) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-0eb1cebd-6313-4290-8261-f617078601c1 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:04:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-0eb1cebd-6313-4290-8261-f617078601c1 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:04:28 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-0eb1cebd-6313-4290-8261-f617078601c1 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:04:28 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-0eb1cebd-6313-4290-8261-f617078601c1 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:04:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-0eb1cebd-6313-4290-8261-f617078601c1 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.414s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:04:28 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-0eb1cebd-6313-4290-8261-f617078601c1 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Deleted allocations for instance 2f4b631a-46c8-4f9b-b5f9-6e2542484658
Nov 28 11:04:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-0eb1cebd-6313-4290-8261-f617078601c1 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "2f4b631a-46c8-4f9b-b5f9-6e2542484658" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.539s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:04:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:31 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:33 user nova-compute[74994]: DEBUG nova.compute.manager [req-474609e9-15ab-4220-9633-55f387d6a096 req-90736aa8-4c16-4597-84a6-e4bc9766dcd5 service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Received event network-changed-e3ec524f-0e85-40e1-8817-b9d4b75f9966 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:04:33 user nova-compute[74994]: DEBUG nova.compute.manager [req-474609e9-15ab-4220-9633-55f387d6a096 req-90736aa8-4c16-4597-84a6-e4bc9766dcd5 service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Refreshing instance network info cache due to event network-changed-e3ec524f-0e85-40e1-8817-b9d4b75f9966. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:04:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-474609e9-15ab-4220-9633-55f387d6a096 req-90736aa8-4c16-4597-84a6-e4bc9766dcd5 service nova] Acquiring lock "refresh_cache-d1de4238-c33e-48a6-bb4f-240e91e81ea3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:04:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-474609e9-15ab-4220-9633-55f387d6a096 req-90736aa8-4c16-4597-84a6-e4bc9766dcd5 service nova] Acquired lock "refresh_cache-d1de4238-c33e-48a6-bb4f-240e91e81ea3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:04:33 user nova-compute[74994]: DEBUG nova.network.neutron [req-474609e9-15ab-4220-9633-55f387d6a096 req-90736aa8-4c16-4597-84a6-e4bc9766dcd5 service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Refreshing network info cache for port e3ec524f-0e85-40e1-8817-b9d4b75f9966 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:04:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9db4672a-4f8a-4977-b4ab-bd0e6cea2601 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Acquiring lock "3cf241c8-e888-4e47-8213-3c83c045e4a3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:04:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9db4672a-4f8a-4977-b4ab-bd0e6cea2601 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "3cf241c8-e888-4e47-8213-3c83c045e4a3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:04:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9db4672a-4f8a-4977-b4ab-bd0e6cea2601 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Acquiring lock "3cf241c8-e888-4e47-8213-3c83c045e4a3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:04:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9db4672a-4f8a-4977-b4ab-bd0e6cea2601 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "3cf241c8-e888-4e47-8213-3c83c045e4a3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:04:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9db4672a-4f8a-4977-b4ab-bd0e6cea2601 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "3cf241c8-e888-4e47-8213-3c83c045e4a3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:04:34 user nova-compute[74994]: INFO nova.compute.manager [None req-9db4672a-4f8a-4977-b4ab-bd0e6cea2601 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Terminating instance
Nov 28 11:04:34 user nova-compute[74994]: DEBUG nova.compute.manager [None req-9db4672a-4f8a-4977-b4ab-bd0e6cea2601 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 11:04:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:34 user nova-compute[74994]: DEBUG nova.network.neutron [req-474609e9-15ab-4220-9633-55f387d6a096 req-90736aa8-4c16-4597-84a6-e4bc9766dcd5 service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Updated VIF entry in instance network info cache for port e3ec524f-0e85-40e1-8817-b9d4b75f9966. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:04:34 user nova-compute[74994]: DEBUG nova.network.neutron [req-474609e9-15ab-4220-9633-55f387d6a096 req-90736aa8-4c16-4597-84a6-e4bc9766dcd5 service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Updating instance_info_cache with network_info: [{"id": "e3ec524f-0e85-40e1-8817-b9d4b75f9966", "address": "fa:16:3e:99:ce:ce", "network": {"id": "89f2b906-9ef3-4e31-87e5-3e0cd23e8695", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2005181920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9670a509ac14f41a9f44d7299fd2f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3ec524f-0e", "ovs_interfaceid": "e3ec524f-0e85-40e1-8817-b9d4b75f9966", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:04:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-474609e9-15ab-4220-9633-55f387d6a096 req-90736aa8-4c16-4597-84a6-e4bc9766dcd5 service nova] Releasing lock "refresh_cache-d1de4238-c33e-48a6-bb4f-240e91e81ea3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:04:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 11:04:34 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WkLcetUG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:04:34 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:04:34 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:04:34 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:04:34 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:04:34 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:04:34 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:04:34 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 11:04:34 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320 -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:34 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Instance destroyed successfully.
Nov 28 11:04:34 user nova-compute[74994]: DEBUG nova.objects.instance [None req-9db4672a-4f8a-4977-b4ab-bd0e6cea2601 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lazy-loading 'resources' on Instance uuid 3cf241c8-e888-4e47-8213-3c83c045e4a3 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:04:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-9db4672a-4f8a-4977-b4ab-bd0e6cea2601 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T10:58:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1735278754',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1735278754',id=27,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmqmu20KDfDBzBY6oASozowL+3S5vdHl8okXBPig0+AxtHwGAkdyi4k3S1Z/tCjZiCbxQI9z+EmWbdqY++IX2p/emffftg2gvlyMhSRLFVHnD/cO28qJSWLbeC6Cv/mew==',key_name='tempest-keypair-2137635767',keypairs=<?>,launch_index=0,launched_at=2023-11-28T11:02:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d3a4dcdeafd6420d8606b37673e3255f',ramdisk_id='',reservation_id='r-8cjiqvp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1700061593',owner_user_name='tempest-AttachVolumeShelveTestJSON-1700061593-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T11:02:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4e1257b844940bebdeab3061c3e0ab4',uuid=3cf241c8-e888-4e47-8213-3c83c045e4a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "017867da-26d5-4fff-9eb9-eb8686888b55", "address": "fa:16:3e:8f:30:5e", "network": {"id": "d46e72ec-d7d5-45f7-951a-b4381f0b472b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-179057367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a4dcdeafd6420d8606b37673e3255f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017867da-26", "ovs_interfaceid": "017867da-26d5-4fff-9eb9-eb8686888b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 11:04:34 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-9db4672a-4f8a-4977-b4ab-bd0e6cea2601 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Converting VIF {"id": "017867da-26d5-4fff-9eb9-eb8686888b55", "address": "fa:16:3e:8f:30:5e", "network": {"id": "d46e72ec-d7d5-45f7-951a-b4381f0b472b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-179057367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a4dcdeafd6420d8606b37673e3255f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017867da-26", "ovs_interfaceid": "017867da-26d5-4fff-9eb9-eb8686888b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:04:34 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-9db4672a-4f8a-4977-b4ab-bd0e6cea2601 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:30:5e,bridge_name='br-int',has_traffic_filtering=True,id=017867da-26d5-4fff-9eb9-eb8686888b55,network=Network(d46e72ec-d7d5-45f7-951a-b4381f0b472b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap017867da-26') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:04:34 user nova-compute[74994]: DEBUG os_vif [None req-9db4672a-4f8a-4977-b4ab-bd0e6cea2601 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:30:5e,bridge_name='br-int',has_traffic_filtering=True,id=017867da-26d5-4fff-9eb9-eb8686888b55,network=Network(d46e72ec-d7d5-45f7-951a-b4381f0b472b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap017867da-26') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 11:04:34 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:34 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe4921a-4118-4cfc-8525-77faa5c24f5c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:34 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 11:04:34 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:04:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap017867da-26, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:04:34 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320 -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:04:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bee21327-a573-4566-a3aa-d44705148564) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:04:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:34 user nova-compute[74994]: INFO os_vif [None req-9db4672a-4f8a-4977-b4ab-bd0e6cea2601 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:30:5e,bridge_name='br-int',has_traffic_filtering=True,id=017867da-26d5-4fff-9eb9-eb8686888b55,network=Network(d46e72ec-d7d5-45f7-951a-b4381f0b472b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap017867da-26')
Nov 28 11:04:34 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-9db4672a-4f8a-4977-b4ab-bd0e6cea2601 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Deleting instance files /opt/stack/data/nova/instances/3cf241c8-e888-4e47-8213-3c83c045e4a3_del
Nov 28 11:04:34 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-9db4672a-4f8a-4977-b4ab-bd0e6cea2601 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Deletion of /opt/stack/data/nova/instances/3cf241c8-e888-4e47-8213-3c83c045e4a3_del complete
Nov 28 11:04:34 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:34 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80f1b47-47b0-4d41-b4f6-8d515e33ee2a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320] added
Nov 28 11:04:35 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[503d77c6-f72f-4f36-aabd-d3e9adc4de7a]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a72bc60-14ac-4e7e-8d07-f6b2312c7ef4]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WkLcetUG {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:35 user nova-compute[74994]: INFO nova.compute.manager [None req-9db4672a-4f8a-4977-b4ab-bd0e6cea2601 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 28 11:04:35 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-9db4672a-4f8a-4977-b4ab-bd0e6cea2601 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG nova.compute.manager [req-089ba07b-6aa5-4596-b6ca-f2c45171dd10 req-356fe403-0cd4-4924-8b15-3ea029321956 service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Received event network-changed-e3ec524f-0e85-40e1-8817-b9d4b75f9966 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG nova.compute.manager [req-089ba07b-6aa5-4596-b6ca-f2c45171dd10 req-356fe403-0cd4-4924-8b15-3ea029321956 service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Refreshing instance network info cache due to event network-changed-e3ec524f-0e85-40e1-8817-b9d4b75f9966. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-089ba07b-6aa5-4596-b6ca-f2c45171dd10 req-356fe403-0cd4-4924-8b15-3ea029321956 service nova] Acquiring lock "refresh_cache-d1de4238-c33e-48a6-bb4f-240e91e81ea3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-089ba07b-6aa5-4596-b6ca-f2c45171dd10 req-356fe403-0cd4-4924-8b15-3ea029321956 service nova] Acquired lock "refresh_cache-d1de4238-c33e-48a6-bb4f-240e91e81ea3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG nova.network.neutron [req-089ba07b-6aa5-4596-b6ca-f2c45171dd10 req-356fe403-0cd4-4924-8b15-3ea029321956 service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Refreshing network info cache for port e3ec524f-0e85-40e1-8817-b9d4b75f9966 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WkLcetUG" returned: 0 in 0.027s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[de52ae63-0adf-41ad-ac2b-6505a0dc1959]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WkLcetUG'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3c0e52-47c4-417c-b11d-4649c5d779dd]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c01d44-e235-4903-b905-893d2104c5c5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:04:35 user nova-compute[74994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)
Nov 28 11:04:35 user nova-compute[74994]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 (non-flash)
Nov 28 11:04:35 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:04:35 user nova-compute[74994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)
Nov 28 11:04:35 user nova-compute[74994]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 (non-flash)
Nov 28 11:04:35 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320 -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a72ace0-d813-45da-8f30-5b4b12d33a7b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320, portal: 172.16.0.220,3260]
Nov 28 11:04:35 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320, portal: 172.16.0.220,3260] successful.
Nov 28 11:04:35 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc3b9ad-0959-4fa0-8d7a-b22ea41481fe]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c0e811-84b8-40c3-8327-455c41374af1]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:04:35 user nova-compute[74994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)
Nov 28 11:04:35 user nova-compute[74994]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 (non-flash)
Nov 28 11:04:35 user nova-compute[74994]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320 (non-flash)
Nov 28 11:04:35 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:04:35 user nova-compute[74994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)
Nov 28 11:04:35 user nova-compute[74994]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 (non-flash)
Nov 28 11:04:35 user nova-compute[74994]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320 (non-flash)
Nov 28 11:04:35 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] HCTL ('36', '-', '-', 0) found on session 38 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e812c94-7247-4689-a8d1-8e1012182c0a]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Searching for a device in session 38 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WkLcetUG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-15343666-066d-4412-a8f3-fd5613e3feee tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Acquiring lock "d1de4238-c33e-48a6-bb4f-240e91e81ea3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-15343666-066d-4412-a8f3-fd5613e3feee tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "d1de4238-c33e-48a6-bb4f-240e91e81ea3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:04:35 user nova-compute[74994]: INFO nova.compute.manager [None req-15343666-066d-4412-a8f3-fd5613e3feee tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Detaching volume 13b829e7-d2df-4c8c-9bc6-119c06a4c5d7
Nov 28 11:04:35 user nova-compute[74994]: INFO nova.virt.block_device [None req-15343666-066d-4412-a8f3-fd5613e3feee tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Attempting to driver detach volume 13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 from mountpoint /dev/vdb
Nov 28 11:04:35 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-15343666-066d-4412-a8f3-fd5613e3feee tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Attempting to detach device vdb from instance d1de4238-c33e-48a6-bb4f-240e91e81ea3 from the persistent domain config. {{(pid=74994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-15343666-066d-4412-a8f3-fd5613e3feee tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 11:04:35 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:04:35 user nova-compute[74994]:   <source dev="/dev/sdc"/>
Nov 28 11:04:35 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:04:35 user nova-compute[74994]:   <serial>13b829e7-d2df-4c8c-9bc6-119c06a4c5d7</serial>
Nov 28 11:04:35 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 11:04:35 user nova-compute[74994]: </disk>
Nov 28 11:04:35 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 11:04:35 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-15343666-066d-4412-a8f3-fd5613e3feee tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Successfully detached device vdb from instance d1de4238-c33e-48a6-bb4f-240e91e81ea3 from the persistent domain config.
Nov 28 11:04:35 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-15343666-066d-4412-a8f3-fd5613e3feee tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d1de4238-c33e-48a6-bb4f-240e91e81ea3 from the live domain config. {{(pid=74994) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-15343666-066d-4412-a8f3-fd5613e3feee tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 11:04:35 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:04:35 user nova-compute[74994]:   <source dev="/dev/sdc"/>
Nov 28 11:04:35 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:04:35 user nova-compute[74994]:   <serial>13b829e7-d2df-4c8c-9bc6-119c06a4c5d7</serial>
Nov 28 11:04:35 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 11:04:35 user nova-compute[74994]: </disk>
Nov 28 11:04:35 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG nova.network.neutron [req-089ba07b-6aa5-4596-b6ca-f2c45171dd10 req-356fe403-0cd4-4924-8b15-3ea029321956 service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Updated VIF entry in instance network info cache for port e3ec524f-0e85-40e1-8817-b9d4b75f9966. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG nova.network.neutron [req-089ba07b-6aa5-4596-b6ca-f2c45171dd10 req-356fe403-0cd4-4924-8b15-3ea029321956 service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Updating instance_info_cache with network_info: [{"id": "e3ec524f-0e85-40e1-8817-b9d4b75f9966", "address": "fa:16:3e:99:ce:ce", "network": {"id": "89f2b906-9ef3-4e31-87e5-3e0cd23e8695", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2005181920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9670a509ac14f41a9f44d7299fd2f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3ec524f-0e", "ovs_interfaceid": "e3ec524f-0e85-40e1-8817-b9d4b75f9966", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-089ba07b-6aa5-4596-b6ca-f2c45171dd10 req-356fe403-0cd4-4924-8b15-3ea029321956 service nova] Releasing lock "refresh_cache-d1de4238-c33e-48a6-bb4f-240e91e81ea3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG nova.compute.manager [req-f156e130-f350-4644-84ef-0aa045b10a7e req-7db6b6a9-32ef-4985-b8a1-884a817d8f7f service nova] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Received event network-vif-unplugged-017867da-26d5-4fff-9eb9-eb8686888b55 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f156e130-f350-4644-84ef-0aa045b10a7e req-7db6b6a9-32ef-4985-b8a1-884a817d8f7f service nova] Acquiring lock "3cf241c8-e888-4e47-8213-3c83c045e4a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f156e130-f350-4644-84ef-0aa045b10a7e req-7db6b6a9-32ef-4985-b8a1-884a817d8f7f service nova] Lock "3cf241c8-e888-4e47-8213-3c83c045e4a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f156e130-f350-4644-84ef-0aa045b10a7e req-7db6b6a9-32ef-4985-b8a1-884a817d8f7f service nova] Lock "3cf241c8-e888-4e47-8213-3c83c045e4a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG nova.compute.manager [req-f156e130-f350-4644-84ef-0aa045b10a7e req-7db6b6a9-32ef-4985-b8a1-884a817d8f7f service nova] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] No waiting events found dispatching network-vif-unplugged-017867da-26d5-4fff-9eb9-eb8686888b55 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG nova.compute.manager [req-f156e130-f350-4644-84ef-0aa045b10a7e req-7db6b6a9-32ef-4985-b8a1-884a817d8f7f service nova] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Received event network-vif-unplugged-017867da-26d5-4fff-9eb9-eb8686888b55 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG nova.compute.manager [req-f156e130-f350-4644-84ef-0aa045b10a7e req-7db6b6a9-32ef-4985-b8a1-884a817d8f7f service nova] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Received event network-vif-plugged-017867da-26d5-4fff-9eb9-eb8686888b55 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f156e130-f350-4644-84ef-0aa045b10a7e req-7db6b6a9-32ef-4985-b8a1-884a817d8f7f service nova] Acquiring lock "3cf241c8-e888-4e47-8213-3c83c045e4a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f156e130-f350-4644-84ef-0aa045b10a7e req-7db6b6a9-32ef-4985-b8a1-884a817d8f7f service nova] Lock "3cf241c8-e888-4e47-8213-3c83c045e4a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f156e130-f350-4644-84ef-0aa045b10a7e req-7db6b6a9-32ef-4985-b8a1-884a817d8f7f service nova] Lock "3cf241c8-e888-4e47-8213-3c83c045e4a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:04:35 user nova-compute[74994]: DEBUG nova.compute.manager [req-f156e130-f350-4644-84ef-0aa045b10a7e req-7db6b6a9-32ef-4985-b8a1-884a817d8f7f service nova] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] No waiting events found dispatching network-vif-plugged-017867da-26d5-4fff-9eb9-eb8686888b55 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:04:35 user nova-compute[74994]: WARNING nova.compute.manager [req-f156e130-f350-4644-84ef-0aa045b10a7e req-7db6b6a9-32ef-4985-b8a1-884a817d8f7f service nova] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Received unexpected event network-vif-plugged-017867da-26d5-4fff-9eb9-eb8686888b55 for instance with vm_state active and task_state deleting.
Nov 28 11:04:35 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-15343666-066d-4412-a8f3-fd5613e3feee tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d1de4238-c33e-48a6-bb4f-240e91e81ea3 {{(pid=74994) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 11:04:36 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:04:36 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Took 1.08 seconds to deallocate network for instance.
Nov 28 11:04:36 user nova-compute[74994]: DEBUG nova.compute.manager [req-eea0ff91-ce44-4dc0-b027-d787f4e06e28 req-87e8c28f-6a46-49b9-82b1-7ea67064bf43 service nova] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Received event network-vif-deleted-017867da-26d5-4fff-9eb9-eb8686888b55 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:04:36 user nova-compute[74994]: INFO nova.compute.manager [req-eea0ff91-ce44-4dc0-b027-d787f4e06e28 req-87e8c28f-6a46-49b9-82b1-7ea67064bf43 service nova] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Neutron deleted interface 017867da-26d5-4fff-9eb9-eb8686888b55; detaching it from the instance and deleting it from the info cache
Nov 28 11:04:36 user nova-compute[74994]: DEBUG nova.network.neutron [req-eea0ff91-ce44-4dc0-b027-d787f4e06e28 req-87e8c28f-6a46-49b9-82b1-7ea67064bf43 service nova] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:04:36 user nova-compute[74994]: DEBUG nova.compute.manager [req-eea0ff91-ce44-4dc0-b027-d787f4e06e28 req-87e8c28f-6a46-49b9-82b1-7ea67064bf43 service nova] [instance: 3cf241c8-e888-4e47-8213-3c83c045e4a3] Detach interface failed, port_id=017867da-26d5-4fff-9eb9-eb8686888b55, reason: Instance 3cf241c8-e888-4e47-8213-3c83c045e4a3 could not be found. {{(pid=74994) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 11:04:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9db4672a-4f8a-4977-b4ab-bd0e6cea2601 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:04:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9db4672a-4f8a-4977-b4ab-bd0e6cea2601 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:04:36 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:04:36 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '23365613365343334', 'path': '/dev/sde'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:04:36 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365613365343334', 'path': '/dev/sde'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 11:04:36 user nova-compute[74994]: DEBUG nova.objects.instance [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Lazy-loading 'flavor' on Instance uuid cdc5adf9-5a73-4d7d-b53d-849354a3a053 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:04:36 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 11:04:36 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:04:36 user nova-compute[74994]:   <source dev="/dev/sde"/>
Nov 28 11:04:36 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:04:36 user nova-compute[74994]:   <serial>b071dc55-7012-43ca-a7f2-51d3046d2320</serial>
Nov 28 11:04:36 user nova-compute[74994]: </disk>
Nov 28 11:04:36 user nova-compute[74994]:  {{(pid=74994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 11:04:36 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-9db4672a-4f8a-4977-b4ab-bd0e6cea2601 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:04:36 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-9db4672a-4f8a-4977-b4ab-bd0e6cea2601 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:04:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9db4672a-4f8a-4977-b4ab-bd0e6cea2601 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.351s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:04:36 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-9db4672a-4f8a-4977-b4ab-bd0e6cea2601 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Deleted allocations for instance 3cf241c8-e888-4e47-8213-3c83c045e4a3
Nov 28 11:04:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9db4672a-4f8a-4977-b4ab-bd0e6cea2601 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "3cf241c8-e888-4e47-8213-3c83c045e4a3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.502s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:04:36 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:04:36 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:04:36 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] No VIF found with MAC fa:16:3e:6d:8e:f7, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:04:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4540a95b-e323-4244-9b99-286b48033a87 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Lock "cdc5adf9-5a73-4d7d-b53d-849354a3a053" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.098s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:04:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Acquiring lock "cdc5adf9-5a73-4d7d-b53d-849354a3a053" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:04:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Lock "cdc5adf9-5a73-4d7d-b53d-849354a3a053" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:04:40 user nova-compute[74994]: DEBUG nova.objects.instance [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Lazy-loading 'flavor' on Instance uuid cdc5adf9-5a73-4d7d-b53d-849354a3a053 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:04:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Lock "cdc5adf9-5a73-4d7d-b53d-849354a3a053" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:04:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Acquiring lock "cdc5adf9-5a73-4d7d-b53d-849354a3a053" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:04:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Lock "cdc5adf9-5a73-4d7d-b53d-849354a3a053" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:04:40 user nova-compute[74994]: INFO nova.compute.manager [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Attaching volume 4c73e998-a73e-4497-860b-82df1190d882 to /dev/vdc
Nov 28 11:04:40 user nova-compute[74994]: DEBUG os_brick.utils [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:04:40 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:40 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:40 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9555ebc-d268-4c82-a1f1-3cba4e8b381e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:40 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:40 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:40 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a0a70e-c482-43f4-acb7-292ea5e80191]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:40 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:40 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:40 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e1e05d-29fa-442d-a5ee-9ea003239de7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:40 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0357d7c-42b6-4a3d-8b1c-454ecd45da55]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:40 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:40 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:04:40 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 11:04:40 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:40 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:04:40 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 11:04:40 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fcfbed3-d6eb-4b64-b4b5-e353f0a1ae66]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:40 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 11:04:40 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 11:04:40 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 11:04:40 user nova-compute[74994]: DEBUG os_brick.utils [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:04:40 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Updating existing volume attachment record: 64c6eefc-3edd-4b43-b18c-daabbfe861ee {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 11:04:44 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:44 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qHFXAEvu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:04:48 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:04:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:04:48 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:04:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:04:48 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 11:04:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882 -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[736e1e25-d35c-469c-9a50-e0921e9e5448]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 11:04:48 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882 -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba36dcd1-a2ae-4ef2-aa31-fd267acf0de3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882] added
Nov 28 11:04:48 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[81024834-6c9a-46fb-b1f9-c8c3eba64e46]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c07bc03-9107-43b1-b70f-68bccc512627]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qHFXAEvu {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qHFXAEvu" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b336659a-382e-48a4-8c60-01e63892671b]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qHFXAEvu'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0959a93-1c1d-4354-8605-868109bc503b]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[130d0f5d-9a83-4430-9b2f-b2cf7c811d81]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:04:48 user nova-compute[74994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)
Nov 28 11:04:48 user nova-compute[74994]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 (non-flash)
Nov 28 11:04:48 user nova-compute[74994]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320 (non-flash)
Nov 28 11:04:48 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:04:48 user nova-compute[74994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)
Nov 28 11:04:48 user nova-compute[74994]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 (non-flash)
Nov 28 11:04:48 user nova-compute[74994]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320 (non-flash)
Nov 28 11:04:48 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882 -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d66b62-c40b-4a6e-b09a-bf829d9f8914]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882, portal: 172.16.0.220,3260]
Nov 28 11:04:48 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882, portal: 172.16.0.220,3260] successful.
Nov 28 11:04:48 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[903c36b2-7ccb-4197-8852-d3eabb813f11]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9164728-5520-4229-8031-104b48f8b725]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:04:48 user nova-compute[74994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)
Nov 28 11:04:48 user nova-compute[74994]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 (non-flash)
Nov 28 11:04:48 user nova-compute[74994]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320 (non-flash)
Nov 28 11:04:48 user nova-compute[74994]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882 (non-flash)
Nov 28 11:04:48 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:04:48 user nova-compute[74994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)
Nov 28 11:04:48 user nova-compute[74994]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 (non-flash)
Nov 28 11:04:48 user nova-compute[74994]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320 (non-flash)
Nov 28 11:04:48 user nova-compute[74994]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882 (non-flash)
Nov 28 11:04:48 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] HCTL ('37', '-', '-', 0) found on session 39 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[86371416-5f79-4ebd-a2d5-9ee814038cca]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:48 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Searching for a device in session 39 and hctl ['37', '*', '*', 0] yield: None {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 11:04:49 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Searching for a device in session 39 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 11:04:49 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qHFXAEvu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 11:04:49 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:04:49 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23234646330353036', 'path': '/dev/sdf'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:04:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234646330353036', 'path': '/dev/sdf'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 11:04:49 user nova-compute[74994]: DEBUG nova.objects.instance [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Lazy-loading 'flavor' on Instance uuid cdc5adf9-5a73-4d7d-b53d-849354a3a053 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:04:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 11:04:49 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:04:49 user nova-compute[74994]:   <source dev="/dev/sdf"/>
Nov 28 11:04:49 user nova-compute[74994]:   <target dev="vdc" bus="virtio"/>
Nov 28 11:04:49 user nova-compute[74994]:   <serial>4c73e998-a73e-4497-860b-82df1190d882</serial>
Nov 28 11:04:49 user nova-compute[74994]: </disk>
Nov 28 11:04:49 user nova-compute[74994]:  {{(pid=74994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 11:04:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:04:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:04:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:04:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] No VIF found with MAC fa:16:3e:6d:8e:f7, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:04:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c0280324-7195-4b05-9c2c-98eeea757c1d tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Lock "cdc5adf9-5a73-4d7d-b53d-849354a3a053" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.329s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:04:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6667efa8-3386-4280-892f-07972c5897c6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Acquiring lock "cdc5adf9-5a73-4d7d-b53d-849354a3a053" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:04:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6667efa8-3386-4280-892f-07972c5897c6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Lock "cdc5adf9-5a73-4d7d-b53d-849354a3a053" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:04:51 user nova-compute[74994]: INFO nova.compute.manager [None req-6667efa8-3386-4280-892f-07972c5897c6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Detaching volume 4c73e998-a73e-4497-860b-82df1190d882
Nov 28 11:04:51 user nova-compute[74994]: INFO nova.virt.block_device [None req-6667efa8-3386-4280-892f-07972c5897c6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Attempting to driver detach volume 4c73e998-a73e-4497-860b-82df1190d882 from mountpoint /dev/vdc
Nov 28 11:04:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-6667efa8-3386-4280-892f-07972c5897c6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Attempting to detach device vdc from instance cdc5adf9-5a73-4d7d-b53d-849354a3a053 from the persistent domain config. {{(pid=74994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 11:04:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-6667efa8-3386-4280-892f-07972c5897c6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 11:04:51 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:04:51 user nova-compute[74994]:   <source dev="/dev/sdf"/>
Nov 28 11:04:51 user nova-compute[74994]:   <target dev="vdc" bus="virtio"/>
Nov 28 11:04:51 user nova-compute[74994]:   <serial>4c73e998-a73e-4497-860b-82df1190d882</serial>
Nov 28 11:04:51 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 28 11:04:51 user nova-compute[74994]: </disk>
Nov 28 11:04:51 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 11:04:51 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-6667efa8-3386-4280-892f-07972c5897c6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Successfully detached device vdc from instance cdc5adf9-5a73-4d7d-b53d-849354a3a053 from the persistent domain config.
Nov 28 11:04:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-6667efa8-3386-4280-892f-07972c5897c6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance cdc5adf9-5a73-4d7d-b53d-849354a3a053 from the live domain config. {{(pid=74994) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 11:04:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-6667efa8-3386-4280-892f-07972c5897c6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 11:04:51 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:04:51 user nova-compute[74994]:   <source dev="/dev/sdf"/>
Nov 28 11:04:51 user nova-compute[74994]:   <target dev="vdc" bus="virtio"/>
Nov 28 11:04:51 user nova-compute[74994]:   <serial>4c73e998-a73e-4497-860b-82df1190d882</serial>
Nov 28 11:04:51 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 28 11:04:51 user nova-compute[74994]: </disk>
Nov 28 11:04:51 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 11:04:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-6667efa8-3386-4280-892f-07972c5897c6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance cdc5adf9-5a73-4d7d-b53d-849354a3a053 {{(pid=74994) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 11:04:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:55 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-15343666-066d-4412-a8f3-fd5613e3feee tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d1de4238-c33e-48a6-bb4f-240e91e81ea3 is timed out.
Nov 28 11:04:55 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-15343666-066d-4412-a8f3-fd5613e3feee tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Successfully detached device vdb from instance d1de4238-c33e-48a6-bb4f-240e91e81ea3 from the live domain config.
Nov 28 11:04:55 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15343666-066d-4412-a8f3-fd5613e3feee tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 11:04:55 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-15343666-066d-4412-a8f3-fd5613e3feee tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AgKYCRiP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:04:55 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-15343666-066d-4412-a8f3-fd5613e3feee tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:04:55 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-15343666-066d-4412-a8f3-fd5613e3feee tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:04:55 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-15343666-066d-4412-a8f3-fd5613e3feee tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:04:55 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:55 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:55 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[96810b49-d1f0-41da-9bbe-c65a06152574]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:55 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-15343666-066d-4412-a8f3-fd5613e3feee tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 11:04:55 user nova-compute[74994]: No targets found.
Nov 28 11:04:55 user nova-compute[74994]: iSNS:
Nov 28 11:04:55 user nova-compute[74994]: No targets found.
Nov 28 11:04:55 user nova-compute[74994]: STATIC:
Nov 28 11:04:55 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd
Nov 28 11:04:55 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:04:55 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:04:55 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320
Nov 28 11:04:55 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:04:55 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:04:55 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de
Nov 28 11:04:55 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:04:55 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:04:55 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7
Nov 28 11:04:55 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:04:55 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:04:55 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882
Nov 28 11:04:55 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:04:55 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:04:55 user nova-compute[74994]: FIRMWARE:
Nov 28 11:04:55 user nova-compute[74994]: No targets found.
Nov 28 11:04:55 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:04:55 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-15343666-066d-4412-a8f3-fd5613e3feee tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 11:04:55 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 11:04:55 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 11:04:55 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-15343666-066d-4412-a8f3-fd5613e3feee tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 11:04:55 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:56 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:56 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b22f20b-e419-41d7-b623-7fb182a81286]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:56 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:56 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:56 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[002ed5c6-7a61-4258-a838-77c910449a05]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:56 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-15343666-066d-4412-a8f3-fd5613e3feee tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:04:56 user nova-compute[74994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)
Nov 28 11:04:56 user nova-compute[74994]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 (non-flash)
Nov 28 11:04:56 user nova-compute[74994]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320 (non-flash)
Nov 28 11:04:56 user nova-compute[74994]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882 (non-flash)
Nov 28 11:04:56 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:04:56 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-15343666-066d-4412-a8f3-fd5613e3feee tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:04:56 user nova-compute[74994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)
Nov 28 11:04:56 user nova-compute[74994]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 (non-flash)
Nov 28 11:04:56 user nova-compute[74994]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320 (non-flash)
Nov 28 11:04:56 user nova-compute[74994]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882 (non-flash)
Nov 28 11:04:56 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:04:56 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-15343666-066d-4412-a8f3-fd5613e3feee tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb94439d990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7'): ({'sdc'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 11:04:56 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-15343666-066d-4412-a8f3-fd5613e3feee tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Removing single pathed devices sdc {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 11:04:56 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:56 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:56 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[813f942f-b741-484a-80ee-1e1fea40aaaf]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:56 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:56 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:56 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceccf56e-3a7e-423e-9546-14e26afb6ffc]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:56 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-15343666-066d-4412-a8f3-fd5613e3feee tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Flushing IO for device /dev/sdc {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 11:04:56 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:56 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:56 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4631362-af32-4811-8804-48bdc3786cbc]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:56 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-15343666-066d-4412-a8f3-fd5613e3feee tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 11:04:56 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:56 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:56 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b8903b-17b3-4b17-bd1a-cc7ad6d55558]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:56 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-15343666-066d-4412-a8f3-fd5613e3feee tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 11:04:56 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-15343666-066d-4412-a8f3-fd5613e3feee tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] SCSI volumes sdc have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 11:04:56 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-15343666-066d-4412-a8f3-fd5613e3feee tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 11:04:56 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:56 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:56 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb55c26-75f9-43db-84d9-0ba5476727e8]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:56 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-15343666-066d-4412-a8f3-fd5613e3feee tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:04:56 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:56 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:56 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a6f676-2816-42d4-b0b4-94942cfc88aa]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:56 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-15343666-066d-4412-a8f3-fd5613e3feee tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7, portal: 172.16.0.220,3260]
Nov 28 11:04:56 user nova-compute[74994]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7, portal: 172.16.0.220,3260] successful.
Nov 28 11:04:56 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:04:56 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:04:56 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b829e7-d2df-4c8c-9bc6-119c06a4c5d7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:04:56 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5d0443-bc48-4985-8349-614f12e3d37b]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:04:56 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-15343666-066d-4412-a8f3-fd5613e3feee tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:04:56 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-15343666-066d-4412-a8f3-fd5613e3feee tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:04:56 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-15343666-066d-4412-a8f3-fd5613e3feee tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] <== disconnect_volume: return (326ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:04:56 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15343666-066d-4412-a8f3-fd5613e3feee tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 11:04:57 user nova-compute[74994]: DEBUG nova.objects.instance [None req-15343666-066d-4412-a8f3-fd5613e3feee tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lazy-loading 'flavor' on Instance uuid d1de4238-c33e-48a6-bb4f-240e91e81ea3 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:04:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-15343666-066d-4412-a8f3-fd5613e3feee tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "d1de4238-c33e-48a6-bb4f-240e91e81ea3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.723s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:04:59 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:04:59 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:05:08 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:05:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:05:11 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-6667efa8-3386-4280-892f-07972c5897c6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance cdc5adf9-5a73-4d7d-b53d-849354a3a053 is timed out.
Nov 28 11:05:11 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-6667efa8-3386-4280-892f-07972c5897c6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Successfully detached device vdc from instance cdc5adf9-5a73-4d7d-b53d-849354a3a053 from the live domain config.
Nov 28 11:05:11 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6667efa8-3386-4280-892f-07972c5897c6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6667efa8-3386-4280-892f-07972c5897c6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qHFXAEvu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:05:11 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-6667efa8-3386-4280-892f-07972c5897c6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:05:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-6667efa8-3386-4280-892f-07972c5897c6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-6667efa8-3386-4280-892f-07972c5897c6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[314ce2e6-6ae5-48ef-bcac-2ba6b6761a90]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6667efa8-3386-4280-892f-07972c5897c6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 11:05:11 user nova-compute[74994]: No targets found.
Nov 28 11:05:11 user nova-compute[74994]: iSNS:
Nov 28 11:05:11 user nova-compute[74994]: No targets found.
Nov 28 11:05:11 user nova-compute[74994]: STATIC:
Nov 28 11:05:11 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd
Nov 28 11:05:11 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:05:11 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:05:11 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320
Nov 28 11:05:11 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:05:11 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:05:11 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de
Nov 28 11:05:11 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:05:11 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:05:11 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882
Nov 28 11:05:11 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:05:11 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:05:11 user nova-compute[74994]: FIRMWARE:
Nov 28 11:05:11 user nova-compute[74994]: No targets found.
Nov 28 11:05:11 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6667efa8-3386-4280-892f-07972c5897c6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 11:05:11 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 11:05:11 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6667efa8-3386-4280-892f-07972c5897c6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f352b3-9490-447b-9028-b34d4a861f28]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb45911d-a1bc-45d7-a1ca-ea7c657e1ee5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6667efa8-3386-4280-892f-07972c5897c6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:05:11 user nova-compute[74994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)
Nov 28 11:05:11 user nova-compute[74994]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320 (non-flash)
Nov 28 11:05:11 user nova-compute[74994]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882 (non-flash)
Nov 28 11:05:11 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6667efa8-3386-4280-892f-07972c5897c6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:05:11 user nova-compute[74994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)
Nov 28 11:05:11 user nova-compute[74994]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320 (non-flash)
Nov 28 11:05:11 user nova-compute[74994]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882 (non-flash)
Nov 28 11:05:11 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6667efa8-3386-4280-892f-07972c5897c6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9443908b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882'): ({'sdf'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-6667efa8-3386-4280-892f-07972c5897c6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Removing single pathed devices sdf {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b86102a-ef43-4c5c-af2f-63c5be9852cf]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb3cf56-a527-4ebf-bcc0-ea492573a2f1]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-6667efa8-3386-4280-892f-07972c5897c6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Flushing IO for device /dev/sdf {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[44eba25c-4631-4995-84ac-036b0b9d672c]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-6667efa8-3386-4280-892f-07972c5897c6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f791ed3f-b155-48c9-ab11-cdc406722a1f]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-6667efa8-3386-4280-892f-07972c5897c6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-6667efa8-3386-4280-892f-07972c5897c6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] SCSI volumes sdf have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6667efa8-3386-4280-892f-07972c5897c6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aae25f7-f1df-4d39-8704-32da0db5bb42]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6667efa8-3386-4280-892f-07972c5897c6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882 -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c71473-a528-4ff4-b6b8-967b2ca23832]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6667efa8-3386-4280-892f-07972c5897c6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882, portal: 172.16.0.220,3260]
Nov 28 11:05:11 user nova-compute[74994]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882, portal: 172.16.0.220,3260] successful.
Nov 28 11:05:11 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882 -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c73e998-a73e-4497-860b-82df1190d882 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab52b842-4a30-4246-be46-38d8e3b34611]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6667efa8-3386-4280-892f-07972c5897c6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-6667efa8-3386-4280-892f-07972c5897c6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6667efa8-3386-4280-892f-07972c5897c6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] <== disconnect_volume: return (341ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:05:11 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6667efa8-3386-4280-892f-07972c5897c6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 11:05:12 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:05:12 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74994) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 11:05:13 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-59a86150-ce59-4f0d-ba6f-e1d460b5a81b tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquiring lock "279e1c4c-36f9-492f-ab3f-1b587347eadd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:05:13 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-59a86150-ce59-4f0d-ba6f-e1d460b5a81b tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "279e1c4c-36f9-492f-ab3f-1b587347eadd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:05:13 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-59a86150-ce59-4f0d-ba6f-e1d460b5a81b tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquiring lock "279e1c4c-36f9-492f-ab3f-1b587347eadd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:05:13 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-59a86150-ce59-4f0d-ba6f-e1d460b5a81b tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "279e1c4c-36f9-492f-ab3f-1b587347eadd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:05:13 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-59a86150-ce59-4f0d-ba6f-e1d460b5a81b tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "279e1c4c-36f9-492f-ab3f-1b587347eadd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:05:13 user nova-compute[74994]: INFO nova.compute.manager [None req-59a86150-ce59-4f0d-ba6f-e1d460b5a81b tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Terminating instance
Nov 28 11:05:13 user nova-compute[74994]: DEBUG nova.compute.manager [None req-59a86150-ce59-4f0d-ba6f-e1d460b5a81b tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 11:05:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:14 user nova-compute[74994]: DEBUG nova.compute.manager [req-4955fe49-5703-435a-bb7b-4cdf7cf319a6 req-2d553c6a-ae96-40c1-9b4f-a10668ed8477 service nova] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Received event network-vif-unplugged-aeaddf62-0ca1-40d1-9228-897ee0015d4a {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:05:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4955fe49-5703-435a-bb7b-4cdf7cf319a6 req-2d553c6a-ae96-40c1-9b4f-a10668ed8477 service nova] Acquiring lock "279e1c4c-36f9-492f-ab3f-1b587347eadd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:05:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4955fe49-5703-435a-bb7b-4cdf7cf319a6 req-2d553c6a-ae96-40c1-9b4f-a10668ed8477 service nova] Lock "279e1c4c-36f9-492f-ab3f-1b587347eadd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:05:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4955fe49-5703-435a-bb7b-4cdf7cf319a6 req-2d553c6a-ae96-40c1-9b4f-a10668ed8477 service nova] Lock "279e1c4c-36f9-492f-ab3f-1b587347eadd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:05:14 user nova-compute[74994]: DEBUG nova.compute.manager [req-4955fe49-5703-435a-bb7b-4cdf7cf319a6 req-2d553c6a-ae96-40c1-9b4f-a10668ed8477 service nova] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] No waiting events found dispatching network-vif-unplugged-aeaddf62-0ca1-40d1-9228-897ee0015d4a {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:05:14 user nova-compute[74994]: DEBUG nova.compute.manager [req-4955fe49-5703-435a-bb7b-4cdf7cf319a6 req-2d553c6a-ae96-40c1-9b4f-a10668ed8477 service nova] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Received event network-vif-unplugged-aeaddf62-0ca1-40d1-9228-897ee0015d4a for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 11:05:14 user nova-compute[74994]: DEBUG nova.objects.instance [None req-6667efa8-3386-4280-892f-07972c5897c6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Lazy-loading 'flavor' on Instance uuid cdc5adf9-5a73-4d7d-b53d-849354a3a053 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:05:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6667efa8-3386-4280-892f-07972c5897c6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Lock "cdc5adf9-5a73-4d7d-b53d-849354a3a053" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.177s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:05:14 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Instance destroyed successfully.
Nov 28 11:05:14 user nova-compute[74994]: DEBUG nova.objects.instance [None req-59a86150-ce59-4f0d-ba6f-e1d460b5a81b tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lazy-loading 'resources' on Instance uuid 279e1c4c-36f9-492f-ab3f-1b587347eadd {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:05:14 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-59a86150-ce59-4f0d-ba6f-e1d460b5a81b tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:49:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-262139967',display_name='tempest-ServerRescueNegativeTestJSON-server-262139967',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-262139967',id=4,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:51:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77126f6f39db4a628b74551ea7d0aa21',ramdisk_id='',reservation_id='r-xeb42ckc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1900175697',owner_user_name='tempest-ServerRescueNegativeTestJSON-1900175697-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T10:51:03Z,user_data=None,user_id='6b5c1a1f2efc4a2faf8b82d467681d45',uuid=279e1c4c-36f9-492f-ab3f-1b587347eadd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "aeaddf62-0ca1-40d1-9228-897ee0015d4a", "address": "fa:16:3e:bc:02:82", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeaddf62-0c", "ovs_interfaceid": "aeaddf62-0ca1-40d1-9228-897ee0015d4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 11:05:14 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-59a86150-ce59-4f0d-ba6f-e1d460b5a81b tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Converting VIF {"id": "aeaddf62-0ca1-40d1-9228-897ee0015d4a", "address": "fa:16:3e:bc:02:82", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeaddf62-0c", "ovs_interfaceid": "aeaddf62-0ca1-40d1-9228-897ee0015d4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:05:14 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-59a86150-ce59-4f0d-ba6f-e1d460b5a81b tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:02:82,bridge_name='br-int',has_traffic_filtering=True,id=aeaddf62-0ca1-40d1-9228-897ee0015d4a,network=Network(77bc68aa-1654-4e4d-9c65-7515fe6f4b2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeaddf62-0c') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:05:14 user nova-compute[74994]: DEBUG os_vif [None req-59a86150-ce59-4f0d-ba6f-e1d460b5a81b tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:02:82,bridge_name='br-int',has_traffic_filtering=True,id=aeaddf62-0ca1-40d1-9228-897ee0015d4a,network=Network(77bc68aa-1654-4e4d-9c65-7515fe6f4b2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeaddf62-0c') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 11:05:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaeaddf62-0c, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:05:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:05:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3da01f43-31bc-4a60-9a81-c02cb74bbf15) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:05:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:14 user nova-compute[74994]: INFO os_vif [None req-59a86150-ce59-4f0d-ba6f-e1d460b5a81b tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:02:82,bridge_name='br-int',has_traffic_filtering=True,id=aeaddf62-0ca1-40d1-9228-897ee0015d4a,network=Network(77bc68aa-1654-4e4d-9c65-7515fe6f4b2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeaddf62-0c')
Nov 28 11:05:14 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-59a86150-ce59-4f0d-ba6f-e1d460b5a81b tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Deleting instance files /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd_del
Nov 28 11:05:14 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-59a86150-ce59-4f0d-ba6f-e1d460b5a81b tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Deletion of /opt/stack/data/nova/instances/279e1c4c-36f9-492f-ab3f-1b587347eadd_del complete
Nov 28 11:05:14 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:05:14 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 11:05:14 user nova-compute[74994]: INFO nova.compute.manager [None req-59a86150-ce59-4f0d-ba6f-e1d460b5a81b tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 28 11:05:14 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-59a86150-ce59-4f0d-ba6f-e1d460b5a81b tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 11:05:14 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 11:05:14 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 11:05:15 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:05:15 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Took 0.50 seconds to deallocate network for instance.
Nov 28 11:05:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-59a86150-ce59-4f0d-ba6f-e1d460b5a81b tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:05:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-59a86150-ce59-4f0d-ba6f-e1d460b5a81b tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:05:15 user nova-compute[74994]: DEBUG nova.compute.manager [req-e3c15113-5511-43ca-ac39-895607b7fb5e req-24816464-f558-4807-acf3-60ff3ba43c5c service nova] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Received event network-vif-deleted-aeaddf62-0ca1-40d1-9228-897ee0015d4a {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:05:15 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-59a86150-ce59-4f0d-ba6f-e1d460b5a81b tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:05:15 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-59a86150-ce59-4f0d-ba6f-e1d460b5a81b tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:05:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-59a86150-ce59-4f0d-ba6f-e1d460b5a81b tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.329s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:05:15 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-59a86150-ce59-4f0d-ba6f-e1d460b5a81b tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Deleted allocations for instance 279e1c4c-36f9-492f-ab3f-1b587347eadd
Nov 28 11:05:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-59a86150-ce59-4f0d-ba6f-e1d460b5a81b tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "279e1c4c-36f9-492f-ab3f-1b587347eadd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.968s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:05:16 user nova-compute[74994]: DEBUG nova.compute.manager [req-f68366a3-e839-4d42-9520-cb051c0d3a34 req-384ea009-7b56-429e-a395-daafc99ead3f service nova] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Received event network-vif-plugged-aeaddf62-0ca1-40d1-9228-897ee0015d4a {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:05:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f68366a3-e839-4d42-9520-cb051c0d3a34 req-384ea009-7b56-429e-a395-daafc99ead3f service nova] Acquiring lock "279e1c4c-36f9-492f-ab3f-1b587347eadd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:05:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f68366a3-e839-4d42-9520-cb051c0d3a34 req-384ea009-7b56-429e-a395-daafc99ead3f service nova] Lock "279e1c4c-36f9-492f-ab3f-1b587347eadd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:05:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f68366a3-e839-4d42-9520-cb051c0d3a34 req-384ea009-7b56-429e-a395-daafc99ead3f service nova] Lock "279e1c4c-36f9-492f-ab3f-1b587347eadd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:05:16 user nova-compute[74994]: DEBUG nova.compute.manager [req-f68366a3-e839-4d42-9520-cb051c0d3a34 req-384ea009-7b56-429e-a395-daafc99ead3f service nova] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] No waiting events found dispatching network-vif-plugged-aeaddf62-0ca1-40d1-9228-897ee0015d4a {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:05:16 user nova-compute[74994]: WARNING nova.compute.manager [req-f68366a3-e839-4d42-9520-cb051c0d3a34 req-384ea009-7b56-429e-a395-daafc99ead3f service nova] [instance: 279e1c4c-36f9-492f-ab3f-1b587347eadd] Received unexpected event network-vif-plugged-aeaddf62-0ca1-40d1-9228-897ee0015d4a for instance with vm_state deleted and task_state None.
Nov 28 11:05:18 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:05:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:05:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:05:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:05:18 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 11:05:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:19 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:19 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:05:19 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:05:19 user nova-compute[74994]: DEBUG nova.compute.manager [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 11:05:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:19 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:05:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc5adf9-5a73-4d7d-b53d-849354a3a053/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:19 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:05:19 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:05:19 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 11:05:19 user nova-compute[74994]: INFO nova.compute.claims [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Claim successful on node user
Nov 28 11:05:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc5adf9-5a73-4d7d-b53d-849354a3a053/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc5adf9-5a73-4d7d-b53d-849354a3a053/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:20 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Refreshing inventories for resource provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 11:05:20 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Updating ProviderTree inventory for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 11:05:20 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Updating inventory in ProviderTree for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 11:05:20 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Refreshing aggregate associations for resource provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a, aggregates: None {{(pid=74994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 11:05:20 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Refreshing trait associations for resource provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=74994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 11:05:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc5adf9-5a73-4d7d-b53d-849354a3a053/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:20 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:05:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Acquiring lock "0f267741-9611-4812-9afa-32717d16abc5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:05:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "0f267741-9611-4812-9afa-32717d16abc5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:05:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:20 user nova-compute[74994]: DEBUG nova.compute.manager [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 11:05:20 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:05:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:05:20 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:05:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.714s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:05:20 user nova-compute[74994]: DEBUG nova.compute.manager [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 11:05:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.072s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:05:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1de4238-c33e-48a6-bb4f-240e91e81ea3/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:20 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 11:05:20 user nova-compute[74994]: INFO nova.compute.claims [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Claim successful on node user
Nov 28 11:05:20 user nova-compute[74994]: DEBUG nova.compute.manager [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 11:05:20 user nova-compute[74994]: DEBUG nova.network.neutron [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 11:05:20 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 11:05:20 user nova-compute[74994]: DEBUG nova.compute.manager [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 11:05:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1de4238-c33e-48a6-bb4f-240e91e81ea3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1de4238-c33e-48a6-bb4f-240e91e81ea3/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:20 user nova-compute[74994]: INFO nova.virt.block_device [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Booting with volume cc3edc15-080f-4593-9a75-5d2719dfe0dd at /dev/vda
Nov 28 11:05:20 user nova-compute[74994]: DEBUG nova.policy [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd51be473c7284977a6533756a1f677f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb43a8fc7bd47728600741762f71112', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 11:05:21 user nova-compute[74994]: DEBUG os_brick.utils [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:05:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:21 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[81aff736-3c47-42db-a257-f38194b8d2b2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:05:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:21 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[173d2713-060d-478b-9571-cee77f021ebc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:05:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:21 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5044e15f-08f9-40a9-8e71-0b2058735498]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:05:21 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f13dd76-dfab-4bbc-8bf2-ce388d109880]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:05:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1de4238-c33e-48a6-bb4f-240e91e81ea3/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:05:21 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 11:05:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:21 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:05:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:05:21 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 11:05:21 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d919f5da-d1c9-4f76-a653-8f41be79194f]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:05:21 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 11:05:21 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 11:05:21 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 11:05:21 user nova-compute[74994]: DEBUG os_brick.utils [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:05:21 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Updating existing volume attachment record: 1fda6fdd-be6b-4713-9cf5-dfd8a7004489 {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 11:05:21 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:21 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:05:21 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:05:21 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=8007MB free_disk=24.996227264404297GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 11:05:21 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:05:21 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:05:21 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:05:21 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.960s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:05:21 user nova-compute[74994]: DEBUG nova.compute.manager [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 11:05:21 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.090s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:05:21 user nova-compute[74994]: DEBUG nova.network.neutron [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Successfully created port: 17fb7783-f3dc-41cf-b838-004f2048fdbc {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 11:05:21 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:05:21 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance bf357856-2d97-42e8-928d-71d0378f48c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:05:21 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 759fbcfd-ab13-438f-b860-6393a97d1205 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:05:21 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 20716905-c56a-4729-8c5b-9188502dc477 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:05:21 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance b743c491-ece8-4781-9530-b2f38ffc1079 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:05:21 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance d1de4238-c33e-48a6-bb4f-240e91e81ea3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:05:21 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 7e67fb47-500c-4e85-b384-27408ec622a9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:05:21 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance cdc5adf9-5a73-4d7d-b53d-849354a3a053 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:05:21 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance e3b0b960-3f38-4a6f-9017-209fbc2110c9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:05:21 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 0f267741-9611-4812-9afa-32717d16abc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:05:21 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 11:05:21 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 11:05:21 user nova-compute[74994]: DEBUG nova.compute.manager [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 11:05:21 user nova-compute[74994]: DEBUG nova.network.neutron [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 11:05:22 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 11:05:22 user nova-compute[74994]: DEBUG nova.compute.manager [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 11:05:22 user nova-compute[74994]: DEBUG nova.policy [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '44e7cead5a1a4ed09ee100e9b7a4968d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33727b28c7d94b7bbe8987c1301eec04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 11:05:22 user nova-compute[74994]: DEBUG nova.compute.manager [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 11:05:22 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 11:05:22 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Creating image(s)
Nov 28 11:05:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Acquiring lock "/opt/stack/data/nova/instances/0f267741-9611-4812-9afa-32717d16abc5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:05:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "/opt/stack/data/nova/instances/0f267741-9611-4812-9afa-32717d16abc5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:05:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "/opt/stack/data/nova/instances/0f267741-9611-4812-9afa-32717d16abc5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:05:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:22 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:05:22 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:05:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 11:05:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.735s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:05:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.206s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Acquiring lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:05:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:05:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.190s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/0f267741-9611-4812-9afa-32717d16abc5/disk 1073741824 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/0f267741-9611-4812-9afa-32717d16abc5/disk 1073741824" returned: 0 in 0.047s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:05:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:22 user nova-compute[74994]: DEBUG nova.network.neutron [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Successfully updated port: 17fb7783-f3dc-41cf-b838-004f2048fdbc {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 11:05:22 user nova-compute[74994]: DEBUG nova.compute.manager [req-ee97e908-9d2f-4d4e-a9c7-72a7387095e7 req-da9f476e-15af-424d-a63c-6841244c805a service nova] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Received event network-changed-17fb7783-f3dc-41cf-b838-004f2048fdbc {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:05:22 user nova-compute[74994]: DEBUG nova.compute.manager [req-ee97e908-9d2f-4d4e-a9c7-72a7387095e7 req-da9f476e-15af-424d-a63c-6841244c805a service nova] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Refreshing instance network info cache due to event network-changed-17fb7783-f3dc-41cf-b838-004f2048fdbc. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:05:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ee97e908-9d2f-4d4e-a9c7-72a7387095e7 req-da9f476e-15af-424d-a63c-6841244c805a service nova] Acquiring lock "refresh_cache-e3b0b960-3f38-4a6f-9017-209fbc2110c9" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:05:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ee97e908-9d2f-4d4e-a9c7-72a7387095e7 req-da9f476e-15af-424d-a63c-6841244c805a service nova] Acquired lock "refresh_cache-e3b0b960-3f38-4a6f-9017-209fbc2110c9" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:05:22 user nova-compute[74994]: DEBUG nova.network.neutron [req-ee97e908-9d2f-4d4e-a9c7-72a7387095e7 req-da9f476e-15af-424d-a63c-6841244c805a service nova] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Refreshing network info cache for port 17fb7783-f3dc-41cf-b838-004f2048fdbc {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:05:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "refresh_cache-e3b0b960-3f38-4a6f-9017-209fbc2110c9" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:05:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.179s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:22 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0f267741-9611-4812-9afa-32717d16abc5/disk. size=1073741824 {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 11:05:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f267741-9611-4812-9afa-32717d16abc5/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:23 user nova-compute[74994]: DEBUG nova.network.neutron [req-ee97e908-9d2f-4d4e-a9c7-72a7387095e7 req-da9f476e-15af-424d-a63c-6841244c805a service nova] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 11:05:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f267741-9611-4812-9afa-32717d16abc5/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:23 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Cannot resize image /opt/stack/data/nova/instances/0f267741-9611-4812-9afa-32717d16abc5/disk to a smaller size. {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 11:05:23 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Created local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 11:05:23 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Ensure instance console log exists: /opt/stack/data/nova/instances/0f267741-9611-4812-9afa-32717d16abc5/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 11:05:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:05:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:05:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:05:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:23 user nova-compute[74994]: DEBUG nova.network.neutron [req-ee97e908-9d2f-4d4e-a9c7-72a7387095e7 req-da9f476e-15af-424d-a63c-6841244c805a service nova] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:05:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ee97e908-9d2f-4d4e-a9c7-72a7387095e7 req-da9f476e-15af-424d-a63c-6841244c805a service nova] Releasing lock "refresh_cache-e3b0b960-3f38-4a6f-9017-209fbc2110c9" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:05:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquired lock "refresh_cache-e3b0b960-3f38-4a6f-9017-209fbc2110c9" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:05:23 user nova-compute[74994]: DEBUG nova.network.neutron [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 11:05:23 user nova-compute[74994]: DEBUG nova.network.neutron [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 11:05:23 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:05:23 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 11:05:23 user nova-compute[74994]: DEBUG nova.network.neutron [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Successfully created port: 73050cb9-2ff8-45ec-b6fa-d54d5c717f25 {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 11:05:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "refresh_cache-bf357856-2d97-42e8-928d-71d0378f48c8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:05:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquired lock "refresh_cache-bf357856-2d97-42e8-928d-71d0378f48c8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:05:23 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Forcefully refreshing network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 11:05:23 user nova-compute[74994]: DEBUG nova.network.neutron [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Updating instance_info_cache with network_info: [{"id": "17fb7783-f3dc-41cf-b838-004f2048fdbc", "address": "fa:16:3e:b7:31:25", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17fb7783-f3", "ovs_interfaceid": "17fb7783-f3dc-41cf-b838-004f2048fdbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:05:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Releasing lock "refresh_cache-e3b0b960-3f38-4a6f-9017-209fbc2110c9" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:05:23 user nova-compute[74994]: DEBUG nova.compute.manager [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Instance network_info: |[{"id": "17fb7783-f3dc-41cf-b838-004f2048fdbc", "address": "fa:16:3e:b7:31:25", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17fb7783-f3", "ovs_interfaceid": "17fb7783-f3dc-41cf-b838-004f2048fdbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 11:05:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:24 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Updating instance_info_cache with network_info: [{"id": "6a884296-8f6f-4647-b4c6-09d7f4e92887", "address": "fa:16:3e:a2:e1:5b", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a884296-8f", "ovs_interfaceid": "6a884296-8f6f-4647-b4c6-09d7f4e92887", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:05:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Releasing lock "refresh_cache-bf357856-2d97-42e8-928d-71d0378f48c8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:05:24 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Updated the network info_cache for instance {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 11:05:24 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:05:24 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:05:24 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:05:24 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG nova.network.neutron [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Successfully updated port: 73050cb9-2ff8-45ec-b6fa-d54d5c717f25 {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Acquiring lock "refresh_cache-0f267741-9611-4812-9afa-32717d16abc5" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Acquired lock "refresh_cache-0f267741-9611-4812-9afa-32717d16abc5" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG nova.network.neutron [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG nova.network.neutron [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG nova.compute.manager [req-6422d71d-b7f2-490f-b215-a0917bdb41b3 req-7459f677-f217-492a-b59b-53b784169d47 service nova] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Received event network-changed-73050cb9-2ff8-45ec-b6fa-d54d5c717f25 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG nova.compute.manager [req-6422d71d-b7f2-490f-b215-a0917bdb41b3 req-7459f677-f217-492a-b59b-53b784169d47 service nova] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Refreshing instance network info cache due to event network-changed-73050cb9-2ff8-45ec-b6fa-d54d5c717f25. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6422d71d-b7f2-490f-b215-a0917bdb41b3 req-7459f677-f217-492a-b59b-53b784169d47 service nova] Acquiring lock "refresh_cache-0f267741-9611-4812-9afa-32717d16abc5" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG nova.network.neutron [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Updating instance_info_cache with network_info: [{"id": "73050cb9-2ff8-45ec-b6fa-d54d5c717f25", "address": "fa:16:3e:10:54:1c", "network": {"id": "844b3eab-57f3-4582-9fcc-04594e44081b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-233988918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33727b28c7d94b7bbe8987c1301eec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73050cb9-2f", "ovs_interfaceid": "73050cb9-2ff8-45ec-b6fa-d54d5c717f25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Releasing lock "refresh_cache-0f267741-9611-4812-9afa-32717d16abc5" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG nova.compute.manager [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Instance network_info: |[{"id": "73050cb9-2ff8-45ec-b6fa-d54d5c717f25", "address": "fa:16:3e:10:54:1c", "network": {"id": "844b3eab-57f3-4582-9fcc-04594e44081b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-233988918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33727b28c7d94b7bbe8987c1301eec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73050cb9-2f", "ovs_interfaceid": "73050cb9-2ff8-45ec-b6fa-d54d5c717f25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6422d71d-b7f2-490f-b215-a0917bdb41b3 req-7459f677-f217-492a-b59b-53b784169d47 service nova] Acquired lock "refresh_cache-0f267741-9611-4812-9afa-32717d16abc5" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG nova.network.neutron [req-6422d71d-b7f2-490f-b215-a0917bdb41b3 req-7459f677-f217-492a-b59b-53b784169d47 service nova] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Refreshing network info cache for port 73050cb9-2ff8-45ec-b6fa-d54d5c717f25 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Start _get_guest_xml network_info=[{"id": "73050cb9-2ff8-45ec-b6fa-d54d5c717f25", "address": "fa:16:3e:10:54:1c", "network": {"id": "844b3eab-57f3-4582-9fcc-04594e44081b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-233988918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33727b28c7d94b7bbe8987c1301eec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73050cb9-2f", "ovs_interfaceid": "73050cb9-2ff8-45ec-b6fa-d54d5c717f25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'aa939d1b-b8a6-4391-935b-0191bf5ccd0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 11:05:25 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:05:25 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:05:25 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:05:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-498247600',display_name='tempest-AttachVolumeTestJSON-server-498247600',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-498247600',id=33,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNcJFEAOnLoxAQK60vamRRARSnn9pzkJXq9rscMo3ZslJV+BiDLuyJJRW0nuaTt7xnbmgx/Fr/ZHLfUE7tXSslC4/fFM94FFhf9D5agOJkE7MFGOU2scFaJkiVRiTjrhSA==',key_name='tempest-keypair-556467887',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33727b28c7d94b7bbe8987c1301eec04',ramdisk_id='',reservation_id='r-84xy82pz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-565652019',owner_user_name='tempest-AttachVolumeTestJSON-565652019-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:05:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44e7cead5a1a4ed09ee100e9b7a4968d',uuid=0f267741-9611-4812-9afa-32717d16abc5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73050cb9-2ff8-45ec-b6fa-d54d5c717f25", "address": "fa:16:3e:10:54:1c", "network": {"id": "844b3eab-57f3-4582-9fcc-04594e44081b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-233988918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33727b28c7d94b7bbe8987c1301eec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73050cb9-2f", "ovs_interfaceid": "73050cb9-2ff8-45ec-b6fa-d54d5c717f25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Converting VIF {"id": "73050cb9-2ff8-45ec-b6fa-d54d5c717f25", "address": "fa:16:3e:10:54:1c", "network": {"id": "844b3eab-57f3-4582-9fcc-04594e44081b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-233988918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33727b28c7d94b7bbe8987c1301eec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73050cb9-2f", "ovs_interfaceid": "73050cb9-2ff8-45ec-b6fa-d54d5c717f25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:54:1c,bridge_name='br-int',has_traffic_filtering=True,id=73050cb9-2ff8-45ec-b6fa-d54d5c717f25,network=Network(844b3eab-57f3-4582-9fcc-04594e44081b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73050cb9-2f') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG nova.objects.instance [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lazy-loading 'pci_devices' on Instance uuid 0f267741-9611-4812-9afa-32717d16abc5 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] End _get_guest_xml xml=<domain type="kvm">
Nov 28 11:05:25 user nova-compute[74994]:   <uuid>0f267741-9611-4812-9afa-32717d16abc5</uuid>
Nov 28 11:05:25 user nova-compute[74994]:   <name>instance-00000021</name>
Nov 28 11:05:25 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 11:05:25 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 11:05:25 user nova-compute[74994]:   <metadata>
Nov 28 11:05:25 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 11:05:25 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 11:05:25 user nova-compute[74994]:       <nova:name>tempest-AttachVolumeTestJSON-server-498247600</nova:name>
Nov 28 11:05:25 user nova-compute[74994]:       <nova:creationTime>2023-11-28 11:05:25</nova:creationTime>
Nov 28 11:05:25 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 11:05:25 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 11:05:25 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 11:05:25 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 11:05:25 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 11:05:25 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 11:05:25 user nova-compute[74994]:       </nova:flavor>
Nov 28 11:05:25 user nova-compute[74994]:       <nova:owner>
Nov 28 11:05:25 user nova-compute[74994]:         <nova:user uuid="44e7cead5a1a4ed09ee100e9b7a4968d">tempest-AttachVolumeTestJSON-565652019-project-member</nova:user>
Nov 28 11:05:25 user nova-compute[74994]:         <nova:project uuid="33727b28c7d94b7bbe8987c1301eec04">tempest-AttachVolumeTestJSON-565652019</nova:project>
Nov 28 11:05:25 user nova-compute[74994]:       </nova:owner>
Nov 28 11:05:25 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 11:05:25 user nova-compute[74994]:       <nova:ports>
Nov 28 11:05:25 user nova-compute[74994]:         <nova:port uuid="73050cb9-2ff8-45ec-b6fa-d54d5c717f25">
Nov 28 11:05:25 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 11:05:25 user nova-compute[74994]:         </nova:port>
Nov 28 11:05:25 user nova-compute[74994]:       </nova:ports>
Nov 28 11:05:25 user nova-compute[74994]:     </nova:instance>
Nov 28 11:05:25 user nova-compute[74994]:   </metadata>
Nov 28 11:05:25 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 11:05:25 user nova-compute[74994]:     <system>
Nov 28 11:05:25 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 11:05:25 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 11:05:25 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 11:05:25 user nova-compute[74994]:       <entry name="serial">0f267741-9611-4812-9afa-32717d16abc5</entry>
Nov 28 11:05:25 user nova-compute[74994]:       <entry name="uuid">0f267741-9611-4812-9afa-32717d16abc5</entry>
Nov 28 11:05:25 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 11:05:25 user nova-compute[74994]:     </system>
Nov 28 11:05:25 user nova-compute[74994]:   </sysinfo>
Nov 28 11:05:25 user nova-compute[74994]:   <os>
Nov 28 11:05:25 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 11:05:25 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 11:05:25 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 11:05:25 user nova-compute[74994]:   </os>
Nov 28 11:05:25 user nova-compute[74994]:   <features>
Nov 28 11:05:25 user nova-compute[74994]:     <acpi/>
Nov 28 11:05:25 user nova-compute[74994]:     <apic/>
Nov 28 11:05:25 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 11:05:25 user nova-compute[74994]:   </features>
Nov 28 11:05:25 user nova-compute[74994]:   <clock offset="utc">
Nov 28 11:05:25 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 11:05:25 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 11:05:25 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 11:05:25 user nova-compute[74994]:   </clock>
Nov 28 11:05:25 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 11:05:25 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 11:05:25 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 11:05:25 user nova-compute[74994]:   </cpu>
Nov 28 11:05:25 user nova-compute[74994]:   <devices>
Nov 28 11:05:25 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 11:05:25 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 11:05:25 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/0f267741-9611-4812-9afa-32717d16abc5/disk"/>
Nov 28 11:05:25 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 11:05:25 user nova-compute[74994]:     </disk>
Nov 28 11:05:25 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 11:05:25 user nova-compute[74994]:       <mac address="fa:16:3e:10:54:1c"/>
Nov 28 11:05:25 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:05:25 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 11:05:25 user nova-compute[74994]:       <target dev="tap73050cb9-2f"/>
Nov 28 11:05:25 user nova-compute[74994]:     </interface>
Nov 28 11:05:25 user nova-compute[74994]:     <serial type="pty">
Nov 28 11:05:25 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/0f267741-9611-4812-9afa-32717d16abc5/console.log" append="off"/>
Nov 28 11:05:25 user nova-compute[74994]:     </serial>
Nov 28 11:05:25 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 11:05:25 user nova-compute[74994]:     <video>
Nov 28 11:05:25 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:05:25 user nova-compute[74994]:     </video>
Nov 28 11:05:25 user nova-compute[74994]:     <rng model="virtio">
Nov 28 11:05:25 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 11:05:25 user nova-compute[74994]:     </rng>
Nov 28 11:05:25 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 11:05:25 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 11:05:25 user nova-compute[74994]:       <stats period="10"/>
Nov 28 11:05:25 user nova-compute[74994]:     </memballoon>
Nov 28 11:05:25 user nova-compute[74994]:   </devices>
Nov 28 11:05:25 user nova-compute[74994]: </domain>
Nov 28 11:05:25 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:05:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-498247600',display_name='tempest-AttachVolumeTestJSON-server-498247600',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-498247600',id=33,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNcJFEAOnLoxAQK60vamRRARSnn9pzkJXq9rscMo3ZslJV+BiDLuyJJRW0nuaTt7xnbmgx/Fr/ZHLfUE7tXSslC4/fFM94FFhf9D5agOJkE7MFGOU2scFaJkiVRiTjrhSA==',key_name='tempest-keypair-556467887',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33727b28c7d94b7bbe8987c1301eec04',ramdisk_id='',reservation_id='r-84xy82pz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-565652019',owner_user_name='tempest-AttachVolumeTestJSON-565652019-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:05:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44e7cead5a1a4ed09ee100e9b7a4968d',uuid=0f267741-9611-4812-9afa-32717d16abc5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73050cb9-2ff8-45ec-b6fa-d54d5c717f25", "address": "fa:16:3e:10:54:1c", "network": {"id": "844b3eab-57f3-4582-9fcc-04594e44081b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-233988918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33727b28c7d94b7bbe8987c1301eec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73050cb9-2f", "ovs_interfaceid": "73050cb9-2ff8-45ec-b6fa-d54d5c717f25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Converting VIF {"id": "73050cb9-2ff8-45ec-b6fa-d54d5c717f25", "address": "fa:16:3e:10:54:1c", "network": {"id": "844b3eab-57f3-4582-9fcc-04594e44081b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-233988918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33727b28c7d94b7bbe8987c1301eec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73050cb9-2f", "ovs_interfaceid": "73050cb9-2ff8-45ec-b6fa-d54d5c717f25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:54:1c,bridge_name='br-int',has_traffic_filtering=True,id=73050cb9-2ff8-45ec-b6fa-d54d5c717f25,network=Network(844b3eab-57f3-4582-9fcc-04594e44081b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73050cb9-2f') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG os_vif [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:54:1c,bridge_name='br-int',has_traffic_filtering=True,id=73050cb9-2ff8-45ec-b6fa-d54d5c717f25,network=Network(844b3eab-57f3-4582-9fcc-04594e44081b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73050cb9-2f') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f8b13099-d2ed-54be-a1d4-c736eb48719a', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap73050cb9-2f, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap73050cb9-2f, col_values=(('qos', UUID('890b086b-39de-4066-878c-2c218f086e4a')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap73050cb9-2f, col_values=(('external_ids', {'iface-id': '73050cb9-2ff8-45ec-b6fa-d54d5c717f25', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:54:1c', 'vm-uuid': '0f267741-9611-4812-9afa-32717d16abc5'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:25 user nova-compute[74994]: INFO os_vif [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:54:1c,bridge_name='br-int',has_traffic_filtering=True,id=73050cb9-2ff8-45ec-b6fa-d54d5c717f25,network=Network(844b3eab-57f3-4582-9fcc-04594e44081b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73050cb9-2f')
Nov 28 11:05:25 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] No VIF found with MAC fa:16:3e:10:54:1c, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:05:25 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:05:26 user nova-compute[74994]: DEBUG nova.network.neutron [req-6422d71d-b7f2-490f-b215-a0917bdb41b3 req-7459f677-f217-492a-b59b-53b784169d47 service nova] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Updated VIF entry in instance network info cache for port 73050cb9-2ff8-45ec-b6fa-d54d5c717f25. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:05:26 user nova-compute[74994]: DEBUG nova.network.neutron [req-6422d71d-b7f2-490f-b215-a0917bdb41b3 req-7459f677-f217-492a-b59b-53b784169d47 service nova] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Updating instance_info_cache with network_info: [{"id": "73050cb9-2ff8-45ec-b6fa-d54d5c717f25", "address": "fa:16:3e:10:54:1c", "network": {"id": "844b3eab-57f3-4582-9fcc-04594e44081b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-233988918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33727b28c7d94b7bbe8987c1301eec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73050cb9-2f", "ovs_interfaceid": "73050cb9-2ff8-45ec-b6fa-d54d5c717f25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:05:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6422d71d-b7f2-490f-b215-a0917bdb41b3 req-7459f677-f217-492a-b59b-53b784169d47 service nova] Releasing lock "refresh_cache-0f267741-9611-4812-9afa-32717d16abc5" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:05:26 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:05:26 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:05:26 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Cleaning up deleted instances {{(pid=74994) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 11:05:26 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] There are 0 instances to clean {{(pid=74994) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 11:05:27 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:27 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:27 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:27 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:27 user nova-compute[74994]: DEBUG nova.compute.manager [req-8a4d9734-2bd0-4c04-a1f2-cb070ad8d6ed req-eadb85b1-adcc-4168-864a-88299645af71 service nova] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Received event network-vif-plugged-73050cb9-2ff8-45ec-b6fa-d54d5c717f25 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:05:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8a4d9734-2bd0-4c04-a1f2-cb070ad8d6ed req-eadb85b1-adcc-4168-864a-88299645af71 service nova] Acquiring lock "0f267741-9611-4812-9afa-32717d16abc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:05:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8a4d9734-2bd0-4c04-a1f2-cb070ad8d6ed req-eadb85b1-adcc-4168-864a-88299645af71 service nova] Lock "0f267741-9611-4812-9afa-32717d16abc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:05:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8a4d9734-2bd0-4c04-a1f2-cb070ad8d6ed req-eadb85b1-adcc-4168-864a-88299645af71 service nova] Lock "0f267741-9611-4812-9afa-32717d16abc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:05:27 user nova-compute[74994]: DEBUG nova.compute.manager [req-8a4d9734-2bd0-4c04-a1f2-cb070ad8d6ed req-eadb85b1-adcc-4168-864a-88299645af71 service nova] [instance: 0f267741-9611-4812-9afa-32717d16abc5] No waiting events found dispatching network-vif-plugged-73050cb9-2ff8-45ec-b6fa-d54d5c717f25 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:05:27 user nova-compute[74994]: WARNING nova.compute.manager [req-8a4d9734-2bd0-4c04-a1f2-cb070ad8d6ed req-eadb85b1-adcc-4168-864a-88299645af71 service nova] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Received unexpected event network-vif-plugged-73050cb9-2ff8-45ec-b6fa-d54d5c717f25 for instance with vm_state building and task_state spawning.
Nov 28 11:05:27 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:27 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:27 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG nova.compute.manager [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 11:05:29 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Creating image(s)
Nov 28 11:05:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Did not create local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Ensure instance console log exists: /opt/stack/data/nova/instances/e3b0b960-3f38-4a6f-9017-209fbc2110c9/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Start _get_guest_xml network_info=[{"id": "17fb7783-f3dc-41cf-b838-004f2048fdbc", "address": "fa:16:3e:b7:31:25", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17fb7783-f3", "ovs_interfaceid": "17fb7783-f3dc-41cf-b838-004f2048fdbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kCgmHZjw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e3b0b960-3f38-4a6f-9017-209fbc2110c9', 'attached_at': '', 'detached_at': '', 'volume_id': 'cc3edc15-080f-4593-9a75-5d2719dfe0dd', 'serial': 'cc3edc15-080f-4593-9a75-5d2719dfe0dd'}, 'attachment_id': '1fda6fdd-be6b-4713-9cf5-dfd8a7004489', 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 11:05:29 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:05:29 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:05:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kCgmHZjw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:05:29 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:05:29 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:05:29 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:05:29 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:05:29 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 11:05:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2845dffa-cfe0-456f-a79e-dde681b43101]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 11:05:29 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5fe381d-b424-4b99-b9b9-491b73efc744]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd] added
Nov 28 11:05:29 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4665d7a-b939-4a9a-b600-8de5755473f6]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Acquiring lock "a2caa913-b0cc-46b7-b90d-fe507bc00b09" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "a2caa913-b0cc-46b7-b90d-fe507bc00b09" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG nova.compute.manager [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c64f01-8683-4727-bba3-9885205bff28]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kCgmHZjw {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kCgmHZjw" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[af25ba9e-4bfa-4dd5-aae1-1f1d57ee4c35]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kCgmHZjw'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb76741-742a-48d7-a2cd-6aafb2c94c53]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-0b261677-30d8-479c-b73c-9df92e0a99d6 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Acquiring lock "d1de4238-c33e-48a6-bb4f-240e91e81ea3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-0b261677-30d8-479c-b73c-9df92e0a99d6 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "d1de4238-c33e-48a6-bb4f-240e91e81ea3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-0b261677-30d8-479c-b73c-9df92e0a99d6 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Acquiring lock "d1de4238-c33e-48a6-bb4f-240e91e81ea3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-0b261677-30d8-479c-b73c-9df92e0a99d6 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "d1de4238-c33e-48a6-bb4f-240e91e81ea3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-0b261677-30d8-479c-b73c-9df92e0a99d6 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "d1de4238-c33e-48a6-bb4f-240e91e81ea3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:05:29 user nova-compute[74994]: INFO nova.compute.manager [None req-0b261677-30d8-479c-b73c-9df92e0a99d6 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Terminating instance
Nov 28 11:05:29 user nova-compute[74994]: DEBUG nova.compute.manager [None req-0b261677-30d8-479c-b73c-9df92e0a99d6 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06758b9-2d39-4f43-a2f2-eff8f43727ee]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:05:29 user nova-compute[74994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)
Nov 28 11:05:29 user nova-compute[74994]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320 (non-flash)
Nov 28 11:05:29 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:05:29 user nova-compute[74994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)
Nov 28 11:05:29 user nova-compute[74994]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320 (non-flash)
Nov 28 11:05:29 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 11:05:29 user nova-compute[74994]: INFO nova.compute.claims [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Claim successful on node user
Nov 28 11:05:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e661819c-6803-4fe2-9565-ed86e1f3e527]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd, portal: 172.16.0.220,3260]
Nov 28 11:05:29 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd, portal: 172.16.0.220,3260] successful.
Nov 28 11:05:29 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d87e2da-d1e0-4872-a3fb-07946e1524f9]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d855dc0a-4552-407f-8b2b-beb1e85374a4]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:05:29 user nova-compute[74994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)
Nov 28 11:05:29 user nova-compute[74994]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320 (non-flash)
Nov 28 11:05:29 user nova-compute[74994]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)
Nov 28 11:05:29 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:05:29 user nova-compute[74994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)
Nov 28 11:05:29 user nova-compute[74994]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320 (non-flash)
Nov 28 11:05:29 user nova-compute[74994]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)
Nov 28 11:05:29 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG nova.compute.manager [req-452566c0-9d44-43f5-9aaf-7ee7bf35f0c7 req-7f0c64a8-b27f-490e-bc2d-2b3f67078746 service nova] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Received event network-vif-plugged-73050cb9-2ff8-45ec-b6fa-d54d5c717f25 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-452566c0-9d44-43f5-9aaf-7ee7bf35f0c7 req-7f0c64a8-b27f-490e-bc2d-2b3f67078746 service nova] Acquiring lock "0f267741-9611-4812-9afa-32717d16abc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-452566c0-9d44-43f5-9aaf-7ee7bf35f0c7 req-7f0c64a8-b27f-490e-bc2d-2b3f67078746 service nova] Lock "0f267741-9611-4812-9afa-32717d16abc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-452566c0-9d44-43f5-9aaf-7ee7bf35f0c7 req-7f0c64a8-b27f-490e-bc2d-2b3f67078746 service nova] Lock "0f267741-9611-4812-9afa-32717d16abc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG nova.compute.manager [req-452566c0-9d44-43f5-9aaf-7ee7bf35f0c7 req-7f0c64a8-b27f-490e-bc2d-2b3f67078746 service nova] [instance: 0f267741-9611-4812-9afa-32717d16abc5] No waiting events found dispatching network-vif-plugged-73050cb9-2ff8-45ec-b6fa-d54d5c717f25 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:05:29 user nova-compute[74994]: WARNING nova.compute.manager [req-452566c0-9d44-43f5-9aaf-7ee7bf35f0c7 req-7f0c64a8-b27f-490e-bc2d-2b3f67078746 service nova] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Received unexpected event network-vif-plugged-73050cb9-2ff8-45ec-b6fa-d54d5c717f25 for instance with vm_state building and task_state spawning.
Nov 28 11:05:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.034s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1009a9f1-7b68-47b3-a875-5e4a468adcb5]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kCgmHZjw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG nova.compute.manager [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 11:05:29 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Instance spawned successfully.
Nov 28 11:05:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:05:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:29 user nova-compute[74994]: INFO nova.compute.manager [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Took 7.67 seconds to spawn the instance on the hypervisor.
Nov 28 11:05:29 user nova-compute[74994]: DEBUG nova.compute.manager [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 11:05:30 user nova-compute[74994]: INFO nova.compute.manager [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Took 9.48 seconds to build instance.
Nov 28 11:05:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-95cf92e7-edd3-4c17-bc9f-aa8451cb906e tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "0f267741-9611-4812-9afa-32717d16abc5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.651s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:05:30 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Instance destroyed successfully.
Nov 28 11:05:30 user nova-compute[74994]: DEBUG nova.objects.instance [None req-0b261677-30d8-479c-b73c-9df92e0a99d6 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lazy-loading 'resources' on Instance uuid d1de4238-c33e-48a6-bb4f-240e91e81ea3 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-0b261677-30d8-479c-b73c-9df92e0a99d6 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:00:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-342030530',display_name='tempest-TestMinimumBasicScenario-server-342030530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-342030530',id=29,image_ref='72081665-97f0-4d07-85e6-e93aff963a9d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyVQMduM13BgMZJIMtke6rN9ybjpOOFWz20TU2DvJ+OA7UvylvkmeAOhXrqzo0DECLS+nqoTXK7yvdL4DWRjTgwl0mH1+2xXyPyunJt/UXv2mIQhL1IpGRflfXkBiMUuw==',key_name='tempest-TestMinimumBasicScenario-928079813',keypairs=<?>,launch_index=0,launched_at=2023-11-28T11:00:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9670a509ac14f41a9f44d7299fd2f30',ramdisk_id='',reservation_id='r-soytlw4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='72081665-97f0-4d07-85e6-e93aff963a9d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-756572202',owner_user_name='tempest-TestMinimumBasicScenario-756572202-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T11:02:50Z,user_data=None,user_id='18ba016046ac42599094e626d3fdd860',uuid=d1de4238-c33e-48a6-bb4f-240e91e81ea3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e3ec524f-0e85-40e1-8817-b9d4b75f9966", "address": "fa:16:3e:99:ce:ce", "network": {"id": "89f2b906-9ef3-4e31-87e5-3e0cd23e8695", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2005181920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9670a509ac14f41a9f44d7299fd2f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3ec524f-0e", "ovs_interfaceid": "e3ec524f-0e85-40e1-8817-b9d4b75f9966", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-0b261677-30d8-479c-b73c-9df92e0a99d6 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Converting VIF {"id": "e3ec524f-0e85-40e1-8817-b9d4b75f9966", "address": "fa:16:3e:99:ce:ce", "network": {"id": "89f2b906-9ef3-4e31-87e5-3e0cd23e8695", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2005181920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9670a509ac14f41a9f44d7299fd2f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3ec524f-0e", "ovs_interfaceid": "e3ec524f-0e85-40e1-8817-b9d4b75f9966", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-0b261677-30d8-479c-b73c-9df92e0a99d6 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:ce:ce,bridge_name='br-int',has_traffic_filtering=True,id=e3ec524f-0e85-40e1-8817-b9d4b75f9966,network=Network(89f2b906-9ef3-4e31-87e5-3e0cd23e8695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3ec524f-0e') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG os_vif [None req-0b261677-30d8-479c-b73c-9df92e0a99d6 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:ce:ce,bridge_name='br-int',has_traffic_filtering=True,id=e3ec524f-0e85-40e1-8817-b9d4b75f9966,network=Network(89f2b906-9ef3-4e31-87e5-3e0cd23e8695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3ec524f-0e') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape3ec524f-0e, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.993s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG nova.compute.manager [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3864a64a-7478-424f-af05-1aae6e5f3f5d) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:30 user nova-compute[74994]: INFO os_vif [None req-0b261677-30d8-479c-b73c-9df92e0a99d6 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:ce:ce,bridge_name='br-int',has_traffic_filtering=True,id=e3ec524f-0e85-40e1-8817-b9d4b75f9966,network=Network(89f2b906-9ef3-4e31-87e5-3e0cd23e8695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3ec524f-0e')
Nov 28 11:05:30 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-0b261677-30d8-479c-b73c-9df92e0a99d6 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Deleting instance files /opt/stack/data/nova/instances/d1de4238-c33e-48a6-bb4f-240e91e81ea3_del
Nov 28 11:05:30 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-0b261677-30d8-479c-b73c-9df92e0a99d6 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Deletion of /opt/stack/data/nova/instances/d1de4238-c33e-48a6-bb4f-240e91e81ea3_del complete
Nov 28 11:05:30 user nova-compute[74994]: DEBUG nova.compute.manager [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG nova.network.neutron [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 11:05:30 user nova-compute[74994]: INFO nova.compute.manager [None req-0b261677-30d8-479c-b73c-9df92e0a99d6 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 28 11:05:30 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-0b261677-30d8-479c-b73c-9df92e0a99d6 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 11:05:30 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 11:05:30 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.416s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] <== connect_volume: return (1418ms) {'type': 'block', 'scsi_wwn': '23832326235376232', 'path': '/dev/sdc'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832326235376232', 'path': '/dev/sdc'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG nova.compute.manager [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:05:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1667657680',display_name='tempest-ServerActionsTestOtherA-server-1667657680',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1667657680',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPW6Lty9ow0zAcm936yuU8WeLpHxpamSCaeKsFRdduK4jmYnIbGWXIhKjvJDlhN8evt/Hb3F2U1wYmR8qRXarp7uOZi0MsdjDWCq+Ku3i87+sooae0XVTHruzSkrMSatFQ==',key_name='tempest-keypair-1409463142',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5eb43a8fc7bd47728600741762f71112',ramdisk_id='',reservation_id='r-d1wwwslj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1927948343',owner_user_name='tempest-ServerActionsTestOtherA-1927948343-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:05:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d51be473c7284977a6533756a1f677f9',uuid=e3b0b960-3f38-4a6f-9017-209fbc2110c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17fb7783-f3dc-41cf-b838-004f2048fdbc", "address": "fa:16:3e:b7:31:25", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17fb7783-f3", "ovs_interfaceid": "17fb7783-f3dc-41cf-b838-004f2048fdbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Converting VIF {"id": "17fb7783-f3dc-41cf-b838-004f2048fdbc", "address": "fa:16:3e:b7:31:25", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17fb7783-f3", "ovs_interfaceid": "17fb7783-f3dc-41cf-b838-004f2048fdbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:31:25,bridge_name='br-int',has_traffic_filtering=True,id=17fb7783-f3dc-41cf-b838-004f2048fdbc,network=Network(16dd32cd-5a00-4111-92e2-283e7635540f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17fb7783-f3') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG nova.objects.instance [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lazy-loading 'pci_devices' on Instance uuid e3b0b960-3f38-4a6f-9017-209fbc2110c9 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] End _get_guest_xml xml=<domain type="kvm">
Nov 28 11:05:30 user nova-compute[74994]:   <uuid>e3b0b960-3f38-4a6f-9017-209fbc2110c9</uuid>
Nov 28 11:05:30 user nova-compute[74994]:   <name>instance-00000020</name>
Nov 28 11:05:30 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 11:05:30 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 11:05:30 user nova-compute[74994]:   <metadata>
Nov 28 11:05:30 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 11:05:30 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 11:05:30 user nova-compute[74994]:       <nova:name>tempest-ServerActionsTestOtherA-server-1667657680</nova:name>
Nov 28 11:05:30 user nova-compute[74994]:       <nova:creationTime>2023-11-28 11:05:29</nova:creationTime>
Nov 28 11:05:30 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 11:05:30 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 11:05:30 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 11:05:30 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 11:05:30 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 11:05:30 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 11:05:30 user nova-compute[74994]:       </nova:flavor>
Nov 28 11:05:30 user nova-compute[74994]:       <nova:owner>
Nov 28 11:05:30 user nova-compute[74994]:         <nova:user uuid="d51be473c7284977a6533756a1f677f9">tempest-ServerActionsTestOtherA-1927948343-project-member</nova:user>
Nov 28 11:05:30 user nova-compute[74994]:         <nova:project uuid="5eb43a8fc7bd47728600741762f71112">tempest-ServerActionsTestOtherA-1927948343</nova:project>
Nov 28 11:05:30 user nova-compute[74994]:       </nova:owner>
Nov 28 11:05:30 user nova-compute[74994]:       <nova:ports>
Nov 28 11:05:30 user nova-compute[74994]:         <nova:port uuid="17fb7783-f3dc-41cf-b838-004f2048fdbc">
Nov 28 11:05:30 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 11:05:30 user nova-compute[74994]:         </nova:port>
Nov 28 11:05:30 user nova-compute[74994]:       </nova:ports>
Nov 28 11:05:30 user nova-compute[74994]:     </nova:instance>
Nov 28 11:05:30 user nova-compute[74994]:   </metadata>
Nov 28 11:05:30 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 11:05:30 user nova-compute[74994]:     <system>
Nov 28 11:05:30 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 11:05:30 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 11:05:30 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 11:05:30 user nova-compute[74994]:       <entry name="serial">e3b0b960-3f38-4a6f-9017-209fbc2110c9</entry>
Nov 28 11:05:30 user nova-compute[74994]:       <entry name="uuid">e3b0b960-3f38-4a6f-9017-209fbc2110c9</entry>
Nov 28 11:05:30 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 11:05:30 user nova-compute[74994]:     </system>
Nov 28 11:05:30 user nova-compute[74994]:   </sysinfo>
Nov 28 11:05:30 user nova-compute[74994]:   <os>
Nov 28 11:05:30 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 11:05:30 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 11:05:30 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 11:05:30 user nova-compute[74994]:   </os>
Nov 28 11:05:30 user nova-compute[74994]:   <features>
Nov 28 11:05:30 user nova-compute[74994]:     <acpi/>
Nov 28 11:05:30 user nova-compute[74994]:     <apic/>
Nov 28 11:05:30 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 11:05:30 user nova-compute[74994]:   </features>
Nov 28 11:05:30 user nova-compute[74994]:   <clock offset="utc">
Nov 28 11:05:30 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 11:05:30 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 11:05:30 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 11:05:30 user nova-compute[74994]:   </clock>
Nov 28 11:05:30 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 11:05:30 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 11:05:30 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 11:05:30 user nova-compute[74994]:   </cpu>
Nov 28 11:05:30 user nova-compute[74994]:   <devices>
Nov 28 11:05:30 user nova-compute[74994]:     <disk type="block" device="disk">
Nov 28 11:05:30 user nova-compute[74994]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:05:30 user nova-compute[74994]:       <source dev="/dev/sdc"/>
Nov 28 11:05:30 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 11:05:30 user nova-compute[74994]:       <serial>cc3edc15-080f-4593-9a75-5d2719dfe0dd</serial>
Nov 28 11:05:30 user nova-compute[74994]:     </disk>
Nov 28 11:05:30 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 11:05:30 user nova-compute[74994]:       <mac address="fa:16:3e:b7:31:25"/>
Nov 28 11:05:30 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:05:30 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 11:05:30 user nova-compute[74994]:       <target dev="tap17fb7783-f3"/>
Nov 28 11:05:30 user nova-compute[74994]:     </interface>
Nov 28 11:05:30 user nova-compute[74994]:     <serial type="pty">
Nov 28 11:05:30 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/e3b0b960-3f38-4a6f-9017-209fbc2110c9/console.log" append="off"/>
Nov 28 11:05:30 user nova-compute[74994]:     </serial>
Nov 28 11:05:30 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 11:05:30 user nova-compute[74994]:     <video>
Nov 28 11:05:30 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:05:30 user nova-compute[74994]:     </video>
Nov 28 11:05:30 user nova-compute[74994]:     <rng model="virtio">
Nov 28 11:05:30 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 11:05:30 user nova-compute[74994]:     </rng>
Nov 28 11:05:30 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 11:05:30 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 11:05:30 user nova-compute[74994]:       <stats period="10"/>
Nov 28 11:05:30 user nova-compute[74994]:     </memballoon>
Nov 28 11:05:30 user nova-compute[74994]:   </devices>
Nov 28 11:05:30 user nova-compute[74994]: </domain>
Nov 28 11:05:30 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:05:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1667657680',display_name='tempest-ServerActionsTestOtherA-server-1667657680',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1667657680',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPW6Lty9ow0zAcm936yuU8WeLpHxpamSCaeKsFRdduK4jmYnIbGWXIhKjvJDlhN8evt/Hb3F2U1wYmR8qRXarp7uOZi0MsdjDWCq+Ku3i87+sooae0XVTHruzSkrMSatFQ==',key_name='tempest-keypair-1409463142',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5eb43a8fc7bd47728600741762f71112',ramdisk_id='',reservation_id='r-d1wwwslj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1927948343',owner_user_name='tempest-ServerActionsTestOtherA-1927948343-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:05:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d51be473c7284977a6533756a1f677f9',uuid=e3b0b960-3f38-4a6f-9017-209fbc2110c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17fb7783-f3dc-41cf-b838-004f2048fdbc", "address": "fa:16:3e:b7:31:25", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17fb7783-f3", "ovs_interfaceid": "17fb7783-f3dc-41cf-b838-004f2048fdbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Converting VIF {"id": "17fb7783-f3dc-41cf-b838-004f2048fdbc", "address": "fa:16:3e:b7:31:25", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17fb7783-f3", "ovs_interfaceid": "17fb7783-f3dc-41cf-b838-004f2048fdbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:31:25,bridge_name='br-int',has_traffic_filtering=True,id=17fb7783-f3dc-41cf-b838-004f2048fdbc,network=Network(16dd32cd-5a00-4111-92e2-283e7635540f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17fb7783-f3') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG os_vif [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:31:25,bridge_name='br-int',has_traffic_filtering=True,id=17fb7783-f3dc-41cf-b838-004f2048fdbc,network=Network(16dd32cd-5a00-4111-92e2-283e7635540f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17fb7783-f3') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '079cbe4e-57a1-577a-96db-314841512102', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap17fb7783-f3, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap17fb7783-f3, col_values=(('qos', UUID('71f7541a-f35a-4b5b-8534-961344fd6564')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap17fb7783-f3, col_values=(('external_ids', {'iface-id': '17fb7783-f3dc-41cf-b838-004f2048fdbc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:31:25', 'vm-uuid': 'e3b0b960-3f38-4a6f-9017-209fbc2110c9'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:30 user nova-compute[74994]: INFO os_vif [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:31:25,bridge_name='br-int',has_traffic_filtering=True,id=17fb7783-f3dc-41cf-b838-004f2048fdbc,network=Network(16dd32cd-5a00-4111-92e2-283e7635540f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17fb7783-f3')
Nov 28 11:05:30 user nova-compute[74994]: DEBUG nova.compute.manager [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 11:05:30 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Creating image(s)
Nov 28 11:05:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Acquiring lock "/opt/stack/data/nova/instances/a2caa913-b0cc-46b7-b90d-fe507bc00b09/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "/opt/stack/data/nova/instances/a2caa913-b0cc-46b7-b90d-fe507bc00b09/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "/opt/stack/data/nova/instances/a2caa913-b0cc-46b7-b90d-fe507bc00b09/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] No VIF found with MAC fa:16:3e:b7:31:25, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.263s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Acquiring lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:05:30 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:31 user nova-compute[74994]: DEBUG nova.policy [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c4e1257b844940bebdeab3061c3e0ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4dcdeafd6420d8606b37673e3255f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 11:05:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.363s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/a2caa913-b0cc-46b7-b90d-fe507bc00b09/disk 1073741824 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/a2caa913-b0cc-46b7-b90d-fe507bc00b09/disk 1073741824" returned: 0 in 0.104s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.476s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:05:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:31 user nova-compute[74994]: DEBUG nova.compute.manager [req-ac46f700-3b71-41c2-b92a-a457cee44165 req-e196ca47-1ef4-4d5f-9c86-3228b4d44551 service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Received event network-vif-unplugged-e3ec524f-0e85-40e1-8817-b9d4b75f9966 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:05:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ac46f700-3b71-41c2-b92a-a457cee44165 req-e196ca47-1ef4-4d5f-9c86-3228b4d44551 service nova] Acquiring lock "d1de4238-c33e-48a6-bb4f-240e91e81ea3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:05:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ac46f700-3b71-41c2-b92a-a457cee44165 req-e196ca47-1ef4-4d5f-9c86-3228b4d44551 service nova] Lock "d1de4238-c33e-48a6-bb4f-240e91e81ea3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:05:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ac46f700-3b71-41c2-b92a-a457cee44165 req-e196ca47-1ef4-4d5f-9c86-3228b4d44551 service nova] Lock "d1de4238-c33e-48a6-bb4f-240e91e81ea3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:05:31 user nova-compute[74994]: DEBUG nova.compute.manager [req-ac46f700-3b71-41c2-b92a-a457cee44165 req-e196ca47-1ef4-4d5f-9c86-3228b4d44551 service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] No waiting events found dispatching network-vif-unplugged-e3ec524f-0e85-40e1-8817-b9d4b75f9966 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:05:31 user nova-compute[74994]: DEBUG nova.compute.manager [req-ac46f700-3b71-41c2-b92a-a457cee44165 req-e196ca47-1ef4-4d5f-9c86-3228b4d44551 service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Received event network-vif-unplugged-e3ec524f-0e85-40e1-8817-b9d4b75f9966 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 11:05:31 user nova-compute[74994]: DEBUG nova.compute.manager [req-ac46f700-3b71-41c2-b92a-a457cee44165 req-e196ca47-1ef4-4d5f-9c86-3228b4d44551 service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Received event network-vif-plugged-e3ec524f-0e85-40e1-8817-b9d4b75f9966 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:05:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ac46f700-3b71-41c2-b92a-a457cee44165 req-e196ca47-1ef4-4d5f-9c86-3228b4d44551 service nova] Acquiring lock "d1de4238-c33e-48a6-bb4f-240e91e81ea3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:05:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ac46f700-3b71-41c2-b92a-a457cee44165 req-e196ca47-1ef4-4d5f-9c86-3228b4d44551 service nova] Lock "d1de4238-c33e-48a6-bb4f-240e91e81ea3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:05:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ac46f700-3b71-41c2-b92a-a457cee44165 req-e196ca47-1ef4-4d5f-9c86-3228b4d44551 service nova] Lock "d1de4238-c33e-48a6-bb4f-240e91e81ea3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:05:31 user nova-compute[74994]: DEBUG nova.compute.manager [req-ac46f700-3b71-41c2-b92a-a457cee44165 req-e196ca47-1ef4-4d5f-9c86-3228b4d44551 service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] No waiting events found dispatching network-vif-plugged-e3ec524f-0e85-40e1-8817-b9d4b75f9966 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:05:31 user nova-compute[74994]: WARNING nova.compute.manager [req-ac46f700-3b71-41c2-b92a-a457cee44165 req-e196ca47-1ef4-4d5f-9c86-3228b4d44551 service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Received unexpected event network-vif-plugged-e3ec524f-0e85-40e1-8817-b9d4b75f9966 for instance with vm_state active and task_state deleting.
Nov 28 11:05:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.261s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:31 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a2caa913-b0cc-46b7-b90d-fe507bc00b09/disk. size=1073741824 {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 11:05:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2caa913-b0cc-46b7-b90d-fe507bc00b09/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2caa913-b0cc-46b7-b90d-fe507bc00b09/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:31 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Cannot resize image /opt/stack/data/nova/instances/a2caa913-b0cc-46b7-b90d-fe507bc00b09/disk to a smaller size. {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 11:05:31 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Created local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 11:05:31 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Ensure instance console log exists: /opt/stack/data/nova/instances/a2caa913-b0cc-46b7-b90d-fe507bc00b09/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 11:05:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:05:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:05:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:05:32 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:05:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:32 user nova-compute[74994]: DEBUG nova.compute.manager [req-b42273e3-79dd-4ca2-8397-7440a93e1c79 req-65b5d8e8-3889-4d1a-be09-5a89693a43e6 service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Received event network-vif-deleted-e3ec524f-0e85-40e1-8817-b9d4b75f9966 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:05:32 user nova-compute[74994]: INFO nova.compute.manager [req-b42273e3-79dd-4ca2-8397-7440a93e1c79 req-65b5d8e8-3889-4d1a-be09-5a89693a43e6 service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Neutron deleted interface e3ec524f-0e85-40e1-8817-b9d4b75f9966; detaching it from the instance and deleting it from the info cache
Nov 28 11:05:32 user nova-compute[74994]: DEBUG nova.network.neutron [req-b42273e3-79dd-4ca2-8397-7440a93e1c79 req-65b5d8e8-3889-4d1a-be09-5a89693a43e6 service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:05:32 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Took 1.68 seconds to deallocate network for instance.
Nov 28 11:05:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:32 user nova-compute[74994]: DEBUG nova.compute.manager [req-b42273e3-79dd-4ca2-8397-7440a93e1c79 req-65b5d8e8-3889-4d1a-be09-5a89693a43e6 service nova] [instance: d1de4238-c33e-48a6-bb4f-240e91e81ea3] Detach interface failed, port_id=e3ec524f-0e85-40e1-8817-b9d4b75f9966, reason: Instance d1de4238-c33e-48a6-bb4f-240e91e81ea3 could not be found. {{(pid=74994) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 11:05:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-0b261677-30d8-479c-b73c-9df92e0a99d6 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:05:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-0b261677-30d8-479c-b73c-9df92e0a99d6 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:05:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:32 user nova-compute[74994]: DEBUG nova.compute.manager [req-8d60261e-5b88-4742-8a6a-d818899b1bec req-7137c091-e9fd-4d32-92a3-1ed0536f5bb2 service nova] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Received event network-vif-plugged-17fb7783-f3dc-41cf-b838-004f2048fdbc {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:05:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8d60261e-5b88-4742-8a6a-d818899b1bec req-7137c091-e9fd-4d32-92a3-1ed0536f5bb2 service nova] Acquiring lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:05:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8d60261e-5b88-4742-8a6a-d818899b1bec req-7137c091-e9fd-4d32-92a3-1ed0536f5bb2 service nova] Lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:05:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8d60261e-5b88-4742-8a6a-d818899b1bec req-7137c091-e9fd-4d32-92a3-1ed0536f5bb2 service nova] Lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:05:32 user nova-compute[74994]: DEBUG nova.compute.manager [req-8d60261e-5b88-4742-8a6a-d818899b1bec req-7137c091-e9fd-4d32-92a3-1ed0536f5bb2 service nova] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] No waiting events found dispatching network-vif-plugged-17fb7783-f3dc-41cf-b838-004f2048fdbc {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:05:32 user nova-compute[74994]: WARNING nova.compute.manager [req-8d60261e-5b88-4742-8a6a-d818899b1bec req-7137c091-e9fd-4d32-92a3-1ed0536f5bb2 service nova] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Received unexpected event network-vif-plugged-17fb7783-f3dc-41cf-b838-004f2048fdbc for instance with vm_state building and task_state spawning.
Nov 28 11:05:32 user nova-compute[74994]: DEBUG nova.network.neutron [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Successfully created port: 69c7a712-9905-4a77-a0ae-cd64dbd347fd {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 11:05:32 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-0b261677-30d8-479c-b73c-9df92e0a99d6 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:05:32 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-0b261677-30d8-479c-b73c-9df92e0a99d6 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:05:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-0b261677-30d8-479c-b73c-9df92e0a99d6 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.515s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:05:32 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-0b261677-30d8-479c-b73c-9df92e0a99d6 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Deleted allocations for instance d1de4238-c33e-48a6-bb4f-240e91e81ea3
Nov 28 11:05:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-0b261677-30d8-479c-b73c-9df92e0a99d6 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "d1de4238-c33e-48a6-bb4f-240e91e81ea3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.627s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:05:33 user nova-compute[74994]: DEBUG nova.network.neutron [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Successfully updated port: 69c7a712-9905-4a77-a0ae-cd64dbd347fd {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 11:05:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Acquiring lock "refresh_cache-a2caa913-b0cc-46b7-b90d-fe507bc00b09" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:05:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Acquired lock "refresh_cache-a2caa913-b0cc-46b7-b90d-fe507bc00b09" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:05:33 user nova-compute[74994]: DEBUG nova.network.neutron [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 11:05:33 user nova-compute[74994]: DEBUG nova.network.neutron [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG nova.network.neutron [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Updating instance_info_cache with network_info: [{"id": "69c7a712-9905-4a77-a0ae-cd64dbd347fd", "address": "fa:16:3e:38:2c:b1", "network": {"id": "d46e72ec-d7d5-45f7-951a-b4381f0b472b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-179057367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a4dcdeafd6420d8606b37673e3255f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c7a712-99", "ovs_interfaceid": "69c7a712-9905-4a77-a0ae-cd64dbd347fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Releasing lock "refresh_cache-a2caa913-b0cc-46b7-b90d-fe507bc00b09" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG nova.compute.manager [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Instance network_info: |[{"id": "69c7a712-9905-4a77-a0ae-cd64dbd347fd", "address": "fa:16:3e:38:2c:b1", "network": {"id": "d46e72ec-d7d5-45f7-951a-b4381f0b472b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-179057367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a4dcdeafd6420d8606b37673e3255f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c7a712-99", "ovs_interfaceid": "69c7a712-9905-4a77-a0ae-cd64dbd347fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Start _get_guest_xml network_info=[{"id": "69c7a712-9905-4a77-a0ae-cd64dbd347fd", "address": "fa:16:3e:38:2c:b1", "network": {"id": "d46e72ec-d7d5-45f7-951a-b4381f0b472b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-179057367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a4dcdeafd6420d8606b37673e3255f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c7a712-99", "ovs_interfaceid": "69c7a712-9905-4a77-a0ae-cd64dbd347fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'aa939d1b-b8a6-4391-935b-0191bf5ccd0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 11:05:34 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:05:34 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:05:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:05:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1217374859',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1217374859',id=34,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPC+y5ycUWPYQy2XZB6kzbHT0mcdyeioMthsGLt6Hmxof5Ngy9OG06XF/Ob1BE/FlbLo4NkWH5tRCW3J+w+6D0hmLq2Ga7sCt9VMBIw+oANqnW44474dY78DHKN2+O8dQ==',key_name='tempest-keypair-328848665',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d3a4dcdeafd6420d8606b37673e3255f',ramdisk_id='',reservation_id='r-taf8uoy1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1700061593',owner_user_name='tempest-AttachVolumeShelveTestJSON-1700061593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:05:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4e1257b844940bebdeab3061c3e0ab4',uuid=a2caa913-b0cc-46b7-b90d-fe507bc00b09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69c7a712-9905-4a77-a0ae-cd64dbd347fd", "address": "fa:16:3e:38:2c:b1", "network": {"id": "d46e72ec-d7d5-45f7-951a-b4381f0b472b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-179057367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a4dcdeafd6420d8606b37673e3255f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c7a712-99", "ovs_interfaceid": "69c7a712-9905-4a77-a0ae-cd64dbd347fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Converting VIF {"id": "69c7a712-9905-4a77-a0ae-cd64dbd347fd", "address": "fa:16:3e:38:2c:b1", "network": {"id": "d46e72ec-d7d5-45f7-951a-b4381f0b472b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-179057367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a4dcdeafd6420d8606b37673e3255f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c7a712-99", "ovs_interfaceid": "69c7a712-9905-4a77-a0ae-cd64dbd347fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:2c:b1,bridge_name='br-int',has_traffic_filtering=True,id=69c7a712-9905-4a77-a0ae-cd64dbd347fd,network=Network(d46e72ec-d7d5-45f7-951a-b4381f0b472b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69c7a712-99') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG nova.objects.instance [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lazy-loading 'pci_devices' on Instance uuid a2caa913-b0cc-46b7-b90d-fe507bc00b09 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG nova.compute.manager [req-40ac396e-3185-4b2c-82bd-fb63d7c8f99b req-ada3aee6-580d-440d-b3f2-f55d1e60e282 service nova] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Received event network-changed-69c7a712-9905-4a77-a0ae-cd64dbd347fd {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG nova.compute.manager [req-40ac396e-3185-4b2c-82bd-fb63d7c8f99b req-ada3aee6-580d-440d-b3f2-f55d1e60e282 service nova] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Refreshing instance network info cache due to event network-changed-69c7a712-9905-4a77-a0ae-cd64dbd347fd. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-40ac396e-3185-4b2c-82bd-fb63d7c8f99b req-ada3aee6-580d-440d-b3f2-f55d1e60e282 service nova] Acquiring lock "refresh_cache-a2caa913-b0cc-46b7-b90d-fe507bc00b09" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-40ac396e-3185-4b2c-82bd-fb63d7c8f99b req-ada3aee6-580d-440d-b3f2-f55d1e60e282 service nova] Acquired lock "refresh_cache-a2caa913-b0cc-46b7-b90d-fe507bc00b09" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG nova.network.neutron [req-40ac396e-3185-4b2c-82bd-fb63d7c8f99b req-ada3aee6-580d-440d-b3f2-f55d1e60e282 service nova] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Refreshing network info cache for port 69c7a712-9905-4a77-a0ae-cd64dbd347fd {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] End _get_guest_xml xml=<domain type="kvm">
Nov 28 11:05:34 user nova-compute[74994]:   <uuid>a2caa913-b0cc-46b7-b90d-fe507bc00b09</uuid>
Nov 28 11:05:34 user nova-compute[74994]:   <name>instance-00000022</name>
Nov 28 11:05:34 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 11:05:34 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 11:05:34 user nova-compute[74994]:   <metadata>
Nov 28 11:05:34 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 11:05:34 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 11:05:34 user nova-compute[74994]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1217374859</nova:name>
Nov 28 11:05:34 user nova-compute[74994]:       <nova:creationTime>2023-11-28 11:05:34</nova:creationTime>
Nov 28 11:05:34 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 11:05:34 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 11:05:34 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 11:05:34 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 11:05:34 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 11:05:34 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 11:05:34 user nova-compute[74994]:       </nova:flavor>
Nov 28 11:05:34 user nova-compute[74994]:       <nova:owner>
Nov 28 11:05:34 user nova-compute[74994]:         <nova:user uuid="c4e1257b844940bebdeab3061c3e0ab4">tempest-AttachVolumeShelveTestJSON-1700061593-project-member</nova:user>
Nov 28 11:05:34 user nova-compute[74994]:         <nova:project uuid="d3a4dcdeafd6420d8606b37673e3255f">tempest-AttachVolumeShelveTestJSON-1700061593</nova:project>
Nov 28 11:05:34 user nova-compute[74994]:       </nova:owner>
Nov 28 11:05:34 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 11:05:34 user nova-compute[74994]:       <nova:ports>
Nov 28 11:05:34 user nova-compute[74994]:         <nova:port uuid="69c7a712-9905-4a77-a0ae-cd64dbd347fd">
Nov 28 11:05:34 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 28 11:05:34 user nova-compute[74994]:         </nova:port>
Nov 28 11:05:34 user nova-compute[74994]:       </nova:ports>
Nov 28 11:05:34 user nova-compute[74994]:     </nova:instance>
Nov 28 11:05:34 user nova-compute[74994]:   </metadata>
Nov 28 11:05:34 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 11:05:34 user nova-compute[74994]:     <system>
Nov 28 11:05:34 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 11:05:34 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 11:05:34 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 11:05:34 user nova-compute[74994]:       <entry name="serial">a2caa913-b0cc-46b7-b90d-fe507bc00b09</entry>
Nov 28 11:05:34 user nova-compute[74994]:       <entry name="uuid">a2caa913-b0cc-46b7-b90d-fe507bc00b09</entry>
Nov 28 11:05:34 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 11:05:34 user nova-compute[74994]:     </system>
Nov 28 11:05:34 user nova-compute[74994]:   </sysinfo>
Nov 28 11:05:34 user nova-compute[74994]:   <os>
Nov 28 11:05:34 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 11:05:34 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 11:05:34 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 11:05:34 user nova-compute[74994]:   </os>
Nov 28 11:05:34 user nova-compute[74994]:   <features>
Nov 28 11:05:34 user nova-compute[74994]:     <acpi/>
Nov 28 11:05:34 user nova-compute[74994]:     <apic/>
Nov 28 11:05:34 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 11:05:34 user nova-compute[74994]:   </features>
Nov 28 11:05:34 user nova-compute[74994]:   <clock offset="utc">
Nov 28 11:05:34 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 11:05:34 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 11:05:34 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 11:05:34 user nova-compute[74994]:   </clock>
Nov 28 11:05:34 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 11:05:34 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 11:05:34 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 11:05:34 user nova-compute[74994]:   </cpu>
Nov 28 11:05:34 user nova-compute[74994]:   <devices>
Nov 28 11:05:34 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 11:05:34 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 11:05:34 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/a2caa913-b0cc-46b7-b90d-fe507bc00b09/disk"/>
Nov 28 11:05:34 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 11:05:34 user nova-compute[74994]:     </disk>
Nov 28 11:05:34 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 11:05:34 user nova-compute[74994]:       <mac address="fa:16:3e:38:2c:b1"/>
Nov 28 11:05:34 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:05:34 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 11:05:34 user nova-compute[74994]:       <target dev="tap69c7a712-99"/>
Nov 28 11:05:34 user nova-compute[74994]:     </interface>
Nov 28 11:05:34 user nova-compute[74994]:     <serial type="pty">
Nov 28 11:05:34 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/a2caa913-b0cc-46b7-b90d-fe507bc00b09/console.log" append="off"/>
Nov 28 11:05:34 user nova-compute[74994]:     </serial>
Nov 28 11:05:34 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 11:05:34 user nova-compute[74994]:     <video>
Nov 28 11:05:34 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:05:34 user nova-compute[74994]:     </video>
Nov 28 11:05:34 user nova-compute[74994]:     <rng model="virtio">
Nov 28 11:05:34 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 11:05:34 user nova-compute[74994]:     </rng>
Nov 28 11:05:34 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 11:05:34 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 11:05:34 user nova-compute[74994]:       <stats period="10"/>
Nov 28 11:05:34 user nova-compute[74994]:     </memballoon>
Nov 28 11:05:34 user nova-compute[74994]:   </devices>
Nov 28 11:05:34 user nova-compute[74994]: </domain>
Nov 28 11:05:34 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:05:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1217374859',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1217374859',id=34,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPC+y5ycUWPYQy2XZB6kzbHT0mcdyeioMthsGLt6Hmxof5Ngy9OG06XF/Ob1BE/FlbLo4NkWH5tRCW3J+w+6D0hmLq2Ga7sCt9VMBIw+oANqnW44474dY78DHKN2+O8dQ==',key_name='tempest-keypair-328848665',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d3a4dcdeafd6420d8606b37673e3255f',ramdisk_id='',reservation_id='r-taf8uoy1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1700061593',owner_user_name='tempest-AttachVolumeShelveTestJSON-1700061593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:05:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4e1257b844940bebdeab3061c3e0ab4',uuid=a2caa913-b0cc-46b7-b90d-fe507bc00b09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69c7a712-9905-4a77-a0ae-cd64dbd347fd", "address": "fa:16:3e:38:2c:b1", "network": {"id": "d46e72ec-d7d5-45f7-951a-b4381f0b472b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-179057367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a4dcdeafd6420d8606b37673e3255f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c7a712-99", "ovs_interfaceid": "69c7a712-9905-4a77-a0ae-cd64dbd347fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Converting VIF {"id": "69c7a712-9905-4a77-a0ae-cd64dbd347fd", "address": "fa:16:3e:38:2c:b1", "network": {"id": "d46e72ec-d7d5-45f7-951a-b4381f0b472b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-179057367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a4dcdeafd6420d8606b37673e3255f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c7a712-99", "ovs_interfaceid": "69c7a712-9905-4a77-a0ae-cd64dbd347fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:2c:b1,bridge_name='br-int',has_traffic_filtering=True,id=69c7a712-9905-4a77-a0ae-cd64dbd347fd,network=Network(d46e72ec-d7d5-45f7-951a-b4381f0b472b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69c7a712-99') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG os_vif [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:2c:b1,bridge_name='br-int',has_traffic_filtering=True,id=69c7a712-9905-4a77-a0ae-cd64dbd347fd,network=Network(d46e72ec-d7d5-45f7-951a-b4381f0b472b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69c7a712-99') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b3260bd2-1c7f-5252-9f5c-4a185ba9b2f2', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69c7a712-99, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap69c7a712-99, col_values=(('qos', UUID('81f96b9c-0185-4ac5-8dce-4c55f4fa695f')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap69c7a712-99, col_values=(('external_ids', {'iface-id': '69c7a712-9905-4a77-a0ae-cd64dbd347fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:2c:b1', 'vm-uuid': 'a2caa913-b0cc-46b7-b90d-fe507bc00b09'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:34 user nova-compute[74994]: INFO os_vif [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:2c:b1,bridge_name='br-int',has_traffic_filtering=True,id=69c7a712-9905-4a77-a0ae-cd64dbd347fd,network=Network(d46e72ec-d7d5-45f7-951a-b4381f0b472b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69c7a712-99')
Nov 28 11:05:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] No VIF found with MAC fa:16:3e:38:2c:b1, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG nova.compute.manager [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 11:05:34 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Instance spawned successfully.
Nov 28 11:05:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG nova.compute.manager [req-46cf91bb-1371-4290-ba91-358739465ee8 req-ee5b6430-8b46-4fa8-a9e4-0e6b89884f65 service nova] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Received event network-vif-plugged-17fb7783-f3dc-41cf-b838-004f2048fdbc {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-46cf91bb-1371-4290-ba91-358739465ee8 req-ee5b6430-8b46-4fa8-a9e4-0e6b89884f65 service nova] Acquiring lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-46cf91bb-1371-4290-ba91-358739465ee8 req-ee5b6430-8b46-4fa8-a9e4-0e6b89884f65 service nova] Lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-46cf91bb-1371-4290-ba91-358739465ee8 req-ee5b6430-8b46-4fa8-a9e4-0e6b89884f65 service nova] Lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG nova.compute.manager [req-46cf91bb-1371-4290-ba91-358739465ee8 req-ee5b6430-8b46-4fa8-a9e4-0e6b89884f65 service nova] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] No waiting events found dispatching network-vif-plugged-17fb7783-f3dc-41cf-b838-004f2048fdbc {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:05:34 user nova-compute[74994]: WARNING nova.compute.manager [req-46cf91bb-1371-4290-ba91-358739465ee8 req-ee5b6430-8b46-4fa8-a9e4-0e6b89884f65 service nova] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Received unexpected event network-vif-plugged-17fb7783-f3dc-41cf-b838-004f2048fdbc for instance with vm_state building and task_state spawning.
Nov 28 11:05:34 user nova-compute[74994]: INFO nova.compute.manager [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Took 5.62 seconds to spawn the instance on the hypervisor.
Nov 28 11:05:34 user nova-compute[74994]: DEBUG nova.compute.manager [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG nova.network.neutron [req-40ac396e-3185-4b2c-82bd-fb63d7c8f99b req-ada3aee6-580d-440d-b3f2-f55d1e60e282 service nova] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Updated VIF entry in instance network info cache for port 69c7a712-9905-4a77-a0ae-cd64dbd347fd. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG nova.network.neutron [req-40ac396e-3185-4b2c-82bd-fb63d7c8f99b req-ada3aee6-580d-440d-b3f2-f55d1e60e282 service nova] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Updating instance_info_cache with network_info: [{"id": "69c7a712-9905-4a77-a0ae-cd64dbd347fd", "address": "fa:16:3e:38:2c:b1", "network": {"id": "d46e72ec-d7d5-45f7-951a-b4381f0b472b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-179057367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a4dcdeafd6420d8606b37673e3255f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c7a712-99", "ovs_interfaceid": "69c7a712-9905-4a77-a0ae-cd64dbd347fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:05:34 user nova-compute[74994]: INFO nova.compute.manager [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Took 14.92 seconds to build instance.
Nov 28 11:05:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-40ac396e-3185-4b2c-82bd-fb63d7c8f99b req-ada3aee6-580d-440d-b3f2-f55d1e60e282 service nova] Releasing lock "refresh_cache-a2caa913-b0cc-46b7-b90d-fe507bc00b09" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-58c28b1a-a5f6-4d15-b98f-b56d3ca5e21e tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.125s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:05:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Acquiring lock "7295ae8a-462e-4b75-af40-35aac439dad0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:05:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "7295ae8a-462e-4b75-af40-35aac439dad0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:05:37 user nova-compute[74994]: DEBUG nova.compute.manager [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 11:05:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:05:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:05:38 user nova-compute[74994]: DEBUG nova.compute.manager [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 11:05:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 11:05:38 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 11:05:38 user nova-compute[74994]: INFO nova.compute.claims [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Claim successful on node user
Nov 28 11:05:38 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Instance spawned successfully.
Nov 28 11:05:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 11:05:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:05:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:05:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:05:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:05:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:05:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:05:38 user nova-compute[74994]: INFO nova.compute.manager [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Took 7.59 seconds to spawn the instance on the hypervisor.
Nov 28 11:05:38 user nova-compute[74994]: DEBUG nova.compute.manager [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 11:05:38 user nova-compute[74994]: INFO nova.compute.manager [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Took 9.09 seconds to build instance.
Nov 28 11:05:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-a30e7dfd-70f9-44ba-9f24-171559dcc73b tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "a2caa913-b0cc-46b7-b90d-fe507bc00b09" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.247s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:05:38 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:05:38 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:05:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.526s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:05:38 user nova-compute[74994]: DEBUG nova.compute.manager [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 11:05:38 user nova-compute[74994]: DEBUG nova.compute.manager [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 11:05:38 user nova-compute[74994]: DEBUG nova.network.neutron [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 11:05:38 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 11:05:38 user nova-compute[74994]: DEBUG nova.compute.manager [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 11:05:38 user nova-compute[74994]: DEBUG nova.policy [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c362617247be45c390a743c3a80e1f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30dae8b62e14c50b9646b13af2a4258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 11:05:38 user nova-compute[74994]: DEBUG nova.compute.manager [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 11:05:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 11:05:38 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Creating image(s)
Nov 28 11:05:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Acquiring lock "/opt/stack/data/nova/instances/7295ae8a-462e-4b75-af40-35aac439dad0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:05:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "/opt/stack/data/nova/instances/7295ae8a-462e-4b75-af40-35aac439dad0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:05:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "/opt/stack/data/nova/instances/7295ae8a-462e-4b75-af40-35aac439dad0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:05:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:39 user nova-compute[74994]: DEBUG nova.compute.manager [req-7d554c08-7cd1-4bfa-bdc6-bb3ff40836d4 req-d1b6b923-dcfd-4fa7-befa-7dcc07a4b6b0 service nova] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Received event network-vif-plugged-69c7a712-9905-4a77-a0ae-cd64dbd347fd {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:05:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-7d554c08-7cd1-4bfa-bdc6-bb3ff40836d4 req-d1b6b923-dcfd-4fa7-befa-7dcc07a4b6b0 service nova] Acquiring lock "a2caa913-b0cc-46b7-b90d-fe507bc00b09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:05:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-7d554c08-7cd1-4bfa-bdc6-bb3ff40836d4 req-d1b6b923-dcfd-4fa7-befa-7dcc07a4b6b0 service nova] Lock "a2caa913-b0cc-46b7-b90d-fe507bc00b09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:05:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-7d554c08-7cd1-4bfa-bdc6-bb3ff40836d4 req-d1b6b923-dcfd-4fa7-befa-7dcc07a4b6b0 service nova] Lock "a2caa913-b0cc-46b7-b90d-fe507bc00b09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:05:39 user nova-compute[74994]: DEBUG nova.compute.manager [req-7d554c08-7cd1-4bfa-bdc6-bb3ff40836d4 req-d1b6b923-dcfd-4fa7-befa-7dcc07a4b6b0 service nova] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] No waiting events found dispatching network-vif-plugged-69c7a712-9905-4a77-a0ae-cd64dbd347fd {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:05:39 user nova-compute[74994]: WARNING nova.compute.manager [req-7d554c08-7cd1-4bfa-bdc6-bb3ff40836d4 req-d1b6b923-dcfd-4fa7-befa-7dcc07a4b6b0 service nova] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Received unexpected event network-vif-plugged-69c7a712-9905-4a77-a0ae-cd64dbd347fd for instance with vm_state active and task_state None.
Nov 28 11:05:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.257s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Acquiring lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:05:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:05:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.233s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/7295ae8a-462e-4b75-af40-35aac439dad0/disk 1073741824 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/7295ae8a-462e-4b75-af40-35aac439dad0/disk 1073741824" returned: 0 in 0.053s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.293s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:05:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:39 user nova-compute[74994]: DEBUG nova.network.neutron [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Successfully created port: 281bdb45-f23e-4ec0-a536-80a82491d3ff {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 11:05:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.192s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:39 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7295ae8a-462e-4b75-af40-35aac439dad0/disk. size=1073741824 {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 11:05:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7295ae8a-462e-4b75-af40-35aac439dad0/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:05:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7295ae8a-462e-4b75-af40-35aac439dad0/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:05:39 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Cannot resize image /opt/stack/data/nova/instances/7295ae8a-462e-4b75-af40-35aac439dad0/disk to a smaller size. {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 11:05:39 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Created local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 11:05:39 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Ensure instance console log exists: /opt/stack/data/nova/instances/7295ae8a-462e-4b75-af40-35aac439dad0/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 11:05:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:05:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:05:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG nova.network.neutron [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Successfully updated port: 281bdb45-f23e-4ec0-a536-80a82491d3ff {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Acquiring lock "refresh_cache-7295ae8a-462e-4b75-af40-35aac439dad0" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Acquired lock "refresh_cache-7295ae8a-462e-4b75-af40-35aac439dad0" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG nova.network.neutron [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG nova.compute.manager [req-36f77bcf-6e40-4280-bef6-cce3b8ac21a0 req-b765e771-ab3a-4a78-83e8-8a82be4e4438 service nova] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Received event network-changed-281bdb45-f23e-4ec0-a536-80a82491d3ff {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG nova.compute.manager [req-36f77bcf-6e40-4280-bef6-cce3b8ac21a0 req-b765e771-ab3a-4a78-83e8-8a82be4e4438 service nova] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Refreshing instance network info cache due to event network-changed-281bdb45-f23e-4ec0-a536-80a82491d3ff. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-36f77bcf-6e40-4280-bef6-cce3b8ac21a0 req-b765e771-ab3a-4a78-83e8-8a82be4e4438 service nova] Acquiring lock "refresh_cache-7295ae8a-462e-4b75-af40-35aac439dad0" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG nova.network.neutron [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG nova.network.neutron [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Updating instance_info_cache with network_info: [{"id": "281bdb45-f23e-4ec0-a536-80a82491d3ff", "address": "fa:16:3e:14:2e:38", "network": {"id": "962e3ca9-e99b-49cd-bb50-c34d108cdfa7", "bridge": "br-int", "label": "tempest-TestStampPattern-359277306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30dae8b62e14c50b9646b13af2a4258", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281bdb45-f2", "ovs_interfaceid": "281bdb45-f23e-4ec0-a536-80a82491d3ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Releasing lock "refresh_cache-7295ae8a-462e-4b75-af40-35aac439dad0" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG nova.compute.manager [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Instance network_info: |[{"id": "281bdb45-f23e-4ec0-a536-80a82491d3ff", "address": "fa:16:3e:14:2e:38", "network": {"id": "962e3ca9-e99b-49cd-bb50-c34d108cdfa7", "bridge": "br-int", "label": "tempest-TestStampPattern-359277306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30dae8b62e14c50b9646b13af2a4258", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281bdb45-f2", "ovs_interfaceid": "281bdb45-f23e-4ec0-a536-80a82491d3ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-36f77bcf-6e40-4280-bef6-cce3b8ac21a0 req-b765e771-ab3a-4a78-83e8-8a82be4e4438 service nova] Acquired lock "refresh_cache-7295ae8a-462e-4b75-af40-35aac439dad0" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG nova.network.neutron [req-36f77bcf-6e40-4280-bef6-cce3b8ac21a0 req-b765e771-ab3a-4a78-83e8-8a82be4e4438 service nova] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Refreshing network info cache for port 281bdb45-f23e-4ec0-a536-80a82491d3ff {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Start _get_guest_xml network_info=[{"id": "281bdb45-f23e-4ec0-a536-80a82491d3ff", "address": "fa:16:3e:14:2e:38", "network": {"id": "962e3ca9-e99b-49cd-bb50-c34d108cdfa7", "bridge": "br-int", "label": "tempest-TestStampPattern-359277306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30dae8b62e14c50b9646b13af2a4258", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281bdb45-f2", "ovs_interfaceid": "281bdb45-f23e-4ec0-a536-80a82491d3ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'aa939d1b-b8a6-4391-935b-0191bf5ccd0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 11:05:40 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:05:40 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:05:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:05:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2015365400',display_name='tempest-TestStampPattern-server-2015365400',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2015365400',id=35,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLhnKlLbDzesoIgRgKjSwDSGDLbJAHMlDTp+nQM/ojqr/PUamcvyDrok1u7+9cOZfKML/zTkQ8RQndwU5iipCM38Od6vAR2Ip4VAwZazka1mUHBKbAYcoeh2nwnJCVXag==',key_name='tempest-TestStampPattern-30928350',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c30dae8b62e14c50b9646b13af2a4258',ramdisk_id='',reservation_id='r-kkzjmcd0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-848738200',owner_user_name='tempest-TestStampPattern-848738200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:05:39Z,user_data=None,user_id='c362617247be45c390a743c3a80e1f63',uuid=7295ae8a-462e-4b75-af40-35aac439dad0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "281bdb45-f23e-4ec0-a536-80a82491d3ff", "address": "fa:16:3e:14:2e:38", "network": {"id": "962e3ca9-e99b-49cd-bb50-c34d108cdfa7", "bridge": "br-int", "label": "tempest-TestStampPattern-359277306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30dae8b62e14c50b9646b13af2a4258", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281bdb45-f2", "ovs_interfaceid": "281bdb45-f23e-4ec0-a536-80a82491d3ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Converting VIF {"id": "281bdb45-f23e-4ec0-a536-80a82491d3ff", "address": "fa:16:3e:14:2e:38", "network": {"id": "962e3ca9-e99b-49cd-bb50-c34d108cdfa7", "bridge": "br-int", "label": "tempest-TestStampPattern-359277306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30dae8b62e14c50b9646b13af2a4258", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281bdb45-f2", "ovs_interfaceid": "281bdb45-f23e-4ec0-a536-80a82491d3ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:2e:38,bridge_name='br-int',has_traffic_filtering=True,id=281bdb45-f23e-4ec0-a536-80a82491d3ff,network=Network(962e3ca9-e99b-49cd-bb50-c34d108cdfa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap281bdb45-f2') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG nova.objects.instance [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lazy-loading 'pci_devices' on Instance uuid 7295ae8a-462e-4b75-af40-35aac439dad0 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] End _get_guest_xml xml=<domain type="kvm">
Nov 28 11:05:40 user nova-compute[74994]:   <uuid>7295ae8a-462e-4b75-af40-35aac439dad0</uuid>
Nov 28 11:05:40 user nova-compute[74994]:   <name>instance-00000023</name>
Nov 28 11:05:40 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 11:05:40 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 11:05:40 user nova-compute[74994]:   <metadata>
Nov 28 11:05:40 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 11:05:40 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 11:05:40 user nova-compute[74994]:       <nova:name>tempest-TestStampPattern-server-2015365400</nova:name>
Nov 28 11:05:40 user nova-compute[74994]:       <nova:creationTime>2023-11-28 11:05:40</nova:creationTime>
Nov 28 11:05:40 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 11:05:40 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 11:05:40 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 11:05:40 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 11:05:40 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 11:05:40 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 11:05:40 user nova-compute[74994]:       </nova:flavor>
Nov 28 11:05:40 user nova-compute[74994]:       <nova:owner>
Nov 28 11:05:40 user nova-compute[74994]:         <nova:user uuid="c362617247be45c390a743c3a80e1f63">tempest-TestStampPattern-848738200-project-member</nova:user>
Nov 28 11:05:40 user nova-compute[74994]:         <nova:project uuid="c30dae8b62e14c50b9646b13af2a4258">tempest-TestStampPattern-848738200</nova:project>
Nov 28 11:05:40 user nova-compute[74994]:       </nova:owner>
Nov 28 11:05:40 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 11:05:40 user nova-compute[74994]:       <nova:ports>
Nov 28 11:05:40 user nova-compute[74994]:         <nova:port uuid="281bdb45-f23e-4ec0-a536-80a82491d3ff">
Nov 28 11:05:40 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 11:05:40 user nova-compute[74994]:         </nova:port>
Nov 28 11:05:40 user nova-compute[74994]:       </nova:ports>
Nov 28 11:05:40 user nova-compute[74994]:     </nova:instance>
Nov 28 11:05:40 user nova-compute[74994]:   </metadata>
Nov 28 11:05:40 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 11:05:40 user nova-compute[74994]:     <system>
Nov 28 11:05:40 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 11:05:40 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 11:05:40 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 11:05:40 user nova-compute[74994]:       <entry name="serial">7295ae8a-462e-4b75-af40-35aac439dad0</entry>
Nov 28 11:05:40 user nova-compute[74994]:       <entry name="uuid">7295ae8a-462e-4b75-af40-35aac439dad0</entry>
Nov 28 11:05:40 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 11:05:40 user nova-compute[74994]:     </system>
Nov 28 11:05:40 user nova-compute[74994]:   </sysinfo>
Nov 28 11:05:40 user nova-compute[74994]:   <os>
Nov 28 11:05:40 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 11:05:40 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 11:05:40 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 11:05:40 user nova-compute[74994]:   </os>
Nov 28 11:05:40 user nova-compute[74994]:   <features>
Nov 28 11:05:40 user nova-compute[74994]:     <acpi/>
Nov 28 11:05:40 user nova-compute[74994]:     <apic/>
Nov 28 11:05:40 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 11:05:40 user nova-compute[74994]:   </features>
Nov 28 11:05:40 user nova-compute[74994]:   <clock offset="utc">
Nov 28 11:05:40 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 11:05:40 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 11:05:40 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 11:05:40 user nova-compute[74994]:   </clock>
Nov 28 11:05:40 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 11:05:40 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 11:05:40 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 11:05:40 user nova-compute[74994]:   </cpu>
Nov 28 11:05:40 user nova-compute[74994]:   <devices>
Nov 28 11:05:40 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 11:05:40 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 11:05:40 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/7295ae8a-462e-4b75-af40-35aac439dad0/disk"/>
Nov 28 11:05:40 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 11:05:40 user nova-compute[74994]:     </disk>
Nov 28 11:05:40 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 11:05:40 user nova-compute[74994]:       <mac address="fa:16:3e:14:2e:38"/>
Nov 28 11:05:40 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:05:40 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 11:05:40 user nova-compute[74994]:       <target dev="tap281bdb45-f2"/>
Nov 28 11:05:40 user nova-compute[74994]:     </interface>
Nov 28 11:05:40 user nova-compute[74994]:     <serial type="pty">
Nov 28 11:05:40 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/7295ae8a-462e-4b75-af40-35aac439dad0/console.log" append="off"/>
Nov 28 11:05:40 user nova-compute[74994]:     </serial>
Nov 28 11:05:40 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 11:05:40 user nova-compute[74994]:     <video>
Nov 28 11:05:40 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:05:40 user nova-compute[74994]:     </video>
Nov 28 11:05:40 user nova-compute[74994]:     <rng model="virtio">
Nov 28 11:05:40 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 11:05:40 user nova-compute[74994]:     </rng>
Nov 28 11:05:40 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 11:05:40 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 11:05:40 user nova-compute[74994]:       <stats period="10"/>
Nov 28 11:05:40 user nova-compute[74994]:     </memballoon>
Nov 28 11:05:40 user nova-compute[74994]:   </devices>
Nov 28 11:05:40 user nova-compute[74994]: </domain>
Nov 28 11:05:40 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:05:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2015365400',display_name='tempest-TestStampPattern-server-2015365400',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2015365400',id=35,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLhnKlLbDzesoIgRgKjSwDSGDLbJAHMlDTp+nQM/ojqr/PUamcvyDrok1u7+9cOZfKML/zTkQ8RQndwU5iipCM38Od6vAR2Ip4VAwZazka1mUHBKbAYcoeh2nwnJCVXag==',key_name='tempest-TestStampPattern-30928350',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c30dae8b62e14c50b9646b13af2a4258',ramdisk_id='',reservation_id='r-kkzjmcd0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-848738200',owner_user_name='tempest-TestStampPattern-848738200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:05:39Z,user_data=None,user_id='c362617247be45c390a743c3a80e1f63',uuid=7295ae8a-462e-4b75-af40-35aac439dad0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "281bdb45-f23e-4ec0-a536-80a82491d3ff", "address": "fa:16:3e:14:2e:38", "network": {"id": "962e3ca9-e99b-49cd-bb50-c34d108cdfa7", "bridge": "br-int", "label": "tempest-TestStampPattern-359277306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30dae8b62e14c50b9646b13af2a4258", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281bdb45-f2", "ovs_interfaceid": "281bdb45-f23e-4ec0-a536-80a82491d3ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Converting VIF {"id": "281bdb45-f23e-4ec0-a536-80a82491d3ff", "address": "fa:16:3e:14:2e:38", "network": {"id": "962e3ca9-e99b-49cd-bb50-c34d108cdfa7", "bridge": "br-int", "label": "tempest-TestStampPattern-359277306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30dae8b62e14c50b9646b13af2a4258", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281bdb45-f2", "ovs_interfaceid": "281bdb45-f23e-4ec0-a536-80a82491d3ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:2e:38,bridge_name='br-int',has_traffic_filtering=True,id=281bdb45-f23e-4ec0-a536-80a82491d3ff,network=Network(962e3ca9-e99b-49cd-bb50-c34d108cdfa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap281bdb45-f2') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG os_vif [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:2e:38,bridge_name='br-int',has_traffic_filtering=True,id=281bdb45-f23e-4ec0-a536-80a82491d3ff,network=Network(962e3ca9-e99b-49cd-bb50-c34d108cdfa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap281bdb45-f2') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '741be98f-5459-5821-908f-87a85402b2de', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap281bdb45-f2, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap281bdb45-f2, col_values=(('qos', UUID('f65febf8-2015-472d-bbe5-2353537243eb')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap281bdb45-f2, col_values=(('external_ids', {'iface-id': '281bdb45-f23e-4ec0-a536-80a82491d3ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:2e:38', 'vm-uuid': '7295ae8a-462e-4b75-af40-35aac439dad0'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:40 user nova-compute[74994]: INFO os_vif [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:2e:38,bridge_name='br-int',has_traffic_filtering=True,id=281bdb45-f23e-4ec0-a536-80a82491d3ff,network=Network(962e3ca9-e99b-49cd-bb50-c34d108cdfa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap281bdb45-f2')
Nov 28 11:05:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:05:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] No VIF found with MAC fa:16:3e:14:2e:38, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:05:41 user nova-compute[74994]: DEBUG nova.network.neutron [req-36f77bcf-6e40-4280-bef6-cce3b8ac21a0 req-b765e771-ab3a-4a78-83e8-8a82be4e4438 service nova] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Updated VIF entry in instance network info cache for port 281bdb45-f23e-4ec0-a536-80a82491d3ff. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:05:41 user nova-compute[74994]: DEBUG nova.network.neutron [req-36f77bcf-6e40-4280-bef6-cce3b8ac21a0 req-b765e771-ab3a-4a78-83e8-8a82be4e4438 service nova] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Updating instance_info_cache with network_info: [{"id": "281bdb45-f23e-4ec0-a536-80a82491d3ff", "address": "fa:16:3e:14:2e:38", "network": {"id": "962e3ca9-e99b-49cd-bb50-c34d108cdfa7", "bridge": "br-int", "label": "tempest-TestStampPattern-359277306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30dae8b62e14c50b9646b13af2a4258", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281bdb45-f2", "ovs_interfaceid": "281bdb45-f23e-4ec0-a536-80a82491d3ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:05:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-36f77bcf-6e40-4280-bef6-cce3b8ac21a0 req-b765e771-ab3a-4a78-83e8-8a82be4e4438 service nova] Releasing lock "refresh_cache-7295ae8a-462e-4b75-af40-35aac439dad0" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:05:41 user nova-compute[74994]: DEBUG nova.compute.manager [req-6dbd743f-0ca8-4148-b524-351b63bacfd2 req-ab630776-fb2c-4633-a149-4973e50d1074 service nova] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Received event network-vif-plugged-69c7a712-9905-4a77-a0ae-cd64dbd347fd {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:05:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6dbd743f-0ca8-4148-b524-351b63bacfd2 req-ab630776-fb2c-4633-a149-4973e50d1074 service nova] Acquiring lock "a2caa913-b0cc-46b7-b90d-fe507bc00b09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:05:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6dbd743f-0ca8-4148-b524-351b63bacfd2 req-ab630776-fb2c-4633-a149-4973e50d1074 service nova] Lock "a2caa913-b0cc-46b7-b90d-fe507bc00b09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:05:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6dbd743f-0ca8-4148-b524-351b63bacfd2 req-ab630776-fb2c-4633-a149-4973e50d1074 service nova] Lock "a2caa913-b0cc-46b7-b90d-fe507bc00b09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:05:41 user nova-compute[74994]: DEBUG nova.compute.manager [req-6dbd743f-0ca8-4148-b524-351b63bacfd2 req-ab630776-fb2c-4633-a149-4973e50d1074 service nova] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] No waiting events found dispatching network-vif-plugged-69c7a712-9905-4a77-a0ae-cd64dbd347fd {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:05:41 user nova-compute[74994]: WARNING nova.compute.manager [req-6dbd743f-0ca8-4148-b524-351b63bacfd2 req-ab630776-fb2c-4633-a149-4973e50d1074 service nova] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Received unexpected event network-vif-plugged-69c7a712-9905-4a77-a0ae-cd64dbd347fd for instance with vm_state active and task_state None.
Nov 28 11:05:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-a67d0337-2b1b-4b21-9bd6-662aa48e4745 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Acquiring lock "cdc5adf9-5a73-4d7d-b53d-849354a3a053" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:05:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-a67d0337-2b1b-4b21-9bd6-662aa48e4745 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Lock "cdc5adf9-5a73-4d7d-b53d-849354a3a053" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:05:41 user nova-compute[74994]: INFO nova.compute.manager [None req-a67d0337-2b1b-4b21-9bd6-662aa48e4745 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Detaching volume b071dc55-7012-43ca-a7f2-51d3046d2320
Nov 28 11:05:41 user nova-compute[74994]: INFO nova.virt.block_device [None req-a67d0337-2b1b-4b21-9bd6-662aa48e4745 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Attempting to driver detach volume b071dc55-7012-43ca-a7f2-51d3046d2320 from mountpoint /dev/vdb
Nov 28 11:05:41 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-a67d0337-2b1b-4b21-9bd6-662aa48e4745 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Attempting to detach device vdb from instance cdc5adf9-5a73-4d7d-b53d-849354a3a053 from the persistent domain config. {{(pid=74994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 11:05:41 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-a67d0337-2b1b-4b21-9bd6-662aa48e4745 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 11:05:41 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:05:41 user nova-compute[74994]:   <source dev="/dev/sde"/>
Nov 28 11:05:41 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:05:41 user nova-compute[74994]:   <serial>b071dc55-7012-43ca-a7f2-51d3046d2320</serial>
Nov 28 11:05:41 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 11:05:41 user nova-compute[74994]: </disk>
Nov 28 11:05:41 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 11:05:41 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-a67d0337-2b1b-4b21-9bd6-662aa48e4745 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Successfully detached device vdb from instance cdc5adf9-5a73-4d7d-b53d-849354a3a053 from the persistent domain config.
Nov 28 11:05:41 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-a67d0337-2b1b-4b21-9bd6-662aa48e4745 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cdc5adf9-5a73-4d7d-b53d-849354a3a053 from the live domain config. {{(pid=74994) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 11:05:41 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-a67d0337-2b1b-4b21-9bd6-662aa48e4745 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 11:05:41 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:05:41 user nova-compute[74994]:   <source dev="/dev/sde"/>
Nov 28 11:05:41 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:05:41 user nova-compute[74994]:   <serial>b071dc55-7012-43ca-a7f2-51d3046d2320</serial>
Nov 28 11:05:41 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 11:05:41 user nova-compute[74994]: </disk>
Nov 28 11:05:41 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 11:05:42 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-a67d0337-2b1b-4b21-9bd6-662aa48e4745 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cdc5adf9-5a73-4d7d-b53d-849354a3a053 {{(pid=74994) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 11:05:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:42 user nova-compute[74994]: DEBUG nova.compute.manager [req-aeaf0a2b-515e-420a-a2a1-0808173438ad req-6452c444-3e28-405a-b2cf-7580d771a73b service nova] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Received event network-vif-plugged-281bdb45-f23e-4ec0-a536-80a82491d3ff {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:05:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-aeaf0a2b-515e-420a-a2a1-0808173438ad req-6452c444-3e28-405a-b2cf-7580d771a73b service nova] Acquiring lock "7295ae8a-462e-4b75-af40-35aac439dad0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:05:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-aeaf0a2b-515e-420a-a2a1-0808173438ad req-6452c444-3e28-405a-b2cf-7580d771a73b service nova] Lock "7295ae8a-462e-4b75-af40-35aac439dad0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:05:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-aeaf0a2b-515e-420a-a2a1-0808173438ad req-6452c444-3e28-405a-b2cf-7580d771a73b service nova] Lock "7295ae8a-462e-4b75-af40-35aac439dad0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:05:42 user nova-compute[74994]: DEBUG nova.compute.manager [req-aeaf0a2b-515e-420a-a2a1-0808173438ad req-6452c444-3e28-405a-b2cf-7580d771a73b service nova] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] No waiting events found dispatching network-vif-plugged-281bdb45-f23e-4ec0-a536-80a82491d3ff {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:05:42 user nova-compute[74994]: WARNING nova.compute.manager [req-aeaf0a2b-515e-420a-a2a1-0808173438ad req-6452c444-3e28-405a-b2cf-7580d771a73b service nova] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Received unexpected event network-vif-plugged-281bdb45-f23e-4ec0-a536-80a82491d3ff for instance with vm_state building and task_state spawning.
Nov 28 11:05:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:44 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:44 user nova-compute[74994]: DEBUG nova.compute.manager [req-bf29e342-133a-4985-90bf-84d700231776 req-09db3eef-33c5-4e37-a062-f3b3870a8595 service nova] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Received event network-vif-plugged-281bdb45-f23e-4ec0-a536-80a82491d3ff {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:05:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bf29e342-133a-4985-90bf-84d700231776 req-09db3eef-33c5-4e37-a062-f3b3870a8595 service nova] Acquiring lock "7295ae8a-462e-4b75-af40-35aac439dad0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:05:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bf29e342-133a-4985-90bf-84d700231776 req-09db3eef-33c5-4e37-a062-f3b3870a8595 service nova] Lock "7295ae8a-462e-4b75-af40-35aac439dad0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:05:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bf29e342-133a-4985-90bf-84d700231776 req-09db3eef-33c5-4e37-a062-f3b3870a8595 service nova] Lock "7295ae8a-462e-4b75-af40-35aac439dad0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:05:44 user nova-compute[74994]: DEBUG nova.compute.manager [req-bf29e342-133a-4985-90bf-84d700231776 req-09db3eef-33c5-4e37-a062-f3b3870a8595 service nova] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] No waiting events found dispatching network-vif-plugged-281bdb45-f23e-4ec0-a536-80a82491d3ff {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:05:44 user nova-compute[74994]: WARNING nova.compute.manager [req-bf29e342-133a-4985-90bf-84d700231776 req-09db3eef-33c5-4e37-a062-f3b3870a8595 service nova] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Received unexpected event network-vif-plugged-281bdb45-f23e-4ec0-a536-80a82491d3ff for instance with vm_state building and task_state spawning.
Nov 28 11:05:44 user nova-compute[74994]: DEBUG nova.compute.manager [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 11:05:44 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 11:05:44 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Instance spawned successfully.
Nov 28 11:05:44 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 11:05:45 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:05:45 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:05:45 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:05:45 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:05:45 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:05:45 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:05:45 user nova-compute[74994]: INFO nova.compute.manager [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Took 6.31 seconds to spawn the instance on the hypervisor.
Nov 28 11:05:45 user nova-compute[74994]: DEBUG nova.compute.manager [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 11:05:45 user nova-compute[74994]: INFO nova.compute.manager [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Took 7.22 seconds to build instance.
Nov 28 11:05:45 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3a4c5e92-adf6-4db4-80d7-095e808c5565 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "7295ae8a-462e-4b75-af40-35aac439dad0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.342s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:05:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:48 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:05:48 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Triggering sync for uuid 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c {{(pid=74994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 11:05:48 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Triggering sync for uuid bf357856-2d97-42e8-928d-71d0378f48c8 {{(pid=74994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 11:05:48 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Triggering sync for uuid 759fbcfd-ab13-438f-b860-6393a97d1205 {{(pid=74994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 11:05:48 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Triggering sync for uuid 20716905-c56a-4729-8c5b-9188502dc477 {{(pid=74994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 11:05:48 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Triggering sync for uuid b743c491-ece8-4781-9530-b2f38ffc1079 {{(pid=74994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 11:05:48 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Triggering sync for uuid 7e67fb47-500c-4e85-b384-27408ec622a9 {{(pid=74994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 11:05:48 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Triggering sync for uuid cdc5adf9-5a73-4d7d-b53d-849354a3a053 {{(pid=74994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 11:05:48 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Triggering sync for uuid e3b0b960-3f38-4a6f-9017-209fbc2110c9 {{(pid=74994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 11:05:48 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Triggering sync for uuid 0f267741-9611-4812-9afa-32717d16abc5 {{(pid=74994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 11:05:48 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Triggering sync for uuid a2caa913-b0cc-46b7-b90d-fe507bc00b09 {{(pid=74994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 11:05:48 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Triggering sync for uuid 7295ae8a-462e-4b75-af40-35aac439dad0 {{(pid=74994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 11:05:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:05:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:05:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "bf357856-2d97-42e8-928d-71d0378f48c8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:05:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "bf357856-2d97-42e8-928d-71d0378f48c8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:05:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "759fbcfd-ab13-438f-b860-6393a97d1205" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:05:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "759fbcfd-ab13-438f-b860-6393a97d1205" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:05:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "20716905-c56a-4729-8c5b-9188502dc477" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:05:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "20716905-c56a-4729-8c5b-9188502dc477" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:05:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "b743c491-ece8-4781-9530-b2f38ffc1079" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:05:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "b743c491-ece8-4781-9530-b2f38ffc1079" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:05:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "7e67fb47-500c-4e85-b384-27408ec622a9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:05:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "7e67fb47-500c-4e85-b384-27408ec622a9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:05:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "cdc5adf9-5a73-4d7d-b53d-849354a3a053" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:05:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:05:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:05:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "0f267741-9611-4812-9afa-32717d16abc5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:05:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "0f267741-9611-4812-9afa-32717d16abc5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:05:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "a2caa913-b0cc-46b7-b90d-fe507bc00b09" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:05:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "a2caa913-b0cc-46b7-b90d-fe507bc00b09" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:05:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "7295ae8a-462e-4b75-af40-35aac439dad0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:05:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "7295ae8a-462e-4b75-af40-35aac439dad0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:05:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:05:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "bf357856-2d97-42e8-928d-71d0378f48c8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:05:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "759fbcfd-ab13-438f-b860-6393a97d1205" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:05:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "7e67fb47-500c-4e85-b384-27408ec622a9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:05:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "b743c491-ece8-4781-9530-b2f38ffc1079" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:05:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "20716905-c56a-4729-8c5b-9188502dc477" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:05:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "a2caa913-b0cc-46b7-b90d-fe507bc00b09" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:05:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "0f267741-9611-4812-9afa-32717d16abc5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:05:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:05:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "7295ae8a-462e-4b75-af40-35aac439dad0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:05:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:05:59 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:02 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-a67d0337-2b1b-4b21-9bd6-662aa48e4745 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cdc5adf9-5a73-4d7d-b53d-849354a3a053 is timed out.
Nov 28 11:06:02 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-a67d0337-2b1b-4b21-9bd6-662aa48e4745 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Successfully detached device vdb from instance cdc5adf9-5a73-4d7d-b53d-849354a3a053 from the live domain config.
Nov 28 11:06:02 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a67d0337-2b1b-4b21-9bd6-662aa48e4745 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 11:06:02 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67d0337-2b1b-4b21-9bd6-662aa48e4745 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WkLcetUG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:06:02 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-a67d0337-2b1b-4b21-9bd6-662aa48e4745 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:06:02 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-a67d0337-2b1b-4b21-9bd6-662aa48e4745 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:06:02 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-a67d0337-2b1b-4b21-9bd6-662aa48e4745 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:06:02 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:06:02 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:06:02 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1621192-7243-4730-aeac-8f2f0a4fa64d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:06:02 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67d0337-2b1b-4b21-9bd6-662aa48e4745 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 11:06:02 user nova-compute[74994]: No targets found.
Nov 28 11:06:02 user nova-compute[74994]: iSNS:
Nov 28 11:06:02 user nova-compute[74994]: No targets found.
Nov 28 11:06:02 user nova-compute[74994]: STATIC:
Nov 28 11:06:02 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd
Nov 28 11:06:02 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:06:02 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:06:02 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd
Nov 28 11:06:02 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:06:02 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:06:02 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320
Nov 28 11:06:02 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:06:02 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:06:02 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de
Nov 28 11:06:02 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:06:02 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:06:02 user nova-compute[74994]: FIRMWARE:
Nov 28 11:06:02 user nova-compute[74994]: No targets found.
Nov 28 11:06:02 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:06:02 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67d0337-2b1b-4b21-9bd6-662aa48e4745 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 11:06:02 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 11:06:02 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 11:06:02 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67d0337-2b1b-4b21-9bd6-662aa48e4745 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 11:06:02 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:06:02 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:06:02 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bde99c9-10fb-46a9-8ac2-97d27c41d856]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:06:02 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:06:02 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:06:02 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d696a02-fc2f-4a50-b59e-dd153600a54c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:06:02 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67d0337-2b1b-4b21-9bd6-662aa48e4745 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:06:02 user nova-compute[74994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)
Nov 28 11:06:02 user nova-compute[74994]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320 (non-flash)
Nov 28 11:06:02 user nova-compute[74994]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)
Nov 28 11:06:02 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:06:02 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67d0337-2b1b-4b21-9bd6-662aa48e4745 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:06:02 user nova-compute[74994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)
Nov 28 11:06:02 user nova-compute[74994]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320 (non-flash)
Nov 28 11:06:02 user nova-compute[74994]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)
Nov 28 11:06:02 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:06:02 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67d0337-2b1b-4b21-9bd6-662aa48e4745 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb94439dbd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320'): ({'sde'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 11:06:02 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-a67d0337-2b1b-4b21-9bd6-662aa48e4745 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Removing single pathed devices sde {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 11:06:02 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:06:02 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:06:02 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c70063b-9a3c-4769-94b3-92b685b1825e]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:06:02 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:06:02 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:06:02 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0d82fd-e6e4-45be-be68-a38b88a3c566]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:06:02 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-a67d0337-2b1b-4b21-9bd6-662aa48e4745 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Flushing IO for device /dev/sde {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 11:06:02 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:06:02 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:06:02 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e52798-0067-4ef9-9fe4-eb9b99de9a28]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:06:02 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-a67d0337-2b1b-4b21-9bd6-662aa48e4745 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 11:06:02 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:06:02 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:06:02 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f70259c-eab4-42b5-a14e-ee387073ca6e]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:06:02 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-a67d0337-2b1b-4b21-9bd6-662aa48e4745 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 11:06:02 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-a67d0337-2b1b-4b21-9bd6-662aa48e4745 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] SCSI volumes sde have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 11:06:02 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67d0337-2b1b-4b21-9bd6-662aa48e4745 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 11:06:02 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:06:02 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:06:02 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5187bd-77a3-4d39-b081-bcd2cc583340]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:06:02 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67d0337-2b1b-4b21-9bd6-662aa48e4745 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:06:02 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320 -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:06:02 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:06:02 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acb30da-e379-4439-ab9b-eb4a15ab2098]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:06:02 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67d0337-2b1b-4b21-9bd6-662aa48e4745 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320, portal: 172.16.0.220,3260]
Nov 28 11:06:02 user nova-compute[74994]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320, portal: 172.16.0.220,3260] successful.
Nov 28 11:06:02 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:06:02 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320 -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:06:02 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b071dc55-7012-43ca-a7f2-51d3046d2320 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:06:02 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e123b958-9b99-4243-b224-884a421ee772]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:06:02 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67d0337-2b1b-4b21-9bd6-662aa48e4745 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:06:02 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-a67d0337-2b1b-4b21-9bd6-662aa48e4745 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:06:02 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67d0337-2b1b-4b21-9bd6-662aa48e4745 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] <== disconnect_volume: return (322ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:06:02 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a67d0337-2b1b-4b21-9bd6-662aa48e4745 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 11:06:03 user nova-compute[74994]: DEBUG nova.objects.instance [None req-a67d0337-2b1b-4b21-9bd6-662aa48e4745 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Lazy-loading 'flavor' on Instance uuid cdc5adf9-5a73-4d7d-b53d-849354a3a053 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:06:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-a67d0337-2b1b-4b21-9bd6-662aa48e4745 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Lock "cdc5adf9-5a73-4d7d-b53d-849354a3a053" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.887s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:06:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "cdc5adf9-5a73-4d7d-b53d-849354a3a053" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 15.040s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:06:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "cdc5adf9-5a73-4d7d-b53d-849354a3a053" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.022s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:06:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1aabb3d4-f34e-4eb5-bf51-0ad8c47146e0 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquiring lock "bf357856-2d97-42e8-928d-71d0378f48c8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:06:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1aabb3d4-f34e-4eb5-bf51-0ad8c47146e0 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "bf357856-2d97-42e8-928d-71d0378f48c8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:06:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1aabb3d4-f34e-4eb5-bf51-0ad8c47146e0 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquiring lock "bf357856-2d97-42e8-928d-71d0378f48c8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:06:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1aabb3d4-f34e-4eb5-bf51-0ad8c47146e0 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "bf357856-2d97-42e8-928d-71d0378f48c8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:06:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1aabb3d4-f34e-4eb5-bf51-0ad8c47146e0 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "bf357856-2d97-42e8-928d-71d0378f48c8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:06:04 user nova-compute[74994]: INFO nova.compute.manager [None req-1aabb3d4-f34e-4eb5-bf51-0ad8c47146e0 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Terminating instance
Nov 28 11:06:04 user nova-compute[74994]: DEBUG nova.compute.manager [None req-1aabb3d4-f34e-4eb5-bf51-0ad8c47146e0 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 11:06:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:04 user nova-compute[74994]: DEBUG nova.compute.manager [req-52776474-7195-474d-b8c7-e32cd8402f1a req-0e7ed4a2-8bff-42be-9896-9d3d6c03fff3 service nova] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Received event network-vif-unplugged-6a884296-8f6f-4647-b4c6-09d7f4e92887 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:06:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-52776474-7195-474d-b8c7-e32cd8402f1a req-0e7ed4a2-8bff-42be-9896-9d3d6c03fff3 service nova] Acquiring lock "bf357856-2d97-42e8-928d-71d0378f48c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:06:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-52776474-7195-474d-b8c7-e32cd8402f1a req-0e7ed4a2-8bff-42be-9896-9d3d6c03fff3 service nova] Lock "bf357856-2d97-42e8-928d-71d0378f48c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:06:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-52776474-7195-474d-b8c7-e32cd8402f1a req-0e7ed4a2-8bff-42be-9896-9d3d6c03fff3 service nova] Lock "bf357856-2d97-42e8-928d-71d0378f48c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:06:04 user nova-compute[74994]: DEBUG nova.compute.manager [req-52776474-7195-474d-b8c7-e32cd8402f1a req-0e7ed4a2-8bff-42be-9896-9d3d6c03fff3 service nova] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] No waiting events found dispatching network-vif-unplugged-6a884296-8f6f-4647-b4c6-09d7f4e92887 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:06:04 user nova-compute[74994]: DEBUG nova.compute.manager [req-52776474-7195-474d-b8c7-e32cd8402f1a req-0e7ed4a2-8bff-42be-9896-9d3d6c03fff3 service nova] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Received event network-vif-unplugged-6a884296-8f6f-4647-b4c6-09d7f4e92887 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 11:06:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:04 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Instance destroyed successfully.
Nov 28 11:06:04 user nova-compute[74994]: DEBUG nova.objects.instance [None req-1aabb3d4-f34e-4eb5-bf51-0ad8c47146e0 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lazy-loading 'resources' on Instance uuid bf357856-2d97-42e8-928d-71d0378f48c8 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:06:05 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-1aabb3d4-f34e-4eb5-bf51-0ad8c47146e0 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:49:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1148888058',display_name='tempest-ServerRescueNegativeTestJSON-server-1148888058',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1148888058',id=3,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:53:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77126f6f39db4a628b74551ea7d0aa21',ramdisk_id='',reservation_id='r-kyiocy2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1900175697',owner_user_name='tempest-ServerRescueNegativeTestJSON-1900175697-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T10:55:47Z,user_data=None,user_id='6b5c1a1f2efc4a2faf8b82d467681d45',uuid=bf357856-2d97-42e8-928d-71d0378f48c8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a884296-8f6f-4647-b4c6-09d7f4e92887", "address": "fa:16:3e:a2:e1:5b", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a884296-8f", "ovs_interfaceid": "6a884296-8f6f-4647-b4c6-09d7f4e92887", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 11:06:05 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-1aabb3d4-f34e-4eb5-bf51-0ad8c47146e0 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Converting VIF {"id": "6a884296-8f6f-4647-b4c6-09d7f4e92887", "address": "fa:16:3e:a2:e1:5b", "network": {"id": "77bc68aa-1654-4e4d-9c65-7515fe6f4b2a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-11532280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77126f6f39db4a628b74551ea7d0aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a884296-8f", "ovs_interfaceid": "6a884296-8f6f-4647-b4c6-09d7f4e92887", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:06:05 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-1aabb3d4-f34e-4eb5-bf51-0ad8c47146e0 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:e1:5b,bridge_name='br-int',has_traffic_filtering=True,id=6a884296-8f6f-4647-b4c6-09d7f4e92887,network=Network(77bc68aa-1654-4e4d-9c65-7515fe6f4b2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a884296-8f') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:06:05 user nova-compute[74994]: DEBUG os_vif [None req-1aabb3d4-f34e-4eb5-bf51-0ad8c47146e0 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:e1:5b,bridge_name='br-int',has_traffic_filtering=True,id=6a884296-8f6f-4647-b4c6-09d7f4e92887,network=Network(77bc68aa-1654-4e4d-9c65-7515fe6f4b2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a884296-8f') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 11:06:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a884296-8f, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:06:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:06:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8928d74e-2cc5-46da-908e-1b5bf2dd9525) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:06:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:05 user nova-compute[74994]: INFO os_vif [None req-1aabb3d4-f34e-4eb5-bf51-0ad8c47146e0 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:e1:5b,bridge_name='br-int',has_traffic_filtering=True,id=6a884296-8f6f-4647-b4c6-09d7f4e92887,network=Network(77bc68aa-1654-4e4d-9c65-7515fe6f4b2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a884296-8f')
Nov 28 11:06:05 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-1aabb3d4-f34e-4eb5-bf51-0ad8c47146e0 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Deleting instance files /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8_del
Nov 28 11:06:05 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-1aabb3d4-f34e-4eb5-bf51-0ad8c47146e0 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Deletion of /opt/stack/data/nova/instances/bf357856-2d97-42e8-928d-71d0378f48c8_del complete
Nov 28 11:06:05 user nova-compute[74994]: INFO nova.compute.manager [None req-1aabb3d4-f34e-4eb5-bf51-0ad8c47146e0 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 28 11:06:05 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-1aabb3d4-f34e-4eb5-bf51-0ad8c47146e0 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 11:06:05 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 11:06:05 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 11:06:05 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:06:05 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Took 0.48 seconds to deallocate network for instance.
Nov 28 11:06:05 user nova-compute[74994]: DEBUG nova.compute.manager [req-0689619d-5dd8-4384-9bbb-aac25e2f507d req-7efdaed4-d06e-4fcd-8e5f-eabda9b53324 service nova] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Received event network-vif-deleted-6a884296-8f6f-4647-b4c6-09d7f4e92887 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:06:05 user nova-compute[74994]: INFO nova.compute.manager [req-0689619d-5dd8-4384-9bbb-aac25e2f507d req-7efdaed4-d06e-4fcd-8e5f-eabda9b53324 service nova] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Neutron deleted interface 6a884296-8f6f-4647-b4c6-09d7f4e92887; detaching it from the instance and deleting it from the info cache
Nov 28 11:06:05 user nova-compute[74994]: DEBUG nova.network.neutron [req-0689619d-5dd8-4384-9bbb-aac25e2f507d req-7efdaed4-d06e-4fcd-8e5f-eabda9b53324 service nova] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:06:05 user nova-compute[74994]: DEBUG nova.compute.manager [req-0689619d-5dd8-4384-9bbb-aac25e2f507d req-7efdaed4-d06e-4fcd-8e5f-eabda9b53324 service nova] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Detach interface failed, port_id=6a884296-8f6f-4647-b4c6-09d7f4e92887, reason: Instance bf357856-2d97-42e8-928d-71d0378f48c8 could not be found. {{(pid=74994) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 11:06:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1aabb3d4-f34e-4eb5-bf51-0ad8c47146e0 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:06:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1aabb3d4-f34e-4eb5-bf51-0ad8c47146e0 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:06:05 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-1aabb3d4-f34e-4eb5-bf51-0ad8c47146e0 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:06:05 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-1aabb3d4-f34e-4eb5-bf51-0ad8c47146e0 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:06:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1aabb3d4-f34e-4eb5-bf51-0ad8c47146e0 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.363s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:06:06 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-1aabb3d4-f34e-4eb5-bf51-0ad8c47146e0 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Deleted allocations for instance bf357856-2d97-42e8-928d-71d0378f48c8
Nov 28 11:06:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1aabb3d4-f34e-4eb5-bf51-0ad8c47146e0 tempest-ServerRescueNegativeTestJSON-1900175697 tempest-ServerRescueNegativeTestJSON-1900175697-project-member] Lock "bf357856-2d97-42e8-928d-71d0378f48c8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.962s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:06:06 user nova-compute[74994]: DEBUG nova.compute.manager [req-548a9b9d-6b14-44cf-ad01-5052851f483e req-a1e0be0d-685f-4c0d-b811-4b6ed3ff2dd7 service nova] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Received event network-vif-plugged-6a884296-8f6f-4647-b4c6-09d7f4e92887 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:06:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-548a9b9d-6b14-44cf-ad01-5052851f483e req-a1e0be0d-685f-4c0d-b811-4b6ed3ff2dd7 service nova] Acquiring lock "bf357856-2d97-42e8-928d-71d0378f48c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:06:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-548a9b9d-6b14-44cf-ad01-5052851f483e req-a1e0be0d-685f-4c0d-b811-4b6ed3ff2dd7 service nova] Lock "bf357856-2d97-42e8-928d-71d0378f48c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:06:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-548a9b9d-6b14-44cf-ad01-5052851f483e req-a1e0be0d-685f-4c0d-b811-4b6ed3ff2dd7 service nova] Lock "bf357856-2d97-42e8-928d-71d0378f48c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:06:06 user nova-compute[74994]: DEBUG nova.compute.manager [req-548a9b9d-6b14-44cf-ad01-5052851f483e req-a1e0be0d-685f-4c0d-b811-4b6ed3ff2dd7 service nova] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] No waiting events found dispatching network-vif-plugged-6a884296-8f6f-4647-b4c6-09d7f4e92887 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:06:06 user nova-compute[74994]: WARNING nova.compute.manager [req-548a9b9d-6b14-44cf-ad01-5052851f483e req-a1e0be0d-685f-4c0d-b811-4b6ed3ff2dd7 service nova] [instance: bf357856-2d97-42e8-928d-71d0378f48c8] Received unexpected event network-vif-plugged-6a884296-8f6f-4647-b4c6-09d7f4e92887 for instance with vm_state deleted and task_state None.
Nov 28 11:06:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-544af908-c06d-4582-937d-c0552a3a4895 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "7e67fb47-500c-4e85-b384-27408ec622a9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:06:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-544af908-c06d-4582-937d-c0552a3a4895 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "7e67fb47-500c-4e85-b384-27408ec622a9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:06:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-544af908-c06d-4582-937d-c0552a3a4895 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "7e67fb47-500c-4e85-b384-27408ec622a9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:06:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-544af908-c06d-4582-937d-c0552a3a4895 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "7e67fb47-500c-4e85-b384-27408ec622a9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:06:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-544af908-c06d-4582-937d-c0552a3a4895 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "7e67fb47-500c-4e85-b384-27408ec622a9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:06:09 user nova-compute[74994]: INFO nova.compute.manager [None req-544af908-c06d-4582-937d-c0552a3a4895 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Terminating instance
Nov 28 11:06:09 user nova-compute[74994]: DEBUG nova.compute.manager [None req-544af908-c06d-4582-937d-c0552a3a4895 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 11:06:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG nova.compute.manager [req-c9f458de-4396-4356-a5d7-f7890cabec7c req-ef5082a9-6c95-43c7-adce-fc1cd0df2925 service nova] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Received event network-vif-unplugged-3787892f-48da-4e39-8c41-8fdb94950e59 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c9f458de-4396-4356-a5d7-f7890cabec7c req-ef5082a9-6c95-43c7-adce-fc1cd0df2925 service nova] Acquiring lock "7e67fb47-500c-4e85-b384-27408ec622a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c9f458de-4396-4356-a5d7-f7890cabec7c req-ef5082a9-6c95-43c7-adce-fc1cd0df2925 service nova] Lock "7e67fb47-500c-4e85-b384-27408ec622a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c9f458de-4396-4356-a5d7-f7890cabec7c req-ef5082a9-6c95-43c7-adce-fc1cd0df2925 service nova] Lock "7e67fb47-500c-4e85-b384-27408ec622a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG nova.compute.manager [req-c9f458de-4396-4356-a5d7-f7890cabec7c req-ef5082a9-6c95-43c7-adce-fc1cd0df2925 service nova] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] No waiting events found dispatching network-vif-unplugged-3787892f-48da-4e39-8c41-8fdb94950e59 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG nova.compute.manager [req-c9f458de-4396-4356-a5d7-f7890cabec7c req-ef5082a9-6c95-43c7-adce-fc1cd0df2925 service nova] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Received event network-vif-unplugged-3787892f-48da-4e39-8c41-8fdb94950e59 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:10 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Instance destroyed successfully.
Nov 28 11:06:10 user nova-compute[74994]: DEBUG nova.objects.instance [None req-544af908-c06d-4582-937d-c0552a3a4895 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lazy-loading 'resources' on Instance uuid 7e67fb47-500c-4e85-b384-27408ec622a9 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-544af908-c06d-4582-937d-c0552a3a4895 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1778676797',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1778676797',id=30,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T11:02:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='612ae9ec21ad40a4b68e0926843874ae',ramdisk_id='',reservation_id='r-bqvy1wtv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-332508527',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T11:04:24Z,user_data=None,user_id='6c49cba00cff4c4b80080c5f917b4176',uuid=7e67fb47-500c-4e85-b384-27408ec622a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3787892f-48da-4e39-8c41-8fdb94950e59", "address": "fa:16:3e:75:4f:64", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3787892f-48", "ovs_interfaceid": "3787892f-48da-4e39-8c41-8fdb94950e59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-544af908-c06d-4582-937d-c0552a3a4895 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Converting VIF {"id": "3787892f-48da-4e39-8c41-8fdb94950e59", "address": "fa:16:3e:75:4f:64", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3787892f-48", "ovs_interfaceid": "3787892f-48da-4e39-8c41-8fdb94950e59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-544af908-c06d-4582-937d-c0552a3a4895 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:4f:64,bridge_name='br-int',has_traffic_filtering=True,id=3787892f-48da-4e39-8c41-8fdb94950e59,network=Network(a1692a13-d1d7-4df6-bfc0-54f231846889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3787892f-48') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG os_vif [None req-544af908-c06d-4582-937d-c0552a3a4895 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:4f:64,bridge_name='br-int',has_traffic_filtering=True,id=3787892f-48da-4e39-8c41-8fdb94950e59,network=Network(a1692a13-d1d7-4df6-bfc0-54f231846889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3787892f-48') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3787892f-48, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dd90c079-e7b2-42f9-963f-53d157a9a39c) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:06:10 user nova-compute[74994]: INFO os_vif [None req-544af908-c06d-4582-937d-c0552a3a4895 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:4f:64,bridge_name='br-int',has_traffic_filtering=True,id=3787892f-48da-4e39-8c41-8fdb94950e59,network=Network(a1692a13-d1d7-4df6-bfc0-54f231846889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3787892f-48')
Nov 28 11:06:10 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-544af908-c06d-4582-937d-c0552a3a4895 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-544af908-c06d-4582-937d-c0552a3a4895 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zNJeKmhr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:06:10 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-544af908-c06d-4582-937d-c0552a3a4895 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:06:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-544af908-c06d-4582-937d-c0552a3a4895 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-544af908-c06d-4582-937d-c0552a3a4895 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcd3a38-4db2-4dfe-837e-2275cad491be]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-544af908-c06d-4582-937d-c0552a3a4895 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 11:06:10 user nova-compute[74994]: No targets found.
Nov 28 11:06:10 user nova-compute[74994]: iSNS:
Nov 28 11:06:10 user nova-compute[74994]: No targets found.
Nov 28 11:06:10 user nova-compute[74994]: STATIC:
Nov 28 11:06:10 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd
Nov 28 11:06:10 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:06:10 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:06:10 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd
Nov 28 11:06:10 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:06:10 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:06:10 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de
Nov 28 11:06:10 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:06:10 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:06:10 user nova-compute[74994]: FIRMWARE:
Nov 28 11:06:10 user nova-compute[74994]: No targets found.
Nov 28 11:06:10 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-544af908-c06d-4582-937d-c0552a3a4895 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 11:06:10 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 11:06:10 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-544af908-c06d-4582-937d-c0552a3a4895 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c27420a-b4c8-41c4-ad86-3c97c81b1899]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce0e97e-08c4-4d50-8a86-7856cb2d6e61]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-544af908-c06d-4582-937d-c0552a3a4895 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:06:10 user nova-compute[74994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)
Nov 28 11:06:10 user nova-compute[74994]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)
Nov 28 11:06:10 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-544af908-c06d-4582-937d-c0552a3a4895 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:06:10 user nova-compute[74994]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd (non-flash)
Nov 28 11:06:10 user nova-compute[74994]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)
Nov 28 11:06:10 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-544af908-c06d-4582-937d-c0552a3a4895 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb92071b6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd'): ({'sdd'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-544af908-c06d-4582-937d-c0552a3a4895 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Removing single pathed devices sdd {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f59b918-c704-4634-8fb6-ce872daef18e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[65dfe5f1-bd94-464e-a494-b7b6ef999cba]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-544af908-c06d-4582-937d-c0552a3a4895 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Flushing IO for device /dev/sdd {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8786be10-f956-4a5f-bc9f-e7bd6f3d11dc]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-544af908-c06d-4582-937d-c0552a3a4895 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57aaa47-2fa8-4dee-91e1-30440673da19]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-544af908-c06d-4582-937d-c0552a3a4895 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-544af908-c06d-4582-937d-c0552a3a4895 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] SCSI volumes sdd have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO3633e89d-cc10eaa7adf3c181', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_3633e89d', '/dev/disk/by-id/scsi-26363313065616137') {{(pid=86494) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[482ec1bf-0743-4cfc-ba86-4f7cbf5e8d17]: (4, None) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-544af908-c06d-4582-937d-c0552a3a4895 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf80478-c8a0-4595-8674-dc1de48cf5c5]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-544af908-c06d-4582-937d-c0552a3a4895 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc405962-b1a4-4db6-9b64-dc549ee8eaf1]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-544af908-c06d-4582-937d-c0552a3a4895 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd, portal: 172.16.0.220,3260]
Nov 28 11:06:10 user nova-compute[74994]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd, portal: 172.16.0.220,3260] successful.
Nov 28 11:06:10 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:06:10 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:06:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e5e838a-f84b-4636-86e1-86a3de5fd7dd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:06:11 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a0be23-9a4b-4be7-bb75-021f82587a34]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:06:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-544af908-c06d-4582-937d-c0552a3a4895 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:06:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-544af908-c06d-4582-937d-c0552a3a4895 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:06:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-544af908-c06d-4582-937d-c0552a3a4895 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] <== disconnect_volume: return (312ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:06:11 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-544af908-c06d-4582-937d-c0552a3a4895 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 11:06:11 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-544af908-c06d-4582-937d-c0552a3a4895 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Deleting instance files /opt/stack/data/nova/instances/7e67fb47-500c-4e85-b384-27408ec622a9_del
Nov 28 11:06:11 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-544af908-c06d-4582-937d-c0552a3a4895 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Deletion of /opt/stack/data/nova/instances/7e67fb47-500c-4e85-b384-27408ec622a9_del complete
Nov 28 11:06:11 user nova-compute[74994]: INFO nova.compute.manager [None req-544af908-c06d-4582-937d-c0552a3a4895 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 28 11:06:11 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-544af908-c06d-4582-937d-c0552a3a4895 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 11:06:11 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 11:06:11 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 11:06:11 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:06:11 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:06:11 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Took 0.56 seconds to deallocate network for instance.
Nov 28 11:06:12 user nova-compute[74994]: DEBUG nova.compute.manager [req-a9b20ec4-bbde-4aec-8b16-07123649b46e req-bf9fb124-e494-4470-bbd8-5dd0459946ce service nova] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Received event network-vif-plugged-3787892f-48da-4e39-8c41-8fdb94950e59 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:06:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a9b20ec4-bbde-4aec-8b16-07123649b46e req-bf9fb124-e494-4470-bbd8-5dd0459946ce service nova] Acquiring lock "7e67fb47-500c-4e85-b384-27408ec622a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:06:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a9b20ec4-bbde-4aec-8b16-07123649b46e req-bf9fb124-e494-4470-bbd8-5dd0459946ce service nova] Lock "7e67fb47-500c-4e85-b384-27408ec622a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:06:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a9b20ec4-bbde-4aec-8b16-07123649b46e req-bf9fb124-e494-4470-bbd8-5dd0459946ce service nova] Lock "7e67fb47-500c-4e85-b384-27408ec622a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:06:12 user nova-compute[74994]: DEBUG nova.compute.manager [req-a9b20ec4-bbde-4aec-8b16-07123649b46e req-bf9fb124-e494-4470-bbd8-5dd0459946ce service nova] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] No waiting events found dispatching network-vif-plugged-3787892f-48da-4e39-8c41-8fdb94950e59 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:06:12 user nova-compute[74994]: WARNING nova.compute.manager [req-a9b20ec4-bbde-4aec-8b16-07123649b46e req-bf9fb124-e494-4470-bbd8-5dd0459946ce service nova] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Received unexpected event network-vif-plugged-3787892f-48da-4e39-8c41-8fdb94950e59 for instance with vm_state active and task_state deleting.
Nov 28 11:06:12 user nova-compute[74994]: DEBUG nova.compute.manager [req-a9b20ec4-bbde-4aec-8b16-07123649b46e req-bf9fb124-e494-4470-bbd8-5dd0459946ce service nova] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Received event network-vif-deleted-3787892f-48da-4e39-8c41-8fdb94950e59 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:06:12 user nova-compute[74994]: INFO nova.compute.manager [None req-544af908-c06d-4582-937d-c0552a3a4895 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 7e67fb47-500c-4e85-b384-27408ec622a9] Took 0.78 seconds to detach 1 volumes for instance.
Nov 28 11:06:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-544af908-c06d-4582-937d-c0552a3a4895 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:06:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-544af908-c06d-4582-937d-c0552a3a4895 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:06:12 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-544af908-c06d-4582-937d-c0552a3a4895 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:06:12 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-544af908-c06d-4582-937d-c0552a3a4895 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:06:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-544af908-c06d-4582-937d-c0552a3a4895 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.341s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:06:12 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-544af908-c06d-4582-937d-c0552a3a4895 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Deleted allocations for instance 7e67fb47-500c-4e85-b384-27408ec622a9
Nov 28 11:06:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-544af908-c06d-4582-937d-c0552a3a4895 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "7e67fb47-500c-4e85-b384-27408ec622a9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.034s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:06:14 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:06:14 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 11:06:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:18 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:06:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:06:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:06:18 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:06:18 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 11:06:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:06:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:06:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:06:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:06:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:06:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:06:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:06:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:06:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc5adf9-5a73-4d7d-b53d-849354a3a053/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:06:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc5adf9-5a73-4d7d-b53d-849354a3a053/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:06:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc5adf9-5a73-4d7d-b53d-849354a3a053/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:06:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc5adf9-5a73-4d7d-b53d-849354a3a053/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:06:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2caa913-b0cc-46b7-b90d-fe507bc00b09/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:06:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2caa913-b0cc-46b7-b90d-fe507bc00b09/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:06:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2caa913-b0cc-46b7-b90d-fe507bc00b09/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:06:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2caa913-b0cc-46b7-b90d-fe507bc00b09/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:06:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:06:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:06:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:06:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json" returned: 0 in 0.293s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:06:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7295ae8a-462e-4b75-af40-35aac439dad0/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:06:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:06:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7295ae8a-462e-4b75-af40-35aac439dad0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:06:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7295ae8a-462e-4b75-af40-35aac439dad0/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:06:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7295ae8a-462e-4b75-af40-35aac439dad0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:06:20 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:06:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f267741-9611-4812-9afa-32717d16abc5/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:06:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f267741-9611-4812-9afa-32717d16abc5/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:06:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f267741-9611-4812-9afa-32717d16abc5/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:06:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f267741-9611-4812-9afa-32717d16abc5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:06:21 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:06:21 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:06:21 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:06:21 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=7657MB free_disk=24.954448699951172GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 11:06:21 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:06:21 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:06:21 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:06:21 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 759fbcfd-ab13-438f-b860-6393a97d1205 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:06:21 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 20716905-c56a-4729-8c5b-9188502dc477 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:06:21 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance b743c491-ece8-4781-9530-b2f38ffc1079 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:06:21 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance cdc5adf9-5a73-4d7d-b53d-849354a3a053 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:06:21 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance e3b0b960-3f38-4a6f-9017-209fbc2110c9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:06:21 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 0f267741-9611-4812-9afa-32717d16abc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:06:21 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance a2caa913-b0cc-46b7-b90d-fe507bc00b09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:06:21 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 7295ae8a-462e-4b75-af40-35aac439dad0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:06:21 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 11:06:21 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 11:06:22 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:06:22 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:06:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 11:06:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.430s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:06:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Acquiring lock "6f2a2617-b00e-4d38-98a0-cca578b95f0e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:06:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "6f2a2617-b00e-4d38-98a0-cca578b95f0e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:06:23 user nova-compute[74994]: DEBUG nova.compute.manager [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 11:06:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:06:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:06:23 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 11:06:23 user nova-compute[74994]: INFO nova.compute.claims [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Claim successful on node user
Nov 28 11:06:23 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:06:23 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:06:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.376s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:06:23 user nova-compute[74994]: DEBUG nova.compute.manager [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 11:06:23 user nova-compute[74994]: DEBUG nova.compute.manager [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 11:06:23 user nova-compute[74994]: DEBUG nova.network.neutron [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 11:06:23 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 11:06:23 user nova-compute[74994]: DEBUG nova.compute.manager [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 11:06:23 user nova-compute[74994]: DEBUG nova.policy [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '18ba016046ac42599094e626d3fdd860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9670a509ac14f41a9f44d7299fd2f30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 11:06:23 user nova-compute[74994]: DEBUG nova.compute.manager [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 11:06:23 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 11:06:23 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Creating image(s)
Nov 28 11:06:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Acquiring lock "/opt/stack/data/nova/instances/6f2a2617-b00e-4d38-98a0-cca578b95f0e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:06:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "/opt/stack/data/nova/instances/6f2a2617-b00e-4d38-98a0-cca578b95f0e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:06:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "/opt/stack/data/nova/instances/6f2a2617-b00e-4d38-98a0-cca578b95f0e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:06:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Acquiring lock "b7a97c095b68db6f6ac2e0065f45f5df1eb8abba" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:06:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "b7a97c095b68db6f6ac2e0065f45f5df1eb8abba" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:06:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7a97c095b68db6f6ac2e0065f45f5df1eb8abba.part --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:06:24 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:06:24 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 11:06:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:24 user nova-compute[74994]: DEBUG nova.network.neutron [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Successfully created port: 5e571385-8510-4cdd-ae39-ebd481e04a59 {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 11:06:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "refresh_cache-759fbcfd-ab13-438f-b860-6393a97d1205" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:06:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquired lock "refresh_cache-759fbcfd-ab13-438f-b860-6393a97d1205" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:06:24 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Forcefully refreshing network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 11:06:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7a97c095b68db6f6ac2e0065f45f5df1eb8abba.part --force-share --output=json" returned: 0 in 0.178s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:06:24 user nova-compute[74994]: DEBUG nova.virt.images [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] b21e7b65-3fcd-47eb-9049-6107312cf158 was qcow2, converting to raw {{(pid=74994) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 11:06:24 user nova-compute[74994]: DEBUG nova.privsep.utils [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74994) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 11:06:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b7a97c095b68db6f6ac2e0065f45f5df1eb8abba.part /opt/stack/data/nova/instances/_base/b7a97c095b68db6f6ac2e0065f45f5df1eb8abba.converted {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:06:25 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b7a97c095b68db6f6ac2e0065f45f5df1eb8abba.part /opt/stack/data/nova/instances/_base/b7a97c095b68db6f6ac2e0065f45f5df1eb8abba.converted" returned: 0 in 0.471s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:06:25 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7a97c095b68db6f6ac2e0065f45f5df1eb8abba.converted --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:06:25 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7a97c095b68db6f6ac2e0065f45f5df1eb8abba.converted --force-share --output=json" returned: 0 in 0.206s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:06:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "b7a97c095b68db6f6ac2e0065f45f5df1eb8abba" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.308s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:06:25 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7a97c095b68db6f6ac2e0065f45f5df1eb8abba --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:06:25 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Updating instance_info_cache with network_info: [{"id": "7d4a82ba-d222-44bb-baac-6642f24b9528", "address": "fa:16:3e:4f:75:25", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d4a82ba-d2", "ovs_interfaceid": "7d4a82ba-d222-44bb-baac-6642f24b9528", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:06:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Releasing lock "refresh_cache-759fbcfd-ab13-438f-b860-6393a97d1205" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:06:25 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Updated the network info_cache for instance {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 11:06:25 user nova-compute[74994]: DEBUG nova.network.neutron [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Successfully updated port: 5e571385-8510-4cdd-ae39-ebd481e04a59 {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 11:06:25 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7a97c095b68db6f6ac2e0065f45f5df1eb8abba --force-share --output=json" returned: 0 in 0.199s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:06:25 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:06:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Acquiring lock "b7a97c095b68db6f6ac2e0065f45f5df1eb8abba" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:06:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "b7a97c095b68db6f6ac2e0065f45f5df1eb8abba" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:06:25 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7a97c095b68db6f6ac2e0065f45f5df1eb8abba --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:06:25 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:06:25 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:06:25 user nova-compute[74994]: DEBUG nova.compute.manager [req-d09126d9-09ee-4036-b349-28eac5a6c570 req-9593d175-5cee-4697-abd8-cd4058d8167f service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Received event network-changed-5e571385-8510-4cdd-ae39-ebd481e04a59 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:06:25 user nova-compute[74994]: DEBUG nova.compute.manager [req-d09126d9-09ee-4036-b349-28eac5a6c570 req-9593d175-5cee-4697-abd8-cd4058d8167f service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Refreshing instance network info cache due to event network-changed-5e571385-8510-4cdd-ae39-ebd481e04a59. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:06:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d09126d9-09ee-4036-b349-28eac5a6c570 req-9593d175-5cee-4697-abd8-cd4058d8167f service nova] Acquiring lock "refresh_cache-6f2a2617-b00e-4d38-98a0-cca578b95f0e" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:06:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d09126d9-09ee-4036-b349-28eac5a6c570 req-9593d175-5cee-4697-abd8-cd4058d8167f service nova] Acquired lock "refresh_cache-6f2a2617-b00e-4d38-98a0-cca578b95f0e" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:06:25 user nova-compute[74994]: DEBUG nova.network.neutron [req-d09126d9-09ee-4036-b349-28eac5a6c570 req-9593d175-5cee-4697-abd8-cd4058d8167f service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Refreshing network info cache for port 5e571385-8510-4cdd-ae39-ebd481e04a59 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:06:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Acquiring lock "refresh_cache-6f2a2617-b00e-4d38-98a0-cca578b95f0e" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:06:25 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:06:25 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:06:25 user nova-compute[74994]: DEBUG nova.network.neutron [req-d09126d9-09ee-4036-b349-28eac5a6c570 req-9593d175-5cee-4697-abd8-cd4058d8167f service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 11:06:25 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7a97c095b68db6f6ac2e0065f45f5df1eb8abba --force-share --output=json" returned: 0 in 0.177s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:06:25 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7a97c095b68db6f6ac2e0065f45f5df1eb8abba,backing_fmt=raw /opt/stack/data/nova/instances/6f2a2617-b00e-4d38-98a0-cca578b95f0e/disk 1073741824 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:06:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:25 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7a97c095b68db6f6ac2e0065f45f5df1eb8abba,backing_fmt=raw /opt/stack/data/nova/instances/6f2a2617-b00e-4d38-98a0-cca578b95f0e/disk 1073741824" returned: 0 in 0.051s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:06:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "b7a97c095b68db6f6ac2e0065f45f5df1eb8abba" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:06:25 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7a97c095b68db6f6ac2e0065f45f5df1eb8abba --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:06:25 user nova-compute[74994]: DEBUG nova.network.neutron [req-d09126d9-09ee-4036-b349-28eac5a6c570 req-9593d175-5cee-4697-abd8-cd4058d8167f service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:06:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d09126d9-09ee-4036-b349-28eac5a6c570 req-9593d175-5cee-4697-abd8-cd4058d8167f service nova] Releasing lock "refresh_cache-6f2a2617-b00e-4d38-98a0-cca578b95f0e" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:06:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Acquired lock "refresh_cache-6f2a2617-b00e-4d38-98a0-cca578b95f0e" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:06:25 user nova-compute[74994]: DEBUG nova.network.neutron [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 11:06:25 user nova-compute[74994]: DEBUG nova.network.neutron [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 11:06:25 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7a97c095b68db6f6ac2e0065f45f5df1eb8abba --force-share --output=json" returned: 0 in 0.172s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:06:25 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6f2a2617-b00e-4d38-98a0-cca578b95f0e/disk. size=1073741824 {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 11:06:25 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2a2617-b00e-4d38-98a0-cca578b95f0e/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:06:26 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2a2617-b00e-4d38-98a0-cca578b95f0e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:06:26 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Cannot resize image /opt/stack/data/nova/instances/6f2a2617-b00e-4d38-98a0-cca578b95f0e/disk to a smaller size. {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 11:06:26 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Created local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 11:06:26 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Ensure instance console log exists: /opt/stack/data/nova/instances/6f2a2617-b00e-4d38-98a0-cca578b95f0e/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 11:06:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:06:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:06:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:06:26 user nova-compute[74994]: DEBUG nova.network.neutron [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Updating instance_info_cache with network_info: [{"id": "5e571385-8510-4cdd-ae39-ebd481e04a59", "address": "fa:16:3e:83:bf:50", "network": {"id": "89f2b906-9ef3-4e31-87e5-3e0cd23e8695", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2005181920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9670a509ac14f41a9f44d7299fd2f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e571385-85", "ovs_interfaceid": "5e571385-8510-4cdd-ae39-ebd481e04a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:06:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Releasing lock "refresh_cache-6f2a2617-b00e-4d38-98a0-cca578b95f0e" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:06:26 user nova-compute[74994]: DEBUG nova.compute.manager [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Instance network_info: |[{"id": "5e571385-8510-4cdd-ae39-ebd481e04a59", "address": "fa:16:3e:83:bf:50", "network": {"id": "89f2b906-9ef3-4e31-87e5-3e0cd23e8695", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2005181920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9670a509ac14f41a9f44d7299fd2f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e571385-85", "ovs_interfaceid": "5e571385-8510-4cdd-ae39-ebd481e04a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 11:06:26 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Start _get_guest_xml network_info=[{"id": "5e571385-8510-4cdd-ae39-ebd481e04a59", "address": "fa:16:3e:83:bf:50", "network": {"id": "89f2b906-9ef3-4e31-87e5-3e0cd23e8695", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2005181920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9670a509ac14f41a9f44d7299fd2f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e571385-85", "ovs_interfaceid": "5e571385-8510-4cdd-ae39-ebd481e04a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T11:06:21Z,direct_url=<?>,disk_format='qcow2',id=b21e7b65-3fcd-47eb-9049-6107312cf158,min_disk=0,min_ram=0,name='tempest-scenario-img--581549072',owner='b9670a509ac14f41a9f44d7299fd2f30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T11:06:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'b21e7b65-3fcd-47eb-9049-6107312cf158'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 11:06:26 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:06:26 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:06:26 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 11:06:26 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 11:06:26 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 11:06:26 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 11:06:26 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 11:06:26 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T11:06:21Z,direct_url=<?>,disk_format='qcow2',id=b21e7b65-3fcd-47eb-9049-6107312cf158,min_disk=0,min_ram=0,name='tempest-scenario-img--581549072',owner='b9670a509ac14f41a9f44d7299fd2f30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T11:06:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 11:06:26 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 11:06:26 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 11:06:26 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 11:06:26 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 11:06:26 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 11:06:26 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 11:06:26 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 11:06:26 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 11:06:26 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 11:06:26 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 11:06:26 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:06:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-296035444',display_name='tempest-TestMinimumBasicScenario-server-296035444',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-296035444',id=36,image_ref='b21e7b65-3fcd-47eb-9049-6107312cf158',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKsXfdwtbuiSkzh8n1hH3biCADc9dOng+NIhhSAsGkiVH3nT+6DmOVQKMzKS1b3MDm4Qq5GZrs0ayvMtPCGozPYZXRugqpHoak1BLnDAWzKwZZQWioftsJSD9qS8Ye+hxg==',key_name='tempest-TestMinimumBasicScenario-568006080',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9670a509ac14f41a9f44d7299fd2f30',ramdisk_id='',reservation_id='r-d2mmhrgx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b21e7b65-3fcd-47eb-9049-6107312cf158',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-756572202',owner_user_name='tempest-TestMinimumBasicScenario-756572202-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:06:24Z,user_data=None,user_id='18ba016046ac42599094e626d3fdd860',uuid=6f2a2617-b00e-4d38-98a0-cca578b95f0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e571385-8510-4cdd-ae39-ebd481e04a59", "address": "fa:16:3e:83:bf:50", "network": {"id": "89f2b906-9ef3-4e31-87e5-3e0cd23e8695", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2005181920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9670a509ac14f41a9f44d7299fd2f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e571385-85", "ovs_interfaceid": "5e571385-8510-4cdd-ae39-ebd481e04a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 11:06:26 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Converting VIF {"id": "5e571385-8510-4cdd-ae39-ebd481e04a59", "address": "fa:16:3e:83:bf:50", "network": {"id": "89f2b906-9ef3-4e31-87e5-3e0cd23e8695", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2005181920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9670a509ac14f41a9f44d7299fd2f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e571385-85", "ovs_interfaceid": "5e571385-8510-4cdd-ae39-ebd481e04a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:06:26 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:bf:50,bridge_name='br-int',has_traffic_filtering=True,id=5e571385-8510-4cdd-ae39-ebd481e04a59,network=Network(89f2b906-9ef3-4e31-87e5-3e0cd23e8695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e571385-85') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:06:26 user nova-compute[74994]: DEBUG nova.objects.instance [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f2a2617-b00e-4d38-98a0-cca578b95f0e {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:06:26 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] End _get_guest_xml xml=<domain type="kvm">
Nov 28 11:06:26 user nova-compute[74994]:   <uuid>6f2a2617-b00e-4d38-98a0-cca578b95f0e</uuid>
Nov 28 11:06:26 user nova-compute[74994]:   <name>instance-00000024</name>
Nov 28 11:06:26 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 11:06:26 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 11:06:26 user nova-compute[74994]:   <metadata>
Nov 28 11:06:26 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 11:06:26 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 11:06:26 user nova-compute[74994]:       <nova:name>tempest-TestMinimumBasicScenario-server-296035444</nova:name>
Nov 28 11:06:26 user nova-compute[74994]:       <nova:creationTime>2023-11-28 11:06:26</nova:creationTime>
Nov 28 11:06:26 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 11:06:26 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 11:06:26 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 11:06:26 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 11:06:26 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 11:06:26 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 11:06:26 user nova-compute[74994]:       </nova:flavor>
Nov 28 11:06:26 user nova-compute[74994]:       <nova:owner>
Nov 28 11:06:26 user nova-compute[74994]:         <nova:user uuid="18ba016046ac42599094e626d3fdd860">tempest-TestMinimumBasicScenario-756572202-project-member</nova:user>
Nov 28 11:06:26 user nova-compute[74994]:         <nova:project uuid="b9670a509ac14f41a9f44d7299fd2f30">tempest-TestMinimumBasicScenario-756572202</nova:project>
Nov 28 11:06:26 user nova-compute[74994]:       </nova:owner>
Nov 28 11:06:26 user nova-compute[74994]:       <nova:root type="image" uuid="b21e7b65-3fcd-47eb-9049-6107312cf158"/>
Nov 28 11:06:26 user nova-compute[74994]:       <nova:ports>
Nov 28 11:06:26 user nova-compute[74994]:         <nova:port uuid="5e571385-8510-4cdd-ae39-ebd481e04a59">
Nov 28 11:06:26 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 11:06:26 user nova-compute[74994]:         </nova:port>
Nov 28 11:06:26 user nova-compute[74994]:       </nova:ports>
Nov 28 11:06:26 user nova-compute[74994]:     </nova:instance>
Nov 28 11:06:26 user nova-compute[74994]:   </metadata>
Nov 28 11:06:26 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 11:06:26 user nova-compute[74994]:     <system>
Nov 28 11:06:26 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 11:06:26 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 11:06:26 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 11:06:26 user nova-compute[74994]:       <entry name="serial">6f2a2617-b00e-4d38-98a0-cca578b95f0e</entry>
Nov 28 11:06:26 user nova-compute[74994]:       <entry name="uuid">6f2a2617-b00e-4d38-98a0-cca578b95f0e</entry>
Nov 28 11:06:26 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 11:06:26 user nova-compute[74994]:     </system>
Nov 28 11:06:26 user nova-compute[74994]:   </sysinfo>
Nov 28 11:06:26 user nova-compute[74994]:   <os>
Nov 28 11:06:26 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 11:06:26 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 11:06:26 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 11:06:26 user nova-compute[74994]:   </os>
Nov 28 11:06:26 user nova-compute[74994]:   <features>
Nov 28 11:06:26 user nova-compute[74994]:     <acpi/>
Nov 28 11:06:26 user nova-compute[74994]:     <apic/>
Nov 28 11:06:26 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 11:06:26 user nova-compute[74994]:   </features>
Nov 28 11:06:26 user nova-compute[74994]:   <clock offset="utc">
Nov 28 11:06:26 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 11:06:26 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 11:06:26 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 11:06:26 user nova-compute[74994]:   </clock>
Nov 28 11:06:26 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 11:06:26 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 11:06:26 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 11:06:26 user nova-compute[74994]:   </cpu>
Nov 28 11:06:26 user nova-compute[74994]:   <devices>
Nov 28 11:06:26 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 11:06:26 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 11:06:26 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/6f2a2617-b00e-4d38-98a0-cca578b95f0e/disk"/>
Nov 28 11:06:26 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 11:06:26 user nova-compute[74994]:     </disk>
Nov 28 11:06:26 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 11:06:26 user nova-compute[74994]:       <mac address="fa:16:3e:83:bf:50"/>
Nov 28 11:06:26 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:06:26 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 11:06:26 user nova-compute[74994]:       <target dev="tap5e571385-85"/>
Nov 28 11:06:26 user nova-compute[74994]:     </interface>
Nov 28 11:06:26 user nova-compute[74994]:     <serial type="pty">
Nov 28 11:06:26 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/6f2a2617-b00e-4d38-98a0-cca578b95f0e/console.log" append="off"/>
Nov 28 11:06:26 user nova-compute[74994]:     </serial>
Nov 28 11:06:26 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 11:06:26 user nova-compute[74994]:     <video>
Nov 28 11:06:26 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:06:26 user nova-compute[74994]:     </video>
Nov 28 11:06:26 user nova-compute[74994]:     <rng model="virtio">
Nov 28 11:06:26 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 11:06:26 user nova-compute[74994]:     </rng>
Nov 28 11:06:26 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 11:06:26 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 11:06:26 user nova-compute[74994]:       <stats period="10"/>
Nov 28 11:06:26 user nova-compute[74994]:     </memballoon>
Nov 28 11:06:26 user nova-compute[74994]:   </devices>
Nov 28 11:06:26 user nova-compute[74994]: </domain>
Nov 28 11:06:26 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 11:06:26 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:06:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-296035444',display_name='tempest-TestMinimumBasicScenario-server-296035444',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-296035444',id=36,image_ref='b21e7b65-3fcd-47eb-9049-6107312cf158',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKsXfdwtbuiSkzh8n1hH3biCADc9dOng+NIhhSAsGkiVH3nT+6DmOVQKMzKS1b3MDm4Qq5GZrs0ayvMtPCGozPYZXRugqpHoak1BLnDAWzKwZZQWioftsJSD9qS8Ye+hxg==',key_name='tempest-TestMinimumBasicScenario-568006080',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9670a509ac14f41a9f44d7299fd2f30',ramdisk_id='',reservation_id='r-d2mmhrgx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b21e7b65-3fcd-47eb-9049-6107312cf158',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-756572202',owner_user_name='tempest-TestMinimumBasicScenario-756572202-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:06:24Z,user_data=None,user_id='18ba016046ac42599094e626d3fdd860',uuid=6f2a2617-b00e-4d38-98a0-cca578b95f0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e571385-8510-4cdd-ae39-ebd481e04a59", "address": "fa:16:3e:83:bf:50", "network": {"id": "89f2b906-9ef3-4e31-87e5-3e0cd23e8695", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2005181920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9670a509ac14f41a9f44d7299fd2f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e571385-85", "ovs_interfaceid": "5e571385-8510-4cdd-ae39-ebd481e04a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 11:06:26 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Converting VIF {"id": "5e571385-8510-4cdd-ae39-ebd481e04a59", "address": "fa:16:3e:83:bf:50", "network": {"id": "89f2b906-9ef3-4e31-87e5-3e0cd23e8695", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2005181920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9670a509ac14f41a9f44d7299fd2f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e571385-85", "ovs_interfaceid": "5e571385-8510-4cdd-ae39-ebd481e04a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:06:26 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:bf:50,bridge_name='br-int',has_traffic_filtering=True,id=5e571385-8510-4cdd-ae39-ebd481e04a59,network=Network(89f2b906-9ef3-4e31-87e5-3e0cd23e8695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e571385-85') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:06:26 user nova-compute[74994]: DEBUG os_vif [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:bf:50,bridge_name='br-int',has_traffic_filtering=True,id=5e571385-8510-4cdd-ae39-ebd481e04a59,network=Network(89f2b906-9ef3-4e31-87e5-3e0cd23e8695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e571385-85') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 11:06:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:06:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 11:06:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '415d3790-3e9d-5a41-9bc5-dea090de295f', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:06:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e571385-85, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:06:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5e571385-85, col_values=(('qos', UUID('e49e7353-a4b5-477f-9bb6-4ebf2a564c31')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:06:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5e571385-85, col_values=(('external_ids', {'iface-id': '5e571385-8510-4cdd-ae39-ebd481e04a59', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:bf:50', 'vm-uuid': '6f2a2617-b00e-4d38-98a0-cca578b95f0e'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:06:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:06:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:26 user nova-compute[74994]: INFO os_vif [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:bf:50,bridge_name='br-int',has_traffic_filtering=True,id=5e571385-8510-4cdd-ae39-ebd481e04a59,network=Network(89f2b906-9ef3-4e31-87e5-3e0cd23e8695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e571385-85')
Nov 28 11:06:26 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:06:26 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] No VIF found with MAC fa:16:3e:83:bf:50, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:06:27 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:27 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:27 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:27 user nova-compute[74994]: DEBUG nova.compute.manager [req-5573a5c2-d66b-4676-80ec-8f0eff1b7d2b req-e2458220-b2b3-4117-bb62-39e00c802201 service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Received event network-vif-plugged-5e571385-8510-4cdd-ae39-ebd481e04a59 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:06:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-5573a5c2-d66b-4676-80ec-8f0eff1b7d2b req-e2458220-b2b3-4117-bb62-39e00c802201 service nova] Acquiring lock "6f2a2617-b00e-4d38-98a0-cca578b95f0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:06:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-5573a5c2-d66b-4676-80ec-8f0eff1b7d2b req-e2458220-b2b3-4117-bb62-39e00c802201 service nova] Lock "6f2a2617-b00e-4d38-98a0-cca578b95f0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:06:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-5573a5c2-d66b-4676-80ec-8f0eff1b7d2b req-e2458220-b2b3-4117-bb62-39e00c802201 service nova] Lock "6f2a2617-b00e-4d38-98a0-cca578b95f0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:06:27 user nova-compute[74994]: DEBUG nova.compute.manager [req-5573a5c2-d66b-4676-80ec-8f0eff1b7d2b req-e2458220-b2b3-4117-bb62-39e00c802201 service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] No waiting events found dispatching network-vif-plugged-5e571385-8510-4cdd-ae39-ebd481e04a59 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:06:27 user nova-compute[74994]: WARNING nova.compute.manager [req-5573a5c2-d66b-4676-80ec-8f0eff1b7d2b req-e2458220-b2b3-4117-bb62-39e00c802201 service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Received unexpected event network-vif-plugged-5e571385-8510-4cdd-ae39-ebd481e04a59 for instance with vm_state building and task_state spawning.
Nov 28 11:06:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:29 user nova-compute[74994]: DEBUG nova.compute.manager [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 11:06:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 11:06:29 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Instance spawned successfully.
Nov 28 11:06:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 11:06:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:06:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:06:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:06:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:06:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:06:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:06:29 user nova-compute[74994]: DEBUG nova.compute.manager [req-1d3445a8-3759-4368-a547-ea255d15da53 req-d70bf6dc-d03a-47cb-a618-bf03b754ca8c service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Received event network-vif-plugged-5e571385-8510-4cdd-ae39-ebd481e04a59 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:06:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-1d3445a8-3759-4368-a547-ea255d15da53 req-d70bf6dc-d03a-47cb-a618-bf03b754ca8c service nova] Acquiring lock "6f2a2617-b00e-4d38-98a0-cca578b95f0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:06:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-1d3445a8-3759-4368-a547-ea255d15da53 req-d70bf6dc-d03a-47cb-a618-bf03b754ca8c service nova] Lock "6f2a2617-b00e-4d38-98a0-cca578b95f0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:06:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-1d3445a8-3759-4368-a547-ea255d15da53 req-d70bf6dc-d03a-47cb-a618-bf03b754ca8c service nova] Lock "6f2a2617-b00e-4d38-98a0-cca578b95f0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:06:29 user nova-compute[74994]: DEBUG nova.compute.manager [req-1d3445a8-3759-4368-a547-ea255d15da53 req-d70bf6dc-d03a-47cb-a618-bf03b754ca8c service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] No waiting events found dispatching network-vif-plugged-5e571385-8510-4cdd-ae39-ebd481e04a59 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:06:29 user nova-compute[74994]: WARNING nova.compute.manager [req-1d3445a8-3759-4368-a547-ea255d15da53 req-d70bf6dc-d03a-47cb-a618-bf03b754ca8c service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Received unexpected event network-vif-plugged-5e571385-8510-4cdd-ae39-ebd481e04a59 for instance with vm_state building and task_state spawning.
Nov 28 11:06:29 user nova-compute[74994]: INFO nova.compute.manager [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Took 5.94 seconds to spawn the instance on the hypervisor.
Nov 28 11:06:29 user nova-compute[74994]: DEBUG nova.compute.manager [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 11:06:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:29 user nova-compute[74994]: INFO nova.compute.manager [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Took 6.70 seconds to build instance.
Nov 28 11:06:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bda085fd-32f3-45b2-b0fd-e5b4e30431a0 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "6f2a2617-b00e-4d38-98a0-cca578b95f0e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.805s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:06:31 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d4e17547-b85f-4be9-a72a-70a978a75ce6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Acquiring lock "cdc5adf9-5a73-4d7d-b53d-849354a3a053" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:06:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d4e17547-b85f-4be9-a72a-70a978a75ce6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Lock "cdc5adf9-5a73-4d7d-b53d-849354a3a053" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:06:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d4e17547-b85f-4be9-a72a-70a978a75ce6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Acquiring lock "cdc5adf9-5a73-4d7d-b53d-849354a3a053-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:06:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d4e17547-b85f-4be9-a72a-70a978a75ce6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Lock "cdc5adf9-5a73-4d7d-b53d-849354a3a053-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:06:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d4e17547-b85f-4be9-a72a-70a978a75ce6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Lock "cdc5adf9-5a73-4d7d-b53d-849354a3a053-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:06:32 user nova-compute[74994]: INFO nova.compute.manager [None req-d4e17547-b85f-4be9-a72a-70a978a75ce6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Terminating instance
Nov 28 11:06:32 user nova-compute[74994]: DEBUG nova.compute.manager [None req-d4e17547-b85f-4be9-a72a-70a978a75ce6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 11:06:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:32 user nova-compute[74994]: DEBUG nova.compute.manager [req-d9486c9e-4b2e-4ee1-a34f-abb71e471c37 req-9faf48b6-3a50-4a46-a4cb-d2454d68566f service nova] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Received event network-vif-unplugged-02fa284c-6c0a-4ace-8b7d-0a5adf50cce0 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:06:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d9486c9e-4b2e-4ee1-a34f-abb71e471c37 req-9faf48b6-3a50-4a46-a4cb-d2454d68566f service nova] Acquiring lock "cdc5adf9-5a73-4d7d-b53d-849354a3a053-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:06:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d9486c9e-4b2e-4ee1-a34f-abb71e471c37 req-9faf48b6-3a50-4a46-a4cb-d2454d68566f service nova] Lock "cdc5adf9-5a73-4d7d-b53d-849354a3a053-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:06:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d9486c9e-4b2e-4ee1-a34f-abb71e471c37 req-9faf48b6-3a50-4a46-a4cb-d2454d68566f service nova] Lock "cdc5adf9-5a73-4d7d-b53d-849354a3a053-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:06:32 user nova-compute[74994]: DEBUG nova.compute.manager [req-d9486c9e-4b2e-4ee1-a34f-abb71e471c37 req-9faf48b6-3a50-4a46-a4cb-d2454d68566f service nova] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] No waiting events found dispatching network-vif-unplugged-02fa284c-6c0a-4ace-8b7d-0a5adf50cce0 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:06:32 user nova-compute[74994]: DEBUG nova.compute.manager [req-d9486c9e-4b2e-4ee1-a34f-abb71e471c37 req-9faf48b6-3a50-4a46-a4cb-d2454d68566f service nova] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Received event network-vif-unplugged-02fa284c-6c0a-4ace-8b7d-0a5adf50cce0 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 11:06:32 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Instance destroyed successfully.
Nov 28 11:06:32 user nova-compute[74994]: DEBUG nova.objects.instance [None req-d4e17547-b85f-4be9-a72a-70a978a75ce6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Lazy-loading 'resources' on Instance uuid cdc5adf9-5a73-4d7d-b53d-849354a3a053 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:06:32 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-d4e17547-b85f-4be9-a72a-70a978a75ce6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:02:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-952578661',display_name='tempest-TestServerVolumeAttachmentScenario-server-952578661',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-952578661',id=31,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCN7IW+z7FvU29yvDdvFUQR00K0HW90nLrXJ4ku8x0B0xfQwVKHF8aQFoF2xcce7kz4/nwrNwhLSOoVU4Mx7rqVLYBw6Z6XTWPsEvNuWzagO/5ds0AKwO6nb99ndvOhxQ==',key_name='tempest-keypair-325096278',keypairs=<?>,launch_index=0,launched_at=2023-11-28T11:02:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='768cbb3a27d142b2a1e8b521894df120',ramdisk_id='',reservation_id='r-2nou5c6o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1027967726',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1027967726-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T11:02:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9affb276780046279c51abc15f9a8e29',uuid=cdc5adf9-5a73-4d7d-b53d-849354a3a053,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "02fa284c-6c0a-4ace-8b7d-0a5adf50cce0", "address": "fa:16:3e:6d:8e:f7", "network": {"id": "3691c6f1-1485-481c-8f01-e7a4a40f0d50", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2021818422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "768cbb3a27d142b2a1e8b521894df120", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02fa284c-6c", "ovs_interfaceid": "02fa284c-6c0a-4ace-8b7d-0a5adf50cce0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 11:06:32 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-d4e17547-b85f-4be9-a72a-70a978a75ce6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Converting VIF {"id": "02fa284c-6c0a-4ace-8b7d-0a5adf50cce0", "address": "fa:16:3e:6d:8e:f7", "network": {"id": "3691c6f1-1485-481c-8f01-e7a4a40f0d50", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2021818422-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "768cbb3a27d142b2a1e8b521894df120", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02fa284c-6c", "ovs_interfaceid": "02fa284c-6c0a-4ace-8b7d-0a5adf50cce0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:06:32 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-d4e17547-b85f-4be9-a72a-70a978a75ce6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:8e:f7,bridge_name='br-int',has_traffic_filtering=True,id=02fa284c-6c0a-4ace-8b7d-0a5adf50cce0,network=Network(3691c6f1-1485-481c-8f01-e7a4a40f0d50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02fa284c-6c') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:06:32 user nova-compute[74994]: DEBUG os_vif [None req-d4e17547-b85f-4be9-a72a-70a978a75ce6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:8e:f7,bridge_name='br-int',has_traffic_filtering=True,id=02fa284c-6c0a-4ace-8b7d-0a5adf50cce0,network=Network(3691c6f1-1485-481c-8f01-e7a4a40f0d50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02fa284c-6c') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 11:06:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap02fa284c-6c, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:06:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:06:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bca15ed1-8ebc-4645-bc4b-3c82a5b9e5f4) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:06:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:32 user nova-compute[74994]: INFO os_vif [None req-d4e17547-b85f-4be9-a72a-70a978a75ce6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:8e:f7,bridge_name='br-int',has_traffic_filtering=True,id=02fa284c-6c0a-4ace-8b7d-0a5adf50cce0,network=Network(3691c6f1-1485-481c-8f01-e7a4a40f0d50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02fa284c-6c')
Nov 28 11:06:32 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-d4e17547-b85f-4be9-a72a-70a978a75ce6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Deleting instance files /opt/stack/data/nova/instances/cdc5adf9-5a73-4d7d-b53d-849354a3a053_del
Nov 28 11:06:32 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-d4e17547-b85f-4be9-a72a-70a978a75ce6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Deletion of /opt/stack/data/nova/instances/cdc5adf9-5a73-4d7d-b53d-849354a3a053_del complete
Nov 28 11:06:32 user nova-compute[74994]: INFO nova.compute.manager [None req-d4e17547-b85f-4be9-a72a-70a978a75ce6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 28 11:06:32 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-d4e17547-b85f-4be9-a72a-70a978a75ce6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 11:06:32 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 11:06:32 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 11:06:33 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:06:33 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Took 0.72 seconds to deallocate network for instance.
Nov 28 11:06:33 user nova-compute[74994]: DEBUG nova.compute.manager [req-2c20901d-d906-4926-8610-e1a7a64db164 req-b3e0626a-3344-4c69-9bc2-f579749e59e2 service nova] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Received event network-vif-deleted-02fa284c-6c0a-4ace-8b7d-0a5adf50cce0 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:06:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d4e17547-b85f-4be9-a72a-70a978a75ce6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:06:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d4e17547-b85f-4be9-a72a-70a978a75ce6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:06:34 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-d4e17547-b85f-4be9-a72a-70a978a75ce6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:06:34 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-d4e17547-b85f-4be9-a72a-70a978a75ce6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:06:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d4e17547-b85f-4be9-a72a-70a978a75ce6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.418s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:06:34 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-d4e17547-b85f-4be9-a72a-70a978a75ce6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Deleted allocations for instance cdc5adf9-5a73-4d7d-b53d-849354a3a053
Nov 28 11:06:34 user nova-compute[74994]: DEBUG nova.compute.manager [req-53dec019-756f-4c7c-8e71-a52a1a92431c req-d9c2135b-20e3-465e-8cfb-282f69bd70f0 service nova] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Received event network-vif-plugged-02fa284c-6c0a-4ace-8b7d-0a5adf50cce0 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:06:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-53dec019-756f-4c7c-8e71-a52a1a92431c req-d9c2135b-20e3-465e-8cfb-282f69bd70f0 service nova] Acquiring lock "cdc5adf9-5a73-4d7d-b53d-849354a3a053-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:06:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-53dec019-756f-4c7c-8e71-a52a1a92431c req-d9c2135b-20e3-465e-8cfb-282f69bd70f0 service nova] Lock "cdc5adf9-5a73-4d7d-b53d-849354a3a053-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:06:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-53dec019-756f-4c7c-8e71-a52a1a92431c req-d9c2135b-20e3-465e-8cfb-282f69bd70f0 service nova] Lock "cdc5adf9-5a73-4d7d-b53d-849354a3a053-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:06:34 user nova-compute[74994]: DEBUG nova.compute.manager [req-53dec019-756f-4c7c-8e71-a52a1a92431c req-d9c2135b-20e3-465e-8cfb-282f69bd70f0 service nova] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] No waiting events found dispatching network-vif-plugged-02fa284c-6c0a-4ace-8b7d-0a5adf50cce0 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:06:34 user nova-compute[74994]: WARNING nova.compute.manager [req-53dec019-756f-4c7c-8e71-a52a1a92431c req-d9c2135b-20e3-465e-8cfb-282f69bd70f0 service nova] [instance: cdc5adf9-5a73-4d7d-b53d-849354a3a053] Received unexpected event network-vif-plugged-02fa284c-6c0a-4ace-8b7d-0a5adf50cce0 for instance with vm_state deleted and task_state None.
Nov 28 11:06:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d4e17547-b85f-4be9-a72a-70a978a75ce6 tempest-TestServerVolumeAttachmentScenario-1027967726 tempest-TestServerVolumeAttachmentScenario-1027967726-project-member] Lock "cdc5adf9-5a73-4d7d-b53d-849354a3a053" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.373s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:06:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:37 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:06:44 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:47 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:57 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:57 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:06:59 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:00 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-99a514b8-4305-4f62-87b8-bd4d014cd1f8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "b743c491-ece8-4781-9530-b2f38ffc1079" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:07:00 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-99a514b8-4305-4f62-87b8-bd4d014cd1f8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "b743c491-ece8-4781-9530-b2f38ffc1079" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:07:00 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-99a514b8-4305-4f62-87b8-bd4d014cd1f8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "b743c491-ece8-4781-9530-b2f38ffc1079-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:07:00 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-99a514b8-4305-4f62-87b8-bd4d014cd1f8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "b743c491-ece8-4781-9530-b2f38ffc1079-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:07:00 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-99a514b8-4305-4f62-87b8-bd4d014cd1f8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "b743c491-ece8-4781-9530-b2f38ffc1079-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:07:00 user nova-compute[74994]: INFO nova.compute.manager [None req-99a514b8-4305-4f62-87b8-bd4d014cd1f8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Terminating instance
Nov 28 11:07:00 user nova-compute[74994]: DEBUG nova.compute.manager [None req-99a514b8-4305-4f62-87b8-bd4d014cd1f8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 11:07:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:01 user nova-compute[74994]: DEBUG nova.compute.manager [req-48cb2712-2047-4367-8245-477c80b42c3f req-344b069a-7239-4986-86f2-cab4afe56930 service nova] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Received event network-vif-unplugged-35d909ae-33dc-4cf7-90af-5d781ee6bb64 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:07:01 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-48cb2712-2047-4367-8245-477c80b42c3f req-344b069a-7239-4986-86f2-cab4afe56930 service nova] Acquiring lock "b743c491-ece8-4781-9530-b2f38ffc1079-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:07:01 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-48cb2712-2047-4367-8245-477c80b42c3f req-344b069a-7239-4986-86f2-cab4afe56930 service nova] Lock "b743c491-ece8-4781-9530-b2f38ffc1079-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:07:01 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-48cb2712-2047-4367-8245-477c80b42c3f req-344b069a-7239-4986-86f2-cab4afe56930 service nova] Lock "b743c491-ece8-4781-9530-b2f38ffc1079-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:07:01 user nova-compute[74994]: DEBUG nova.compute.manager [req-48cb2712-2047-4367-8245-477c80b42c3f req-344b069a-7239-4986-86f2-cab4afe56930 service nova] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] No waiting events found dispatching network-vif-unplugged-35d909ae-33dc-4cf7-90af-5d781ee6bb64 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:07:01 user nova-compute[74994]: DEBUG nova.compute.manager [req-48cb2712-2047-4367-8245-477c80b42c3f req-344b069a-7239-4986-86f2-cab4afe56930 service nova] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Received event network-vif-unplugged-35d909ae-33dc-4cf7-90af-5d781ee6bb64 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 11:07:01 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Instance destroyed successfully.
Nov 28 11:07:01 user nova-compute[74994]: DEBUG nova.objects.instance [None req-99a514b8-4305-4f62-87b8-bd4d014cd1f8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lazy-loading 'resources' on Instance uuid b743c491-ece8-4781-9530-b2f38ffc1079 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:07:01 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-99a514b8-4305-4f62-87b8-bd4d014cd1f8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:57:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-154052709',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-154052709',id=25,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:57:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='612ae9ec21ad40a4b68e0926843874ae',ramdisk_id='',reservation_id='r-ja5k9c6j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-332508527',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T10:59:35Z,user_data=None,user_id='6c49cba00cff4c4b80080c5f917b4176',uuid=b743c491-ece8-4781-9530-b2f38ffc1079,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35d909ae-33dc-4cf7-90af-5d781ee6bb64", "address": "fa:16:3e:48:76:e2", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d909ae-33", "ovs_interfaceid": "35d909ae-33dc-4cf7-90af-5d781ee6bb64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 11:07:01 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-99a514b8-4305-4f62-87b8-bd4d014cd1f8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Converting VIF {"id": "35d909ae-33dc-4cf7-90af-5d781ee6bb64", "address": "fa:16:3e:48:76:e2", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d909ae-33", "ovs_interfaceid": "35d909ae-33dc-4cf7-90af-5d781ee6bb64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:07:01 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-99a514b8-4305-4f62-87b8-bd4d014cd1f8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:76:e2,bridge_name='br-int',has_traffic_filtering=True,id=35d909ae-33dc-4cf7-90af-5d781ee6bb64,network=Network(a1692a13-d1d7-4df6-bfc0-54f231846889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d909ae-33') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:07:01 user nova-compute[74994]: DEBUG os_vif [None req-99a514b8-4305-4f62-87b8-bd4d014cd1f8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:76:e2,bridge_name='br-int',has_traffic_filtering=True,id=35d909ae-33dc-4cf7-90af-5d781ee6bb64,network=Network(a1692a13-d1d7-4df6-bfc0-54f231846889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d909ae-33') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 11:07:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap35d909ae-33, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:07:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:07:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=49fa5272-79f9-47a0-91e8-022aaa850d54) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:07:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:01 user nova-compute[74994]: INFO os_vif [None req-99a514b8-4305-4f62-87b8-bd4d014cd1f8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:76:e2,bridge_name='br-int',has_traffic_filtering=True,id=35d909ae-33dc-4cf7-90af-5d781ee6bb64,network=Network(a1692a13-d1d7-4df6-bfc0-54f231846889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d909ae-33')
Nov 28 11:07:01 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-99a514b8-4305-4f62-87b8-bd4d014cd1f8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Deleting instance files /opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079_del
Nov 28 11:07:01 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-99a514b8-4305-4f62-87b8-bd4d014cd1f8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Deletion of /opt/stack/data/nova/instances/b743c491-ece8-4781-9530-b2f38ffc1079_del complete
Nov 28 11:07:01 user nova-compute[74994]: INFO nova.compute.manager [None req-99a514b8-4305-4f62-87b8-bd4d014cd1f8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 28 11:07:01 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-99a514b8-4305-4f62-87b8-bd4d014cd1f8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 11:07:01 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 11:07:01 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 11:07:02 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:07:02 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Took 0.67 seconds to deallocate network for instance.
Nov 28 11:07:02 user nova-compute[74994]: DEBUG nova.compute.manager [req-8338f59f-255e-4ae3-bb34-5567d6464fc7 req-530a9cb1-7d01-46fb-9d47-89bdedd1ffa5 service nova] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Received event network-vif-deleted-35d909ae-33dc-4cf7-90af-5d781ee6bb64 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:07:02 user nova-compute[74994]: INFO nova.compute.manager [req-8338f59f-255e-4ae3-bb34-5567d6464fc7 req-530a9cb1-7d01-46fb-9d47-89bdedd1ffa5 service nova] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Neutron deleted interface 35d909ae-33dc-4cf7-90af-5d781ee6bb64; detaching it from the instance and deleting it from the info cache
Nov 28 11:07:02 user nova-compute[74994]: DEBUG nova.network.neutron [req-8338f59f-255e-4ae3-bb34-5567d6464fc7 req-530a9cb1-7d01-46fb-9d47-89bdedd1ffa5 service nova] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:07:02 user nova-compute[74994]: DEBUG nova.compute.manager [req-8338f59f-255e-4ae3-bb34-5567d6464fc7 req-530a9cb1-7d01-46fb-9d47-89bdedd1ffa5 service nova] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Detach interface failed, port_id=35d909ae-33dc-4cf7-90af-5d781ee6bb64, reason: Instance b743c491-ece8-4781-9530-b2f38ffc1079 could not be found. {{(pid=74994) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 11:07:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-99a514b8-4305-4f62-87b8-bd4d014cd1f8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:07:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-99a514b8-4305-4f62-87b8-bd4d014cd1f8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:07:02 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-99a514b8-4305-4f62-87b8-bd4d014cd1f8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:07:02 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-99a514b8-4305-4f62-87b8-bd4d014cd1f8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:07:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-99a514b8-4305-4f62-87b8-bd4d014cd1f8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.275s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:07:02 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-99a514b8-4305-4f62-87b8-bd4d014cd1f8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Deleted allocations for instance b743c491-ece8-4781-9530-b2f38ffc1079
Nov 28 11:07:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-99a514b8-4305-4f62-87b8-bd4d014cd1f8 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "b743c491-ece8-4781-9530-b2f38ffc1079" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.815s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:07:03 user nova-compute[74994]: DEBUG nova.compute.manager [req-441210b5-45ed-4e47-aafa-92a29fb68480 req-e7e7255a-fc84-44a1-8e5a-a7822cccc6ee service nova] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Received event network-vif-plugged-35d909ae-33dc-4cf7-90af-5d781ee6bb64 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:07:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-441210b5-45ed-4e47-aafa-92a29fb68480 req-e7e7255a-fc84-44a1-8e5a-a7822cccc6ee service nova] Acquiring lock "b743c491-ece8-4781-9530-b2f38ffc1079-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:07:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-441210b5-45ed-4e47-aafa-92a29fb68480 req-e7e7255a-fc84-44a1-8e5a-a7822cccc6ee service nova] Lock "b743c491-ece8-4781-9530-b2f38ffc1079-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:07:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-441210b5-45ed-4e47-aafa-92a29fb68480 req-e7e7255a-fc84-44a1-8e5a-a7822cccc6ee service nova] Lock "b743c491-ece8-4781-9530-b2f38ffc1079-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:07:03 user nova-compute[74994]: DEBUG nova.compute.manager [req-441210b5-45ed-4e47-aafa-92a29fb68480 req-e7e7255a-fc84-44a1-8e5a-a7822cccc6ee service nova] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] No waiting events found dispatching network-vif-plugged-35d909ae-33dc-4cf7-90af-5d781ee6bb64 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:07:03 user nova-compute[74994]: WARNING nova.compute.manager [req-441210b5-45ed-4e47-aafa-92a29fb68480 req-e7e7255a-fc84-44a1-8e5a-a7822cccc6ee service nova] [instance: b743c491-ece8-4781-9530-b2f38ffc1079] Received unexpected event network-vif-plugged-35d909ae-33dc-4cf7-90af-5d781ee6bb64 for instance with vm_state deleted and task_state None.
Nov 28 11:07:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:10 user nova-compute[74994]: DEBUG nova.compute.manager [req-a155b7dd-e4b6-4a47-96b3-846487bc6afe req-5017b5d5-020d-4bf2-a36f-48f615a0b136 service nova] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Received event network-changed-10b84648-2b56-4451-b4f3-3ec4ad7b7771 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:07:10 user nova-compute[74994]: DEBUG nova.compute.manager [req-a155b7dd-e4b6-4a47-96b3-846487bc6afe req-5017b5d5-020d-4bf2-a36f-48f615a0b136 service nova] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Refreshing instance network info cache due to event network-changed-10b84648-2b56-4451-b4f3-3ec4ad7b7771. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:07:10 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a155b7dd-e4b6-4a47-96b3-846487bc6afe req-5017b5d5-020d-4bf2-a36f-48f615a0b136 service nova] Acquiring lock "refresh_cache-20716905-c56a-4729-8c5b-9188502dc477" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:07:10 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a155b7dd-e4b6-4a47-96b3-846487bc6afe req-5017b5d5-020d-4bf2-a36f-48f615a0b136 service nova] Acquired lock "refresh_cache-20716905-c56a-4729-8c5b-9188502dc477" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:07:10 user nova-compute[74994]: DEBUG nova.network.neutron [req-a155b7dd-e4b6-4a47-96b3-846487bc6afe req-5017b5d5-020d-4bf2-a36f-48f615a0b136 service nova] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Refreshing network info cache for port 10b84648-2b56-4451-b4f3-3ec4ad7b7771 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:07:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:11 user nova-compute[74994]: DEBUG nova.network.neutron [req-a155b7dd-e4b6-4a47-96b3-846487bc6afe req-5017b5d5-020d-4bf2-a36f-48f615a0b136 service nova] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Updated VIF entry in instance network info cache for port 10b84648-2b56-4451-b4f3-3ec4ad7b7771. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:07:11 user nova-compute[74994]: DEBUG nova.network.neutron [req-a155b7dd-e4b6-4a47-96b3-846487bc6afe req-5017b5d5-020d-4bf2-a36f-48f615a0b136 service nova] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Updating instance_info_cache with network_info: [{"id": "10b84648-2b56-4451-b4f3-3ec4ad7b7771", "address": "fa:16:3e:96:e0:ac", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b84648-2b", "ovs_interfaceid": "10b84648-2b56-4451-b4f3-3ec4ad7b7771", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:07:11 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a155b7dd-e4b6-4a47-96b3-846487bc6afe req-5017b5d5-020d-4bf2-a36f-48f615a0b136 service nova] Releasing lock "refresh_cache-20716905-c56a-4729-8c5b-9188502dc477" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:07:11 user nova-compute[74994]: DEBUG nova.compute.manager [req-1dc5378b-60be-4861-b1ec-78dd0f6d920b req-5d94b8ca-8535-4e27-846b-7ded25cd8f2e service nova] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Received event network-changed-73050cb9-2ff8-45ec-b6fa-d54d5c717f25 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:07:11 user nova-compute[74994]: DEBUG nova.compute.manager [req-1dc5378b-60be-4861-b1ec-78dd0f6d920b req-5d94b8ca-8535-4e27-846b-7ded25cd8f2e service nova] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Refreshing instance network info cache due to event network-changed-73050cb9-2ff8-45ec-b6fa-d54d5c717f25. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:07:11 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-1dc5378b-60be-4861-b1ec-78dd0f6d920b req-5d94b8ca-8535-4e27-846b-7ded25cd8f2e service nova] Acquiring lock "refresh_cache-0f267741-9611-4812-9afa-32717d16abc5" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:07:11 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-1dc5378b-60be-4861-b1ec-78dd0f6d920b req-5d94b8ca-8535-4e27-846b-7ded25cd8f2e service nova] Acquired lock "refresh_cache-0f267741-9611-4812-9afa-32717d16abc5" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:07:11 user nova-compute[74994]: DEBUG nova.network.neutron [req-1dc5378b-60be-4861-b1ec-78dd0f6d920b req-5d94b8ca-8535-4e27-846b-7ded25cd8f2e service nova] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Refreshing network info cache for port 73050cb9-2ff8-45ec-b6fa-d54d5c717f25 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:07:12 user nova-compute[74994]: DEBUG nova.network.neutron [req-1dc5378b-60be-4861-b1ec-78dd0f6d920b req-5d94b8ca-8535-4e27-846b-7ded25cd8f2e service nova] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Updated VIF entry in instance network info cache for port 73050cb9-2ff8-45ec-b6fa-d54d5c717f25. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:07:12 user nova-compute[74994]: DEBUG nova.network.neutron [req-1dc5378b-60be-4861-b1ec-78dd0f6d920b req-5d94b8ca-8535-4e27-846b-7ded25cd8f2e service nova] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Updating instance_info_cache with network_info: [{"id": "73050cb9-2ff8-45ec-b6fa-d54d5c717f25", "address": "fa:16:3e:10:54:1c", "network": {"id": "844b3eab-57f3-4582-9fcc-04594e44081b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-233988918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33727b28c7d94b7bbe8987c1301eec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73050cb9-2f", "ovs_interfaceid": "73050cb9-2ff8-45ec-b6fa-d54d5c717f25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:07:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-1dc5378b-60be-4861-b1ec-78dd0f6d920b req-5d94b8ca-8535-4e27-846b-7ded25cd8f2e service nova] Releasing lock "refresh_cache-0f267741-9611-4812-9afa-32717d16abc5" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:07:12 user nova-compute[74994]: DEBUG nova.compute.manager [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Stashing vm_state: active {{(pid=74994) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 28 11:07:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:07:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:07:12 user nova-compute[74994]: DEBUG nova.compute.manager [req-14f0fd29-1143-46b5-bd3e-777b6071f24a req-d565a9d2-0718-4ef1-9e27-c2212a481228 service nova] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Received event network-changed-17fb7783-f3dc-41cf-b838-004f2048fdbc {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:07:12 user nova-compute[74994]: DEBUG nova.compute.manager [req-14f0fd29-1143-46b5-bd3e-777b6071f24a req-d565a9d2-0718-4ef1-9e27-c2212a481228 service nova] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Refreshing instance network info cache due to event network-changed-17fb7783-f3dc-41cf-b838-004f2048fdbc. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:07:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-14f0fd29-1143-46b5-bd3e-777b6071f24a req-d565a9d2-0718-4ef1-9e27-c2212a481228 service nova] Acquiring lock "refresh_cache-e3b0b960-3f38-4a6f-9017-209fbc2110c9" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:07:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-14f0fd29-1143-46b5-bd3e-777b6071f24a req-d565a9d2-0718-4ef1-9e27-c2212a481228 service nova] Acquired lock "refresh_cache-e3b0b960-3f38-4a6f-9017-209fbc2110c9" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:07:12 user nova-compute[74994]: DEBUG nova.network.neutron [req-14f0fd29-1143-46b5-bd3e-777b6071f24a req-d565a9d2-0718-4ef1-9e27-c2212a481228 service nova] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Refreshing network info cache for port 17fb7783-f3dc-41cf-b838-004f2048fdbc {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:07:13 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 11:07:13 user nova-compute[74994]: INFO nova.compute.claims [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Claim successful on node user
Nov 28 11:07:13 user nova-compute[74994]: INFO nova.compute.resource_tracker [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Updating resource usage from migration fb045cf2-9047-4fea-8c89-1cae63b402e1
Nov 28 11:07:13 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:07:13 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:07:13 user nova-compute[74994]: DEBUG nova.network.neutron [req-14f0fd29-1143-46b5-bd3e-777b6071f24a req-d565a9d2-0718-4ef1-9e27-c2212a481228 service nova] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Updated VIF entry in instance network info cache for port 17fb7783-f3dc-41cf-b838-004f2048fdbc. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:07:13 user nova-compute[74994]: DEBUG nova.network.neutron [req-14f0fd29-1143-46b5-bd3e-777b6071f24a req-d565a9d2-0718-4ef1-9e27-c2212a481228 service nova] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Updating instance_info_cache with network_info: [{"id": "17fb7783-f3dc-41cf-b838-004f2048fdbc", "address": "fa:16:3e:b7:31:25", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17fb7783-f3", "ovs_interfaceid": "17fb7783-f3dc-41cf-b838-004f2048fdbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:07:13 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.458s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:07:13 user nova-compute[74994]: INFO nova.compute.manager [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Migrating
Nov 28 11:07:13 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:07:13 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-14f0fd29-1143-46b5-bd3e-777b6071f24a req-d565a9d2-0718-4ef1-9e27-c2212a481228 service nova] Releasing lock "refresh_cache-e3b0b960-3f38-4a6f-9017-209fbc2110c9" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:07:13 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "refresh_cache-e3b0b960-3f38-4a6f-9017-209fbc2110c9" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:07:13 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquired lock "refresh_cache-e3b0b960-3f38-4a6f-9017-209fbc2110c9" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:07:13 user nova-compute[74994]: DEBUG nova.network.neutron [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 11:07:13 user nova-compute[74994]: DEBUG nova.network.neutron [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Updating instance_info_cache with network_info: [{"id": "17fb7783-f3dc-41cf-b838-004f2048fdbc", "address": "fa:16:3e:b7:31:25", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17fb7783-f3", "ovs_interfaceid": "17fb7783-f3dc-41cf-b838-004f2048fdbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:07:13 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Releasing lock "refresh_cache-e3b0b960-3f38-4a6f-9017-209fbc2110c9" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:07:14 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Starting migrate_disk_and_power_off {{(pid=74994) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 28 11:07:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:14 user nova-compute[74994]: DEBUG nova.compute.manager [req-23b95ee0-4b8b-47f8-b125-34fd1959c773 req-7ed63d9d-c193-42fd-ae47-6f3f8074b1b6 service nova] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Received event network-vif-unplugged-17fb7783-f3dc-41cf-b838-004f2048fdbc {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:07:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-23b95ee0-4b8b-47f8-b125-34fd1959c773 req-7ed63d9d-c193-42fd-ae47-6f3f8074b1b6 service nova] Acquiring lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:07:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-23b95ee0-4b8b-47f8-b125-34fd1959c773 req-7ed63d9d-c193-42fd-ae47-6f3f8074b1b6 service nova] Lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:07:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-23b95ee0-4b8b-47f8-b125-34fd1959c773 req-7ed63d9d-c193-42fd-ae47-6f3f8074b1b6 service nova] Lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:07:14 user nova-compute[74994]: DEBUG nova.compute.manager [req-23b95ee0-4b8b-47f8-b125-34fd1959c773 req-7ed63d9d-c193-42fd-ae47-6f3f8074b1b6 service nova] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] No waiting events found dispatching network-vif-unplugged-17fb7783-f3dc-41cf-b838-004f2048fdbc {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:07:14 user nova-compute[74994]: WARNING nova.compute.manager [req-23b95ee0-4b8b-47f8-b125-34fd1959c773 req-7ed63d9d-c193-42fd-ae47-6f3f8074b1b6 service nova] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Received unexpected event network-vif-unplugged-17fb7783-f3dc-41cf-b838-004f2048fdbc for instance with vm_state active and task_state resize_migrating.
Nov 28 11:07:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:14 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:07:14 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 11:07:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:14 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Instance destroyed successfully.
Nov 28 11:07:14 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:05:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1667657680',display_name='tempest-ServerActionsTestOtherA-server-1667657680',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1667657680',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPW6Lty9ow0zAcm936yuU8WeLpHxpamSCaeKsFRdduK4jmYnIbGWXIhKjvJDlhN8evt/Hb3F2U1wYmR8qRXarp7uOZi0MsdjDWCq+Ku3i87+sooae0XVTHruzSkrMSatFQ==',key_name='tempest-keypair-1409463142',keypairs=<?>,launch_index=0,launched_at=2023-11-28T11:05:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5eb43a8fc7bd47728600741762f71112',ramdisk_id='',reservation_id='r-d1wwwslj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1927948343',owner_user_name='tempest-ServerActionsTestOtherA-1927948343-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:07:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d51be473c7284977a6533756a1f677f9',uuid=e3b0b960-3f38-4a6f-9017-209fbc2110c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "17fb7783-f3dc-41cf-b838-004f2048fdbc", "address": "fa:16:3e:b7:31:25", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-490143931-network", "vif_mac": "fa:16:3e:b7:31:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17fb7783-f3", "ovs_interfaceid": "17fb7783-f3dc-41cf-b838-004f2048fdbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 11:07:14 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Converting VIF {"id": "17fb7783-f3dc-41cf-b838-004f2048fdbc", "address": "fa:16:3e:b7:31:25", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-490143931-network", "vif_mac": "fa:16:3e:b7:31:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17fb7783-f3", "ovs_interfaceid": "17fb7783-f3dc-41cf-b838-004f2048fdbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:07:14 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:31:25,bridge_name='br-int',has_traffic_filtering=True,id=17fb7783-f3dc-41cf-b838-004f2048fdbc,network=Network(16dd32cd-5a00-4111-92e2-283e7635540f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17fb7783-f3') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:07:14 user nova-compute[74994]: DEBUG os_vif [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:31:25,bridge_name='br-int',has_traffic_filtering=True,id=17fb7783-f3dc-41cf-b838-004f2048fdbc,network=Network(16dd32cd-5a00-4111-92e2-283e7635540f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17fb7783-f3') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 11:07:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap17fb7783-f3, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:07:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:07:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=71f7541a-f35a-4b5b-8534-961344fd6564) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:07:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:14 user nova-compute[74994]: INFO os_vif [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:31:25,bridge_name='br-int',has_traffic_filtering=True,id=17fb7783-f3dc-41cf-b838-004f2048fdbc,network=Network(16dd32cd-5a00-4111-92e2-283e7635540f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17fb7783-f3')
Nov 28 11:07:14 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 11:07:14 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kCgmHZjw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:07:14 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:07:14 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:07:14 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:07:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:14 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefc35b7-8ea8-4ee5-8465-a0e6659dd026]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:14 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 11:07:14 user nova-compute[74994]: No targets found.
Nov 28 11:07:14 user nova-compute[74994]: iSNS:
Nov 28 11:07:14 user nova-compute[74994]: No targets found.
Nov 28 11:07:14 user nova-compute[74994]: STATIC:
Nov 28 11:07:14 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd
Nov 28 11:07:14 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:07:14 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:07:14 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de
Nov 28 11:07:14 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:07:14 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:07:14 user nova-compute[74994]: FIRMWARE:
Nov 28 11:07:14 user nova-compute[74994]: No targets found.
Nov 28 11:07:14 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:07:14 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 11:07:14 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 11:07:14 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 11:07:14 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 11:07:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:14 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d882fe5d-7810-4cde-9ebc-cce052c5727f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:14 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[981cc0c2-3d17-4389-ae49-41489f86e42f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:14 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:07:14 user nova-compute[74994]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)
Nov 28 11:07:14 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:07:14 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:07:14 user nova-compute[74994]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)
Nov 28 11:07:14 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:07:14 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9444d4820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd'): ({'sdc'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 11:07:14 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Removing single pathed devices sdc {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 11:07:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:14 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[20fcda06-b6d9-455f-8cb3-4704bdb8b3a0]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f337db9-9dc6-4587-85ba-95704815cf72]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Flushing IO for device /dev/sdc {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eaeb151-3019-4fd3-8b41-bcd9908d76cf]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf12059-c988-40fd-9c53-f88c3ab74aa3]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] SCSI volumes sdc have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO42f3447-822b57b28999cfd5', '/dev/disk/by-id/scsi-23832326235376232', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_42f3447') {{(pid=86494) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ad1ea6-a3ee-4069-a02d-6bdb16d4c24f]: (4, None) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[119ad225-7f5c-4ca9-b2d2-aeac4effc1bb]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d50ec6-b587-4e52-a40e-68a4935ba783]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd, portal: 172.16.0.220,3260]
Nov 28 11:07:15 user nova-compute[74994]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd, portal: 172.16.0.220,3260] successful.
Nov 28 11:07:15 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[16bceef6-32d4-486e-ac14-7e11144ec2f6]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] <== disconnect_volume: return (326ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Acquiring lock "0f267741-9611-4812-9afa-32717d16abc5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "0f267741-9611-4812-9afa-32717d16abc5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG nova.objects.instance [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lazy-loading 'flavor' on Instance uuid 0f267741-9611-4812-9afa-32717d16abc5 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "0f267741-9611-4812-9afa-32717d16abc5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Acquiring lock "0f267741-9611-4812-9afa-32717d16abc5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "0f267741-9611-4812-9afa-32717d16abc5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:07:15 user nova-compute[74994]: INFO nova.compute.manager [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Attaching volume 07e1aa43-1637-45ed-ad63-5f5ff971569a to /dev/vdb
Nov 28 11:07:15 user nova-compute[74994]: DEBUG os_brick.utils [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce4256d-f322-496f-943b-914f50c3680f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ada3f4f-25c1-493c-b09a-18c57652b867]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c6c1fe-9665-4348-8883-458afd92c3f3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[de14a4a2-9b8b-4d3c-9080-0e02abe5dde2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:07:15 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 11:07:15 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4614ebc-a952-41d7-880d-84be3f8c99d2]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG os_brick.utils [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:07:15 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Updating existing volume attachment record: 41105af9-821c-420a-8863-982e9867f2af {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 11:07:16 user nova-compute[74994]: DEBUG nova.network.neutron [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Port 17fb7783-f3dc-41cf-b838-004f2048fdbc binding to destination host user is already ACTIVE {{(pid=74994) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 28 11:07:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:07:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:07:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:07:16 user nova-compute[74994]: DEBUG nova.compute.manager [req-f5c25b2e-426b-4072-8598-c5506b763aac req-cfd217d9-a085-4e60-8ffc-b7abff47fcf9 service nova] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Received event network-vif-plugged-17fb7783-f3dc-41cf-b838-004f2048fdbc {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:07:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f5c25b2e-426b-4072-8598-c5506b763aac req-cfd217d9-a085-4e60-8ffc-b7abff47fcf9 service nova] Acquiring lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:07:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f5c25b2e-426b-4072-8598-c5506b763aac req-cfd217d9-a085-4e60-8ffc-b7abff47fcf9 service nova] Lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:07:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f5c25b2e-426b-4072-8598-c5506b763aac req-cfd217d9-a085-4e60-8ffc-b7abff47fcf9 service nova] Lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:07:16 user nova-compute[74994]: DEBUG nova.compute.manager [req-f5c25b2e-426b-4072-8598-c5506b763aac req-cfd217d9-a085-4e60-8ffc-b7abff47fcf9 service nova] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] No waiting events found dispatching network-vif-plugged-17fb7783-f3dc-41cf-b838-004f2048fdbc {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:07:16 user nova-compute[74994]: WARNING nova.compute.manager [req-f5c25b2e-426b-4072-8598-c5506b763aac req-cfd217d9-a085-4e60-8ffc-b7abff47fcf9 service nova] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Received unexpected event network-vif-plugged-17fb7783-f3dc-41cf-b838-004f2048fdbc for instance with vm_state active and task_state resize_migrated.
Nov 28 11:07:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "refresh_cache-e3b0b960-3f38-4a6f-9017-209fbc2110c9" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:07:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquired lock "refresh_cache-e3b0b960-3f38-4a6f-9017-209fbc2110c9" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:07:16 user nova-compute[74994]: DEBUG nova.network.neutron [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 11:07:16 user nova-compute[74994]: DEBUG nova.network.neutron [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Updating instance_info_cache with network_info: [{"id": "17fb7783-f3dc-41cf-b838-004f2048fdbc", "address": "fa:16:3e:b7:31:25", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17fb7783-f3", "ovs_interfaceid": "17fb7783-f3dc-41cf-b838-004f2048fdbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:07:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Releasing lock "refresh_cache-e3b0b960-3f38-4a6f-9017-209fbc2110c9" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:07:16 user nova-compute[74994]: DEBUG os_brick.utils [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:07:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:16 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e8b01d-7c9f-47dc-96c5-45c6fc84e4ff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:16 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[41170bf5-23fd-48e7-8eb9-35e36a5a8bb2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:16 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb90148e-b6c6-4049-bfdf-05194d124386]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:16 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[67540aca-89f0-4c5d-93b1-e17a673e5461]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:07:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 11:07:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:07:17 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 11:07:17 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[573d8ead-9331-4a72-b71f-a3e65a67149c]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 11:07:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 11:07:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 11:07:17 user nova-compute[74994]: DEBUG os_brick.utils [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:07:19 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:07:19 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:07:19 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:07:19 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:07:19 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 11:07:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:19 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:19 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2caa913-b0cc-46b7-b90d-fe507bc00b09/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2caa913-b0cc-46b7-b90d-fe507bc00b09/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2caa913-b0cc-46b7-b90d-fe507bc00b09/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2caa913-b0cc-46b7-b90d-fe507bc00b09/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:20 user nova-compute[74994]: DEBUG nova.compute.manager [req-af5d015d-764b-4060-b08d-141377814bf7 req-f8fe16e4-7769-4588-888b-9e76c34ccd36 service nova] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Received event network-changed-69c7a712-9905-4a77-a0ae-cd64dbd347fd {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:07:20 user nova-compute[74994]: DEBUG nova.compute.manager [req-af5d015d-764b-4060-b08d-141377814bf7 req-f8fe16e4-7769-4588-888b-9e76c34ccd36 service nova] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Refreshing instance network info cache due to event network-changed-69c7a712-9905-4a77-a0ae-cd64dbd347fd. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:07:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-af5d015d-764b-4060-b08d-141377814bf7 req-f8fe16e4-7769-4588-888b-9e76c34ccd36 service nova] Acquiring lock "refresh_cache-a2caa913-b0cc-46b7-b90d-fe507bc00b09" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:07:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-af5d015d-764b-4060-b08d-141377814bf7 req-f8fe16e4-7769-4588-888b-9e76c34ccd36 service nova] Acquired lock "refresh_cache-a2caa913-b0cc-46b7-b90d-fe507bc00b09" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:07:20 user nova-compute[74994]: DEBUG nova.network.neutron [req-af5d015d-764b-4060-b08d-141377814bf7 req-f8fe16e4-7769-4588-888b-9e76c34ccd36 service nova] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Refreshing network info cache for port 69c7a712-9905-4a77-a0ae-cd64dbd347fd {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:07:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7295ae8a-462e-4b75-af40-35aac439dad0/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:20 user nova-compute[74994]: DEBUG nova.network.neutron [req-af5d015d-764b-4060-b08d-141377814bf7 req-f8fe16e4-7769-4588-888b-9e76c34ccd36 service nova] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Updated VIF entry in instance network info cache for port 69c7a712-9905-4a77-a0ae-cd64dbd347fd. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:07:20 user nova-compute[74994]: DEBUG nova.network.neutron [req-af5d015d-764b-4060-b08d-141377814bf7 req-f8fe16e4-7769-4588-888b-9e76c34ccd36 service nova] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Updating instance_info_cache with network_info: [{"id": "69c7a712-9905-4a77-a0ae-cd64dbd347fd", "address": "fa:16:3e:38:2c:b1", "network": {"id": "d46e72ec-d7d5-45f7-951a-b4381f0b472b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-179057367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a4dcdeafd6420d8606b37673e3255f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c7a712-99", "ovs_interfaceid": "69c7a712-9905-4a77-a0ae-cd64dbd347fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:07:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-af5d015d-764b-4060-b08d-141377814bf7 req-f8fe16e4-7769-4588-888b-9e76c34ccd36 service nova] Releasing lock "refresh_cache-a2caa913-b0cc-46b7-b90d-fe507bc00b09" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:07:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7295ae8a-462e-4b75-af40-35aac439dad0/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7295ae8a-462e-4b75-af40-35aac439dad0/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7295ae8a-462e-4b75-af40-35aac439dad0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2a2617-b00e-4d38-98a0-cca578b95f0e/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2a2617-b00e-4d38-98a0-cca578b95f0e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2a2617-b00e-4d38-98a0-cca578b95f0e/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2a2617-b00e-4d38-98a0-cca578b95f0e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:21 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:07:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f267741-9611-4812-9afa-32717d16abc5/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f267741-9611-4812-9afa-32717d16abc5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f267741-9611-4812-9afa-32717d16abc5/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f267741-9611-4812-9afa-32717d16abc5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:22 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:07:22 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:07:22 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:07:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=8015MB free_disk=25.047466278076172GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 11:07:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:07:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:07:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Applying migration context for instance e3b0b960-3f38-4a6f-9017-209fbc2110c9 as it has an incoming, in-progress migration fb045cf2-9047-4fea-8c89-1cae63b402e1. Migration status is post-migrating {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 28 11:07:22 user nova-compute[74994]: INFO nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Updating resource usage from migration fb045cf2-9047-4fea-8c89-1cae63b402e1
Nov 28 11:07:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:07:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 759fbcfd-ab13-438f-b860-6393a97d1205 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:07:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 20716905-c56a-4729-8c5b-9188502dc477 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:07:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 0f267741-9611-4812-9afa-32717d16abc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:07:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance a2caa913-b0cc-46b7-b90d-fe507bc00b09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:07:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 7295ae8a-462e-4b75-af40-35aac439dad0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:07:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 6f2a2617-b00e-4d38-98a0-cca578b95f0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:07:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Migration fb045cf2-9047-4fea-8c89-1cae63b402e1 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 28 11:07:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance e3b0b960-3f38-4a6f-9017-209fbc2110c9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:07:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 11:07:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 11:07:22 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 11:07:22 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PCvwAopY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:07:22 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:07:22 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:07:22 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:07:22 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:07:22 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:07:22 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:07:22 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 11:07:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:22 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0974f8d-f7cf-40fa-898e-72e24d589fd5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:22 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 11:07:22 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:07:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:22 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf24fa8-ad06-4b06-b0b7-512d40c99b93]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:22 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a] added
Nov 28 11:07:22 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:07:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:22 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3af1eea-a08c-4bc7-a7f5-ddedf6b06423]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:22 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:07:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:22 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c419ae06-618a-4c95-9652-813e96876bf6]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:22 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:07:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PCvwAopY {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PCvwAopY" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:22 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc8a7e1-a240-45b0-b1f2-ee3bb096e5f7]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:22 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PCvwAopY'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:07:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:22 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b70a1e-ec76-4ebe-9a7f-a06d042116a1]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:22 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:07:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:22 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac26d6d-2c95-4013-aa86-1739eedc8e82]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:22 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:07:22 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:07:22 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:07:22 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:07:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:22 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:07:23 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:07:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac8ba4b-0d5f-41a6-8ce6-0af6e8db1a0f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a, portal: 172.16.0.220,3260]
Nov 28 11:07:23 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a, portal: 172.16.0.220,3260] successful.
Nov 28 11:07:23 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:07:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[06830051-f55a-4b92-b51e-a066e3754b93]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:07:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.077s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6108c549-01a4-4fba-b080-c200033763e6]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:07:23 user nova-compute[74994]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a (non-flash)
Nov 28 11:07:23 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:07:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:07:23 user nova-compute[74994]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a (non-flash)
Nov 28 11:07:23 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:07:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:07:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 11:07:23 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 11:07:23 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 11:07:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:23 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 11:07:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.672s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:07:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.079s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a083cce-2363-440e-9479-81791f350896]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:23 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: None {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 11:07:24 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 11:07:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PCvwAopY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 11:07:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.487s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:07:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] <== connect_volume: return (1489ms) {'type': 'block', 'scsi_wwn': '23235356534633930', 'path': '/dev/sdc'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:07:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235356534633930', 'path': '/dev/sdc'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 11:07:24 user nova-compute[74994]: DEBUG nova.objects.instance [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lazy-loading 'flavor' on Instance uuid 0f267741-9611-4812-9afa-32717d16abc5 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:07:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 11:07:24 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:07:24 user nova-compute[74994]:   <source dev="/dev/sdc"/>
Nov 28 11:07:24 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:07:24 user nova-compute[74994]:   <serial>07e1aa43-1637-45ed-ad63-5f5ff971569a</serial>
Nov 28 11:07:24 user nova-compute[74994]: </disk>
Nov 28 11:07:24 user nova-compute[74994]:  {{(pid=74994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 11:07:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:07:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:07:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] No VIF found with MAC fa:16:3e:10:54:1c, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:07:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-773cd314-451f-478e-964a-85d99204fdf8 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "0f267741-9611-4812-9afa-32717d16abc5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.112s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:07:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:26 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:07:26 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:07:26 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 11:07:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "refresh_cache-20716905-c56a-4729-8c5b-9188502dc477" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:07:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquired lock "refresh_cache-20716905-c56a-4729-8c5b-9188502dc477" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:07:26 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Forcefully refreshing network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 11:07:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e95a8d32-b390-463a-bb7e-fe41ad36838e tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Acquiring lock "a2caa913-b0cc-46b7-b90d-fe507bc00b09" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:07:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e95a8d32-b390-463a-bb7e-fe41ad36838e tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "a2caa913-b0cc-46b7-b90d-fe507bc00b09" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:07:26 user nova-compute[74994]: INFO nova.compute.manager [None req-e95a8d32-b390-463a-bb7e-fe41ad36838e tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Shelving
Nov 28 11:07:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:26 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Updating instance_info_cache with network_info: [{"id": "10b84648-2b56-4451-b4f3-3ec4ad7b7771", "address": "fa:16:3e:96:e0:ac", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b84648-2b", "ovs_interfaceid": "10b84648-2b56-4451-b4f3-3ec4ad7b7771", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:07:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Releasing lock "refresh_cache-20716905-c56a-4729-8c5b-9188502dc477" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:07:26 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Updated the network info_cache for instance {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 11:07:26 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:07:26 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:07:26 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:07:26 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:07:26 user nova-compute[74994]: DEBUG nova.compute.manager [req-73612fc9-5e7a-46da-8b99-9691017fbdd5 req-d100a250-9e7a-4f7a-9d00-bb7a56a0622b service nova] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Received event network-vif-unplugged-69c7a712-9905-4a77-a0ae-cd64dbd347fd {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:07:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-73612fc9-5e7a-46da-8b99-9691017fbdd5 req-d100a250-9e7a-4f7a-9d00-bb7a56a0622b service nova] Acquiring lock "a2caa913-b0cc-46b7-b90d-fe507bc00b09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:07:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-73612fc9-5e7a-46da-8b99-9691017fbdd5 req-d100a250-9e7a-4f7a-9d00-bb7a56a0622b service nova] Lock "a2caa913-b0cc-46b7-b90d-fe507bc00b09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:07:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-73612fc9-5e7a-46da-8b99-9691017fbdd5 req-d100a250-9e7a-4f7a-9d00-bb7a56a0622b service nova] Lock "a2caa913-b0cc-46b7-b90d-fe507bc00b09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:07:26 user nova-compute[74994]: DEBUG nova.compute.manager [req-73612fc9-5e7a-46da-8b99-9691017fbdd5 req-d100a250-9e7a-4f7a-9d00-bb7a56a0622b service nova] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] No waiting events found dispatching network-vif-unplugged-69c7a712-9905-4a77-a0ae-cd64dbd347fd {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:07:26 user nova-compute[74994]: WARNING nova.compute.manager [req-73612fc9-5e7a-46da-8b99-9691017fbdd5 req-d100a250-9e7a-4f7a-9d00-bb7a56a0622b service nova] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Received unexpected event network-vif-unplugged-69c7a712-9905-4a77-a0ae-cd64dbd347fd for instance with vm_state active and task_state shelving.
Nov 28 11:07:26 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:07:27 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Instance destroyed successfully.
Nov 28 11:07:27 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-e95a8d32-b390-463a-bb7e-fe41ad36838e tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Beginning cold snapshot process
Nov 28 11:07:27 user nova-compute[74994]: DEBUG nova.privsep.utils [None req-e95a8d32-b390-463a-bb7e-fe41ad36838e tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74994) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 11:07:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-e95a8d32-b390-463a-bb7e-fe41ad36838e tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/a2caa913-b0cc-46b7-b90d-fe507bc00b09/disk /opt/stack/data/nova/instances/snapshots/tmp178qnppj/f9f4c2e1b05c4c68a6bb9cd93ee8a44a {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Acquiring lock "0f267741-9611-4812-9afa-32717d16abc5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "0f267741-9611-4812-9afa-32717d16abc5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG nova.objects.instance [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lazy-loading 'flavor' on Instance uuid 0f267741-9611-4812-9afa-32717d16abc5 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "0f267741-9611-4812-9afa-32717d16abc5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.097s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Acquiring lock "0f267741-9611-4812-9afa-32717d16abc5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "0f267741-9611-4812-9afa-32717d16abc5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:07:28 user nova-compute[74994]: INFO nova.compute.manager [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Attaching volume 807a7039-4bee-445b-a2b5-02d10f63f092 to /dev/vdc
Nov 28 11:07:28 user nova-compute[74994]: DEBUG os_brick.utils [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-e95a8d32-b390-463a-bb7e-fe41ad36838e tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/a2caa913-b0cc-46b7-b90d-fe507bc00b09/disk /opt/stack/data/nova/instances/snapshots/tmp178qnppj/f9f4c2e1b05c4c68a6bb9cd93ee8a44a" returned: 0 in 1.167s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:28 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-e95a8d32-b390-463a-bb7e-fe41ad36838e tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Snapshot extracted, beginning image upload
Nov 28 11:07:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb84092-82c0-444c-93ca-6671cd793fc3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[198bc64d-d848-4e3e-9c04-b56636e2f2f5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70d1b9f-ae2f-4bf9-b85b-0c535167504b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[af83df05-3b61-402b-b848-7a85af43cd35]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:07:28 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 11:07:28 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[027a319d-29d2-48f6-9558-ce1eda410fca]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG os_brick.utils [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Updating existing volume attachment record: 9ca44661-4a6b-475f-82f2-526ed7b31444 {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Starting finish_migration {{(pid=74994) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Instance directory exists: not creating {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 11:07:28 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Creating image(s)
Nov 28 11:07:28 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Did not create local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Ensure instance console log exists: /opt/stack/data/nova/instances/e3b0b960-3f38-4a6f-9017-209fbc2110c9/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Start _get_guest_xml network_info=[{"id": "17fb7783-f3dc-41cf-b838-004f2048fdbc", "address": "fa:16:3e:b7:31:25", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-490143931-network", "vif_mac": "fa:16:3e:b7:31:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17fb7783-f3", "ovs_interfaceid": "17fb7783-f3dc-41cf-b838-004f2048fdbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kCgmHZjw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'e3b0b960-3f38-4a6f-9017-209fbc2110c9', 'attached_at': '2023-11-28T11:07:28.000000', 'detached_at': '', 'volume_id': 'cc3edc15-080f-4593-9a75-5d2719dfe0dd', 'serial': 'cc3edc15-080f-4593-9a75-5d2719dfe0dd'}, 'attachment_id': 'e33201ee-13a4-4d31-8063-4e44d7a5e019', 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 11:07:28 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:07:28 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:07:28 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kCgmHZjw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:07:28 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:07:28 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:07:28 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:07:28 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:07:28 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 11:07:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e44139-1c82-43c6-976c-bb825266b775]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 11:07:28 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a2ca18-703d-441d-9c1d-72237c35a0fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd] added
Nov 28 11:07:28 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[577519fe-b6d6-4077-84b5-22381977662c]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[39dce226-92f4-4171-babf-0c69ee726f6d]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kCgmHZjw {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kCgmHZjw" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5beb91-a5d9-4c6e-9d70-f56a375d09dc]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kCgmHZjw'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2384e213-b3d7-4cfb-a029-5274f0a1a86f]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a5faed-e615-483f-8eef-02a632e52d33]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:07:28 user nova-compute[74994]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a (non-flash)
Nov 28 11:07:28 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:07:28 user nova-compute[74994]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a (non-flash)
Nov 28 11:07:28 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG nova.compute.manager [req-e4a4ad71-a199-407e-84c8-4e06beac0bc3 req-6c359a6c-de26-45e5-987f-91f518625c89 service nova] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Received event network-vif-plugged-69c7a712-9905-4a77-a0ae-cd64dbd347fd {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-e4a4ad71-a199-407e-84c8-4e06beac0bc3 req-6c359a6c-de26-45e5-987f-91f518625c89 service nova] Acquiring lock "a2caa913-b0cc-46b7-b90d-fe507bc00b09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-e4a4ad71-a199-407e-84c8-4e06beac0bc3 req-6c359a6c-de26-45e5-987f-91f518625c89 service nova] Lock "a2caa913-b0cc-46b7-b90d-fe507bc00b09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-e4a4ad71-a199-407e-84c8-4e06beac0bc3 req-6c359a6c-de26-45e5-987f-91f518625c89 service nova] Lock "a2caa913-b0cc-46b7-b90d-fe507bc00b09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:07:28 user nova-compute[74994]: DEBUG nova.compute.manager [req-e4a4ad71-a199-407e-84c8-4e06beac0bc3 req-6c359a6c-de26-45e5-987f-91f518625c89 service nova] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] No waiting events found dispatching network-vif-plugged-69c7a712-9905-4a77-a0ae-cd64dbd347fd {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:07:28 user nova-compute[74994]: WARNING nova.compute.manager [req-e4a4ad71-a199-407e-84c8-4e06beac0bc3 req-6c359a6c-de26-45e5-987f-91f518625c89 service nova] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Received unexpected event network-vif-plugged-69c7a712-9905-4a77-a0ae-cd64dbd347fd for instance with vm_state active and task_state shelving_image_uploading.
Nov 28 11:07:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:29 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ca158d-98e5-4b85-8aab-13c0e7ddfed0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:29 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd, portal: 172.16.0.220,3260]
Nov 28 11:07:29 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd, portal: 172.16.0.220,3260] successful.
Nov 28 11:07:29 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:07:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:29 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47f7f63-9127-41fb-8b7f-132106f961e5]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:29 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:07:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:29 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[457d9497-3e16-4a0a-b9c8-0ac54d9bdb76]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:29 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:07:29 user nova-compute[74994]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a (non-flash)
Nov 28 11:07:29 user nova-compute[74994]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)
Nov 28 11:07:29 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:07:29 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:07:29 user nova-compute[74994]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a (non-flash)
Nov 28 11:07:29 user nova-compute[74994]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)
Nov 28 11:07:29 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:07:29 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:07:29 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 11:07:29 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] HCTL ('35', '-', '-', 0) found on session 42 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 11:07:29 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 11:07:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:29 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce3d591-bea1-4bd7-adf9-27fc7b494953]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:29 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 11:07:29 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kCgmHZjw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 11:07:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:30 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:07:30 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23832326235376232', 'path': '/dev/sdd'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:07:30 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832326235376232', 'path': '/dev/sdd'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 11:07:30 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:05:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1667657680',display_name='tempest-ServerActionsTestOtherA-server-1667657680',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1667657680',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPW6Lty9ow0zAcm936yuU8WeLpHxpamSCaeKsFRdduK4jmYnIbGWXIhKjvJDlhN8evt/Hb3F2U1wYmR8qRXarp7uOZi0MsdjDWCq+Ku3i87+sooae0XVTHruzSkrMSatFQ==',key_name='tempest-keypair-1409463142',keypairs=<?>,launch_index=0,launched_at=2023-11-28T11:05:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5eb43a8fc7bd47728600741762f71112',ramdisk_id='',reservation_id='r-d1wwwslj',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1927948343',owner_user_name='tempest-ServerActionsTestOtherA-1927948343-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:07:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d51be473c7284977a6533756a1f677f9',uuid=e3b0b960-3f38-4a6f-9017-209fbc2110c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "17fb7783-f3dc-41cf-b838-004f2048fdbc", "address": "fa:16:3e:b7:31:25", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-490143931-network", "vif_mac": "fa:16:3e:b7:31:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17fb7783-f3", "ovs_interfaceid": "17fb7783-f3dc-41cf-b838-004f2048fdbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 11:07:30 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Converting VIF {"id": "17fb7783-f3dc-41cf-b838-004f2048fdbc", "address": "fa:16:3e:b7:31:25", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-490143931-network", "vif_mac": "fa:16:3e:b7:31:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17fb7783-f3", "ovs_interfaceid": "17fb7783-f3dc-41cf-b838-004f2048fdbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:07:30 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:31:25,bridge_name='br-int',has_traffic_filtering=True,id=17fb7783-f3dc-41cf-b838-004f2048fdbc,network=Network(16dd32cd-5a00-4111-92e2-283e7635540f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17fb7783-f3') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:07:30 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] End _get_guest_xml xml=<domain type="kvm">
Nov 28 11:07:30 user nova-compute[74994]:   <uuid>e3b0b960-3f38-4a6f-9017-209fbc2110c9</uuid>
Nov 28 11:07:30 user nova-compute[74994]:   <name>instance-00000020</name>
Nov 28 11:07:30 user nova-compute[74994]:   <memory>2097152</memory>
Nov 28 11:07:30 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 11:07:30 user nova-compute[74994]:   <metadata>
Nov 28 11:07:30 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 11:07:30 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 11:07:30 user nova-compute[74994]:       <nova:name>tempest-ServerActionsTestOtherA-server-1667657680</nova:name>
Nov 28 11:07:30 user nova-compute[74994]:       <nova:creationTime>2023-11-28 11:07:28</nova:creationTime>
Nov 28 11:07:30 user nova-compute[74994]:       <nova:flavor name="m1.small">
Nov 28 11:07:30 user nova-compute[74994]:         <nova:memory>2048</nova:memory>
Nov 28 11:07:30 user nova-compute[74994]:         <nova:disk>20</nova:disk>
Nov 28 11:07:30 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 11:07:30 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 11:07:30 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 11:07:30 user nova-compute[74994]:       </nova:flavor>
Nov 28 11:07:30 user nova-compute[74994]:       <nova:owner>
Nov 28 11:07:30 user nova-compute[74994]:         <nova:user uuid="d51be473c7284977a6533756a1f677f9">tempest-ServerActionsTestOtherA-1927948343-project-member</nova:user>
Nov 28 11:07:30 user nova-compute[74994]:         <nova:project uuid="5eb43a8fc7bd47728600741762f71112">tempest-ServerActionsTestOtherA-1927948343</nova:project>
Nov 28 11:07:30 user nova-compute[74994]:       </nova:owner>
Nov 28 11:07:30 user nova-compute[74994]:       <nova:ports>
Nov 28 11:07:30 user nova-compute[74994]:         <nova:port uuid="17fb7783-f3dc-41cf-b838-004f2048fdbc">
Nov 28 11:07:30 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 11:07:30 user nova-compute[74994]:         </nova:port>
Nov 28 11:07:30 user nova-compute[74994]:       </nova:ports>
Nov 28 11:07:30 user nova-compute[74994]:     </nova:instance>
Nov 28 11:07:30 user nova-compute[74994]:   </metadata>
Nov 28 11:07:30 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 11:07:30 user nova-compute[74994]:     <system>
Nov 28 11:07:30 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 11:07:30 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 11:07:30 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 11:07:30 user nova-compute[74994]:       <entry name="serial">e3b0b960-3f38-4a6f-9017-209fbc2110c9</entry>
Nov 28 11:07:30 user nova-compute[74994]:       <entry name="uuid">e3b0b960-3f38-4a6f-9017-209fbc2110c9</entry>
Nov 28 11:07:30 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 11:07:30 user nova-compute[74994]:     </system>
Nov 28 11:07:30 user nova-compute[74994]:   </sysinfo>
Nov 28 11:07:30 user nova-compute[74994]:   <os>
Nov 28 11:07:30 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 11:07:30 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 11:07:30 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 11:07:30 user nova-compute[74994]:   </os>
Nov 28 11:07:30 user nova-compute[74994]:   <features>
Nov 28 11:07:30 user nova-compute[74994]:     <acpi/>
Nov 28 11:07:30 user nova-compute[74994]:     <apic/>
Nov 28 11:07:30 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 11:07:30 user nova-compute[74994]:   </features>
Nov 28 11:07:30 user nova-compute[74994]:   <clock offset="utc">
Nov 28 11:07:30 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 11:07:30 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 11:07:30 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 11:07:30 user nova-compute[74994]:   </clock>
Nov 28 11:07:30 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 11:07:30 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 11:07:30 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 11:07:30 user nova-compute[74994]:   </cpu>
Nov 28 11:07:30 user nova-compute[74994]:   <devices>
Nov 28 11:07:30 user nova-compute[74994]:     <disk type="block" device="disk">
Nov 28 11:07:30 user nova-compute[74994]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:07:30 user nova-compute[74994]:       <source dev="/dev/sdd"/>
Nov 28 11:07:30 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 11:07:30 user nova-compute[74994]:       <serial>cc3edc15-080f-4593-9a75-5d2719dfe0dd</serial>
Nov 28 11:07:30 user nova-compute[74994]:     </disk>
Nov 28 11:07:30 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 11:07:30 user nova-compute[74994]:       <mac address="fa:16:3e:b7:31:25"/>
Nov 28 11:07:30 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:07:30 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 11:07:30 user nova-compute[74994]:       <target dev="tap17fb7783-f3"/>
Nov 28 11:07:30 user nova-compute[74994]:     </interface>
Nov 28 11:07:30 user nova-compute[74994]:     <serial type="pty">
Nov 28 11:07:30 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/e3b0b960-3f38-4a6f-9017-209fbc2110c9/console.log" append="off"/>
Nov 28 11:07:30 user nova-compute[74994]:     </serial>
Nov 28 11:07:30 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 11:07:30 user nova-compute[74994]:     <video>
Nov 28 11:07:30 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:07:30 user nova-compute[74994]:     </video>
Nov 28 11:07:30 user nova-compute[74994]:     <rng model="virtio">
Nov 28 11:07:30 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 11:07:30 user nova-compute[74994]:     </rng>
Nov 28 11:07:30 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 11:07:30 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 11:07:30 user nova-compute[74994]:       <stats period="10"/>
Nov 28 11:07:30 user nova-compute[74994]:     </memballoon>
Nov 28 11:07:30 user nova-compute[74994]:   </devices>
Nov 28 11:07:30 user nova-compute[74994]: </domain>
Nov 28 11:07:30 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 11:07:30 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:05:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1667657680',display_name='tempest-ServerActionsTestOtherA-server-1667657680',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1667657680',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPW6Lty9ow0zAcm936yuU8WeLpHxpamSCaeKsFRdduK4jmYnIbGWXIhKjvJDlhN8evt/Hb3F2U1wYmR8qRXarp7uOZi0MsdjDWCq+Ku3i87+sooae0XVTHruzSkrMSatFQ==',key_name='tempest-keypair-1409463142',keypairs=<?>,launch_index=0,launched_at=2023-11-28T11:05:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5eb43a8fc7bd47728600741762f71112',ramdisk_id='',reservation_id='r-d1wwwslj',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1927948343',owner_user_name='tempest-ServerActionsTestOtherA-1927948343-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:07:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d51be473c7284977a6533756a1f677f9',uuid=e3b0b960-3f38-4a6f-9017-209fbc2110c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "17fb7783-f3dc-41cf-b838-004f2048fdbc", "address": "fa:16:3e:b7:31:25", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-490143931-network", "vif_mac": "fa:16:3e:b7:31:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17fb7783-f3", "ovs_interfaceid": "17fb7783-f3dc-41cf-b838-004f2048fdbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 11:07:30 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Converting VIF {"id": "17fb7783-f3dc-41cf-b838-004f2048fdbc", "address": "fa:16:3e:b7:31:25", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-490143931-network", "vif_mac": "fa:16:3e:b7:31:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17fb7783-f3", "ovs_interfaceid": "17fb7783-f3dc-41cf-b838-004f2048fdbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:07:30 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:31:25,bridge_name='br-int',has_traffic_filtering=True,id=17fb7783-f3dc-41cf-b838-004f2048fdbc,network=Network(16dd32cd-5a00-4111-92e2-283e7635540f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17fb7783-f3') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:07:30 user nova-compute[74994]: DEBUG os_vif [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:31:25,bridge_name='br-int',has_traffic_filtering=True,id=17fb7783-f3dc-41cf-b838-004f2048fdbc,network=Network(16dd32cd-5a00-4111-92e2-283e7635540f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17fb7783-f3') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 11:07:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:07:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 11:07:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '079cbe4e-57a1-577a-96db-314841512102', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:07:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:07:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap17fb7783-f3, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:07:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap17fb7783-f3, col_values=(('qos', UUID('eff8028c-3d4b-459f-a84d-2dc167607dae')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:07:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap17fb7783-f3, col_values=(('external_ids', {'iface-id': '17fb7783-f3dc-41cf-b838-004f2048fdbc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:31:25', 'vm-uuid': 'e3b0b960-3f38-4a6f-9017-209fbc2110c9'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:07:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:07:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:30 user nova-compute[74994]: INFO os_vif [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:31:25,bridge_name='br-int',has_traffic_filtering=True,id=17fb7783-f3dc-41cf-b838-004f2048fdbc,network=Network(16dd32cd-5a00-4111-92e2-283e7635540f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17fb7783-f3')
Nov 28 11:07:30 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:07:30 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] No VIF found with MAC fa:16:3e:b7:31:25, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:07:30 user nova-compute[74994]: DEBUG nova.compute.manager [req-c9973c02-5f43-441e-ba5f-af5739644d61 req-4edf767d-1c38-48eb-b481-a0f73ad063c4 service nova] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Received event network-changed-281bdb45-f23e-4ec0-a536-80a82491d3ff {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:07:30 user nova-compute[74994]: DEBUG nova.compute.manager [req-c9973c02-5f43-441e-ba5f-af5739644d61 req-4edf767d-1c38-48eb-b481-a0f73ad063c4 service nova] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Refreshing instance network info cache due to event network-changed-281bdb45-f23e-4ec0-a536-80a82491d3ff. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:07:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c9973c02-5f43-441e-ba5f-af5739644d61 req-4edf767d-1c38-48eb-b481-a0f73ad063c4 service nova] Acquiring lock "refresh_cache-7295ae8a-462e-4b75-af40-35aac439dad0" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:07:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c9973c02-5f43-441e-ba5f-af5739644d61 req-4edf767d-1c38-48eb-b481-a0f73ad063c4 service nova] Acquired lock "refresh_cache-7295ae8a-462e-4b75-af40-35aac439dad0" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:07:30 user nova-compute[74994]: DEBUG nova.network.neutron [req-c9973c02-5f43-441e-ba5f-af5739644d61 req-4edf767d-1c38-48eb-b481-a0f73ad063c4 service nova] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Refreshing network info cache for port 281bdb45-f23e-4ec0-a536-80a82491d3ff {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:07:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Acquiring lock "7295ae8a-462e-4b75-af40-35aac439dad0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:07:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "7295ae8a-462e-4b75-af40-35aac439dad0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:07:31 user nova-compute[74994]: DEBUG nova.network.neutron [req-c9973c02-5f43-441e-ba5f-af5739644d61 req-4edf767d-1c38-48eb-b481-a0f73ad063c4 service nova] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Updated VIF entry in instance network info cache for port 281bdb45-f23e-4ec0-a536-80a82491d3ff. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:07:31 user nova-compute[74994]: DEBUG nova.network.neutron [req-c9973c02-5f43-441e-ba5f-af5739644d61 req-4edf767d-1c38-48eb-b481-a0f73ad063c4 service nova] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Updating instance_info_cache with network_info: [{"id": "281bdb45-f23e-4ec0-a536-80a82491d3ff", "address": "fa:16:3e:14:2e:38", "network": {"id": "962e3ca9-e99b-49cd-bb50-c34d108cdfa7", "bridge": "br-int", "label": "tempest-TestStampPattern-359277306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30dae8b62e14c50b9646b13af2a4258", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281bdb45-f2", "ovs_interfaceid": "281bdb45-f23e-4ec0-a536-80a82491d3ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:07:31 user nova-compute[74994]: DEBUG nova.objects.instance [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lazy-loading 'flavor' on Instance uuid 7295ae8a-462e-4b75-af40-35aac439dad0 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:07:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c9973c02-5f43-441e-ba5f-af5739644d61 req-4edf767d-1c38-48eb-b481-a0f73ad063c4 service nova] Releasing lock "refresh_cache-7295ae8a-462e-4b75-af40-35aac439dad0" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:07:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "7295ae8a-462e-4b75-af40-35aac439dad0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:07:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Acquiring lock "7295ae8a-462e-4b75-af40-35aac439dad0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:07:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "7295ae8a-462e-4b75-af40-35aac439dad0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:07:31 user nova-compute[74994]: INFO nova.compute.manager [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Attaching volume d6c2162d-1a69-465c-9bd9-00c684c4ab1d to /dev/vdb
Nov 28 11:07:31 user nova-compute[74994]: DEBUG os_brick.utils [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:07:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:31 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac398d2-eade-4cc1-a6ab-2a869fe28252]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:31 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.033s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:31 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0422031a-8276-46a4-b42f-1b06a599ad49]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:31 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:31 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:31 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:31 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f45488c-ca84-4adc-b957-b471ce8fb5e3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:31 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[188c4db8-8500-4772-aa1f-6a69761a3d27]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:07:31 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 11:07:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:07:31 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 11:07:31 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[80950016-4479-4df4-a2e4-874fc39ef836]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:31 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 11:07:31 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 11:07:31 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 11:07:31 user nova-compute[74994]: DEBUG os_brick.utils [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] <== get_connector_properties: return (183ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:07:31 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Updating existing volume attachment record: fc06d539-ab98-4eb4-8d21-6ac0952d0ed8 {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 11:07:32 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-e95a8d32-b390-463a-bb7e-fe41ad36838e tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Snapshot image upload complete
Nov 28 11:07:32 user nova-compute[74994]: DEBUG nova.compute.manager [None req-e95a8d32-b390-463a-bb7e-fe41ad36838e tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 11:07:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:32 user nova-compute[74994]: DEBUG nova.compute.manager [req-c967e6d9-b228-400f-b9da-224ef3202250 req-8c67f83b-7238-4016-a190-4fe0b0be7ebd service nova] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Received event network-vif-plugged-17fb7783-f3dc-41cf-b838-004f2048fdbc {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:07:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c967e6d9-b228-400f-b9da-224ef3202250 req-8c67f83b-7238-4016-a190-4fe0b0be7ebd service nova] Acquiring lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:07:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c967e6d9-b228-400f-b9da-224ef3202250 req-8c67f83b-7238-4016-a190-4fe0b0be7ebd service nova] Lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:07:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c967e6d9-b228-400f-b9da-224ef3202250 req-8c67f83b-7238-4016-a190-4fe0b0be7ebd service nova] Lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:07:32 user nova-compute[74994]: DEBUG nova.compute.manager [req-c967e6d9-b228-400f-b9da-224ef3202250 req-8c67f83b-7238-4016-a190-4fe0b0be7ebd service nova] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] No waiting events found dispatching network-vif-plugged-17fb7783-f3dc-41cf-b838-004f2048fdbc {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:07:32 user nova-compute[74994]: WARNING nova.compute.manager [req-c967e6d9-b228-400f-b9da-224ef3202250 req-8c67f83b-7238-4016-a190-4fe0b0be7ebd service nova] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Received unexpected event network-vif-plugged-17fb7783-f3dc-41cf-b838-004f2048fdbc for instance with vm_state active and task_state resize_finish.
Nov 28 11:07:32 user nova-compute[74994]: INFO nova.compute.manager [None req-e95a8d32-b390-463a-bb7e-fe41ad36838e tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Shelve offloading
Nov 28 11:07:32 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Instance destroyed successfully.
Nov 28 11:07:32 user nova-compute[74994]: DEBUG nova.compute.manager [None req-e95a8d32-b390-463a-bb7e-fe41ad36838e tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 11:07:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e95a8d32-b390-463a-bb7e-fe41ad36838e tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Acquiring lock "refresh_cache-a2caa913-b0cc-46b7-b90d-fe507bc00b09" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:07:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e95a8d32-b390-463a-bb7e-fe41ad36838e tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Acquired lock "refresh_cache-a2caa913-b0cc-46b7-b90d-fe507bc00b09" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:07:32 user nova-compute[74994]: DEBUG nova.network.neutron [None req-e95a8d32-b390-463a-bb7e-fe41ad36838e tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 11:07:32 user nova-compute[74994]: DEBUG nova.network.neutron [None req-e95a8d32-b390-463a-bb7e-fe41ad36838e tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Updating instance_info_cache with network_info: [{"id": "69c7a712-9905-4a77-a0ae-cd64dbd347fd", "address": "fa:16:3e:38:2c:b1", "network": {"id": "d46e72ec-d7d5-45f7-951a-b4381f0b472b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-179057367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a4dcdeafd6420d8606b37673e3255f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c7a712-99", "ovs_interfaceid": "69c7a712-9905-4a77-a0ae-cd64dbd347fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:07:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e95a8d32-b390-463a-bb7e-fe41ad36838e tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Releasing lock "refresh_cache-a2caa913-b0cc-46b7-b90d-fe507bc00b09" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:07:33 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Instance destroyed successfully.
Nov 28 11:07:33 user nova-compute[74994]: DEBUG nova.objects.instance [None req-e95a8d32-b390-463a-bb7e-fe41ad36838e tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lazy-loading 'resources' on Instance uuid a2caa913-b0cc-46b7-b90d-fe507bc00b09 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:07:33 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-e95a8d32-b390-463a-bb7e-fe41ad36838e tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:05:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1217374859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1217374859',id=34,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPC+y5ycUWPYQy2XZB6kzbHT0mcdyeioMthsGLt6Hmxof5Ngy9OG06XF/Ob1BE/FlbLo4NkWH5tRCW3J+w+6D0hmLq2Ga7sCt9VMBIw+oANqnW44474dY78DHKN2+O8dQ==',key_name='tempest-keypair-328848665',keypairs=<?>,launch_index=0,launched_at=2023-11-28T11:05:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d3a4dcdeafd6420d8606b37673e3255f',ramdisk_id='',reservation_id='r-taf8uoy1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1700061593',owner_user_name='tempest-AttachVolumeShelveTestJSON-1700061593-project-member',shelved_at='2023-11-28T11:07:32.111963',shelved_host='user',shelved_image_id='7b43e346-d7a9-4e73-8ab1-5e265d1c130c'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T11:07:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4e1257b844940bebdeab3061c3e0ab4',uuid=a2caa913-b0cc-46b7-b90d-fe507bc00b09,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "69c7a712-9905-4a77-a0ae-cd64dbd347fd", "address": "fa:16:3e:38:2c:b1", "network": {"id": "d46e72ec-d7d5-45f7-951a-b4381f0b472b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-179057367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a4dcdeafd6420d8606b37673e3255f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c7a712-99", "ovs_interfaceid": "69c7a712-9905-4a77-a0ae-cd64dbd347fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 11:07:33 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-e95a8d32-b390-463a-bb7e-fe41ad36838e tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Converting VIF {"id": "69c7a712-9905-4a77-a0ae-cd64dbd347fd", "address": "fa:16:3e:38:2c:b1", "network": {"id": "d46e72ec-d7d5-45f7-951a-b4381f0b472b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-179057367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a4dcdeafd6420d8606b37673e3255f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c7a712-99", "ovs_interfaceid": "69c7a712-9905-4a77-a0ae-cd64dbd347fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:07:33 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-e95a8d32-b390-463a-bb7e-fe41ad36838e tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:2c:b1,bridge_name='br-int',has_traffic_filtering=True,id=69c7a712-9905-4a77-a0ae-cd64dbd347fd,network=Network(d46e72ec-d7d5-45f7-951a-b4381f0b472b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69c7a712-99') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:07:33 user nova-compute[74994]: DEBUG os_vif [None req-e95a8d32-b390-463a-bb7e-fe41ad36838e tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:2c:b1,bridge_name='br-int',has_traffic_filtering=True,id=69c7a712-9905-4a77-a0ae-cd64dbd347fd,network=Network(d46e72ec-d7d5-45f7-951a-b4381f0b472b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69c7a712-99') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 11:07:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69c7a712-99, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:07:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:07:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=81f96b9c-0185-4ac5-8dce-4c55f4fa695f) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:07:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:33 user nova-compute[74994]: INFO os_vif [None req-e95a8d32-b390-463a-bb7e-fe41ad36838e tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:2c:b1,bridge_name='br-int',has_traffic_filtering=True,id=69c7a712-9905-4a77-a0ae-cd64dbd347fd,network=Network(d46e72ec-d7d5-45f7-951a-b4381f0b472b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69c7a712-99')
Nov 28 11:07:33 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-e95a8d32-b390-463a-bb7e-fe41ad36838e tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Deleting instance files /opt/stack/data/nova/instances/a2caa913-b0cc-46b7-b90d-fe507bc00b09_del
Nov 28 11:07:33 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-e95a8d32-b390-463a-bb7e-fe41ad36838e tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Deletion of /opt/stack/data/nova/instances/a2caa913-b0cc-46b7-b90d-fe507bc00b09_del complete
Nov 28 11:07:33 user nova-compute[74994]: DEBUG nova.compute.manager [req-e5ed562d-a6b6-48f5-bc15-0cc8e8f2d0bc req-df7f67f9-9d31-4f3d-94d1-36b2a702d396 service nova] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Received event network-changed-69c7a712-9905-4a77-a0ae-cd64dbd347fd {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:07:33 user nova-compute[74994]: DEBUG nova.compute.manager [req-e5ed562d-a6b6-48f5-bc15-0cc8e8f2d0bc req-df7f67f9-9d31-4f3d-94d1-36b2a702d396 service nova] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Refreshing instance network info cache due to event network-changed-69c7a712-9905-4a77-a0ae-cd64dbd347fd. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:07:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-e5ed562d-a6b6-48f5-bc15-0cc8e8f2d0bc req-df7f67f9-9d31-4f3d-94d1-36b2a702d396 service nova] Acquiring lock "refresh_cache-a2caa913-b0cc-46b7-b90d-fe507bc00b09" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:07:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-e5ed562d-a6b6-48f5-bc15-0cc8e8f2d0bc req-df7f67f9-9d31-4f3d-94d1-36b2a702d396 service nova] Acquired lock "refresh_cache-a2caa913-b0cc-46b7-b90d-fe507bc00b09" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:07:33 user nova-compute[74994]: DEBUG nova.network.neutron [req-e5ed562d-a6b6-48f5-bc15-0cc8e8f2d0bc req-df7f67f9-9d31-4f3d-94d1-36b2a702d396 service nova] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Refreshing network info cache for port 69c7a712-9905-4a77-a0ae-cd64dbd347fd {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:07:33 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-e95a8d32-b390-463a-bb7e-fe41ad36838e tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Deleted allocations for instance a2caa913-b0cc-46b7-b90d-fe507bc00b09
Nov 28 11:07:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e95a8d32-b390-463a-bb7e-fe41ad36838e tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:07:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e95a8d32-b390-463a-bb7e-fe41ad36838e tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:07:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:33 user nova-compute[74994]: DEBUG nova.objects.instance [None req-e95a8d32-b390-463a-bb7e-fe41ad36838e tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lazy-loading 'numa_topology' on Instance uuid a2caa913-b0cc-46b7-b90d-fe507bc00b09 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:07:33 user nova-compute[74994]: DEBUG nova.objects.base [None req-e95a8d32-b390-463a-bb7e-fe41ad36838e tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Object Instance<a2caa913-b0cc-46b7-b90d-fe507bc00b09> lazy-loaded attributes: resources,numa_topology {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 11:07:34 user nova-compute[74994]: DEBUG nova.compute.manager [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 11:07:34 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Instance running successfully.
Nov 28 11:07:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Failed to set time: agent not configured {{(pid=74994) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 28 11:07:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-da701c09-fb8f-4eac-83a7-1a802b4a847c tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] finish_migration finished successfully. {{(pid=74994) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 28 11:07:34 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-e95a8d32-b390-463a-bb7e-fe41ad36838e tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:07:34 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-e95a8d32-b390-463a-bb7e-fe41ad36838e tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:07:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e95a8d32-b390-463a-bb7e-fe41ad36838e tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.452s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:07:34 user nova-compute[74994]: DEBUG nova.network.neutron [req-e5ed562d-a6b6-48f5-bc15-0cc8e8f2d0bc req-df7f67f9-9d31-4f3d-94d1-36b2a702d396 service nova] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Updated VIF entry in instance network info cache for port 69c7a712-9905-4a77-a0ae-cd64dbd347fd. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:07:34 user nova-compute[74994]: DEBUG nova.network.neutron [req-e5ed562d-a6b6-48f5-bc15-0cc8e8f2d0bc req-df7f67f9-9d31-4f3d-94d1-36b2a702d396 service nova] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Updating instance_info_cache with network_info: [{"id": "69c7a712-9905-4a77-a0ae-cd64dbd347fd", "address": "fa:16:3e:38:2c:b1", "network": {"id": "d46e72ec-d7d5-45f7-951a-b4381f0b472b", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-179057367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a4dcdeafd6420d8606b37673e3255f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap69c7a712-99", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:07:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-e5ed562d-a6b6-48f5-bc15-0cc8e8f2d0bc req-df7f67f9-9d31-4f3d-94d1-36b2a702d396 service nova] Releasing lock "refresh_cache-a2caa913-b0cc-46b7-b90d-fe507bc00b09" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:07:34 user nova-compute[74994]: DEBUG nova.compute.manager [req-96416d51-7be7-4305-9b9c-421fcbb12914 req-963208bb-47be-4d59-9c88-ee7d3979c03d service nova] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Received event network-vif-plugged-17fb7783-f3dc-41cf-b838-004f2048fdbc {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:07:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-96416d51-7be7-4305-9b9c-421fcbb12914 req-963208bb-47be-4d59-9c88-ee7d3979c03d service nova] Acquiring lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:07:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-96416d51-7be7-4305-9b9c-421fcbb12914 req-963208bb-47be-4d59-9c88-ee7d3979c03d service nova] Lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:07:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-96416d51-7be7-4305-9b9c-421fcbb12914 req-963208bb-47be-4d59-9c88-ee7d3979c03d service nova] Lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:07:34 user nova-compute[74994]: DEBUG nova.compute.manager [req-96416d51-7be7-4305-9b9c-421fcbb12914 req-963208bb-47be-4d59-9c88-ee7d3979c03d service nova] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] No waiting events found dispatching network-vif-plugged-17fb7783-f3dc-41cf-b838-004f2048fdbc {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:07:34 user nova-compute[74994]: WARNING nova.compute.manager [req-96416d51-7be7-4305-9b9c-421fcbb12914 req-963208bb-47be-4d59-9c88-ee7d3979c03d service nova] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Received unexpected event network-vif-plugged-17fb7783-f3dc-41cf-b838-004f2048fdbc for instance with vm_state active and task_state resize_finish.
Nov 28 11:07:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e95a8d32-b390-463a-bb7e-fe41ad36838e tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "a2caa913-b0cc-46b7-b90d-fe507bc00b09" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.823s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:07:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:36 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 11:07:36 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QSJgctrK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:07:36 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:07:36 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:07:36 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:07:36 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:07:36 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:07:36 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:07:36 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 11:07:36 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092 -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:36 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:36 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ff874e-90ca-4235-af01-63c04a10f401]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:36 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 11:07:36 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:07:36 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092 -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:36 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:36 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2909dc6a-7af1-4c8d-b30c-a39ae772f44b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:36 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092] added
Nov 28 11:07:36 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:07:36 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:36 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:36 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[12510fb8-e732-47cc-8fd7-8e1d1ec493b9]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:36 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:07:36 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:36 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:36 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b4aac8-764f-40ff-8b56-01fd06ed46a6]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:36 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:07:36 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QSJgctrK {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:36 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QSJgctrK" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:36 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a432586f-a941-4e63-8490-abc32d5f70d0]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:36 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QSJgctrK'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:07:36 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:37 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd24042c-ff3a-4059-af59-293c290386d9]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:07:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:37 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f7a8a8-7b30-440d-8f3c-2df024b5563e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:07:37 user nova-compute[74994]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a (non-flash)
Nov 28 11:07:37 user nova-compute[74994]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)
Nov 28 11:07:37 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:07:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:07:37 user nova-compute[74994]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a (non-flash)
Nov 28 11:07:37 user nova-compute[74994]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)
Nov 28 11:07:37 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:07:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092 -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:37 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[324619b9-89fa-4593-ae4e-5eb8a02ee8d4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092, portal: 172.16.0.220,3260]
Nov 28 11:07:37 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092, portal: 172.16.0.220,3260] successful.
Nov 28 11:07:37 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:07:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:37 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4428e5-2419-47fe-8fc5-814c2e8c80b5]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:07:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:37 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2a7206-8442-45ed-b9b3-ee74155352c5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:07:37 user nova-compute[74994]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a (non-flash)
Nov 28 11:07:37 user nova-compute[74994]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)
Nov 28 11:07:37 user nova-compute[74994]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092 (non-flash)
Nov 28 11:07:37 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:07:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:07:37 user nova-compute[74994]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a (non-flash)
Nov 28 11:07:37 user nova-compute[74994]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)
Nov 28 11:07:37 user nova-compute[74994]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092 (non-flash)
Nov 28 11:07:37 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:07:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:07:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 11:07:37 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] HCTL ('36', '-', '-', 0) found on session 43 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 11:07:37 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 11:07:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:37 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[780eac57-5ecb-4ad9-8563-9d79fc6b38d5]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:37 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Searching for a device in session 43 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 11:07:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QSJgctrK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 11:07:37 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:07:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '26533613734316533', 'path': '/dev/sde'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:07:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533613734316533', 'path': '/dev/sde'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 11:07:38 user nova-compute[74994]: DEBUG nova.objects.instance [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lazy-loading 'flavor' on Instance uuid 0f267741-9611-4812-9afa-32717d16abc5 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:07:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 11:07:38 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:07:38 user nova-compute[74994]:   <source dev="/dev/sde"/>
Nov 28 11:07:38 user nova-compute[74994]:   <target dev="vdc" bus="virtio"/>
Nov 28 11:07:38 user nova-compute[74994]:   <serial>807a7039-4bee-445b-a2b5-02d10f63f092</serial>
Nov 28 11:07:38 user nova-compute[74994]: </disk>
Nov 28 11:07:38 user nova-compute[74994]:  {{(pid=74994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 11:07:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:07:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:07:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:07:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] No VIF found with MAC fa:16:3e:10:54:1c, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:07:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1ae4d105-c033-4010-9f70-ab737a577714 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "0f267741-9611-4812-9afa-32717d16abc5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.806s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:07:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3cba6d3c-dcb5-4358-aea9-3d54bf50de08 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Acquiring lock "0f267741-9611-4812-9afa-32717d16abc5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:07:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3cba6d3c-dcb5-4358-aea9-3d54bf50de08 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "0f267741-9611-4812-9afa-32717d16abc5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:07:39 user nova-compute[74994]: INFO nova.compute.manager [None req-3cba6d3c-dcb5-4358-aea9-3d54bf50de08 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Detaching volume 07e1aa43-1637-45ed-ad63-5f5ff971569a
Nov 28 11:07:39 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 11:07:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qWerFOfm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:07:39 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:07:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:07:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:07:39 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:07:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:07:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:07:39 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 11:07:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:39 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c581f2f-acd0-417b-b960-d13bfd163da0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 11:07:39 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:07:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:40 user nova-compute[74994]: INFO nova.virt.block_device [None req-3cba6d3c-dcb5-4358-aea9-3d54bf50de08 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Attempting to driver detach volume 07e1aa43-1637-45ed-ad63-5f5ff971569a from mountpoint /dev/vdb
Nov 28 11:07:40 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:40 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[915ddbf1-72db-4162-a362-e0c1f829a7cb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:40 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d] added
Nov 28 11:07:40 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:07:40 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3cba6d3c-dcb5-4358-aea9-3d54bf50de08 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Attempting to detach device vdb from instance 0f267741-9611-4812-9afa-32717d16abc5 from the persistent domain config. {{(pid=74994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 11:07:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-3cba6d3c-dcb5-4358-aea9-3d54bf50de08 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 11:07:40 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:07:40 user nova-compute[74994]:   <source dev="/dev/sdc"/>
Nov 28 11:07:40 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:07:40 user nova-compute[74994]:   <serial>07e1aa43-1637-45ed-ad63-5f5ff971569a</serial>
Nov 28 11:07:40 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 11:07:40 user nova-compute[74994]: </disk>
Nov 28 11:07:40 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 11:07:40 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-3cba6d3c-dcb5-4358-aea9-3d54bf50de08 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Successfully detached device vdb from instance 0f267741-9611-4812-9afa-32717d16abc5 from the persistent domain config.
Nov 28 11:07:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3cba6d3c-dcb5-4358-aea9-3d54bf50de08 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0f267741-9611-4812-9afa-32717d16abc5 from the live domain config. {{(pid=74994) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 11:07:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-3cba6d3c-dcb5-4358-aea9-3d54bf50de08 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 11:07:40 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:07:40 user nova-compute[74994]:   <source dev="/dev/sdc"/>
Nov 28 11:07:40 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:07:40 user nova-compute[74994]:   <serial>07e1aa43-1637-45ed-ad63-5f5ff971569a</serial>
Nov 28 11:07:40 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 11:07:40 user nova-compute[74994]: </disk>
Nov 28 11:07:40 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 11:07:40 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:40 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab52c63e-dfc1-4af1-aeef-e37368d18860]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:40 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:07:40 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:40 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:40 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f509ee6-1219-4cec-b9a0-c7444922a429]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:40 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:07:40 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qWerFOfm {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:40 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qWerFOfm" returned: 0 in 0.025s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:40 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b66a50a-cc28-4172-ba72-e5101006a44d]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:40 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qWerFOfm'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:07:40 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:40 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:40 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5a218a-0233-444a-97ec-d3d34b65eb20]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:40 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:07:40 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:40 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:40 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60856aa-36a4-43d5-82b8-d537b11ee5f9]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:40 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:07:40 user nova-compute[74994]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a (non-flash)
Nov 28 11:07:40 user nova-compute[74994]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)
Nov 28 11:07:40 user nova-compute[74994]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092 (non-flash)
Nov 28 11:07:40 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:07:40 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:07:40 user nova-compute[74994]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a (non-flash)
Nov 28 11:07:40 user nova-compute[74994]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)
Nov 28 11:07:40 user nova-compute[74994]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092 (non-flash)
Nov 28 11:07:40 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:07:40 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:40 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:40 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f57858-231d-420f-8aee-96362d13085b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:40 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d, portal: 172.16.0.220,3260]
Nov 28 11:07:40 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d, portal: 172.16.0.220,3260] successful.
Nov 28 11:07:40 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:07:40 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:40 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:40 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef11d80d-6c0d-4002-a41d-b3ae74fba95a]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:40 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:07:40 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:40 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:40 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f860677-1c80-4c77-bdde-b1bae9ccd193]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:40 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:07:40 user nova-compute[74994]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a (non-flash)
Nov 28 11:07:40 user nova-compute[74994]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)
Nov 28 11:07:40 user nova-compute[74994]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092 (non-flash)
Nov 28 11:07:40 user nova-compute[74994]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d (non-flash)
Nov 28 11:07:40 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:07:40 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:07:40 user nova-compute[74994]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a (non-flash)
Nov 28 11:07:40 user nova-compute[74994]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)
Nov 28 11:07:40 user nova-compute[74994]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092 (non-flash)
Nov 28 11:07:40 user nova-compute[74994]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d (non-flash)
Nov 28 11:07:40 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:07:40 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:07:40 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 11:07:40 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] HCTL ('37', '-', '-', 0) found on session 44 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 11:07:40 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 11:07:40 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:40 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:40 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b91855f-cc2f-46a5-b671-6b2a77b68b83]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:40 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Searching for a device in session 44 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 11:07:40 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qWerFOfm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 11:07:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-3cba6d3c-dcb5-4358-aea9-3d54bf50de08 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0f267741-9611-4812-9afa-32717d16abc5 {{(pid=74994) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 11:07:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:07:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '26263643532656230', 'path': '/dev/sdf'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:07:41 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263643532656230', 'path': '/dev/sdf'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 11:07:41 user nova-compute[74994]: DEBUG nova.objects.instance [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lazy-loading 'flavor' on Instance uuid 7295ae8a-462e-4b75-af40-35aac439dad0 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:07:41 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 11:07:41 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:07:41 user nova-compute[74994]:   <source dev="/dev/sdf"/>
Nov 28 11:07:41 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:07:41 user nova-compute[74994]:   <serial>d6c2162d-1a69-465c-9bd9-00c684c4ab1d</serial>
Nov 28 11:07:41 user nova-compute[74994]: </disk>
Nov 28 11:07:41 user nova-compute[74994]:  {{(pid=74994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 11:07:41 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:07:41 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:07:41 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] No VIF found with MAC fa:16:3e:14:2e:38, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:07:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-18356d76-a5ac-485c-9fed-b79e2cb26340 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "7295ae8a-462e-4b75-af40-35aac439dad0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.429s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:07:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-abe7ffe5-b39d-4586-b521-243954b47313 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Acquiring lock "7295ae8a-462e-4b75-af40-35aac439dad0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:07:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-abe7ffe5-b39d-4586-b521-243954b47313 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "7295ae8a-462e-4b75-af40-35aac439dad0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.004s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:07:44 user nova-compute[74994]: INFO nova.compute.manager [None req-abe7ffe5-b39d-4586-b521-243954b47313 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Detaching volume d6c2162d-1a69-465c-9bd9-00c684c4ab1d
Nov 28 11:07:44 user nova-compute[74994]: INFO nova.virt.block_device [None req-abe7ffe5-b39d-4586-b521-243954b47313 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Attempting to driver detach volume d6c2162d-1a69-465c-9bd9-00c684c4ab1d from mountpoint /dev/vdb
Nov 28 11:07:44 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-abe7ffe5-b39d-4586-b521-243954b47313 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Attempting to detach device vdb from instance 7295ae8a-462e-4b75-af40-35aac439dad0 from the persistent domain config. {{(pid=74994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 11:07:44 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-abe7ffe5-b39d-4586-b521-243954b47313 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 11:07:44 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:07:44 user nova-compute[74994]:   <source dev="/dev/sdf"/>
Nov 28 11:07:44 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:07:44 user nova-compute[74994]:   <serial>d6c2162d-1a69-465c-9bd9-00c684c4ab1d</serial>
Nov 28 11:07:44 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 11:07:44 user nova-compute[74994]: </disk>
Nov 28 11:07:44 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 11:07:44 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-abe7ffe5-b39d-4586-b521-243954b47313 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Successfully detached device vdb from instance 7295ae8a-462e-4b75-af40-35aac439dad0 from the persistent domain config.
Nov 28 11:07:44 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-abe7ffe5-b39d-4586-b521-243954b47313 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7295ae8a-462e-4b75-af40-35aac439dad0 from the live domain config. {{(pid=74994) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 11:07:44 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-abe7ffe5-b39d-4586-b521-243954b47313 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 11:07:44 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:07:44 user nova-compute[74994]:   <source dev="/dev/sdf"/>
Nov 28 11:07:44 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:07:44 user nova-compute[74994]:   <serial>d6c2162d-1a69-465c-9bd9-00c684c4ab1d</serial>
Nov 28 11:07:44 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 11:07:44 user nova-compute[74994]: </disk>
Nov 28 11:07:44 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 11:07:44 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:44 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-abe7ffe5-b39d-4586-b521-243954b47313 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7295ae8a-462e-4b75-af40-35aac439dad0 {{(pid=74994) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 11:07:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d2279c16-92af-4353-9b63-a4044b738794 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "759fbcfd-ab13-438f-b860-6393a97d1205" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d2279c16-92af-4353-9b63-a4044b738794 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "759fbcfd-ab13-438f-b860-6393a97d1205" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d2279c16-92af-4353-9b63-a4044b738794 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "759fbcfd-ab13-438f-b860-6393a97d1205-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d2279c16-92af-4353-9b63-a4044b738794 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "759fbcfd-ab13-438f-b860-6393a97d1205-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d2279c16-92af-4353-9b63-a4044b738794 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "759fbcfd-ab13-438f-b860-6393a97d1205-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:07:51 user nova-compute[74994]: INFO nova.compute.manager [None req-d2279c16-92af-4353-9b63-a4044b738794 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Terminating instance
Nov 28 11:07:51 user nova-compute[74994]: DEBUG nova.compute.manager [None req-d2279c16-92af-4353-9b63-a4044b738794 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG nova.compute.manager [req-8b02f88a-3e2d-4885-92b4-372c6ed0039c req-5daabe67-7e14-45d3-8196-82473ba96008 service nova] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Received event network-vif-unplugged-7d4a82ba-d222-44bb-baac-6642f24b9528 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8b02f88a-3e2d-4885-92b4-372c6ed0039c req-5daabe67-7e14-45d3-8196-82473ba96008 service nova] Acquiring lock "759fbcfd-ab13-438f-b860-6393a97d1205-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8b02f88a-3e2d-4885-92b4-372c6ed0039c req-5daabe67-7e14-45d3-8196-82473ba96008 service nova] Lock "759fbcfd-ab13-438f-b860-6393a97d1205-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8b02f88a-3e2d-4885-92b4-372c6ed0039c req-5daabe67-7e14-45d3-8196-82473ba96008 service nova] Lock "759fbcfd-ab13-438f-b860-6393a97d1205-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG nova.compute.manager [req-8b02f88a-3e2d-4885-92b4-372c6ed0039c req-5daabe67-7e14-45d3-8196-82473ba96008 service nova] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] No waiting events found dispatching network-vif-unplugged-7d4a82ba-d222-44bb-baac-6642f24b9528 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG nova.compute.manager [req-8b02f88a-3e2d-4885-92b4-372c6ed0039c req-5daabe67-7e14-45d3-8196-82473ba96008 service nova] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Received event network-vif-unplugged-7d4a82ba-d222-44bb-baac-6642f24b9528 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:51 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Instance destroyed successfully.
Nov 28 11:07:51 user nova-compute[74994]: DEBUG nova.objects.instance [None req-d2279c16-92af-4353-9b63-a4044b738794 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lazy-loading 'resources' on Instance uuid 759fbcfd-ab13-438f-b860-6393a97d1205 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-d2279c16-92af-4353-9b63-a4044b738794 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:52:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-478607448',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-478607448',id=15,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:54:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='612ae9ec21ad40a4b68e0926843874ae',ramdisk_id='',reservation_id='r-51gyvey2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-332508527',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T10:55:50Z,user_data=None,user_id='6c49cba00cff4c4b80080c5f917b4176',uuid=759fbcfd-ab13-438f-b860-6393a97d1205,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d4a82ba-d222-44bb-baac-6642f24b9528", "address": "fa:16:3e:4f:75:25", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d4a82ba-d2", "ovs_interfaceid": "7d4a82ba-d222-44bb-baac-6642f24b9528", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-d2279c16-92af-4353-9b63-a4044b738794 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Converting VIF {"id": "7d4a82ba-d222-44bb-baac-6642f24b9528", "address": "fa:16:3e:4f:75:25", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d4a82ba-d2", "ovs_interfaceid": "7d4a82ba-d222-44bb-baac-6642f24b9528", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-d2279c16-92af-4353-9b63-a4044b738794 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:75:25,bridge_name='br-int',has_traffic_filtering=True,id=7d4a82ba-d222-44bb-baac-6642f24b9528,network=Network(a1692a13-d1d7-4df6-bfc0-54f231846889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d4a82ba-d2') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG os_vif [None req-d2279c16-92af-4353-9b63-a4044b738794 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:75:25,bridge_name='br-int',has_traffic_filtering=True,id=7d4a82ba-d222-44bb-baac-6642f24b9528,network=Network(a1692a13-d1d7-4df6-bfc0-54f231846889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d4a82ba-d2') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7d4a82ba-d2, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a7423e1c-4be4-4fef-a066-7164192cdf23) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:51 user nova-compute[74994]: INFO os_vif [None req-d2279c16-92af-4353-9b63-a4044b738794 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:75:25,bridge_name='br-int',has_traffic_filtering=True,id=7d4a82ba-d222-44bb-baac-6642f24b9528,network=Network(a1692a13-d1d7-4df6-bfc0-54f231846889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d4a82ba-d2')
Nov 28 11:07:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2279c16-92af-4353-9b63-a4044b738794 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2279c16-92af-4353-9b63-a4044b738794 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'npJsWGzr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:07:51 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-d2279c16-92af-4353-9b63-a4044b738794 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:07:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-d2279c16-92af-4353-9b63-a4044b738794 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-d2279c16-92af-4353-9b63-a4044b738794 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5943ea80-68aa-4901-99e5-8e730ea07a02]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2279c16-92af-4353-9b63-a4044b738794 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 11:07:51 user nova-compute[74994]: No targets found.
Nov 28 11:07:51 user nova-compute[74994]: iSNS:
Nov 28 11:07:51 user nova-compute[74994]: No targets found.
Nov 28 11:07:51 user nova-compute[74994]: STATIC:
Nov 28 11:07:51 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a
Nov 28 11:07:51 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:07:51 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:07:51 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092
Nov 28 11:07:51 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:07:51 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:07:51 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd
Nov 28 11:07:51 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:07:51 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:07:51 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d
Nov 28 11:07:51 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:07:51 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:07:51 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de
Nov 28 11:07:51 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:07:51 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:07:51 user nova-compute[74994]: FIRMWARE:
Nov 28 11:07:51 user nova-compute[74994]: No targets found.
Nov 28 11:07:51 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2279c16-92af-4353-9b63-a4044b738794 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 11:07:51 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 11:07:51 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2279c16-92af-4353-9b63-a4044b738794 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[302cabe0-a3d7-47d4-b265-5780e35709af]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c93d07-fdc6-4170-a491-71428672db6d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2279c16-92af-4353-9b63-a4044b738794 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:07:51 user nova-compute[74994]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a (non-flash)
Nov 28 11:07:51 user nova-compute[74994]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)
Nov 28 11:07:51 user nova-compute[74994]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092 (non-flash)
Nov 28 11:07:51 user nova-compute[74994]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d (non-flash)
Nov 28 11:07:51 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2279c16-92af-4353-9b63-a4044b738794 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de (non-flash)
Nov 28 11:07:51 user nova-compute[74994]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a (non-flash)
Nov 28 11:07:51 user nova-compute[74994]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)
Nov 28 11:07:51 user nova-compute[74994]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092 (non-flash)
Nov 28 11:07:51 user nova-compute[74994]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d (non-flash)
Nov 28 11:07:51 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2279c16-92af-4353-9b63-a4044b738794 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9204ab760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de'): ({'sdb'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-d2279c16-92af-4353-9b63-a4044b738794 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Removing single pathed devices sdb {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7868a4ee-fcb5-4151-a04d-77c10cfe4ec9]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e93b8b-3767-4dd2-a470-8ede0c451a61]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-d2279c16-92af-4353-9b63-a4044b738794 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Flushing IO for device /dev/sdb {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[082a60fd-d994-433a-9a95-c1055163dbd6]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-d2279c16-92af-4353-9b63-a4044b738794 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 11:07:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:52 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8df43a-293c-4f56-bb7b-bdf1d3d59f7d]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:52 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-d2279c16-92af-4353-9b63-a4044b738794 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 11:07:52 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-d2279c16-92af-4353-9b63-a4044b738794 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] SCSI volumes sdb have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 11:07:52 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2279c16-92af-4353-9b63-a4044b738794 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 11:07:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:52 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed9031e-f6f5-4ece-8184-e378292b4a61]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:52 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2279c16-92af-4353-9b63-a4044b738794 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:07:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:52 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9426060c-8f72-4c94-b6a1-f9ad369ab704]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:52 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2279c16-92af-4353-9b63-a4044b738794 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de, portal: 172.16.0.220,3260]
Nov 28 11:07:52 user nova-compute[74994]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de, portal: 172.16.0.220,3260] successful.
Nov 28 11:07:52 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:07:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:07:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b722d69-93d3-49c4-ab46-38ce89b057de -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:07:52 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fd01ee-eca2-4759-9136-a9587927972b]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:07:52 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2279c16-92af-4353-9b63-a4044b738794 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:07:52 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-d2279c16-92af-4353-9b63-a4044b738794 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:07:52 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2279c16-92af-4353-9b63-a4044b738794 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] <== disconnect_volume: return (316ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:07:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2279c16-92af-4353-9b63-a4044b738794 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 11:07:52 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-d2279c16-92af-4353-9b63-a4044b738794 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Deleting instance files /opt/stack/data/nova/instances/759fbcfd-ab13-438f-b860-6393a97d1205_del
Nov 28 11:07:52 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-d2279c16-92af-4353-9b63-a4044b738794 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Deletion of /opt/stack/data/nova/instances/759fbcfd-ab13-438f-b860-6393a97d1205_del complete
Nov 28 11:07:52 user nova-compute[74994]: INFO nova.compute.manager [None req-d2279c16-92af-4353-9b63-a4044b738794 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 28 11:07:52 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-d2279c16-92af-4353-9b63-a4044b738794 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 11:07:52 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 11:07:52 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 11:07:52 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:07:52 user nova-compute[74994]: DEBUG nova.compute.manager [req-65708818-29fa-4508-8977-0348b94246bc req-4331e767-a150-4112-beb9-d4a00e5eab81 service nova] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Received event network-vif-deleted-7d4a82ba-d222-44bb-baac-6642f24b9528 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:07:52 user nova-compute[74994]: INFO nova.compute.manager [req-65708818-29fa-4508-8977-0348b94246bc req-4331e767-a150-4112-beb9-d4a00e5eab81 service nova] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Neutron deleted interface 7d4a82ba-d222-44bb-baac-6642f24b9528; detaching it from the instance and deleting it from the info cache
Nov 28 11:07:52 user nova-compute[74994]: DEBUG nova.network.neutron [req-65708818-29fa-4508-8977-0348b94246bc req-4331e767-a150-4112-beb9-d4a00e5eab81 service nova] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:07:52 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Took 0.63 seconds to deallocate network for instance.
Nov 28 11:07:52 user nova-compute[74994]: DEBUG nova.compute.manager [req-65708818-29fa-4508-8977-0348b94246bc req-4331e767-a150-4112-beb9-d4a00e5eab81 service nova] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Detach interface failed, port_id=7d4a82ba-d222-44bb-baac-6642f24b9528, reason: Instance 759fbcfd-ab13-438f-b860-6393a97d1205 could not be found. {{(pid=74994) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 11:07:53 user nova-compute[74994]: DEBUG nova.compute.manager [req-aa067aad-9355-4c0a-91a6-e290e221c78a req-4e056830-00d8-49ec-a64b-da02560c2c56 service nova] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Received event network-vif-plugged-7d4a82ba-d222-44bb-baac-6642f24b9528 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:07:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-aa067aad-9355-4c0a-91a6-e290e221c78a req-4e056830-00d8-49ec-a64b-da02560c2c56 service nova] Acquiring lock "759fbcfd-ab13-438f-b860-6393a97d1205-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:07:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-aa067aad-9355-4c0a-91a6-e290e221c78a req-4e056830-00d8-49ec-a64b-da02560c2c56 service nova] Lock "759fbcfd-ab13-438f-b860-6393a97d1205-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:07:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-aa067aad-9355-4c0a-91a6-e290e221c78a req-4e056830-00d8-49ec-a64b-da02560c2c56 service nova] Lock "759fbcfd-ab13-438f-b860-6393a97d1205-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:07:53 user nova-compute[74994]: DEBUG nova.compute.manager [req-aa067aad-9355-4c0a-91a6-e290e221c78a req-4e056830-00d8-49ec-a64b-da02560c2c56 service nova] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] No waiting events found dispatching network-vif-plugged-7d4a82ba-d222-44bb-baac-6642f24b9528 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:07:53 user nova-compute[74994]: WARNING nova.compute.manager [req-aa067aad-9355-4c0a-91a6-e290e221c78a req-4e056830-00d8-49ec-a64b-da02560c2c56 service nova] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Received unexpected event network-vif-plugged-7d4a82ba-d222-44bb-baac-6642f24b9528 for instance with vm_state active and task_state deleting.
Nov 28 11:07:53 user nova-compute[74994]: INFO nova.compute.manager [None req-d2279c16-92af-4353-9b63-a4044b738794 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 759fbcfd-ab13-438f-b860-6393a97d1205] Took 0.97 seconds to detach 1 volumes for instance.
Nov 28 11:07:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d2279c16-92af-4353-9b63-a4044b738794 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:07:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d2279c16-92af-4353-9b63-a4044b738794 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:07:54 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-d2279c16-92af-4353-9b63-a4044b738794 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:07:54 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-d2279c16-92af-4353-9b63-a4044b738794 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:07:54 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d2279c16-92af-4353-9b63-a4044b738794 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.296s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:07:54 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-d2279c16-92af-4353-9b63-a4044b738794 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Deleted allocations for instance 759fbcfd-ab13-438f-b860-6393a97d1205
Nov 28 11:07:54 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d2279c16-92af-4353-9b63-a4044b738794 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "759fbcfd-ab13-438f-b860-6393a97d1205" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.109s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:07:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:56 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:07:59 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:00 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-3cba6d3c-dcb5-4358-aea9-3d54bf50de08 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0f267741-9611-4812-9afa-32717d16abc5 is timed out.
Nov 28 11:08:00 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-3cba6d3c-dcb5-4358-aea9-3d54bf50de08 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Successfully detached device vdb from instance 0f267741-9611-4812-9afa-32717d16abc5 from the live domain config.
Nov 28 11:08:00 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cba6d3c-dcb5-4358-aea9-3d54bf50de08 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cba6d3c-dcb5-4358-aea9-3d54bf50de08 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PCvwAopY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:08:00 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-3cba6d3c-dcb5-4358-aea9-3d54bf50de08 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:08:00 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-3cba6d3c-dcb5-4358-aea9-3d54bf50de08 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-3cba6d3c-dcb5-4358-aea9-3d54bf50de08 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[920d34f1-91ed-4261-a2b4-4125fce15a62]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cba6d3c-dcb5-4358-aea9-3d54bf50de08 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 11:08:00 user nova-compute[74994]: No targets found.
Nov 28 11:08:00 user nova-compute[74994]: iSNS:
Nov 28 11:08:00 user nova-compute[74994]: No targets found.
Nov 28 11:08:00 user nova-compute[74994]: STATIC:
Nov 28 11:08:00 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a
Nov 28 11:08:00 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:08:00 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:08:00 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092
Nov 28 11:08:00 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:08:00 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:08:00 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd
Nov 28 11:08:00 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:08:00 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:08:00 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d
Nov 28 11:08:00 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:08:00 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:08:00 user nova-compute[74994]: FIRMWARE:
Nov 28 11:08:00 user nova-compute[74994]: No targets found.
Nov 28 11:08:00 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cba6d3c-dcb5-4358-aea9-3d54bf50de08 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 11:08:00 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 11:08:00 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cba6d3c-dcb5-4358-aea9-3d54bf50de08 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9384df-99eb-47fd-bc43-063be7858381]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f9e374-61b3-4058-ba7c-03ab88642371]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cba6d3c-dcb5-4358-aea9-3d54bf50de08 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a (non-flash)
Nov 28 11:08:00 user nova-compute[74994]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)
Nov 28 11:08:00 user nova-compute[74994]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092 (non-flash)
Nov 28 11:08:00 user nova-compute[74994]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d (non-flash)
Nov 28 11:08:00 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cba6d3c-dcb5-4358-aea9-3d54bf50de08 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a (non-flash)
Nov 28 11:08:00 user nova-compute[74994]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)
Nov 28 11:08:00 user nova-compute[74994]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092 (non-flash)
Nov 28 11:08:00 user nova-compute[74994]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d (non-flash)
Nov 28 11:08:00 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cba6d3c-dcb5-4358-aea9-3d54bf50de08 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb920513370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a'): ({'sdc'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-3cba6d3c-dcb5-4358-aea9-3d54bf50de08 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Removing single pathed devices sdc {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[40463e17-a7b3-4e0c-90be-f5f615f0c07f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c349ba5-07bd-4900-a59f-06afe33f547e]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-3cba6d3c-dcb5-4358-aea9-3d54bf50de08 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Flushing IO for device /dev/sdc {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67eafda-9748-4d21-b79b-0944d30a5d98]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-3cba6d3c-dcb5-4358-aea9-3d54bf50de08 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc416525-944c-40bc-85ff-d501bd09b89e]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-3cba6d3c-dcb5-4358-aea9-3d54bf50de08 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-3cba6d3c-dcb5-4358-aea9-3d54bf50de08 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] SCSI volumes sdc have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cba6d3c-dcb5-4358-aea9-3d54bf50de08 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcab78b1-ef6a-4f53-b741-ac72614a706e]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cba6d3c-dcb5-4358-aea9-3d54bf50de08 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d351f0e-ecdc-47fb-a70b-13952a84c347]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cba6d3c-dcb5-4358-aea9-3d54bf50de08 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a, portal: 172.16.0.220,3260]
Nov 28 11:08:00 user nova-compute[74994]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a, portal: 172.16.0.220,3260] successful.
Nov 28 11:08:00 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07e1aa43-1637-45ed-ad63-5f5ff971569a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[13361680-4bac-46e6-9f28-739308f5b3df]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cba6d3c-dcb5-4358-aea9-3d54bf50de08 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-3cba6d3c-dcb5-4358-aea9-3d54bf50de08 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cba6d3c-dcb5-4358-aea9-3d54bf50de08 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] <== disconnect_volume: return (319ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:08:00 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cba6d3c-dcb5-4358-aea9-3d54bf50de08 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 11:08:01 user nova-compute[74994]: DEBUG nova.objects.instance [None req-3cba6d3c-dcb5-4358-aea9-3d54bf50de08 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lazy-loading 'flavor' on Instance uuid 0f267741-9611-4812-9afa-32717d16abc5 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:08:01 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3cba6d3c-dcb5-4358-aea9-3d54bf50de08 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "0f267741-9611-4812-9afa-32717d16abc5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.871s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:08:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9052a8cf-0e5c-4e24-91b7-84e1120dcce2 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Acquiring lock "0f267741-9611-4812-9afa-32717d16abc5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:08:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9052a8cf-0e5c-4e24-91b7-84e1120dcce2 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "0f267741-9611-4812-9afa-32717d16abc5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:08:02 user nova-compute[74994]: INFO nova.compute.manager [None req-9052a8cf-0e5c-4e24-91b7-84e1120dcce2 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Detaching volume 807a7039-4bee-445b-a2b5-02d10f63f092
Nov 28 11:08:02 user nova-compute[74994]: INFO nova.virt.block_device [None req-9052a8cf-0e5c-4e24-91b7-84e1120dcce2 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Attempting to driver detach volume 807a7039-4bee-445b-a2b5-02d10f63f092 from mountpoint /dev/vdc
Nov 28 11:08:02 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-9052a8cf-0e5c-4e24-91b7-84e1120dcce2 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Attempting to detach device vdc from instance 0f267741-9611-4812-9afa-32717d16abc5 from the persistent domain config. {{(pid=74994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 11:08:02 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-9052a8cf-0e5c-4e24-91b7-84e1120dcce2 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 11:08:02 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:08:02 user nova-compute[74994]:   <source dev="/dev/sde"/>
Nov 28 11:08:02 user nova-compute[74994]:   <target dev="vdc" bus="virtio"/>
Nov 28 11:08:02 user nova-compute[74994]:   <serial>807a7039-4bee-445b-a2b5-02d10f63f092</serial>
Nov 28 11:08:02 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 28 11:08:02 user nova-compute[74994]: </disk>
Nov 28 11:08:02 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 11:08:02 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-9052a8cf-0e5c-4e24-91b7-84e1120dcce2 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Successfully detached device vdc from instance 0f267741-9611-4812-9afa-32717d16abc5 from the persistent domain config.
Nov 28 11:08:02 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-9052a8cf-0e5c-4e24-91b7-84e1120dcce2 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 0f267741-9611-4812-9afa-32717d16abc5 from the live domain config. {{(pid=74994) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 11:08:02 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-9052a8cf-0e5c-4e24-91b7-84e1120dcce2 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 11:08:02 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:08:02 user nova-compute[74994]:   <source dev="/dev/sde"/>
Nov 28 11:08:02 user nova-compute[74994]:   <target dev="vdc" bus="virtio"/>
Nov 28 11:08:02 user nova-compute[74994]:   <serial>807a7039-4bee-445b-a2b5-02d10f63f092</serial>
Nov 28 11:08:02 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 28 11:08:02 user nova-compute[74994]: </disk>
Nov 28 11:08:02 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 11:08:03 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-9052a8cf-0e5c-4e24-91b7-84e1120dcce2 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 0f267741-9611-4812-9afa-32717d16abc5 {{(pid=74994) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 11:08:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:04 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-abe7ffe5-b39d-4586-b521-243954b47313 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7295ae8a-462e-4b75-af40-35aac439dad0 is timed out.
Nov 28 11:08:04 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-abe7ffe5-b39d-4586-b521-243954b47313 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Successfully detached device vdb from instance 7295ae8a-462e-4b75-af40-35aac439dad0 from the live domain config.
Nov 28 11:08:05 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abe7ffe5-b39d-4586-b521-243954b47313 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe7ffe5-b39d-4586-b521-243954b47313 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qWerFOfm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:08:05 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-abe7ffe5-b39d-4586-b521-243954b47313 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:08:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-abe7ffe5-b39d-4586-b521-243954b47313 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-abe7ffe5-b39d-4586-b521-243954b47313 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e41917-e7a8-4abb-b260-3da85e9f5e1b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe7ffe5-b39d-4586-b521-243954b47313 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 11:08:05 user nova-compute[74994]: No targets found.
Nov 28 11:08:05 user nova-compute[74994]: iSNS:
Nov 28 11:08:05 user nova-compute[74994]: No targets found.
Nov 28 11:08:05 user nova-compute[74994]: STATIC:
Nov 28 11:08:05 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092
Nov 28 11:08:05 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:08:05 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:08:05 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd
Nov 28 11:08:05 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:08:05 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:08:05 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d
Nov 28 11:08:05 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:08:05 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:08:05 user nova-compute[74994]: FIRMWARE:
Nov 28 11:08:05 user nova-compute[74994]: No targets found.
Nov 28 11:08:05 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe7ffe5-b39d-4586-b521-243954b47313 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 11:08:05 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 11:08:05 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe7ffe5-b39d-4586-b521-243954b47313 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee06a6d-1863-4569-9c4a-118954bb5b2e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcbfce0-719a-4036-8455-268f7c4e7028]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe7ffe5-b39d-4586-b521-243954b47313 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)
Nov 28 11:08:05 user nova-compute[74994]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092 (non-flash)
Nov 28 11:08:05 user nova-compute[74994]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d (non-flash)
Nov 28 11:08:05 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe7ffe5-b39d-4586-b521-243954b47313 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)
Nov 28 11:08:05 user nova-compute[74994]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092 (non-flash)
Nov 28 11:08:05 user nova-compute[74994]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d (non-flash)
Nov 28 11:08:05 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe7ffe5-b39d-4586-b521-243954b47313 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb920746e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d'): ({'sdf'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-abe7ffe5-b39d-4586-b521-243954b47313 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Removing single pathed devices sdf {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a283719-851d-44fc-9194-22f0af5522e4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[54becb12-b8b8-490d-983a-b39c9a3623db]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-abe7ffe5-b39d-4586-b521-243954b47313 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Flushing IO for device /dev/sdf {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf430ac-60d4-481b-8e15-bc47316fb6e7]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-abe7ffe5-b39d-4586-b521-243954b47313 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f3f22a-681f-4ec8-8bd5-4df14151a00b]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-abe7ffe5-b39d-4586-b521-243954b47313 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-abe7ffe5-b39d-4586-b521-243954b47313 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] SCSI volumes sdf have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe7ffe5-b39d-4586-b521-243954b47313 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14d57e5-829b-46ef-acf6-d62016a82694]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe7ffe5-b39d-4586-b521-243954b47313 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6cb90f6-b3c5-47a9-8361-1187f2532388]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe7ffe5-b39d-4586-b521-243954b47313 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d, portal: 172.16.0.220,3260]
Nov 28 11:08:05 user nova-compute[74994]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d, portal: 172.16.0.220,3260] successful.
Nov 28 11:08:05 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6c2162d-1a69-465c-9bd9-00c684c4ab1d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e5a66c-5186-4819-9b65-f589d2f15785]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe7ffe5-b39d-4586-b521-243954b47313 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-abe7ffe5-b39d-4586-b521-243954b47313 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe7ffe5-b39d-4586-b521-243954b47313 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] <== disconnect_volume: return (310ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:08:05 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abe7ffe5-b39d-4586-b521-243954b47313 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 11:08:06 user nova-compute[74994]: DEBUG nova.objects.instance [None req-abe7ffe5-b39d-4586-b521-243954b47313 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lazy-loading 'flavor' on Instance uuid 7295ae8a-462e-4b75-af40-35aac439dad0 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:08:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-abe7ffe5-b39d-4586-b521-243954b47313 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "7295ae8a-462e-4b75-af40-35aac439dad0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.676s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:08:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Acquiring lock "50ab7d36-2d31-46cd-81ec-96646698a6c3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:08:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Lock "50ab7d36-2d31-46cd-81ec-96646698a6c3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:08:06 user nova-compute[74994]: DEBUG nova.compute.manager [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 11:08:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:08:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:08:06 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 11:08:06 user nova-compute[74994]: INFO nova.compute.claims [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Claim successful on node user
Nov 28 11:08:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:06 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:08:06 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:08:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:08:06 user nova-compute[74994]: DEBUG nova.compute.manager [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 11:08:07 user nova-compute[74994]: DEBUG nova.compute.manager [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 11:08:07 user nova-compute[74994]: DEBUG nova.network.neutron [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 11:08:07 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 11:08:07 user nova-compute[74994]: DEBUG nova.compute.manager [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 11:08:07 user nova-compute[74994]: DEBUG nova.policy [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4516dcba29d34d3cb95936d073c3dff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81266cc350f4f8693946c8db8f28db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 11:08:07 user nova-compute[74994]: DEBUG nova.compute.manager [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 11:08:07 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 11:08:07 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Creating image(s)
Nov 28 11:08:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Acquiring lock "/opt/stack/data/nova/instances/50ab7d36-2d31-46cd-81ec-96646698a6c3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:08:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Lock "/opt/stack/data/nova/instances/50ab7d36-2d31-46cd-81ec-96646698a6c3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:08:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Lock "/opt/stack/data/nova/instances/50ab7d36-2d31-46cd-81ec-96646698a6c3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:08:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.172s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Acquiring lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:08:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:08:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.178s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/50ab7d36-2d31-46cd-81ec-96646698a6c3/disk 1073741824 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:07 user nova-compute[74994]: DEBUG nova.network.neutron [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Successfully created port: 5a0be0be-7a6c-49fe-9065-716d88636671 {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 11:08:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/50ab7d36-2d31-46cd-81ec-96646698a6c3/disk 1073741824" returned: 0 in 0.049s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:08:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.169s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:07 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Checking if we can resize image /opt/stack/data/nova/instances/50ab7d36-2d31-46cd-81ec-96646698a6c3/disk. size=1073741824 {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 11:08:07 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ab7d36-2d31-46cd-81ec-96646698a6c3/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ab7d36-2d31-46cd-81ec-96646698a6c3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Cannot resize image /opt/stack/data/nova/instances/50ab7d36-2d31-46cd-81ec-96646698a6c3/disk to a smaller size. {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Created local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Ensure instance console log exists: /opt/stack/data/nova/instances/50ab7d36-2d31-46cd-81ec-96646698a6c3/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG nova.network.neutron [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Successfully updated port: 5a0be0be-7a6c-49fe-9065-716d88636671 {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Acquiring lock "refresh_cache-50ab7d36-2d31-46cd-81ec-96646698a6c3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Acquired lock "refresh_cache-50ab7d36-2d31-46cd-81ec-96646698a6c3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG nova.network.neutron [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG nova.compute.manager [req-a061a296-85e6-40ad-97f0-6743ee088781 req-d6d7cb36-17e8-4d22-a251-57248cf3f83d service nova] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Received event network-changed-5a0be0be-7a6c-49fe-9065-716d88636671 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG nova.compute.manager [req-a061a296-85e6-40ad-97f0-6743ee088781 req-d6d7cb36-17e8-4d22-a251-57248cf3f83d service nova] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Refreshing instance network info cache due to event network-changed-5a0be0be-7a6c-49fe-9065-716d88636671. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a061a296-85e6-40ad-97f0-6743ee088781 req-d6d7cb36-17e8-4d22-a251-57248cf3f83d service nova] Acquiring lock "refresh_cache-50ab7d36-2d31-46cd-81ec-96646698a6c3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG nova.network.neutron [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG nova.network.neutron [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Updating instance_info_cache with network_info: [{"id": "5a0be0be-7a6c-49fe-9065-716d88636671", "address": "fa:16:3e:02:33:37", "network": {"id": "14e8cac9-dfee-4ffc-a968-8b6c2e93ce38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1067281528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c81266cc350f4f8693946c8db8f28db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a0be0be-7a", "ovs_interfaceid": "5a0be0be-7a6c-49fe-9065-716d88636671", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Releasing lock "refresh_cache-50ab7d36-2d31-46cd-81ec-96646698a6c3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG nova.compute.manager [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Instance network_info: |[{"id": "5a0be0be-7a6c-49fe-9065-716d88636671", "address": "fa:16:3e:02:33:37", "network": {"id": "14e8cac9-dfee-4ffc-a968-8b6c2e93ce38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1067281528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c81266cc350f4f8693946c8db8f28db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a0be0be-7a", "ovs_interfaceid": "5a0be0be-7a6c-49fe-9065-716d88636671", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a061a296-85e6-40ad-97f0-6743ee088781 req-d6d7cb36-17e8-4d22-a251-57248cf3f83d service nova] Acquired lock "refresh_cache-50ab7d36-2d31-46cd-81ec-96646698a6c3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG nova.network.neutron [req-a061a296-85e6-40ad-97f0-6743ee088781 req-d6d7cb36-17e8-4d22-a251-57248cf3f83d service nova] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Refreshing network info cache for port 5a0be0be-7a6c-49fe-9065-716d88636671 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Start _get_guest_xml network_info=[{"id": "5a0be0be-7a6c-49fe-9065-716d88636671", "address": "fa:16:3e:02:33:37", "network": {"id": "14e8cac9-dfee-4ffc-a968-8b6c2e93ce38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1067281528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c81266cc350f4f8693946c8db8f28db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a0be0be-7a", "ovs_interfaceid": "5a0be0be-7a6c-49fe-9065-716d88636671", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'aa939d1b-b8a6-4391-935b-0191bf5ccd0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 11:08:08 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:08:08 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:08:08 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:08:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1579143262',display_name='tempest-VolumesActionsTest-instance-1579143262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1579143262',id=37,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c81266cc350f4f8693946c8db8f28db5',ramdisk_id='',reservation_id='r-r2o1qjq1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1636508076',owner_user_name='tempest-VolumesActionsTest-1636508076-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:08:07Z,user_data=None,user_id='4516dcba29d34d3cb95936d073c3dff1',uuid=50ab7d36-2d31-46cd-81ec-96646698a6c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a0be0be-7a6c-49fe-9065-716d88636671", "address": "fa:16:3e:02:33:37", "network": {"id": "14e8cac9-dfee-4ffc-a968-8b6c2e93ce38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1067281528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c81266cc350f4f8693946c8db8f28db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a0be0be-7a", "ovs_interfaceid": "5a0be0be-7a6c-49fe-9065-716d88636671", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Converting VIF {"id": "5a0be0be-7a6c-49fe-9065-716d88636671", "address": "fa:16:3e:02:33:37", "network": {"id": "14e8cac9-dfee-4ffc-a968-8b6c2e93ce38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1067281528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c81266cc350f4f8693946c8db8f28db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a0be0be-7a", "ovs_interfaceid": "5a0be0be-7a6c-49fe-9065-716d88636671", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:33:37,bridge_name='br-int',has_traffic_filtering=True,id=5a0be0be-7a6c-49fe-9065-716d88636671,network=Network(14e8cac9-dfee-4ffc-a968-8b6c2e93ce38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a0be0be-7a') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG nova.objects.instance [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Lazy-loading 'pci_devices' on Instance uuid 50ab7d36-2d31-46cd-81ec-96646698a6c3 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] End _get_guest_xml xml=<domain type="kvm">
Nov 28 11:08:08 user nova-compute[74994]:   <uuid>50ab7d36-2d31-46cd-81ec-96646698a6c3</uuid>
Nov 28 11:08:08 user nova-compute[74994]:   <name>instance-00000025</name>
Nov 28 11:08:08 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 11:08:08 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 11:08:08 user nova-compute[74994]:   <metadata>
Nov 28 11:08:08 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 11:08:08 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 11:08:08 user nova-compute[74994]:       <nova:name>tempest-VolumesActionsTest-instance-1579143262</nova:name>
Nov 28 11:08:08 user nova-compute[74994]:       <nova:creationTime>2023-11-28 11:08:08</nova:creationTime>
Nov 28 11:08:08 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 11:08:08 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 11:08:08 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 11:08:08 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 11:08:08 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 11:08:08 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 11:08:08 user nova-compute[74994]:       </nova:flavor>
Nov 28 11:08:08 user nova-compute[74994]:       <nova:owner>
Nov 28 11:08:08 user nova-compute[74994]:         <nova:user uuid="4516dcba29d34d3cb95936d073c3dff1">tempest-VolumesActionsTest-1636508076-project-member</nova:user>
Nov 28 11:08:08 user nova-compute[74994]:         <nova:project uuid="c81266cc350f4f8693946c8db8f28db5">tempest-VolumesActionsTest-1636508076</nova:project>
Nov 28 11:08:08 user nova-compute[74994]:       </nova:owner>
Nov 28 11:08:08 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 11:08:08 user nova-compute[74994]:       <nova:ports>
Nov 28 11:08:08 user nova-compute[74994]:         <nova:port uuid="5a0be0be-7a6c-49fe-9065-716d88636671">
Nov 28 11:08:08 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 11:08:08 user nova-compute[74994]:         </nova:port>
Nov 28 11:08:08 user nova-compute[74994]:       </nova:ports>
Nov 28 11:08:08 user nova-compute[74994]:     </nova:instance>
Nov 28 11:08:08 user nova-compute[74994]:   </metadata>
Nov 28 11:08:08 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 11:08:08 user nova-compute[74994]:     <system>
Nov 28 11:08:08 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 11:08:08 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 11:08:08 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 11:08:08 user nova-compute[74994]:       <entry name="serial">50ab7d36-2d31-46cd-81ec-96646698a6c3</entry>
Nov 28 11:08:08 user nova-compute[74994]:       <entry name="uuid">50ab7d36-2d31-46cd-81ec-96646698a6c3</entry>
Nov 28 11:08:08 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 11:08:08 user nova-compute[74994]:     </system>
Nov 28 11:08:08 user nova-compute[74994]:   </sysinfo>
Nov 28 11:08:08 user nova-compute[74994]:   <os>
Nov 28 11:08:08 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 11:08:08 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 11:08:08 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 11:08:08 user nova-compute[74994]:   </os>
Nov 28 11:08:08 user nova-compute[74994]:   <features>
Nov 28 11:08:08 user nova-compute[74994]:     <acpi/>
Nov 28 11:08:08 user nova-compute[74994]:     <apic/>
Nov 28 11:08:08 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 11:08:08 user nova-compute[74994]:   </features>
Nov 28 11:08:08 user nova-compute[74994]:   <clock offset="utc">
Nov 28 11:08:08 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 11:08:08 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 11:08:08 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 11:08:08 user nova-compute[74994]:   </clock>
Nov 28 11:08:08 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 11:08:08 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 11:08:08 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 11:08:08 user nova-compute[74994]:   </cpu>
Nov 28 11:08:08 user nova-compute[74994]:   <devices>
Nov 28 11:08:08 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 11:08:08 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 11:08:08 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/50ab7d36-2d31-46cd-81ec-96646698a6c3/disk"/>
Nov 28 11:08:08 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 11:08:08 user nova-compute[74994]:     </disk>
Nov 28 11:08:08 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 11:08:08 user nova-compute[74994]:       <mac address="fa:16:3e:02:33:37"/>
Nov 28 11:08:08 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:08:08 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 11:08:08 user nova-compute[74994]:       <target dev="tap5a0be0be-7a"/>
Nov 28 11:08:08 user nova-compute[74994]:     </interface>
Nov 28 11:08:08 user nova-compute[74994]:     <serial type="pty">
Nov 28 11:08:08 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/50ab7d36-2d31-46cd-81ec-96646698a6c3/console.log" append="off"/>
Nov 28 11:08:08 user nova-compute[74994]:     </serial>
Nov 28 11:08:08 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 11:08:08 user nova-compute[74994]:     <video>
Nov 28 11:08:08 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:08:08 user nova-compute[74994]:     </video>
Nov 28 11:08:08 user nova-compute[74994]:     <rng model="virtio">
Nov 28 11:08:08 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 11:08:08 user nova-compute[74994]:     </rng>
Nov 28 11:08:08 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 11:08:08 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 11:08:08 user nova-compute[74994]:       <stats period="10"/>
Nov 28 11:08:08 user nova-compute[74994]:     </memballoon>
Nov 28 11:08:08 user nova-compute[74994]:   </devices>
Nov 28 11:08:08 user nova-compute[74994]: </domain>
Nov 28 11:08:08 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:08:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1579143262',display_name='tempest-VolumesActionsTest-instance-1579143262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1579143262',id=37,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c81266cc350f4f8693946c8db8f28db5',ramdisk_id='',reservation_id='r-r2o1qjq1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1636508076',owner_user_name='tempest-VolumesActionsTest-1636508076-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:08:07Z,user_data=None,user_id='4516dcba29d34d3cb95936d073c3dff1',uuid=50ab7d36-2d31-46cd-81ec-96646698a6c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a0be0be-7a6c-49fe-9065-716d88636671", "address": "fa:16:3e:02:33:37", "network": {"id": "14e8cac9-dfee-4ffc-a968-8b6c2e93ce38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1067281528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c81266cc350f4f8693946c8db8f28db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a0be0be-7a", "ovs_interfaceid": "5a0be0be-7a6c-49fe-9065-716d88636671", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Converting VIF {"id": "5a0be0be-7a6c-49fe-9065-716d88636671", "address": "fa:16:3e:02:33:37", "network": {"id": "14e8cac9-dfee-4ffc-a968-8b6c2e93ce38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1067281528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c81266cc350f4f8693946c8db8f28db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a0be0be-7a", "ovs_interfaceid": "5a0be0be-7a6c-49fe-9065-716d88636671", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:33:37,bridge_name='br-int',has_traffic_filtering=True,id=5a0be0be-7a6c-49fe-9065-716d88636671,network=Network(14e8cac9-dfee-4ffc-a968-8b6c2e93ce38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a0be0be-7a') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG os_vif [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:33:37,bridge_name='br-int',has_traffic_filtering=True,id=5a0be0be-7a6c-49fe-9065-716d88636671,network=Network(14e8cac9-dfee-4ffc-a968-8b6c2e93ce38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a0be0be-7a') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '300535df-ed9e-5d2d-b952-a78a08b9c0a7', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a0be0be-7a, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5a0be0be-7a, col_values=(('qos', UUID('24659a42-4649-460a-89ec-ba581b9c0046')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5a0be0be-7a, col_values=(('external_ids', {'iface-id': '5a0be0be-7a6c-49fe-9065-716d88636671', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:33:37', 'vm-uuid': '50ab7d36-2d31-46cd-81ec-96646698a6c3'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:08 user nova-compute[74994]: INFO os_vif [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:33:37,bridge_name='br-int',has_traffic_filtering=True,id=5a0be0be-7a6c-49fe-9065-716d88636671,network=Network(14e8cac9-dfee-4ffc-a968-8b6c2e93ce38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a0be0be-7a')
Nov 28 11:08:08 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:08:08 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] No VIF found with MAC fa:16:3e:02:33:37, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:08:09 user nova-compute[74994]: DEBUG nova.network.neutron [req-a061a296-85e6-40ad-97f0-6743ee088781 req-d6d7cb36-17e8-4d22-a251-57248cf3f83d service nova] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Updated VIF entry in instance network info cache for port 5a0be0be-7a6c-49fe-9065-716d88636671. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:08:09 user nova-compute[74994]: DEBUG nova.network.neutron [req-a061a296-85e6-40ad-97f0-6743ee088781 req-d6d7cb36-17e8-4d22-a251-57248cf3f83d service nova] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Updating instance_info_cache with network_info: [{"id": "5a0be0be-7a6c-49fe-9065-716d88636671", "address": "fa:16:3e:02:33:37", "network": {"id": "14e8cac9-dfee-4ffc-a968-8b6c2e93ce38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1067281528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c81266cc350f4f8693946c8db8f28db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a0be0be-7a", "ovs_interfaceid": "5a0be0be-7a6c-49fe-9065-716d88636671", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:08:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a061a296-85e6-40ad-97f0-6743ee088781 req-d6d7cb36-17e8-4d22-a251-57248cf3f83d service nova] Releasing lock "refresh_cache-50ab7d36-2d31-46cd-81ec-96646698a6c3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:08:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:10 user nova-compute[74994]: DEBUG nova.compute.manager [req-dc69184a-4621-4234-a2d6-9f353ab27db6 req-98ad1e0c-7a0c-4f79-a334-2af788514340 service nova] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Received event network-vif-plugged-5a0be0be-7a6c-49fe-9065-716d88636671 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:08:10 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-dc69184a-4621-4234-a2d6-9f353ab27db6 req-98ad1e0c-7a0c-4f79-a334-2af788514340 service nova] Acquiring lock "50ab7d36-2d31-46cd-81ec-96646698a6c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:08:10 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-dc69184a-4621-4234-a2d6-9f353ab27db6 req-98ad1e0c-7a0c-4f79-a334-2af788514340 service nova] Lock "50ab7d36-2d31-46cd-81ec-96646698a6c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:08:10 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-dc69184a-4621-4234-a2d6-9f353ab27db6 req-98ad1e0c-7a0c-4f79-a334-2af788514340 service nova] Lock "50ab7d36-2d31-46cd-81ec-96646698a6c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:08:10 user nova-compute[74994]: DEBUG nova.compute.manager [req-dc69184a-4621-4234-a2d6-9f353ab27db6 req-98ad1e0c-7a0c-4f79-a334-2af788514340 service nova] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] No waiting events found dispatching network-vif-plugged-5a0be0be-7a6c-49fe-9065-716d88636671 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:08:10 user nova-compute[74994]: WARNING nova.compute.manager [req-dc69184a-4621-4234-a2d6-9f353ab27db6 req-98ad1e0c-7a0c-4f79-a334-2af788514340 service nova] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Received unexpected event network-vif-plugged-5a0be0be-7a6c-49fe-9065-716d88636671 for instance with vm_state building and task_state spawning.
Nov 28 11:08:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:12 user nova-compute[74994]: DEBUG nova.compute.manager [req-c4249e93-eeb3-4acf-a32f-976513f10144 req-103865e4-2bca-4158-95c2-fd721e82879c service nova] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Received event network-vif-plugged-5a0be0be-7a6c-49fe-9065-716d88636671 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:08:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c4249e93-eeb3-4acf-a32f-976513f10144 req-103865e4-2bca-4158-95c2-fd721e82879c service nova] Acquiring lock "50ab7d36-2d31-46cd-81ec-96646698a6c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:08:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c4249e93-eeb3-4acf-a32f-976513f10144 req-103865e4-2bca-4158-95c2-fd721e82879c service nova] Lock "50ab7d36-2d31-46cd-81ec-96646698a6c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:08:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c4249e93-eeb3-4acf-a32f-976513f10144 req-103865e4-2bca-4158-95c2-fd721e82879c service nova] Lock "50ab7d36-2d31-46cd-81ec-96646698a6c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:08:12 user nova-compute[74994]: DEBUG nova.compute.manager [req-c4249e93-eeb3-4acf-a32f-976513f10144 req-103865e4-2bca-4158-95c2-fd721e82879c service nova] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] No waiting events found dispatching network-vif-plugged-5a0be0be-7a6c-49fe-9065-716d88636671 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:08:12 user nova-compute[74994]: WARNING nova.compute.manager [req-c4249e93-eeb3-4acf-a32f-976513f10144 req-103865e4-2bca-4158-95c2-fd721e82879c service nova] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Received unexpected event network-vif-plugged-5a0be0be-7a6c-49fe-9065-716d88636671 for instance with vm_state building and task_state spawning.
Nov 28 11:08:12 user nova-compute[74994]: DEBUG nova.compute.manager [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 11:08:12 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 11:08:12 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Instance spawned successfully.
Nov 28 11:08:12 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 11:08:12 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:08:12 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:08:12 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:08:12 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:08:12 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:08:12 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:08:12 user nova-compute[74994]: INFO nova.compute.manager [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Took 5.20 seconds to spawn the instance on the hypervisor.
Nov 28 11:08:12 user nova-compute[74994]: DEBUG nova.compute.manager [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 11:08:12 user nova-compute[74994]: INFO nova.compute.manager [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Took 6.08 seconds to build instance.
Nov 28 11:08:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bedd86f1-32a2-45ac-969d-f7f4cb3c4ff1 tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Lock "50ab7d36-2d31-46cd-81ec-96646698a6c3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.182s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:08:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:14 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:08:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:16 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:08:16 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 11:08:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Acquiring lock "6f2a2617-b00e-4d38-98a0-cca578b95f0e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:08:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "6f2a2617-b00e-4d38-98a0-cca578b95f0e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:08:16 user nova-compute[74994]: DEBUG nova.objects.instance [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lazy-loading 'flavor' on Instance uuid 6f2a2617-b00e-4d38-98a0-cca578b95f0e {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:08:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "6f2a2617-b00e-4d38-98a0-cca578b95f0e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:08:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Acquiring lock "6f2a2617-b00e-4d38-98a0-cca578b95f0e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:08:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "6f2a2617-b00e-4d38-98a0-cca578b95f0e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:08:17 user nova-compute[74994]: INFO nova.compute.manager [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Attaching volume 6eaefd7d-f42c-48b9-9892-c77e46a0c000 to /dev/vdb
Nov 28 11:08:17 user nova-compute[74994]: DEBUG os_brick.utils [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:08:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:17 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[66acdb17-8420-41d2-b859-0d1efd446066]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:08:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:17 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8aa64bb-47db-4878-b1b1-28bdcd335752]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:08:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:17 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[834f445e-fa8a-4487-b01f-5fac3fcdf11c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:08:17 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df77b80-7e38-4633-8b4b-fabd3bd6d826]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:08:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:08:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 11:08:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:17 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:08:17 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 11:08:17 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[74483f37-1a5a-43bb-a0d4-c115c7e0d29e]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:08:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 11:08:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 11:08:17 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 11:08:17 user nova-compute[74994]: DEBUG os_brick.utils [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:08:17 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Updating existing volume attachment record: 64896386-af96-47b9-a41e-a1b17338903d {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 11:08:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:19 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:08:19 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:08:19 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:08:19 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:08:19 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 11:08:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:19 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ab7d36-2d31-46cd-81ec-96646698a6c3/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ab7d36-2d31-46cd-81ec-96646698a6c3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ab7d36-2d31-46cd-81ec-96646698a6c3/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ab7d36-2d31-46cd-81ec-96646698a6c3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7295ae8a-462e-4b75-af40-35aac439dad0/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7295ae8a-462e-4b75-af40-35aac439dad0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7295ae8a-462e-4b75-af40-35aac439dad0/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7295ae8a-462e-4b75-af40-35aac439dad0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f267741-9611-4812-9afa-32717d16abc5/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f267741-9611-4812-9afa-32717d16abc5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f267741-9611-4812-9afa-32717d16abc5/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f267741-9611-4812-9afa-32717d16abc5/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:21 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:08:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2a2617-b00e-4d38-98a0-cca578b95f0e/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2a2617-b00e-4d38-98a0-cca578b95f0e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2a2617-b00e-4d38-98a0-cca578b95f0e/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2a2617-b00e-4d38-98a0-cca578b95f0e/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:22 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:08:22 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:08:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=8085MB free_disk=25.003711700439453GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 11:08:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:08:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:08:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Applying migration context for instance e3b0b960-3f38-4a6f-9017-209fbc2110c9 as it has an incoming, in-progress migration fb045cf2-9047-4fea-8c89-1cae63b402e1. Migration status is finished {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 28 11:08:22 user nova-compute[74994]: INFO nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Updating resource usage from migration fb045cf2-9047-4fea-8c89-1cae63b402e1
Nov 28 11:08:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:08:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 20716905-c56a-4729-8c5b-9188502dc477 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:08:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 0f267741-9611-4812-9afa-32717d16abc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:08:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 7295ae8a-462e-4b75-af40-35aac439dad0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:08:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 6f2a2617-b00e-4d38-98a0-cca578b95f0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:08:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Migration fb045cf2-9047-4fea-8c89-1cae63b402e1 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 28 11:08:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance e3b0b960-3f38-4a6f-9017-209fbc2110c9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:08:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 50ab7d36-2d31-46cd-81ec-96646698a6c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:08:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 11:08:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 11:08:22 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:08:22 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:08:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 11:08:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.434s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:08:23 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-9052a8cf-0e5c-4e24-91b7-84e1120dcce2 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 0f267741-9611-4812-9afa-32717d16abc5 is timed out.
Nov 28 11:08:23 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-9052a8cf-0e5c-4e24-91b7-84e1120dcce2 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Successfully detached device vdc from instance 0f267741-9611-4812-9afa-32717d16abc5 from the live domain config.
Nov 28 11:08:23 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9052a8cf-0e5c-4e24-91b7-84e1120dcce2 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9052a8cf-0e5c-4e24-91b7-84e1120dcce2 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QSJgctrK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:08:23 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-9052a8cf-0e5c-4e24-91b7-84e1120dcce2 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:08:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-9052a8cf-0e5c-4e24-91b7-84e1120dcce2 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-9052a8cf-0e5c-4e24-91b7-84e1120dcce2 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f1e068-dd4b-4927-b08d-e45deb515b1c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9052a8cf-0e5c-4e24-91b7-84e1120dcce2 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 11:08:23 user nova-compute[74994]: No targets found.
Nov 28 11:08:23 user nova-compute[74994]: iSNS:
Nov 28 11:08:23 user nova-compute[74994]: No targets found.
Nov 28 11:08:23 user nova-compute[74994]: STATIC:
Nov 28 11:08:23 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092
Nov 28 11:08:23 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:08:23 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:08:23 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd
Nov 28 11:08:23 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:08:23 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:08:23 user nova-compute[74994]: FIRMWARE:
Nov 28 11:08:23 user nova-compute[74994]: No targets found.
Nov 28 11:08:23 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9052a8cf-0e5c-4e24-91b7-84e1120dcce2 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 11:08:23 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 11:08:23 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9052a8cf-0e5c-4e24-91b7-84e1120dcce2 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca8d7dd-dac4-4f05-935d-a2468a5f6ad2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[285508d1-0cc7-4a1d-b088-7658055778a7]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9052a8cf-0e5c-4e24-91b7-84e1120dcce2 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)
Nov 28 11:08:23 user nova-compute[74994]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092 (non-flash)
Nov 28 11:08:23 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9052a8cf-0e5c-4e24-91b7-84e1120dcce2 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)
Nov 28 11:08:23 user nova-compute[74994]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092 (non-flash)
Nov 28 11:08:23 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9052a8cf-0e5c-4e24-91b7-84e1120dcce2 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9204ab7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092'): ({'sde'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-9052a8cf-0e5c-4e24-91b7-84e1120dcce2 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Removing single pathed devices sde {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3acba6-82f4-489e-9657-16c72387ce62]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba8b8e1-b522-4d9b-a6c5-072f347323c7]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-9052a8cf-0e5c-4e24-91b7-84e1120dcce2 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Flushing IO for device /dev/sde {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[40bc5eca-c580-4dc3-8f57-fe14cc6824fd]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-9052a8cf-0e5c-4e24-91b7-84e1120dcce2 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb02ff44-792b-41f1-9370-5840caa3eabf]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-9052a8cf-0e5c-4e24-91b7-84e1120dcce2 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-9052a8cf-0e5c-4e24-91b7-84e1120dcce2 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] SCSI volumes sde have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9052a8cf-0e5c-4e24-91b7-84e1120dcce2 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[414bc828-076a-484f-98b2-48b09af7c599]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9052a8cf-0e5c-4e24-91b7-84e1120dcce2 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092 -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a478f171-ad2e-4c8e-8517-73973a100edd]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9052a8cf-0e5c-4e24-91b7-84e1120dcce2 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092, portal: 172.16.0.220,3260]
Nov 28 11:08:23 user nova-compute[74994]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092, portal: 172.16.0.220,3260] successful.
Nov 28 11:08:23 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092 -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:807a7039-4bee-445b-a2b5-02d10f63f092 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1b1474-40c3-4a55-8cc6-8ce4fcd27296]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9052a8cf-0e5c-4e24-91b7-84e1120dcce2 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-9052a8cf-0e5c-4e24-91b7-84e1120dcce2 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9052a8cf-0e5c-4e24-91b7-84e1120dcce2 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] <== disconnect_volume: return (301ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9052a8cf-0e5c-4e24-91b7-84e1120dcce2 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 11:08:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG nova.objects.instance [None req-9052a8cf-0e5c-4e24-91b7-84e1120dcce2 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lazy-loading 'flavor' on Instance uuid 0f267741-9611-4812-9afa-32717d16abc5 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9052a8cf-0e5c-4e24-91b7-84e1120dcce2 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "0f267741-9611-4812-9afa-32717d16abc5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.615s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6eaefd7d-f42c-48b9-9892-c77e46a0c000', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EwxLSrVF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:08:24 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:08:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:08:24 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:08:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6eaefd7d-f42c-48b9-9892-c77e46a0c000" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6eaefd7d-f42c-48b9-9892-c77e46a0c000" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:08:24 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 11:08:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eaefd7d-f42c-48b9-9892-c77e46a0c000 -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eaefd7d-f42c-48b9-9892-c77e46a0c000 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[21aa8c33-14e1-4e39-b992-a927bae8444d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 11:08:24 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eaefd7d-f42c-48b9-9892-c77e46a0c000 -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eaefd7d-f42c-48b9-9892-c77e46a0c000 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[403f1ff7-48bf-47a7-8949-196050764cd6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6eaefd7d-f42c-48b9-9892-c77e46a0c000] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6eaefd7d-f42c-48b9-9892-c77e46a0c000] added
Nov 28 11:08:24 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eaefd7d-f42c-48b9-9892-c77e46a0c000 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eaefd7d-f42c-48b9-9892-c77e46a0c000 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[23eb6de7-e537-4375-9621-5316ad834a65]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eaefd7d-f42c-48b9-9892-c77e46a0c000 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eaefd7d-f42c-48b9-9892-c77e46a0c000 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[36368912-371c-4aab-b0d4-11127df169e0]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eaefd7d-f42c-48b9-9892-c77e46a0c000 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EwxLSrVF {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eaefd7d-f42c-48b9-9892-c77e46a0c000 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EwxLSrVF" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3493eef7-a096-4d54-ad4e-4108be5a87e5]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EwxLSrVF'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eaefd7d-f42c-48b9-9892-c77e46a0c000 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eaefd7d-f42c-48b9-9892-c77e46a0c000 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91d1b86-e5da-48d9-97a3-bac5b3d09f28]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d8395f-b9ac-4687-b805-e6b27bf4705f]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)
Nov 28 11:08:24 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)
Nov 28 11:08:24 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eaefd7d-f42c-48b9-9892-c77e46a0c000 -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eaefd7d-f42c-48b9-9892-c77e46a0c000 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f23de89-dad0-4aaa-844e-e2552c76ce13]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6eaefd7d-f42c-48b9-9892-c77e46a0c000, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6eaefd7d-f42c-48b9-9892-c77e46a0c000, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6eaefd7d-f42c-48b9-9892-c77e46a0c000, portal: 172.16.0.220,3260]
Nov 28 11:08:24 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:6eaefd7d-f42c-48b9-9892-c77e46a0c000, portal: 172.16.0.220,3260] successful.
Nov 28 11:08:24 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eaefd7d-f42c-48b9-9892-c77e46a0c000 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eaefd7d-f42c-48b9-9892-c77e46a0c000 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1346fba-27a8-448a-b7ed-62a62ebed31f]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09cabb6-f67b-490e-947b-f50fc9f3257d]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaefd7d-f42c-48b9-9892-c77e46a0c000 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)
Nov 28 11:08:24 user nova-compute[74994]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaefd7d-f42c-48b9-9892-c77e46a0c000 (non-flash)
Nov 28 11:08:24 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)
Nov 28 11:08:24 user nova-compute[74994]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaefd7d-f42c-48b9-9892-c77e46a0c000 (non-flash)
Nov 28 11:08:24 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6eaefd7d-f42c-48b9-9892-c77e46a0c000" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[172f2f8e-63c8-4e5a-ab4b-714451c56a14]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 11:08:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6eaefd7d-f42c-48b9-9892-c77e46a0c000', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EwxLSrVF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 11:08:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bd66d69e-2ef8-4c2a-9108-9b5cd9a58b75 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Acquiring lock "0f267741-9611-4812-9afa-32717d16abc5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:08:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bd66d69e-2ef8-4c2a-9108-9b5cd9a58b75 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "0f267741-9611-4812-9afa-32717d16abc5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:08:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bd66d69e-2ef8-4c2a-9108-9b5cd9a58b75 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Acquiring lock "0f267741-9611-4812-9afa-32717d16abc5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:08:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bd66d69e-2ef8-4c2a-9108-9b5cd9a58b75 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "0f267741-9611-4812-9afa-32717d16abc5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:08:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bd66d69e-2ef8-4c2a-9108-9b5cd9a58b75 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "0f267741-9611-4812-9afa-32717d16abc5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:08:25 user nova-compute[74994]: INFO nova.compute.manager [None req-bd66d69e-2ef8-4c2a-9108-9b5cd9a58b75 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Terminating instance
Nov 28 11:08:25 user nova-compute[74994]: DEBUG nova.compute.manager [None req-bd66d69e-2ef8-4c2a-9108-9b5cd9a58b75 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 11:08:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:25 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:08:25 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23439323233653233', 'path': '/dev/sdb'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:08:25 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439323233653233', 'path': '/dev/sdb'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 11:08:25 user nova-compute[74994]: DEBUG nova.objects.instance [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lazy-loading 'flavor' on Instance uuid 6f2a2617-b00e-4d38-98a0-cca578b95f0e {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:08:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:25 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 11:08:25 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:08:25 user nova-compute[74994]:   <source dev="/dev/sdb"/>
Nov 28 11:08:25 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:08:25 user nova-compute[74994]:   <serial>6eaefd7d-f42c-48b9-9892-c77e46a0c000</serial>
Nov 28 11:08:25 user nova-compute[74994]: </disk>
Nov 28 11:08:25 user nova-compute[74994]:  {{(pid=74994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 11:08:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:25 user nova-compute[74994]: DEBUG nova.compute.manager [req-86135176-b142-4050-b72e-b1218054ee9e req-c0bc1e67-8b16-4b7c-9cc7-a9d4bc131ceb service nova] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Received event network-vif-unplugged-73050cb9-2ff8-45ec-b6fa-d54d5c717f25 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:08:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-86135176-b142-4050-b72e-b1218054ee9e req-c0bc1e67-8b16-4b7c-9cc7-a9d4bc131ceb service nova] Acquiring lock "0f267741-9611-4812-9afa-32717d16abc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:08:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-86135176-b142-4050-b72e-b1218054ee9e req-c0bc1e67-8b16-4b7c-9cc7-a9d4bc131ceb service nova] Lock "0f267741-9611-4812-9afa-32717d16abc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:08:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-86135176-b142-4050-b72e-b1218054ee9e req-c0bc1e67-8b16-4b7c-9cc7-a9d4bc131ceb service nova] Lock "0f267741-9611-4812-9afa-32717d16abc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:08:25 user nova-compute[74994]: DEBUG nova.compute.manager [req-86135176-b142-4050-b72e-b1218054ee9e req-c0bc1e67-8b16-4b7c-9cc7-a9d4bc131ceb service nova] [instance: 0f267741-9611-4812-9afa-32717d16abc5] No waiting events found dispatching network-vif-unplugged-73050cb9-2ff8-45ec-b6fa-d54d5c717f25 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:08:25 user nova-compute[74994]: DEBUG nova.compute.manager [req-86135176-b142-4050-b72e-b1218054ee9e req-c0bc1e67-8b16-4b7c-9cc7-a9d4bc131ceb service nova] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Received event network-vif-unplugged-73050cb9-2ff8-45ec-b6fa-d54d5c717f25 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 11:08:26 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:08:26 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:08:26 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] No VIF found with MAC fa:16:3e:83:bf:50, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:08:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-aa306912-2a9c-4246-8903-eba6476dc7cd tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "6f2a2617-b00e-4d38-98a0-cca578b95f0e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.254s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:08:26 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Instance destroyed successfully.
Nov 28 11:08:26 user nova-compute[74994]: DEBUG nova.objects.instance [None req-bd66d69e-2ef8-4c2a-9108-9b5cd9a58b75 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lazy-loading 'resources' on Instance uuid 0f267741-9611-4812-9afa-32717d16abc5 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:08:26 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-bd66d69e-2ef8-4c2a-9108-9b5cd9a58b75 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:05:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-498247600',display_name='tempest-AttachVolumeTestJSON-server-498247600',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-498247600',id=33,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNcJFEAOnLoxAQK60vamRRARSnn9pzkJXq9rscMo3ZslJV+BiDLuyJJRW0nuaTt7xnbmgx/Fr/ZHLfUE7tXSslC4/fFM94FFhf9D5agOJkE7MFGOU2scFaJkiVRiTjrhSA==',key_name='tempest-keypair-556467887',keypairs=<?>,launch_index=0,launched_at=2023-11-28T11:05:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='33727b28c7d94b7bbe8987c1301eec04',ramdisk_id='',reservation_id='r-84xy82pz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-565652019',owner_user_name='tempest-AttachVolumeTestJSON-565652019-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T11:05:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44e7cead5a1a4ed09ee100e9b7a4968d',uuid=0f267741-9611-4812-9afa-32717d16abc5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73050cb9-2ff8-45ec-b6fa-d54d5c717f25", "address": "fa:16:3e:10:54:1c", "network": {"id": "844b3eab-57f3-4582-9fcc-04594e44081b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-233988918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33727b28c7d94b7bbe8987c1301eec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73050cb9-2f", "ovs_interfaceid": "73050cb9-2ff8-45ec-b6fa-d54d5c717f25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 11:08:26 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-bd66d69e-2ef8-4c2a-9108-9b5cd9a58b75 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Converting VIF {"id": "73050cb9-2ff8-45ec-b6fa-d54d5c717f25", "address": "fa:16:3e:10:54:1c", "network": {"id": "844b3eab-57f3-4582-9fcc-04594e44081b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-233988918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33727b28c7d94b7bbe8987c1301eec04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73050cb9-2f", "ovs_interfaceid": "73050cb9-2ff8-45ec-b6fa-d54d5c717f25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:08:26 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-bd66d69e-2ef8-4c2a-9108-9b5cd9a58b75 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:54:1c,bridge_name='br-int',has_traffic_filtering=True,id=73050cb9-2ff8-45ec-b6fa-d54d5c717f25,network=Network(844b3eab-57f3-4582-9fcc-04594e44081b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73050cb9-2f') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:08:26 user nova-compute[74994]: DEBUG os_vif [None req-bd66d69e-2ef8-4c2a-9108-9b5cd9a58b75 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:54:1c,bridge_name='br-int',has_traffic_filtering=True,id=73050cb9-2ff8-45ec-b6fa-d54d5c717f25,network=Network(844b3eab-57f3-4582-9fcc-04594e44081b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73050cb9-2f') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 11:08:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap73050cb9-2f, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:08:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=890b086b-39de-4066-878c-2c218f086e4a) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:08:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:08:26 user nova-compute[74994]: INFO os_vif [None req-bd66d69e-2ef8-4c2a-9108-9b5cd9a58b75 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:54:1c,bridge_name='br-int',has_traffic_filtering=True,id=73050cb9-2ff8-45ec-b6fa-d54d5c717f25,network=Network(844b3eab-57f3-4582-9fcc-04594e44081b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73050cb9-2f')
Nov 28 11:08:26 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-bd66d69e-2ef8-4c2a-9108-9b5cd9a58b75 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Deleting instance files /opt/stack/data/nova/instances/0f267741-9611-4812-9afa-32717d16abc5_del
Nov 28 11:08:26 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-bd66d69e-2ef8-4c2a-9108-9b5cd9a58b75 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Deletion of /opt/stack/data/nova/instances/0f267741-9611-4812-9afa-32717d16abc5_del complete
Nov 28 11:08:26 user nova-compute[74994]: INFO nova.compute.manager [None req-bd66d69e-2ef8-4c2a-9108-9b5cd9a58b75 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 28 11:08:26 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-bd66d69e-2ef8-4c2a-9108-9b5cd9a58b75 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 11:08:26 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 11:08:26 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 0f267741-9611-4812-9afa-32717d16abc5] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 11:08:26 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:08:26 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:08:26 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 11:08:26 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Didn't find any instances for network info cache update. {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 11:08:26 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:08:26 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:08:26 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:08:27 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:08:27 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Took 0.69 seconds to deallocate network for instance.
Nov 28 11:08:27 user nova-compute[74994]: DEBUG nova.compute.manager [req-74f034a5-673c-4ed8-808c-de841704e348 req-96101062-3f65-41ee-984e-f824bfb7c203 service nova] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Received event network-vif-deleted-73050cb9-2ff8-45ec-b6fa-d54d5c717f25 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:08:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bd66d69e-2ef8-4c2a-9108-9b5cd9a58b75 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:08:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bd66d69e-2ef8-4c2a-9108-9b5cd9a58b75 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:08:27 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:08:27 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-bd66d69e-2ef8-4c2a-9108-9b5cd9a58b75 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:08:27 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-bd66d69e-2ef8-4c2a-9108-9b5cd9a58b75 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:08:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bd66d69e-2ef8-4c2a-9108-9b5cd9a58b75 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.289s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:08:27 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-bd66d69e-2ef8-4c2a-9108-9b5cd9a58b75 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Deleted allocations for instance 0f267741-9611-4812-9afa-32717d16abc5
Nov 28 11:08:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bd66d69e-2ef8-4c2a-9108-9b5cd9a58b75 tempest-AttachVolumeTestJSON-565652019 tempest-AttachVolumeTestJSON-565652019-project-member] Lock "0f267741-9611-4812-9afa-32717d16abc5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.062s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:08:27 user nova-compute[74994]: DEBUG nova.compute.manager [req-d4733963-9433-4508-9e4b-0de608e10fd7 req-ea9edf14-71e8-4c75-ae5a-06269da96a09 service nova] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Received event network-vif-plugged-73050cb9-2ff8-45ec-b6fa-d54d5c717f25 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:08:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d4733963-9433-4508-9e4b-0de608e10fd7 req-ea9edf14-71e8-4c75-ae5a-06269da96a09 service nova] Acquiring lock "0f267741-9611-4812-9afa-32717d16abc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:08:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d4733963-9433-4508-9e4b-0de608e10fd7 req-ea9edf14-71e8-4c75-ae5a-06269da96a09 service nova] Lock "0f267741-9611-4812-9afa-32717d16abc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:08:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d4733963-9433-4508-9e4b-0de608e10fd7 req-ea9edf14-71e8-4c75-ae5a-06269da96a09 service nova] Lock "0f267741-9611-4812-9afa-32717d16abc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:08:27 user nova-compute[74994]: DEBUG nova.compute.manager [req-d4733963-9433-4508-9e4b-0de608e10fd7 req-ea9edf14-71e8-4c75-ae5a-06269da96a09 service nova] [instance: 0f267741-9611-4812-9afa-32717d16abc5] No waiting events found dispatching network-vif-plugged-73050cb9-2ff8-45ec-b6fa-d54d5c717f25 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:08:27 user nova-compute[74994]: WARNING nova.compute.manager [req-d4733963-9433-4508-9e4b-0de608e10fd7 req-ea9edf14-71e8-4c75-ae5a-06269da96a09 service nova] [instance: 0f267741-9611-4812-9afa-32717d16abc5] Received unexpected event network-vif-plugged-73050cb9-2ff8-45ec-b6fa-d54d5c717f25 for instance with vm_state deleted and task_state None.
Nov 28 11:08:28 user nova-compute[74994]: DEBUG nova.compute.manager [req-572dcf50-6e1a-4207-ac3e-0094c2e960c9 req-e293daa3-40f5-4a68-add5-7f4771c28520 service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Received event network-changed-5e571385-8510-4cdd-ae39-ebd481e04a59 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:08:28 user nova-compute[74994]: DEBUG nova.compute.manager [req-572dcf50-6e1a-4207-ac3e-0094c2e960c9 req-e293daa3-40f5-4a68-add5-7f4771c28520 service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Refreshing instance network info cache due to event network-changed-5e571385-8510-4cdd-ae39-ebd481e04a59. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:08:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-572dcf50-6e1a-4207-ac3e-0094c2e960c9 req-e293daa3-40f5-4a68-add5-7f4771c28520 service nova] Acquiring lock "refresh_cache-6f2a2617-b00e-4d38-98a0-cca578b95f0e" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:08:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-572dcf50-6e1a-4207-ac3e-0094c2e960c9 req-e293daa3-40f5-4a68-add5-7f4771c28520 service nova] Acquired lock "refresh_cache-6f2a2617-b00e-4d38-98a0-cca578b95f0e" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:08:28 user nova-compute[74994]: DEBUG nova.network.neutron [req-572dcf50-6e1a-4207-ac3e-0094c2e960c9 req-e293daa3-40f5-4a68-add5-7f4771c28520 service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Refreshing network info cache for port 5e571385-8510-4cdd-ae39-ebd481e04a59 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:08:29 user nova-compute[74994]: DEBUG nova.network.neutron [req-572dcf50-6e1a-4207-ac3e-0094c2e960c9 req-e293daa3-40f5-4a68-add5-7f4771c28520 service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Updated VIF entry in instance network info cache for port 5e571385-8510-4cdd-ae39-ebd481e04a59. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:08:29 user nova-compute[74994]: DEBUG nova.network.neutron [req-572dcf50-6e1a-4207-ac3e-0094c2e960c9 req-e293daa3-40f5-4a68-add5-7f4771c28520 service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Updating instance_info_cache with network_info: [{"id": "5e571385-8510-4cdd-ae39-ebd481e04a59", "address": "fa:16:3e:83:bf:50", "network": {"id": "89f2b906-9ef3-4e31-87e5-3e0cd23e8695", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2005181920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9670a509ac14f41a9f44d7299fd2f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e571385-85", "ovs_interfaceid": "5e571385-8510-4cdd-ae39-ebd481e04a59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:08:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-572dcf50-6e1a-4207-ac3e-0094c2e960c9 req-e293daa3-40f5-4a68-add5-7f4771c28520 service nova] Releasing lock "refresh_cache-6f2a2617-b00e-4d38-98a0-cca578b95f0e" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:08:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:30 user nova-compute[74994]: DEBUG nova.compute.manager [req-7fc03082-598c-4e0e-addf-5e6325f6c085 req-2669ad46-988c-42b9-b771-d89a3976df94 service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Received event network-changed-5e571385-8510-4cdd-ae39-ebd481e04a59 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:08:30 user nova-compute[74994]: DEBUG nova.compute.manager [req-7fc03082-598c-4e0e-addf-5e6325f6c085 req-2669ad46-988c-42b9-b771-d89a3976df94 service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Refreshing instance network info cache due to event network-changed-5e571385-8510-4cdd-ae39-ebd481e04a59. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:08:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-7fc03082-598c-4e0e-addf-5e6325f6c085 req-2669ad46-988c-42b9-b771-d89a3976df94 service nova] Acquiring lock "refresh_cache-6f2a2617-b00e-4d38-98a0-cca578b95f0e" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:08:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-7fc03082-598c-4e0e-addf-5e6325f6c085 req-2669ad46-988c-42b9-b771-d89a3976df94 service nova] Acquired lock "refresh_cache-6f2a2617-b00e-4d38-98a0-cca578b95f0e" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:08:30 user nova-compute[74994]: DEBUG nova.network.neutron [req-7fc03082-598c-4e0e-addf-5e6325f6c085 req-2669ad46-988c-42b9-b771-d89a3976df94 service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Refreshing network info cache for port 5e571385-8510-4cdd-ae39-ebd481e04a59 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:08:31 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:31 user nova-compute[74994]: DEBUG nova.network.neutron [req-7fc03082-598c-4e0e-addf-5e6325f6c085 req-2669ad46-988c-42b9-b771-d89a3976df94 service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Updated VIF entry in instance network info cache for port 5e571385-8510-4cdd-ae39-ebd481e04a59. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:08:31 user nova-compute[74994]: DEBUG nova.network.neutron [req-7fc03082-598c-4e0e-addf-5e6325f6c085 req-2669ad46-988c-42b9-b771-d89a3976df94 service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Updating instance_info_cache with network_info: [{"id": "5e571385-8510-4cdd-ae39-ebd481e04a59", "address": "fa:16:3e:83:bf:50", "network": {"id": "89f2b906-9ef3-4e31-87e5-3e0cd23e8695", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2005181920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9670a509ac14f41a9f44d7299fd2f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e571385-85", "ovs_interfaceid": "5e571385-8510-4cdd-ae39-ebd481e04a59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:08:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-7fc03082-598c-4e0e-addf-5e6325f6c085 req-2669ad46-988c-42b9-b771-d89a3976df94 service nova] Releasing lock "refresh_cache-6f2a2617-b00e-4d38-98a0-cca578b95f0e" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:08:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c00a3750-19f4-4b40-8ff9-2f1e5c278bcc tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Acquiring lock "6f2a2617-b00e-4d38-98a0-cca578b95f0e" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:08:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c00a3750-19f4-4b40-8ff9-2f1e5c278bcc tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "6f2a2617-b00e-4d38-98a0-cca578b95f0e" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:08:31 user nova-compute[74994]: INFO nova.compute.manager [None req-c00a3750-19f4-4b40-8ff9-2f1e5c278bcc tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Rebooting instance
Nov 28 11:08:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c00a3750-19f4-4b40-8ff9-2f1e5c278bcc tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Acquiring lock "refresh_cache-6f2a2617-b00e-4d38-98a0-cca578b95f0e" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:08:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c00a3750-19f4-4b40-8ff9-2f1e5c278bcc tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Acquired lock "refresh_cache-6f2a2617-b00e-4d38-98a0-cca578b95f0e" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:08:31 user nova-compute[74994]: DEBUG nova.network.neutron [None req-c00a3750-19f4-4b40-8ff9-2f1e5c278bcc tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 11:08:32 user nova-compute[74994]: DEBUG nova.network.neutron [None req-c00a3750-19f4-4b40-8ff9-2f1e5c278bcc tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Updating instance_info_cache with network_info: [{"id": "5e571385-8510-4cdd-ae39-ebd481e04a59", "address": "fa:16:3e:83:bf:50", "network": {"id": "89f2b906-9ef3-4e31-87e5-3e0cd23e8695", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2005181920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9670a509ac14f41a9f44d7299fd2f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e571385-85", "ovs_interfaceid": "5e571385-8510-4cdd-ae39-ebd481e04a59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:08:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c00a3750-19f4-4b40-8ff9-2f1e5c278bcc tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Releasing lock "refresh_cache-6f2a2617-b00e-4d38-98a0-cca578b95f0e" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:08:32 user nova-compute[74994]: DEBUG nova.compute.manager [None req-c00a3750-19f4-4b40-8ff9-2f1e5c278bcc tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 11:08:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:34 user nova-compute[74994]: DEBUG nova.compute.manager [req-d126a5c0-024b-4958-8c5b-4339899bb81c req-61d278ad-04de-45cc-a59b-cebf20ee07f4 service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Received event network-vif-unplugged-5e571385-8510-4cdd-ae39-ebd481e04a59 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:08:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d126a5c0-024b-4958-8c5b-4339899bb81c req-61d278ad-04de-45cc-a59b-cebf20ee07f4 service nova] Acquiring lock "6f2a2617-b00e-4d38-98a0-cca578b95f0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:08:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d126a5c0-024b-4958-8c5b-4339899bb81c req-61d278ad-04de-45cc-a59b-cebf20ee07f4 service nova] Lock "6f2a2617-b00e-4d38-98a0-cca578b95f0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:08:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d126a5c0-024b-4958-8c5b-4339899bb81c req-61d278ad-04de-45cc-a59b-cebf20ee07f4 service nova] Lock "6f2a2617-b00e-4d38-98a0-cca578b95f0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:08:34 user nova-compute[74994]: DEBUG nova.compute.manager [req-d126a5c0-024b-4958-8c5b-4339899bb81c req-61d278ad-04de-45cc-a59b-cebf20ee07f4 service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] No waiting events found dispatching network-vif-unplugged-5e571385-8510-4cdd-ae39-ebd481e04a59 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:08:34 user nova-compute[74994]: WARNING nova.compute.manager [req-d126a5c0-024b-4958-8c5b-4339899bb81c req-61d278ad-04de-45cc-a59b-cebf20ee07f4 service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Received unexpected event network-vif-unplugged-5e571385-8510-4cdd-ae39-ebd481e04a59 for instance with vm_state active and task_state reboot_started.
Nov 28 11:08:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:35 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-c00a3750-19f4-4b40-8ff9-2f1e5c278bcc tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Instance shutdown successfully.
Nov 28 11:08:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:36 user nova-compute[74994]: DEBUG nova.compute.manager [req-9a552bde-c3bf-4b4c-9271-ba4620d175a6 req-06bad305-f072-4180-a688-64a44a88d365 service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Received event network-vif-plugged-5e571385-8510-4cdd-ae39-ebd481e04a59 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:08:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9a552bde-c3bf-4b4c-9271-ba4620d175a6 req-06bad305-f072-4180-a688-64a44a88d365 service nova] Acquiring lock "6f2a2617-b00e-4d38-98a0-cca578b95f0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:08:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9a552bde-c3bf-4b4c-9271-ba4620d175a6 req-06bad305-f072-4180-a688-64a44a88d365 service nova] Lock "6f2a2617-b00e-4d38-98a0-cca578b95f0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:08:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9a552bde-c3bf-4b4c-9271-ba4620d175a6 req-06bad305-f072-4180-a688-64a44a88d365 service nova] Lock "6f2a2617-b00e-4d38-98a0-cca578b95f0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:08:36 user nova-compute[74994]: DEBUG nova.compute.manager [req-9a552bde-c3bf-4b4c-9271-ba4620d175a6 req-06bad305-f072-4180-a688-64a44a88d365 service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] No waiting events found dispatching network-vif-plugged-5e571385-8510-4cdd-ae39-ebd481e04a59 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:08:36 user nova-compute[74994]: WARNING nova.compute.manager [req-9a552bde-c3bf-4b4c-9271-ba4620d175a6 req-06bad305-f072-4180-a688-64a44a88d365 service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Received unexpected event network-vif-plugged-5e571385-8510-4cdd-ae39-ebd481e04a59 for instance with vm_state active and task_state reboot_started.
Nov 28 11:08:37 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:37 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:37 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:37 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:38 user nova-compute[74994]: DEBUG nova.compute.manager [None req-e4e46b47-7914-4919-b6e6-c58bbc92bc37 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 11:08:38 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Instance running successfully.
Nov 28 11:08:38 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-c00a3750-19f4-4b40-8ff9-2f1e5c278bcc tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Instance soft rebooted successfully.
Nov 28 11:08:38 user nova-compute[74994]: DEBUG nova.compute.manager [None req-c00a3750-19f4-4b40-8ff9-2f1e5c278bcc tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 11:08:38 user nova-compute[74994]: INFO nova.compute.manager [None req-e4e46b47-7914-4919-b6e6-c58bbc92bc37 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] instance snapshotting
Nov 28 11:08:38 user nova-compute[74994]: DEBUG nova.compute.manager [req-265abb3a-b247-4745-84f3-53fcad689e74 req-56f7b026-19cc-4209-9c82-662ed9c3596b service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Received event network-vif-plugged-5e571385-8510-4cdd-ae39-ebd481e04a59 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:08:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-265abb3a-b247-4745-84f3-53fcad689e74 req-56f7b026-19cc-4209-9c82-662ed9c3596b service nova] Acquiring lock "6f2a2617-b00e-4d38-98a0-cca578b95f0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:08:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-265abb3a-b247-4745-84f3-53fcad689e74 req-56f7b026-19cc-4209-9c82-662ed9c3596b service nova] Lock "6f2a2617-b00e-4d38-98a0-cca578b95f0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:08:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-265abb3a-b247-4745-84f3-53fcad689e74 req-56f7b026-19cc-4209-9c82-662ed9c3596b service nova] Lock "6f2a2617-b00e-4d38-98a0-cca578b95f0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:08:38 user nova-compute[74994]: DEBUG nova.compute.manager [req-265abb3a-b247-4745-84f3-53fcad689e74 req-56f7b026-19cc-4209-9c82-662ed9c3596b service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] No waiting events found dispatching network-vif-plugged-5e571385-8510-4cdd-ae39-ebd481e04a59 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:08:38 user nova-compute[74994]: WARNING nova.compute.manager [req-265abb3a-b247-4745-84f3-53fcad689e74 req-56f7b026-19cc-4209-9c82-662ed9c3596b service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Received unexpected event network-vif-plugged-5e571385-8510-4cdd-ae39-ebd481e04a59 for instance with vm_state active and task_state reboot_started.
Nov 28 11:08:38 user nova-compute[74994]: DEBUG nova.compute.manager [req-265abb3a-b247-4745-84f3-53fcad689e74 req-56f7b026-19cc-4209-9c82-662ed9c3596b service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Received event network-vif-plugged-5e571385-8510-4cdd-ae39-ebd481e04a59 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:08:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-265abb3a-b247-4745-84f3-53fcad689e74 req-56f7b026-19cc-4209-9c82-662ed9c3596b service nova] Acquiring lock "6f2a2617-b00e-4d38-98a0-cca578b95f0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:08:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-265abb3a-b247-4745-84f3-53fcad689e74 req-56f7b026-19cc-4209-9c82-662ed9c3596b service nova] Lock "6f2a2617-b00e-4d38-98a0-cca578b95f0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:08:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-265abb3a-b247-4745-84f3-53fcad689e74 req-56f7b026-19cc-4209-9c82-662ed9c3596b service nova] Lock "6f2a2617-b00e-4d38-98a0-cca578b95f0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:08:38 user nova-compute[74994]: DEBUG nova.compute.manager [req-265abb3a-b247-4745-84f3-53fcad689e74 req-56f7b026-19cc-4209-9c82-662ed9c3596b service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] No waiting events found dispatching network-vif-plugged-5e571385-8510-4cdd-ae39-ebd481e04a59 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:08:38 user nova-compute[74994]: WARNING nova.compute.manager [req-265abb3a-b247-4745-84f3-53fcad689e74 req-56f7b026-19cc-4209-9c82-662ed9c3596b service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Received unexpected event network-vif-plugged-5e571385-8510-4cdd-ae39-ebd481e04a59 for instance with vm_state active and task_state reboot_started.
Nov 28 11:08:38 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-e4e46b47-7914-4919-b6e6-c58bbc92bc37 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Beginning live snapshot process
Nov 28 11:08:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c00a3750-19f4-4b40-8ff9-2f1e5c278bcc tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "6f2a2617-b00e-4d38-98a0-cca578b95f0e" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.246s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:08:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-e4e46b47-7914-4919-b6e6-c58bbc92bc37 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7295ae8a-462e-4b75-af40-35aac439dad0/disk --force-share --output=json -f qcow2 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-e4e46b47-7914-4919-b6e6-c58bbc92bc37 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7295ae8a-462e-4b75-af40-35aac439dad0/disk --force-share --output=json -f qcow2" returned: 0 in 0.188s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-e4e46b47-7914-4919-b6e6-c58bbc92bc37 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7295ae8a-462e-4b75-af40-35aac439dad0/disk --force-share --output=json -f qcow2 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-e4e46b47-7914-4919-b6e6-c58bbc92bc37 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7295ae8a-462e-4b75-af40-35aac439dad0/disk --force-share --output=json -f qcow2" returned: 0 in 0.180s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-e4e46b47-7914-4919-b6e6-c58bbc92bc37 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-e4e46b47-7914-4919-b6e6-c58bbc92bc37 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.183s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-e4e46b47-7914-4919-b6e6-c58bbc92bc37 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphhag_5sw/7a693f19478a4d659449ab5ca342a553.delta 1073741824 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-e4e46b47-7914-4919-b6e6-c58bbc92bc37 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphhag_5sw/7a693f19478a4d659449ab5ca342a553.delta 1073741824" returned: 0 in 0.068s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:39 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-e4e46b47-7914-4919-b6e6-c58bbc92bc37 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 28 11:08:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-e4e46b47-7914-4919-b6e6-c58bbc92bc37 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 11:08:41 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-e4e46b47-7914-4919-b6e6-c58bbc92bc37 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] COPY block job progress, current cursor: 74973184 final cursor: 75563008 {{(pid=74994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 11:08:41 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:41 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-e4e46b47-7914-4919-b6e6-c58bbc92bc37 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 11:08:41 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-e4e46b47-7914-4919-b6e6-c58bbc92bc37 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 28 11:08:41 user nova-compute[74994]: DEBUG nova.privsep.utils [None req-e4e46b47-7914-4919-b6e6-c58bbc92bc37 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74994) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 11:08:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-e4e46b47-7914-4919-b6e6-c58bbc92bc37 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphhag_5sw/7a693f19478a4d659449ab5ca342a553.delta /opt/stack/data/nova/instances/snapshots/tmphhag_5sw/7a693f19478a4d659449ab5ca342a553 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8894325b-f50f-413f-8e76-8b3acf714471 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:08:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8894325b-f50f-413f-8e76-8b3acf714471 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:08:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8894325b-f50f-413f-8e76-8b3acf714471 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:08:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8894325b-f50f-413f-8e76-8b3acf714471 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:08:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8894325b-f50f-413f-8e76-8b3acf714471 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:08:42 user nova-compute[74994]: INFO nova.compute.manager [None req-8894325b-f50f-413f-8e76-8b3acf714471 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Terminating instance
Nov 28 11:08:42 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8894325b-f50f-413f-8e76-8b3acf714471 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 11:08:42 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-e4e46b47-7914-4919-b6e6-c58bbc92bc37 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphhag_5sw/7a693f19478a4d659449ab5ca342a553.delta /opt/stack/data/nova/instances/snapshots/tmphhag_5sw/7a693f19478a4d659449ab5ca342a553" returned: 0 in 0.670s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:42 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-e4e46b47-7914-4919-b6e6-c58bbc92bc37 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Snapshot extracted, beginning image upload
Nov 28 11:08:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:42 user nova-compute[74994]: DEBUG nova.compute.manager [req-90bc9bbe-cafc-49c9-89f5-dfb59ac40cd5 req-04554e45-df15-4e85-9572-d575372e0ee8 service nova] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Received event network-vif-unplugged-6b1a991d-033b-45ab-839c-7b6b98082667 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:08:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-90bc9bbe-cafc-49c9-89f5-dfb59ac40cd5 req-04554e45-df15-4e85-9572-d575372e0ee8 service nova] Acquiring lock "76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:08:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-90bc9bbe-cafc-49c9-89f5-dfb59ac40cd5 req-04554e45-df15-4e85-9572-d575372e0ee8 service nova] Lock "76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:08:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-90bc9bbe-cafc-49c9-89f5-dfb59ac40cd5 req-04554e45-df15-4e85-9572-d575372e0ee8 service nova] Lock "76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:08:42 user nova-compute[74994]: DEBUG nova.compute.manager [req-90bc9bbe-cafc-49c9-89f5-dfb59ac40cd5 req-04554e45-df15-4e85-9572-d575372e0ee8 service nova] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] No waiting events found dispatching network-vif-unplugged-6b1a991d-033b-45ab-839c-7b6b98082667 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:08:42 user nova-compute[74994]: DEBUG nova.compute.manager [req-90bc9bbe-cafc-49c9-89f5-dfb59ac40cd5 req-04554e45-df15-4e85-9572-d575372e0ee8 service nova] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Received event network-vif-unplugged-6b1a991d-033b-45ab-839c-7b6b98082667 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 11:08:42 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Instance destroyed successfully.
Nov 28 11:08:42 user nova-compute[74994]: DEBUG nova.objects.instance [None req-8894325b-f50f-413f-8e76-8b3acf714471 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lazy-loading 'resources' on Instance uuid 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:08:43 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-8894325b-f50f-413f-8e76-8b3acf714471 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:49:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1762704213',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1762704213',id=1,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:49:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='612ae9ec21ad40a4b68e0926843874ae',ramdisk_id='',reservation_id='r-12dd9pqk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-332508527',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T10:51:01Z,user_data=None,user_id='6c49cba00cff4c4b80080c5f917b4176',uuid=76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b1a991d-033b-45ab-839c-7b6b98082667", "address": "fa:16:3e:3c:9f:61", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b1a991d-03", "ovs_interfaceid": "6b1a991d-033b-45ab-839c-7b6b98082667", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 11:08:43 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-8894325b-f50f-413f-8e76-8b3acf714471 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Converting VIF {"id": "6b1a991d-033b-45ab-839c-7b6b98082667", "address": "fa:16:3e:3c:9f:61", "network": {"id": "a1692a13-d1d7-4df6-bfc0-54f231846889", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1719227991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "612ae9ec21ad40a4b68e0926843874ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b1a991d-03", "ovs_interfaceid": "6b1a991d-033b-45ab-839c-7b6b98082667", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:08:43 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-8894325b-f50f-413f-8e76-8b3acf714471 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:9f:61,bridge_name='br-int',has_traffic_filtering=True,id=6b1a991d-033b-45ab-839c-7b6b98082667,network=Network(a1692a13-d1d7-4df6-bfc0-54f231846889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b1a991d-03') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:08:43 user nova-compute[74994]: DEBUG os_vif [None req-8894325b-f50f-413f-8e76-8b3acf714471 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:9f:61,bridge_name='br-int',has_traffic_filtering=True,id=6b1a991d-033b-45ab-839c-7b6b98082667,network=Network(a1692a13-d1d7-4df6-bfc0-54f231846889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b1a991d-03') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 11:08:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b1a991d-03, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:08:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:08:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ca4fcbd0-fc03-451a-93e6-50e5e106fca2) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:08:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:08:43 user nova-compute[74994]: INFO os_vif [None req-8894325b-f50f-413f-8e76-8b3acf714471 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:9f:61,bridge_name='br-int',has_traffic_filtering=True,id=6b1a991d-033b-45ab-839c-7b6b98082667,network=Network(a1692a13-d1d7-4df6-bfc0-54f231846889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b1a991d-03')
Nov 28 11:08:43 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-8894325b-f50f-413f-8e76-8b3acf714471 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Deleting instance files /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c_del
Nov 28 11:08:43 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-8894325b-f50f-413f-8e76-8b3acf714471 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Deletion of /opt/stack/data/nova/instances/76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c_del complete
Nov 28 11:08:43 user nova-compute[74994]: INFO nova.compute.manager [None req-8894325b-f50f-413f-8e76-8b3acf714471 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 28 11:08:43 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-8894325b-f50f-413f-8e76-8b3acf714471 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 11:08:43 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 11:08:43 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 11:08:43 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:08:43 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Took 0.50 seconds to deallocate network for instance.
Nov 28 11:08:43 user nova-compute[74994]: DEBUG nova.compute.manager [req-f207cee2-03bd-4cd0-a7fe-68d34454b306 req-759c9046-321e-4b63-ad63-733b23dedda1 service nova] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Received event network-vif-deleted-6b1a991d-033b-45ab-839c-7b6b98082667 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:08:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8894325b-f50f-413f-8e76-8b3acf714471 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:08:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8894325b-f50f-413f-8e76-8b3acf714471 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:08:43 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8894325b-f50f-413f-8e76-8b3acf714471 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:08:43 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8894325b-f50f-413f-8e76-8b3acf714471 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:08:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8894325b-f50f-413f-8e76-8b3acf714471 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.308s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:08:44 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-8894325b-f50f-413f-8e76-8b3acf714471 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Deleted allocations for instance 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c
Nov 28 11:08:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8894325b-f50f-413f-8e76-8b3acf714471 tempest-ServerBootFromVolumeStableRescueTest-332508527 tempest-ServerBootFromVolumeStableRescueTest-332508527-project-member] Lock "76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.928s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:08:44 user nova-compute[74994]: DEBUG nova.compute.manager [req-31a3bb4b-3cf8-46cc-afce-3219106d09f9 req-81c09eb7-a4c3-4801-976a-686f2b56b794 service nova] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Received event network-vif-plugged-6b1a991d-033b-45ab-839c-7b6b98082667 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:08:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-31a3bb4b-3cf8-46cc-afce-3219106d09f9 req-81c09eb7-a4c3-4801-976a-686f2b56b794 service nova] Acquiring lock "76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:08:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-31a3bb4b-3cf8-46cc-afce-3219106d09f9 req-81c09eb7-a4c3-4801-976a-686f2b56b794 service nova] Lock "76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:08:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-31a3bb4b-3cf8-46cc-afce-3219106d09f9 req-81c09eb7-a4c3-4801-976a-686f2b56b794 service nova] Lock "76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:08:44 user nova-compute[74994]: DEBUG nova.compute.manager [req-31a3bb4b-3cf8-46cc-afce-3219106d09f9 req-81c09eb7-a4c3-4801-976a-686f2b56b794 service nova] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] No waiting events found dispatching network-vif-plugged-6b1a991d-033b-45ab-839c-7b6b98082667 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:08:44 user nova-compute[74994]: WARNING nova.compute.manager [req-31a3bb4b-3cf8-46cc-afce-3219106d09f9 req-81c09eb7-a4c3-4801-976a-686f2b56b794 service nova] [instance: 76ddc1ed-fc7c-481a-8b02-b76f56b2cd5c] Received unexpected event network-vif-plugged-6b1a991d-033b-45ab-839c-7b6b98082667 for instance with vm_state deleted and task_state None.
Nov 28 11:08:44 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:44 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-e4e46b47-7914-4919-b6e6-c58bbc92bc37 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Snapshot image upload complete
Nov 28 11:08:44 user nova-compute[74994]: INFO nova.compute.manager [None req-e4e46b47-7914-4919-b6e6-c58bbc92bc37 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Took 6.09 seconds to snapshot the instance on the hypervisor.
Nov 28 11:08:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Acquiring lock "bea7f301-29d1-454c-856a-71be9b55fed3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:08:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "bea7f301-29d1-454c-856a-71be9b55fed3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:08:46 user nova-compute[74994]: DEBUG nova.compute.manager [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 11:08:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:08:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:08:46 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 11:08:46 user nova-compute[74994]: INFO nova.compute.claims [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Claim successful on node user
Nov 28 11:08:47 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:08:47 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:08:47 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.704s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:08:47 user nova-compute[74994]: DEBUG nova.compute.manager [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 11:08:47 user nova-compute[74994]: DEBUG nova.compute.manager [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 11:08:47 user nova-compute[74994]: DEBUG nova.network.neutron [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 11:08:47 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 11:08:47 user nova-compute[74994]: DEBUG nova.compute.manager [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 11:08:47 user nova-compute[74994]: DEBUG nova.policy [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c362617247be45c390a743c3a80e1f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c30dae8b62e14c50b9646b13af2a4258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 11:08:47 user nova-compute[74994]: DEBUG nova.compute.manager [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 11:08:47 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 11:08:47 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Creating image(s)
Nov 28 11:08:47 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Acquiring lock "/opt/stack/data/nova/instances/bea7f301-29d1-454c-856a-71be9b55fed3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:08:47 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "/opt/stack/data/nova/instances/bea7f301-29d1-454c-856a-71be9b55fed3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:08:47 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "/opt/stack/data/nova/instances/bea7f301-29d1-454c-856a-71be9b55fed3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:08:47 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Acquiring lock "1305c9a31cb42b02e8c3b001610fd7605fbf07b7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:08:47 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "1305c9a31cb42b02e8c3b001610fd7605fbf07b7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:08:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1305c9a31cb42b02e8c3b001610fd7605fbf07b7.part --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:48 user nova-compute[74994]: DEBUG nova.network.neutron [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Successfully created port: d326e9a1-1c44-4c63-9fb0-a22056ee25b5 {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 11:08:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1305c9a31cb42b02e8c3b001610fd7605fbf07b7.part --force-share --output=json" returned: 0 in 0.171s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:48 user nova-compute[74994]: DEBUG nova.virt.images [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] d624da83-945e-4296-a3cf-d729c0170fed was qcow2, converting to raw {{(pid=74994) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 11:08:48 user nova-compute[74994]: DEBUG nova.privsep.utils [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74994) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 11:08:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1305c9a31cb42b02e8c3b001610fd7605fbf07b7.part /opt/stack/data/nova/instances/_base/1305c9a31cb42b02e8c3b001610fd7605fbf07b7.converted {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:49 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1305c9a31cb42b02e8c3b001610fd7605fbf07b7.part /opt/stack/data/nova/instances/_base/1305c9a31cb42b02e8c3b001610fd7605fbf07b7.converted" returned: 0 in 0.547s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:49 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1305c9a31cb42b02e8c3b001610fd7605fbf07b7.converted --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:49 user nova-compute[74994]: DEBUG nova.network.neutron [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Successfully updated port: d326e9a1-1c44-4c63-9fb0-a22056ee25b5 {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 11:08:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Acquiring lock "refresh_cache-bea7f301-29d1-454c-856a-71be9b55fed3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:08:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Acquired lock "refresh_cache-bea7f301-29d1-454c-856a-71be9b55fed3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:08:49 user nova-compute[74994]: DEBUG nova.network.neutron [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 11:08:49 user nova-compute[74994]: DEBUG nova.compute.manager [req-af99f531-6dbb-45b9-ab8c-bbc2384b38ff req-930664b9-53eb-4932-a666-4cfbc17874c7 service nova] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Received event network-changed-d326e9a1-1c44-4c63-9fb0-a22056ee25b5 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:08:49 user nova-compute[74994]: DEBUG nova.compute.manager [req-af99f531-6dbb-45b9-ab8c-bbc2384b38ff req-930664b9-53eb-4932-a666-4cfbc17874c7 service nova] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Refreshing instance network info cache due to event network-changed-d326e9a1-1c44-4c63-9fb0-a22056ee25b5. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:08:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-af99f531-6dbb-45b9-ab8c-bbc2384b38ff req-930664b9-53eb-4932-a666-4cfbc17874c7 service nova] Acquiring lock "refresh_cache-bea7f301-29d1-454c-856a-71be9b55fed3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:08:49 user nova-compute[74994]: DEBUG nova.network.neutron [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 11:08:49 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1305c9a31cb42b02e8c3b001610fd7605fbf07b7.converted --force-share --output=json" returned: 0 in 0.185s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "1305c9a31cb42b02e8c3b001610fd7605fbf07b7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.883s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:08:49 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1305c9a31cb42b02e8c3b001610fd7605fbf07b7 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:49 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1305c9a31cb42b02e8c3b001610fd7605fbf07b7 --force-share --output=json" returned: 0 in 0.172s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Acquiring lock "1305c9a31cb42b02e8c3b001610fd7605fbf07b7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:08:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "1305c9a31cb42b02e8c3b001610fd7605fbf07b7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:08:49 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1305c9a31cb42b02e8c3b001610fd7605fbf07b7 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:49 user nova-compute[74994]: DEBUG nova.network.neutron [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Updating instance_info_cache with network_info: [{"id": "d326e9a1-1c44-4c63-9fb0-a22056ee25b5", "address": "fa:16:3e:d7:87:35", "network": {"id": "962e3ca9-e99b-49cd-bb50-c34d108cdfa7", "bridge": "br-int", "label": "tempest-TestStampPattern-359277306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30dae8b62e14c50b9646b13af2a4258", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd326e9a1-1c", "ovs_interfaceid": "d326e9a1-1c44-4c63-9fb0-a22056ee25b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:08:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Releasing lock "refresh_cache-bea7f301-29d1-454c-856a-71be9b55fed3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:08:49 user nova-compute[74994]: DEBUG nova.compute.manager [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Instance network_info: |[{"id": "d326e9a1-1c44-4c63-9fb0-a22056ee25b5", "address": "fa:16:3e:d7:87:35", "network": {"id": "962e3ca9-e99b-49cd-bb50-c34d108cdfa7", "bridge": "br-int", "label": "tempest-TestStampPattern-359277306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30dae8b62e14c50b9646b13af2a4258", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd326e9a1-1c", "ovs_interfaceid": "d326e9a1-1c44-4c63-9fb0-a22056ee25b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 11:08:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-af99f531-6dbb-45b9-ab8c-bbc2384b38ff req-930664b9-53eb-4932-a666-4cfbc17874c7 service nova] Acquired lock "refresh_cache-bea7f301-29d1-454c-856a-71be9b55fed3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:08:49 user nova-compute[74994]: DEBUG nova.network.neutron [req-af99f531-6dbb-45b9-ab8c-bbc2384b38ff req-930664b9-53eb-4932-a666-4cfbc17874c7 service nova] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Refreshing network info cache for port d326e9a1-1c44-4c63-9fb0-a22056ee25b5 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:08:49 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1305c9a31cb42b02e8c3b001610fd7605fbf07b7 --force-share --output=json" returned: 0 in 0.193s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:49 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1305c9a31cb42b02e8c3b001610fd7605fbf07b7,backing_fmt=raw /opt/stack/data/nova/instances/bea7f301-29d1-454c-856a-71be9b55fed3/disk 1073741824 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:49 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1305c9a31cb42b02e8c3b001610fd7605fbf07b7,backing_fmt=raw /opt/stack/data/nova/instances/bea7f301-29d1-454c-856a-71be9b55fed3/disk 1073741824" returned: 0 in 0.048s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "1305c9a31cb42b02e8c3b001610fd7605fbf07b7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:08:49 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1305c9a31cb42b02e8c3b001610fd7605fbf07b7 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:08:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1305c9a31cb42b02e8c3b001610fd7605fbf07b7 --force-share --output=json" returned: 0 in 0.177s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:08:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Created local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 11:08:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Ensure instance console log exists: /opt/stack/data/nova/instances/bea7f301-29d1-454c-856a-71be9b55fed3/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 11:08:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:08:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:08:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:08:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Start _get_guest_xml network_info=[{"id": "d326e9a1-1c44-4c63-9fb0-a22056ee25b5", "address": "fa:16:3e:d7:87:35", "network": {"id": "962e3ca9-e99b-49cd-bb50-c34d108cdfa7", "bridge": "br-int", "label": "tempest-TestStampPattern-359277306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30dae8b62e14c50b9646b13af2a4258", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd326e9a1-1c", "ovs_interfaceid": "d326e9a1-1c44-4c63-9fb0-a22056ee25b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='aec92e38e4cc690648695c35eb57a3d2',container_format='bare',created_at=2023-11-28T11:08:39Z,direct_url=<?>,disk_format='qcow2',id=d624da83-945e-4296-a3cf-d729c0170fed,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1466043916',owner='c30dae8b62e14c50b9646b13af2a4258',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-28T11:08:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'd624da83-945e-4296-a3cf-d729c0170fed'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 11:08:50 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:08:50 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:08:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 11:08:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 11:08:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 11:08:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 11:08:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 11:08:50 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='aec92e38e4cc690648695c35eb57a3d2',container_format='bare',created_at=2023-11-28T11:08:39Z,direct_url=<?>,disk_format='qcow2',id=d624da83-945e-4296-a3cf-d729c0170fed,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1466043916',owner='c30dae8b62e14c50b9646b13af2a4258',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-28T11:08:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 11:08:50 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 11:08:50 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 11:08:50 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 11:08:50 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 11:08:50 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 11:08:50 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 11:08:50 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 11:08:50 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 11:08:50 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 11:08:50 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 11:08:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:08:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-580116615',display_name='tempest-TestStampPattern-server-580116615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-580116615',id=38,image_ref='d624da83-945e-4296-a3cf-d729c0170fed',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLhnKlLbDzesoIgRgKjSwDSGDLbJAHMlDTp+nQM/ojqr/PUamcvyDrok1u7+9cOZfKML/zTkQ8RQndwU5iipCM38Od6vAR2Ip4VAwZazka1mUHBKbAYcoeh2nwnJCVXag==',key_name='tempest-TestStampPattern-30928350',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c30dae8b62e14c50b9646b13af2a4258',ramdisk_id='',reservation_id='r-dve1xq6y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='7295ae8a-462e-4b75-af40-35aac439dad0',image_min_disk='1',image_min_ram='0',image_owner_id='c30dae8b62e14c50b9646b13af2a4258',image_owner_project_name='tempest-TestStampPattern-848738200',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-848738200-project-member',image_user_id='c362617247be45c390a743c3a80e1f63',network_allocated='True',owner_project_name='tempest-TestStampPattern-848738200',owner_user_name='tempest-TestStampPattern-848738200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:08:48Z,user_data=None,user_id='c362617247be45c390a743c3a80e1f63',uuid=bea7f301-29d1-454c-856a-71be9b55fed3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d326e9a1-1c44-4c63-9fb0-a22056ee25b5", "address": "fa:16:3e:d7:87:35", "network": {"id": "962e3ca9-e99b-49cd-bb50-c34d108cdfa7", "bridge": "br-int", "label": "tempest-TestStampPattern-359277306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30dae8b62e14c50b9646b13af2a4258", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd326e9a1-1c", "ovs_interfaceid": "d326e9a1-1c44-4c63-9fb0-a22056ee25b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 11:08:50 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Converting VIF {"id": "d326e9a1-1c44-4c63-9fb0-a22056ee25b5", "address": "fa:16:3e:d7:87:35", "network": {"id": "962e3ca9-e99b-49cd-bb50-c34d108cdfa7", "bridge": "br-int", "label": "tempest-TestStampPattern-359277306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30dae8b62e14c50b9646b13af2a4258", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd326e9a1-1c", "ovs_interfaceid": "d326e9a1-1c44-4c63-9fb0-a22056ee25b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:08:50 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:87:35,bridge_name='br-int',has_traffic_filtering=True,id=d326e9a1-1c44-4c63-9fb0-a22056ee25b5,network=Network(962e3ca9-e99b-49cd-bb50-c34d108cdfa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd326e9a1-1c') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:08:50 user nova-compute[74994]: DEBUG nova.objects.instance [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lazy-loading 'pci_devices' on Instance uuid bea7f301-29d1-454c-856a-71be9b55fed3 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:08:50 user nova-compute[74994]: DEBUG nova.network.neutron [req-af99f531-6dbb-45b9-ab8c-bbc2384b38ff req-930664b9-53eb-4932-a666-4cfbc17874c7 service nova] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Updated VIF entry in instance network info cache for port d326e9a1-1c44-4c63-9fb0-a22056ee25b5. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:08:50 user nova-compute[74994]: DEBUG nova.network.neutron [req-af99f531-6dbb-45b9-ab8c-bbc2384b38ff req-930664b9-53eb-4932-a666-4cfbc17874c7 service nova] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Updating instance_info_cache with network_info: [{"id": "d326e9a1-1c44-4c63-9fb0-a22056ee25b5", "address": "fa:16:3e:d7:87:35", "network": {"id": "962e3ca9-e99b-49cd-bb50-c34d108cdfa7", "bridge": "br-int", "label": "tempest-TestStampPattern-359277306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30dae8b62e14c50b9646b13af2a4258", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd326e9a1-1c", "ovs_interfaceid": "d326e9a1-1c44-4c63-9fb0-a22056ee25b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:08:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] End _get_guest_xml xml=<domain type="kvm">
Nov 28 11:08:50 user nova-compute[74994]:   <uuid>bea7f301-29d1-454c-856a-71be9b55fed3</uuid>
Nov 28 11:08:50 user nova-compute[74994]:   <name>instance-00000026</name>
Nov 28 11:08:50 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 11:08:50 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 11:08:50 user nova-compute[74994]:   <metadata>
Nov 28 11:08:50 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 11:08:50 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 11:08:50 user nova-compute[74994]:       <nova:name>tempest-TestStampPattern-server-580116615</nova:name>
Nov 28 11:08:50 user nova-compute[74994]:       <nova:creationTime>2023-11-28 11:08:50</nova:creationTime>
Nov 28 11:08:50 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 11:08:50 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 11:08:50 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 11:08:50 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 11:08:50 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 11:08:50 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 11:08:50 user nova-compute[74994]:       </nova:flavor>
Nov 28 11:08:50 user nova-compute[74994]:       <nova:owner>
Nov 28 11:08:50 user nova-compute[74994]:         <nova:user uuid="c362617247be45c390a743c3a80e1f63">tempest-TestStampPattern-848738200-project-member</nova:user>
Nov 28 11:08:50 user nova-compute[74994]:         <nova:project uuid="c30dae8b62e14c50b9646b13af2a4258">tempest-TestStampPattern-848738200</nova:project>
Nov 28 11:08:50 user nova-compute[74994]:       </nova:owner>
Nov 28 11:08:50 user nova-compute[74994]:       <nova:root type="image" uuid="d624da83-945e-4296-a3cf-d729c0170fed"/>
Nov 28 11:08:50 user nova-compute[74994]:       <nova:ports>
Nov 28 11:08:50 user nova-compute[74994]:         <nova:port uuid="d326e9a1-1c44-4c63-9fb0-a22056ee25b5">
Nov 28 11:08:50 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 11:08:50 user nova-compute[74994]:         </nova:port>
Nov 28 11:08:50 user nova-compute[74994]:       </nova:ports>
Nov 28 11:08:50 user nova-compute[74994]:     </nova:instance>
Nov 28 11:08:50 user nova-compute[74994]:   </metadata>
Nov 28 11:08:50 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 11:08:50 user nova-compute[74994]:     <system>
Nov 28 11:08:50 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 11:08:50 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 11:08:50 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 11:08:50 user nova-compute[74994]:       <entry name="serial">bea7f301-29d1-454c-856a-71be9b55fed3</entry>
Nov 28 11:08:50 user nova-compute[74994]:       <entry name="uuid">bea7f301-29d1-454c-856a-71be9b55fed3</entry>
Nov 28 11:08:50 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 11:08:50 user nova-compute[74994]:     </system>
Nov 28 11:08:50 user nova-compute[74994]:   </sysinfo>
Nov 28 11:08:50 user nova-compute[74994]:   <os>
Nov 28 11:08:50 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 11:08:50 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 11:08:50 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 11:08:50 user nova-compute[74994]:   </os>
Nov 28 11:08:50 user nova-compute[74994]:   <features>
Nov 28 11:08:50 user nova-compute[74994]:     <acpi/>
Nov 28 11:08:50 user nova-compute[74994]:     <apic/>
Nov 28 11:08:50 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 11:08:50 user nova-compute[74994]:   </features>
Nov 28 11:08:50 user nova-compute[74994]:   <clock offset="utc">
Nov 28 11:08:50 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 11:08:50 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 11:08:50 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 11:08:50 user nova-compute[74994]:   </clock>
Nov 28 11:08:50 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 11:08:50 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 11:08:50 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 11:08:50 user nova-compute[74994]:   </cpu>
Nov 28 11:08:50 user nova-compute[74994]:   <devices>
Nov 28 11:08:50 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 11:08:50 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 11:08:50 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/bea7f301-29d1-454c-856a-71be9b55fed3/disk"/>
Nov 28 11:08:50 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 11:08:50 user nova-compute[74994]:     </disk>
Nov 28 11:08:50 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 11:08:50 user nova-compute[74994]:       <mac address="fa:16:3e:d7:87:35"/>
Nov 28 11:08:50 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:08:50 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 11:08:50 user nova-compute[74994]:       <target dev="tapd326e9a1-1c"/>
Nov 28 11:08:50 user nova-compute[74994]:     </interface>
Nov 28 11:08:50 user nova-compute[74994]:     <serial type="pty">
Nov 28 11:08:50 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/bea7f301-29d1-454c-856a-71be9b55fed3/console.log" append="off"/>
Nov 28 11:08:50 user nova-compute[74994]:     </serial>
Nov 28 11:08:50 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 11:08:50 user nova-compute[74994]:     <video>
Nov 28 11:08:50 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:08:50 user nova-compute[74994]:     </video>
Nov 28 11:08:50 user nova-compute[74994]:     <rng model="virtio">
Nov 28 11:08:50 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 11:08:50 user nova-compute[74994]:     </rng>
Nov 28 11:08:50 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 11:08:50 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 11:08:50 user nova-compute[74994]:       <stats period="10"/>
Nov 28 11:08:50 user nova-compute[74994]:     </memballoon>
Nov 28 11:08:50 user nova-compute[74994]:   </devices>
Nov 28 11:08:50 user nova-compute[74994]: </domain>
Nov 28 11:08:50 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 11:08:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:08:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-580116615',display_name='tempest-TestStampPattern-server-580116615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-580116615',id=38,image_ref='d624da83-945e-4296-a3cf-d729c0170fed',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLhnKlLbDzesoIgRgKjSwDSGDLbJAHMlDTp+nQM/ojqr/PUamcvyDrok1u7+9cOZfKML/zTkQ8RQndwU5iipCM38Od6vAR2Ip4VAwZazka1mUHBKbAYcoeh2nwnJCVXag==',key_name='tempest-TestStampPattern-30928350',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c30dae8b62e14c50b9646b13af2a4258',ramdisk_id='',reservation_id='r-dve1xq6y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='7295ae8a-462e-4b75-af40-35aac439dad0',image_min_disk='1',image_min_ram='0',image_owner_id='c30dae8b62e14c50b9646b13af2a4258',image_owner_project_name='tempest-TestStampPattern-848738200',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-848738200-project-member',image_user_id='c362617247be45c390a743c3a80e1f63',network_allocated='True',owner_project_name='tempest-TestStampPattern-848738200',owner_user_name='tempest-TestStampPattern-848738200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:08:48Z,user_data=None,user_id='c362617247be45c390a743c3a80e1f63',uuid=bea7f301-29d1-454c-856a-71be9b55fed3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d326e9a1-1c44-4c63-9fb0-a22056ee25b5", "address": "fa:16:3e:d7:87:35", "network": {"id": "962e3ca9-e99b-49cd-bb50-c34d108cdfa7", "bridge": "br-int", "label": "tempest-TestStampPattern-359277306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30dae8b62e14c50b9646b13af2a4258", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd326e9a1-1c", "ovs_interfaceid": "d326e9a1-1c44-4c63-9fb0-a22056ee25b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 11:08:50 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Converting VIF {"id": "d326e9a1-1c44-4c63-9fb0-a22056ee25b5", "address": "fa:16:3e:d7:87:35", "network": {"id": "962e3ca9-e99b-49cd-bb50-c34d108cdfa7", "bridge": "br-int", "label": "tempest-TestStampPattern-359277306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30dae8b62e14c50b9646b13af2a4258", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd326e9a1-1c", "ovs_interfaceid": "d326e9a1-1c44-4c63-9fb0-a22056ee25b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:08:50 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:87:35,bridge_name='br-int',has_traffic_filtering=True,id=d326e9a1-1c44-4c63-9fb0-a22056ee25b5,network=Network(962e3ca9-e99b-49cd-bb50-c34d108cdfa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd326e9a1-1c') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:08:50 user nova-compute[74994]: DEBUG os_vif [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:87:35,bridge_name='br-int',has_traffic_filtering=True,id=d326e9a1-1c44-4c63-9fb0-a22056ee25b5,network=Network(962e3ca9-e99b-49cd-bb50-c34d108cdfa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd326e9a1-1c') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 11:08:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:08:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 11:08:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-af99f531-6dbb-45b9-ab8c-bbc2384b38ff req-930664b9-53eb-4932-a666-4cfbc17874c7 service nova] Releasing lock "refresh_cache-bea7f301-29d1-454c-856a-71be9b55fed3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:08:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '16dd6a29-54d9-5e22-bb64-ff7b899dccce', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:08:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd326e9a1-1c, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:08:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd326e9a1-1c, col_values=(('qos', UUID('c43604b6-d2db-4b3a-970d-24b4d6df8850')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:08:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd326e9a1-1c, col_values=(('external_ids', {'iface-id': 'd326e9a1-1c44-4c63-9fb0-a22056ee25b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:87:35', 'vm-uuid': 'bea7f301-29d1-454c-856a-71be9b55fed3'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:08:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:08:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:50 user nova-compute[74994]: INFO os_vif [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:87:35,bridge_name='br-int',has_traffic_filtering=True,id=d326e9a1-1c44-4c63-9fb0-a22056ee25b5,network=Network(962e3ca9-e99b-49cd-bb50-c34d108cdfa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd326e9a1-1c')
Nov 28 11:08:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:08:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] No VIF found with MAC fa:16:3e:d7:87:35, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:08:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:51 user nova-compute[74994]: DEBUG nova.compute.manager [req-32959093-adae-4e08-a186-8019aa937a60 req-0eed4783-9cd1-425b-b424-d40f2ea60b13 service nova] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Received event network-vif-plugged-d326e9a1-1c44-4c63-9fb0-a22056ee25b5 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:08:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-32959093-adae-4e08-a186-8019aa937a60 req-0eed4783-9cd1-425b-b424-d40f2ea60b13 service nova] Acquiring lock "bea7f301-29d1-454c-856a-71be9b55fed3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:08:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-32959093-adae-4e08-a186-8019aa937a60 req-0eed4783-9cd1-425b-b424-d40f2ea60b13 service nova] Lock "bea7f301-29d1-454c-856a-71be9b55fed3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:08:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-32959093-adae-4e08-a186-8019aa937a60 req-0eed4783-9cd1-425b-b424-d40f2ea60b13 service nova] Lock "bea7f301-29d1-454c-856a-71be9b55fed3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:08:51 user nova-compute[74994]: DEBUG nova.compute.manager [req-32959093-adae-4e08-a186-8019aa937a60 req-0eed4783-9cd1-425b-b424-d40f2ea60b13 service nova] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] No waiting events found dispatching network-vif-plugged-d326e9a1-1c44-4c63-9fb0-a22056ee25b5 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:08:51 user nova-compute[74994]: WARNING nova.compute.manager [req-32959093-adae-4e08-a186-8019aa937a60 req-0eed4783-9cd1-425b-b424-d40f2ea60b13 service nova] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Received unexpected event network-vif-plugged-d326e9a1-1c44-4c63-9fb0-a22056ee25b5 for instance with vm_state building and task_state spawning.
Nov 28 11:08:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:53 user nova-compute[74994]: DEBUG nova.compute.manager [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 11:08:53 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 11:08:53 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Instance spawned successfully.
Nov 28 11:08:53 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 11:08:53 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:08:53 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:08:53 user nova-compute[74994]: INFO nova.compute.manager [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Took 6.15 seconds to spawn the instance on the hypervisor.
Nov 28 11:08:53 user nova-compute[74994]: DEBUG nova.compute.manager [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 11:08:53 user nova-compute[74994]: DEBUG nova.compute.manager [req-4703a1e9-89a0-4ee3-8313-ac30eb0c82e1 req-6ce3dfff-6382-4e36-8b59-1e8d59b73116 service nova] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Received event network-vif-plugged-d326e9a1-1c44-4c63-9fb0-a22056ee25b5 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:08:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4703a1e9-89a0-4ee3-8313-ac30eb0c82e1 req-6ce3dfff-6382-4e36-8b59-1e8d59b73116 service nova] Acquiring lock "bea7f301-29d1-454c-856a-71be9b55fed3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:08:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4703a1e9-89a0-4ee3-8313-ac30eb0c82e1 req-6ce3dfff-6382-4e36-8b59-1e8d59b73116 service nova] Lock "bea7f301-29d1-454c-856a-71be9b55fed3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:08:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4703a1e9-89a0-4ee3-8313-ac30eb0c82e1 req-6ce3dfff-6382-4e36-8b59-1e8d59b73116 service nova] Lock "bea7f301-29d1-454c-856a-71be9b55fed3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:08:53 user nova-compute[74994]: DEBUG nova.compute.manager [req-4703a1e9-89a0-4ee3-8313-ac30eb0c82e1 req-6ce3dfff-6382-4e36-8b59-1e8d59b73116 service nova] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] No waiting events found dispatching network-vif-plugged-d326e9a1-1c44-4c63-9fb0-a22056ee25b5 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:08:53 user nova-compute[74994]: WARNING nova.compute.manager [req-4703a1e9-89a0-4ee3-8313-ac30eb0c82e1 req-6ce3dfff-6382-4e36-8b59-1e8d59b73116 service nova] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Received unexpected event network-vif-plugged-d326e9a1-1c44-4c63-9fb0-a22056ee25b5 for instance with vm_state building and task_state spawning.
Nov 28 11:08:53 user nova-compute[74994]: INFO nova.compute.manager [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Took 7.19 seconds to build instance.
Nov 28 11:08:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e69c9af6-d41f-49f7-a370-0ed8f9418e0a tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "bea7f301-29d1-454c-856a-71be9b55fed3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.287s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:08:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:08:59 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:09:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:09:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-33b22ea2-4b72-4259-a8ce-e3cd4dcb4d5a tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:09:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-33b22ea2-4b72-4259-a8ce-e3cd4dcb4d5a tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:09:02 user nova-compute[74994]: DEBUG nova.compute.manager [None req-33b22ea2-4b72-4259-a8ce-e3cd4dcb4d5a tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Going to confirm migration 2 {{(pid=74994) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 28 11:09:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-33b22ea2-4b72-4259-a8ce-e3cd4dcb4d5a tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "refresh_cache-e3b0b960-3f38-4a6f-9017-209fbc2110c9" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:09:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-33b22ea2-4b72-4259-a8ce-e3cd4dcb4d5a tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquired lock "refresh_cache-e3b0b960-3f38-4a6f-9017-209fbc2110c9" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:09:03 user nova-compute[74994]: DEBUG nova.network.neutron [None req-33b22ea2-4b72-4259-a8ce-e3cd4dcb4d5a tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 11:09:03 user nova-compute[74994]: DEBUG nova.objects.instance [None req-33b22ea2-4b72-4259-a8ce-e3cd4dcb4d5a tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lazy-loading 'info_cache' on Instance uuid e3b0b960-3f38-4a6f-9017-209fbc2110c9 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:09:03 user nova-compute[74994]: DEBUG nova.network.neutron [None req-33b22ea2-4b72-4259-a8ce-e3cd4dcb4d5a tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Updating instance_info_cache with network_info: [{"id": "17fb7783-f3dc-41cf-b838-004f2048fdbc", "address": "fa:16:3e:b7:31:25", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17fb7783-f3", "ovs_interfaceid": "17fb7783-f3dc-41cf-b838-004f2048fdbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:09:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-33b22ea2-4b72-4259-a8ce-e3cd4dcb4d5a tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Releasing lock "refresh_cache-e3b0b960-3f38-4a6f-9017-209fbc2110c9" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:09:03 user nova-compute[74994]: DEBUG nova.objects.instance [None req-33b22ea2-4b72-4259-a8ce-e3cd4dcb4d5a tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lazy-loading 'migration_context' on Instance uuid e3b0b960-3f38-4a6f-9017-209fbc2110c9 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:09:03 user nova-compute[74994]: DEBUG nova.objects.base [None req-33b22ea2-4b72-4259-a8ce-e3cd4dcb4d5a tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Object Instance<e3b0b960-3f38-4a6f-9017-209fbc2110c9> lazy-loaded attributes: info_cache,migration_context {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 11:09:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-33b22ea2-4b72-4259-a8ce-e3cd4dcb4d5a tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:09:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-33b22ea2-4b72-4259-a8ce-e3cd4dcb4d5a tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:09:03 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-33b22ea2-4b72-4259-a8ce-e3cd4dcb4d5a tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:09:03 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-33b22ea2-4b72-4259-a8ce-e3cd4dcb4d5a tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:09:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-33b22ea2-4b72-4259-a8ce-e3cd4dcb4d5a tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.314s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:09:04 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-33b22ea2-4b72-4259-a8ce-e3cd4dcb4d5a tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Deleted allocation for migration fb045cf2-9047-4fea-8c89-1cae63b402e1
Nov 28 11:09:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-33b22ea2-4b72-4259-a8ce-e3cd4dcb4d5a tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.820s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:09:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:09:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:09:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:09:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:09:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:09:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:09:16 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:09:16 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:09:16 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 11:09:19 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Acquiring lock "a2caa913-b0cc-46b7-b90d-fe507bc00b09" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:09:19 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "a2caa913-b0cc-46b7-b90d-fe507bc00b09" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:09:19 user nova-compute[74994]: INFO nova.compute.manager [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Unshelving
Nov 28 11:09:19 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:09:19 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:09:19 user nova-compute[74994]: DEBUG nova.objects.instance [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lazy-loading 'pci_requests' on Instance uuid a2caa913-b0cc-46b7-b90d-fe507bc00b09 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:09:19 user nova-compute[74994]: DEBUG nova.objects.instance [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lazy-loading 'numa_topology' on Instance uuid a2caa913-b0cc-46b7-b90d-fe507bc00b09 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:09:19 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 11:09:19 user nova-compute[74994]: INFO nova.compute.claims [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Claim successful on node user
Nov 28 11:09:19 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:09:19 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:09:20 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:09:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.410s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:09:20 user nova-compute[74994]: INFO nova.network.neutron [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Updating port 69c7a712-9905-4a77-a0ae-cd64dbd347fd with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 28 11:09:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:09:20 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:09:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:09:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:09:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:09:20 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 11:09:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:09:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:09:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:09:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Acquiring lock "refresh_cache-a2caa913-b0cc-46b7-b90d-fe507bc00b09" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:09:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Acquired lock "refresh_cache-a2caa913-b0cc-46b7-b90d-fe507bc00b09" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:09:20 user nova-compute[74994]: DEBUG nova.network.neutron [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 11:09:20 user nova-compute[74994]: DEBUG nova.compute.manager [req-951491e9-21fe-4f57-9fa1-f49407dc77d1 req-aacae3b2-1b90-42f9-a59c-cb3d107e8a10 service nova] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Received event network-changed-69c7a712-9905-4a77-a0ae-cd64dbd347fd {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:09:20 user nova-compute[74994]: DEBUG nova.compute.manager [req-951491e9-21fe-4f57-9fa1-f49407dc77d1 req-aacae3b2-1b90-42f9-a59c-cb3d107e8a10 service nova] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Refreshing instance network info cache due to event network-changed-69c7a712-9905-4a77-a0ae-cd64dbd347fd. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:09:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-951491e9-21fe-4f57-9fa1-f49407dc77d1 req-aacae3b2-1b90-42f9-a59c-cb3d107e8a10 service nova] Acquiring lock "refresh_cache-a2caa913-b0cc-46b7-b90d-fe507bc00b09" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:09:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:09:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ab7d36-2d31-46cd-81ec-96646698a6c3/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:09:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ab7d36-2d31-46cd-81ec-96646698a6c3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:09:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ab7d36-2d31-46cd-81ec-96646698a6c3/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:09:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50ab7d36-2d31-46cd-81ec-96646698a6c3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:09:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7295ae8a-462e-4b75-af40-35aac439dad0/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:09:21 user nova-compute[74994]: DEBUG nova.network.neutron [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Updating instance_info_cache with network_info: [{"id": "69c7a712-9905-4a77-a0ae-cd64dbd347fd", "address": "fa:16:3e:38:2c:b1", "network": {"id": "d46e72ec-d7d5-45f7-951a-b4381f0b472b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-179057367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a4dcdeafd6420d8606b37673e3255f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c7a712-99", "ovs_interfaceid": "69c7a712-9905-4a77-a0ae-cd64dbd347fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:09:21 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Releasing lock "refresh_cache-a2caa913-b0cc-46b7-b90d-fe507bc00b09" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:09:21 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 11:09:21 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Creating image(s)
Nov 28 11:09:21 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Acquiring lock "/opt/stack/data/nova/instances/a2caa913-b0cc-46b7-b90d-fe507bc00b09/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:09:21 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "/opt/stack/data/nova/instances/a2caa913-b0cc-46b7-b90d-fe507bc00b09/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:09:21 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "/opt/stack/data/nova/instances/a2caa913-b0cc-46b7-b90d-fe507bc00b09/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:09:21 user nova-compute[74994]: DEBUG nova.objects.instance [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lazy-loading 'trusted_certs' on Instance uuid a2caa913-b0cc-46b7-b90d-fe507bc00b09 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:09:21 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-951491e9-21fe-4f57-9fa1-f49407dc77d1 req-aacae3b2-1b90-42f9-a59c-cb3d107e8a10 service nova] Acquired lock "refresh_cache-a2caa913-b0cc-46b7-b90d-fe507bc00b09" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:09:21 user nova-compute[74994]: DEBUG nova.network.neutron [req-951491e9-21fe-4f57-9fa1-f49407dc77d1 req-aacae3b2-1b90-42f9-a59c-cb3d107e8a10 service nova] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Refreshing network info cache for port 69c7a712-9905-4a77-a0ae-cd64dbd347fd {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:09:21 user nova-compute[74994]: DEBUG nova.objects.base [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Object Instance<a2caa913-b0cc-46b7-b90d-fe507bc00b09> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 11:09:21 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Acquiring lock "c2724c25d66ad36d084e74acd2605267affa62a9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:09:21 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "c2724c25d66ad36d084e74acd2605267affa62a9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:09:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7295ae8a-462e-4b75-af40-35aac439dad0/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:09:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7295ae8a-462e-4b75-af40-35aac439dad0/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:09:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c2724c25d66ad36d084e74acd2605267affa62a9.part --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:09:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7295ae8a-462e-4b75-af40-35aac439dad0/disk --force-share --output=json" returned: 0 in 1.087s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:09:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bea7f301-29d1-454c-856a-71be9b55fed3/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:09:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c2724c25d66ad36d084e74acd2605267affa62a9.part --force-share --output=json" returned: 0 in 0.173s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:09:22 user nova-compute[74994]: DEBUG nova.virt.images [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] 7b43e346-d7a9-4e73-8ab1-5e265d1c130c was qcow2, converting to raw {{(pid=74994) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 11:09:22 user nova-compute[74994]: DEBUG nova.privsep.utils [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74994) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 11:09:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c2724c25d66ad36d084e74acd2605267affa62a9.part /opt/stack/data/nova/instances/_base/c2724c25d66ad36d084e74acd2605267affa62a9.converted {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:09:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bea7f301-29d1-454c-856a-71be9b55fed3/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:09:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bea7f301-29d1-454c-856a-71be9b55fed3/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:09:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bea7f301-29d1-454c-856a-71be9b55fed3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:09:23 user nova-compute[74994]: DEBUG nova.network.neutron [req-951491e9-21fe-4f57-9fa1-f49407dc77d1 req-aacae3b2-1b90-42f9-a59c-cb3d107e8a10 service nova] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Updated VIF entry in instance network info cache for port 69c7a712-9905-4a77-a0ae-cd64dbd347fd. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:09:23 user nova-compute[74994]: DEBUG nova.network.neutron [req-951491e9-21fe-4f57-9fa1-f49407dc77d1 req-aacae3b2-1b90-42f9-a59c-cb3d107e8a10 service nova] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Updating instance_info_cache with network_info: [{"id": "69c7a712-9905-4a77-a0ae-cd64dbd347fd", "address": "fa:16:3e:38:2c:b1", "network": {"id": "d46e72ec-d7d5-45f7-951a-b4381f0b472b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-179057367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a4dcdeafd6420d8606b37673e3255f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c7a712-99", "ovs_interfaceid": "69c7a712-9905-4a77-a0ae-cd64dbd347fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:09:23 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:09:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-951491e9-21fe-4f57-9fa1-f49407dc77d1 req-aacae3b2-1b90-42f9-a59c-cb3d107e8a10 service nova] Releasing lock "refresh_cache-a2caa913-b0cc-46b7-b90d-fe507bc00b09" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:09:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2a2617-b00e-4d38-98a0-cca578b95f0e/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:09:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2a2617-b00e-4d38-98a0-cca578b95f0e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:09:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2a2617-b00e-4d38-98a0-cca578b95f0e/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:09:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c2724c25d66ad36d084e74acd2605267affa62a9.part /opt/stack/data/nova/instances/_base/c2724c25d66ad36d084e74acd2605267affa62a9.converted" returned: 0 in 0.722s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:09:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c2724c25d66ad36d084e74acd2605267affa62a9.converted --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:09:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2a2617-b00e-4d38-98a0-cca578b95f0e/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:09:23 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:09:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c2724c25d66ad36d084e74acd2605267affa62a9.converted --force-share --output=json" returned: 0 in 0.464s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:09:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "c2724c25d66ad36d084e74acd2605267affa62a9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.520s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:09:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c2724c25d66ad36d084e74acd2605267affa62a9 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:09:24 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:09:24 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:09:24 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=8052MB free_disk=24.97308349609375GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 11:09:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:09:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:09:24 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 20716905-c56a-4729-8c5b-9188502dc477 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:09:24 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 7295ae8a-462e-4b75-af40-35aac439dad0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:09:24 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 6f2a2617-b00e-4d38-98a0-cca578b95f0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:09:24 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance e3b0b960-3f38-4a6f-9017-209fbc2110c9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:09:24 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 50ab7d36-2d31-46cd-81ec-96646698a6c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:09:24 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance bea7f301-29d1-454c-856a-71be9b55fed3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:09:24 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Nov 28 11:09:24 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 11:09:24 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 11:09:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c2724c25d66ad36d084e74acd2605267affa62a9 --force-share --output=json" returned: 0 in 0.177s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:09:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Acquiring lock "c2724c25d66ad36d084e74acd2605267affa62a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:09:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "c2724c25d66ad36d084e74acd2605267affa62a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:09:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c2724c25d66ad36d084e74acd2605267affa62a9 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:09:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c2724c25d66ad36d084e74acd2605267affa62a9 --force-share --output=json" returned: 0 in 0.189s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:09:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c2724c25d66ad36d084e74acd2605267affa62a9,backing_fmt=raw /opt/stack/data/nova/instances/a2caa913-b0cc-46b7-b90d-fe507bc00b09/disk 1073741824 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:09:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c2724c25d66ad36d084e74acd2605267affa62a9,backing_fmt=raw /opt/stack/data/nova/instances/a2caa913-b0cc-46b7-b90d-fe507bc00b09/disk 1073741824" returned: 0 in 0.050s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:09:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "c2724c25d66ad36d084e74acd2605267affa62a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:09:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c2724c25d66ad36d084e74acd2605267affa62a9 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:09:24 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:09:24 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:09:24 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 11:09:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.498s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:09:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c2724c25d66ad36d084e74acd2605267affa62a9 --force-share --output=json" returned: 0 in 0.184s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:09:24 user nova-compute[74994]: DEBUG nova.objects.instance [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lazy-loading 'migration_context' on Instance uuid a2caa913-b0cc-46b7-b90d-fe507bc00b09 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:09:24 user nova-compute[74994]: DEBUG nova.objects.base [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Object Instance<a2caa913-b0cc-46b7-b90d-fe507bc00b09> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 11:09:24 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Rebasing disk image.
Nov 28 11:09:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:09:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.185s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:09:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 -F raw /opt/stack/data/nova/instances/a2caa913-b0cc-46b7-b90d-fe507bc00b09/disk {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:09:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:09:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:09:26 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 -F raw /opt/stack/data/nova/instances/a2caa913-b0cc-46b7-b90d-fe507bc00b09/disk" returned: 0 in 2.017s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:09:26 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Created local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 11:09:26 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Ensure instance console log exists: /opt/stack/data/nova/instances/a2caa913-b0cc-46b7-b90d-fe507bc00b09/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 11:09:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:09:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:09:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:09:26 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Start _get_guest_xml network_info=[{"id": "69c7a712-9905-4a77-a0ae-cd64dbd347fd", "address": "fa:16:3e:38:2c:b1", "network": {"id": "d46e72ec-d7d5-45f7-951a-b4381f0b472b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-179057367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a4dcdeafd6420d8606b37673e3255f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c7a712-99", "ovs_interfaceid": "69c7a712-9905-4a77-a0ae-cd64dbd347fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d21942281897e178cf9c0770589fcc4a',container_format='bare',created_at=2023-11-28T11:07:26Z,direct_url=<?>,disk_format='qcow2',id=7b43e346-d7a9-4e73-8ab1-5e265d1c130c,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1217374859-shelved',owner='d3a4dcdeafd6420d8606b37673e3255f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-28T11:07:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'aa939d1b-b8a6-4391-935b-0191bf5ccd0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 11:09:26 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:09:26 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:09:26 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 11:09:26 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 11:09:26 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 11:09:26 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 11:09:26 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 11:09:26 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d21942281897e178cf9c0770589fcc4a',container_format='bare',created_at=2023-11-28T11:07:26Z,direct_url=<?>,disk_format='qcow2',id=7b43e346-d7a9-4e73-8ab1-5e265d1c130c,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1217374859-shelved',owner='d3a4dcdeafd6420d8606b37673e3255f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-28T11:07:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 11:09:26 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 11:09:26 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 11:09:26 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 11:09:26 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 11:09:26 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 11:09:26 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 11:09:26 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 11:09:26 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 11:09:26 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 11:09:26 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 11:09:26 user nova-compute[74994]: DEBUG nova.objects.instance [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lazy-loading 'vcpu_model' on Instance uuid a2caa913-b0cc-46b7-b90d-fe507bc00b09 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:09:26 user nova-compute[74994]: DEBUG nova.objects.base [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Object Instance<a2caa913-b0cc-46b7-b90d-fe507bc00b09> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 11:09:26 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T11:05:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1217374859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1217374859',id=34,image_ref='7b43e346-d7a9-4e73-8ab1-5e265d1c130c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-328848665',keypairs=<?>,launch_index=0,launched_at=2023-11-28T11:05:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d3a4dcdeafd6420d8606b37673e3255f',ramdisk_id='',reservation_id='r-taf8uoy1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1700061593',owner_user_name='tempest-AttachVolumeShelveTestJSON-1700061593-project-member',shelved_at='2023-11-28T11:07:32.111963',shelved_host='user',shelved_image_id='7b43e346-d7a9-4e73-8ab1-5e265d1c130c'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:09:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4e1257b844940bebdeab3061c3e0ab4',uuid=a2caa913-b0cc-46b7-b90d-fe507bc00b09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "69c7a712-9905-4a77-a0ae-cd64dbd347fd", "address": "fa:16:3e:38:2c:b1", "network": {"id": "d46e72ec-d7d5-45f7-951a-b4381f0b472b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-179057367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a4dcdeafd6420d8606b37673e3255f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c7a712-99", "ovs_interfaceid": "69c7a712-9905-4a77-a0ae-cd64dbd347fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 11:09:26 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Converting VIF {"id": "69c7a712-9905-4a77-a0ae-cd64dbd347fd", "address": "fa:16:3e:38:2c:b1", "network": {"id": "d46e72ec-d7d5-45f7-951a-b4381f0b472b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-179057367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a4dcdeafd6420d8606b37673e3255f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c7a712-99", "ovs_interfaceid": "69c7a712-9905-4a77-a0ae-cd64dbd347fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:09:26 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:2c:b1,bridge_name='br-int',has_traffic_filtering=True,id=69c7a712-9905-4a77-a0ae-cd64dbd347fd,network=Network(d46e72ec-d7d5-45f7-951a-b4381f0b472b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69c7a712-99') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:09:26 user nova-compute[74994]: DEBUG nova.objects.instance [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lazy-loading 'pci_devices' on Instance uuid a2caa913-b0cc-46b7-b90d-fe507bc00b09 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:09:26 user nova-compute[74994]: DEBUG nova.objects.base [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Object Instance<a2caa913-b0cc-46b7-b90d-fe507bc00b09> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 11:09:26 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] End _get_guest_xml xml=<domain type="kvm">
Nov 28 11:09:26 user nova-compute[74994]:   <uuid>a2caa913-b0cc-46b7-b90d-fe507bc00b09</uuid>
Nov 28 11:09:26 user nova-compute[74994]:   <name>instance-00000022</name>
Nov 28 11:09:26 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 11:09:26 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 11:09:26 user nova-compute[74994]:   <metadata>
Nov 28 11:09:26 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 11:09:26 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 11:09:26 user nova-compute[74994]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1217374859</nova:name>
Nov 28 11:09:26 user nova-compute[74994]:       <nova:creationTime>2023-11-28 11:09:26</nova:creationTime>
Nov 28 11:09:26 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 11:09:26 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 11:09:26 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 11:09:26 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 11:09:26 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 11:09:26 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 11:09:26 user nova-compute[74994]:       </nova:flavor>
Nov 28 11:09:26 user nova-compute[74994]:       <nova:owner>
Nov 28 11:09:26 user nova-compute[74994]:         <nova:user uuid="c4e1257b844940bebdeab3061c3e0ab4">tempest-AttachVolumeShelveTestJSON-1700061593-project-member</nova:user>
Nov 28 11:09:26 user nova-compute[74994]:         <nova:project uuid="d3a4dcdeafd6420d8606b37673e3255f">tempest-AttachVolumeShelveTestJSON-1700061593</nova:project>
Nov 28 11:09:26 user nova-compute[74994]:       </nova:owner>
Nov 28 11:09:26 user nova-compute[74994]:       <nova:root type="image" uuid="7b43e346-d7a9-4e73-8ab1-5e265d1c130c"/>
Nov 28 11:09:26 user nova-compute[74994]:       <nova:ports>
Nov 28 11:09:26 user nova-compute[74994]:         <nova:port uuid="69c7a712-9905-4a77-a0ae-cd64dbd347fd">
Nov 28 11:09:26 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 28 11:09:26 user nova-compute[74994]:         </nova:port>
Nov 28 11:09:26 user nova-compute[74994]:       </nova:ports>
Nov 28 11:09:26 user nova-compute[74994]:     </nova:instance>
Nov 28 11:09:26 user nova-compute[74994]:   </metadata>
Nov 28 11:09:26 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 11:09:26 user nova-compute[74994]:     <system>
Nov 28 11:09:26 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 11:09:26 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 11:09:26 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 11:09:26 user nova-compute[74994]:       <entry name="serial">a2caa913-b0cc-46b7-b90d-fe507bc00b09</entry>
Nov 28 11:09:26 user nova-compute[74994]:       <entry name="uuid">a2caa913-b0cc-46b7-b90d-fe507bc00b09</entry>
Nov 28 11:09:26 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 11:09:26 user nova-compute[74994]:     </system>
Nov 28 11:09:26 user nova-compute[74994]:   </sysinfo>
Nov 28 11:09:26 user nova-compute[74994]:   <os>
Nov 28 11:09:26 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 11:09:26 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 11:09:26 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 11:09:26 user nova-compute[74994]:   </os>
Nov 28 11:09:26 user nova-compute[74994]:   <features>
Nov 28 11:09:26 user nova-compute[74994]:     <acpi/>
Nov 28 11:09:26 user nova-compute[74994]:     <apic/>
Nov 28 11:09:26 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 11:09:26 user nova-compute[74994]:   </features>
Nov 28 11:09:26 user nova-compute[74994]:   <clock offset="utc">
Nov 28 11:09:26 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 11:09:26 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 11:09:26 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 11:09:26 user nova-compute[74994]:   </clock>
Nov 28 11:09:26 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 11:09:26 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 11:09:26 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 11:09:26 user nova-compute[74994]:   </cpu>
Nov 28 11:09:26 user nova-compute[74994]:   <devices>
Nov 28 11:09:26 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 11:09:26 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 11:09:26 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/a2caa913-b0cc-46b7-b90d-fe507bc00b09/disk"/>
Nov 28 11:09:26 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 11:09:26 user nova-compute[74994]:     </disk>
Nov 28 11:09:26 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 11:09:26 user nova-compute[74994]:       <mac address="fa:16:3e:38:2c:b1"/>
Nov 28 11:09:26 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:09:26 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 11:09:26 user nova-compute[74994]:       <target dev="tap69c7a712-99"/>
Nov 28 11:09:26 user nova-compute[74994]:     </interface>
Nov 28 11:09:26 user nova-compute[74994]:     <serial type="pty">
Nov 28 11:09:26 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/a2caa913-b0cc-46b7-b90d-fe507bc00b09/console.log" append="off"/>
Nov 28 11:09:26 user nova-compute[74994]:     </serial>
Nov 28 11:09:26 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 11:09:26 user nova-compute[74994]:     <video>
Nov 28 11:09:26 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:09:26 user nova-compute[74994]:     </video>
Nov 28 11:09:26 user nova-compute[74994]:     <rng model="virtio">
Nov 28 11:09:26 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 11:09:26 user nova-compute[74994]:     </rng>
Nov 28 11:09:26 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 11:09:26 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 11:09:26 user nova-compute[74994]:       <stats period="10"/>
Nov 28 11:09:26 user nova-compute[74994]:     </memballoon>
Nov 28 11:09:26 user nova-compute[74994]:   </devices>
Nov 28 11:09:26 user nova-compute[74994]: </domain>
Nov 28 11:09:26 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 11:09:26 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T11:05:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1217374859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1217374859',id=34,image_ref='7b43e346-d7a9-4e73-8ab1-5e265d1c130c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-328848665',keypairs=<?>,launch_index=0,launched_at=2023-11-28T11:05:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d3a4dcdeafd6420d8606b37673e3255f',ramdisk_id='',reservation_id='r-taf8uoy1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1700061593',owner_user_name='tempest-AttachVolumeShelveTestJSON-1700061593-project-member',shelved_at='2023-11-28T11:07:32.111963',shelved_host='user',shelved_image_id='7b43e346-d7a9-4e73-8ab1-5e265d1c130c'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:09:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4e1257b844940bebdeab3061c3e0ab4',uuid=a2caa913-b0cc-46b7-b90d-fe507bc00b09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "69c7a712-9905-4a77-a0ae-cd64dbd347fd", "address": "fa:16:3e:38:2c:b1", "network": {"id": "d46e72ec-d7d5-45f7-951a-b4381f0b472b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-179057367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a4dcdeafd6420d8606b37673e3255f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c7a712-99", "ovs_interfaceid": "69c7a712-9905-4a77-a0ae-cd64dbd347fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 11:09:26 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Converting VIF {"id": "69c7a712-9905-4a77-a0ae-cd64dbd347fd", "address": "fa:16:3e:38:2c:b1", "network": {"id": "d46e72ec-d7d5-45f7-951a-b4381f0b472b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-179057367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a4dcdeafd6420d8606b37673e3255f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c7a712-99", "ovs_interfaceid": "69c7a712-9905-4a77-a0ae-cd64dbd347fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:09:26 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:2c:b1,bridge_name='br-int',has_traffic_filtering=True,id=69c7a712-9905-4a77-a0ae-cd64dbd347fd,network=Network(d46e72ec-d7d5-45f7-951a-b4381f0b472b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69c7a712-99') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:09:26 user nova-compute[74994]: DEBUG os_vif [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:2c:b1,bridge_name='br-int',has_traffic_filtering=True,id=69c7a712-9905-4a77-a0ae-cd64dbd347fd,network=Network(d46e72ec-d7d5-45f7-951a-b4381f0b472b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69c7a712-99') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 11:09:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:09:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:09:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 11:09:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:09:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b3260bd2-1c7f-5252-9f5c-4a185ba9b2f2', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:09:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:09:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:09:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69c7a712-99, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:09:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap69c7a712-99, col_values=(('qos', UUID('a5acbe31-36da-4bd6-9ee1-8619d1319bca')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:09:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap69c7a712-99, col_values=(('external_ids', {'iface-id': '69c7a712-9905-4a77-a0ae-cd64dbd347fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:2c:b1', 'vm-uuid': 'a2caa913-b0cc-46b7-b90d-fe507bc00b09'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:09:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:09:27 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:09:27 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:09:27 user nova-compute[74994]: INFO os_vif [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:2c:b1,bridge_name='br-int',has_traffic_filtering=True,id=69c7a712-9905-4a77-a0ae-cd64dbd347fd,network=Network(d46e72ec-d7d5-45f7-951a-b4381f0b472b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69c7a712-99')
Nov 28 11:09:27 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:09:27 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] No VIF found with MAC fa:16:3e:38:2c:b1, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:09:27 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:09:27 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:09:27 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 11:09:27 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Rebuilding the list of instances to heal {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 11:09:27 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:09:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "refresh_cache-20716905-c56a-4729-8c5b-9188502dc477" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:09:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquired lock "refresh_cache-20716905-c56a-4729-8c5b-9188502dc477" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:09:27 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Forcefully refreshing network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 11:09:27 user nova-compute[74994]: DEBUG nova.objects.instance [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lazy-loading 'info_cache' on Instance uuid 20716905-c56a-4729-8c5b-9188502dc477 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:09:28 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Updating instance_info_cache with network_info: [{"id": "10b84648-2b56-4451-b4f3-3ec4ad7b7771", "address": "fa:16:3e:96:e0:ac", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b84648-2b", "ovs_interfaceid": "10b84648-2b56-4451-b4f3-3ec4ad7b7771", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:09:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Releasing lock "refresh_cache-20716905-c56a-4729-8c5b-9188502dc477" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:09:28 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Updated the network info_cache for instance {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 11:09:28 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:09:28 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:09:28 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:09:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:09:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:09:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:09:28 user nova-compute[74994]: DEBUG nova.compute.manager [req-bcf25aef-2a84-448c-b867-a11c9b4755e7 req-0dddaaa5-7d04-4ec7-aa9b-5f6845df3a1c service nova] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Received event network-vif-plugged-69c7a712-9905-4a77-a0ae-cd64dbd347fd {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:09:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bcf25aef-2a84-448c-b867-a11c9b4755e7 req-0dddaaa5-7d04-4ec7-aa9b-5f6845df3a1c service nova] Acquiring lock "a2caa913-b0cc-46b7-b90d-fe507bc00b09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:09:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bcf25aef-2a84-448c-b867-a11c9b4755e7 req-0dddaaa5-7d04-4ec7-aa9b-5f6845df3a1c service nova] Lock "a2caa913-b0cc-46b7-b90d-fe507bc00b09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:09:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bcf25aef-2a84-448c-b867-a11c9b4755e7 req-0dddaaa5-7d04-4ec7-aa9b-5f6845df3a1c service nova] Lock "a2caa913-b0cc-46b7-b90d-fe507bc00b09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:09:28 user nova-compute[74994]: DEBUG nova.compute.manager [req-bcf25aef-2a84-448c-b867-a11c9b4755e7 req-0dddaaa5-7d04-4ec7-aa9b-5f6845df3a1c service nova] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] No waiting events found dispatching network-vif-plugged-69c7a712-9905-4a77-a0ae-cd64dbd347fd {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:09:28 user nova-compute[74994]: WARNING nova.compute.manager [req-bcf25aef-2a84-448c-b867-a11c9b4755e7 req-0dddaaa5-7d04-4ec7-aa9b-5f6845df3a1c service nova] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Received unexpected event network-vif-plugged-69c7a712-9905-4a77-a0ae-cd64dbd347fd for instance with vm_state shelved_offloaded and task_state spawning.
Nov 28 11:09:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:09:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:09:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:09:29 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:09:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:09:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:09:30 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:09:30 user nova-compute[74994]: DEBUG nova.compute.manager [req-f3ee1acb-fb36-41d6-b523-4e3c1e58cb70 req-a90d6f0c-1643-4ee3-94af-fcefc245a37e service nova] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Received event network-vif-plugged-69c7a712-9905-4a77-a0ae-cd64dbd347fd {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:09:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f3ee1acb-fb36-41d6-b523-4e3c1e58cb70 req-a90d6f0c-1643-4ee3-94af-fcefc245a37e service nova] Acquiring lock "a2caa913-b0cc-46b7-b90d-fe507bc00b09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:09:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f3ee1acb-fb36-41d6-b523-4e3c1e58cb70 req-a90d6f0c-1643-4ee3-94af-fcefc245a37e service nova] Lock "a2caa913-b0cc-46b7-b90d-fe507bc00b09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:09:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f3ee1acb-fb36-41d6-b523-4e3c1e58cb70 req-a90d6f0c-1643-4ee3-94af-fcefc245a37e service nova] Lock "a2caa913-b0cc-46b7-b90d-fe507bc00b09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:09:30 user nova-compute[74994]: DEBUG nova.compute.manager [req-f3ee1acb-fb36-41d6-b523-4e3c1e58cb70 req-a90d6f0c-1643-4ee3-94af-fcefc245a37e service nova] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] No waiting events found dispatching network-vif-plugged-69c7a712-9905-4a77-a0ae-cd64dbd347fd {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:09:30 user nova-compute[74994]: WARNING nova.compute.manager [req-f3ee1acb-fb36-41d6-b523-4e3c1e58cb70 req-a90d6f0c-1643-4ee3-94af-fcefc245a37e service nova] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Received unexpected event network-vif-plugged-69c7a712-9905-4a77-a0ae-cd64dbd347fd for instance with vm_state shelved_offloaded and task_state spawning.
Nov 28 11:09:30 user nova-compute[74994]: DEBUG nova.compute.manager [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 11:09:30 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 11:09:30 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Instance spawned successfully.
Nov 28 11:09:31 user nova-compute[74994]: DEBUG nova.compute.manager [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 11:09:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c5f4af60-b92b-4344-9226-5c1057cba380 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "a2caa913-b0cc-46b7-b90d-fe507bc00b09" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.794s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:09:31 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:09:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:09:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:09:37 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:09:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:09:47 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:09:47 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:09:47 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:09:47 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:09:47 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:09:47 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:09:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:09:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:09:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:09:57 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:09:59 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:10:02 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:10:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4afb53b9-d07a-4239-a304-f4adf2162a5c tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Acquiring lock "50ab7d36-2d31-46cd-81ec-96646698a6c3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:10:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4afb53b9-d07a-4239-a304-f4adf2162a5c tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Lock "50ab7d36-2d31-46cd-81ec-96646698a6c3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:10:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4afb53b9-d07a-4239-a304-f4adf2162a5c tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Acquiring lock "50ab7d36-2d31-46cd-81ec-96646698a6c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:10:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4afb53b9-d07a-4239-a304-f4adf2162a5c tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Lock "50ab7d36-2d31-46cd-81ec-96646698a6c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:10:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4afb53b9-d07a-4239-a304-f4adf2162a5c tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Lock "50ab7d36-2d31-46cd-81ec-96646698a6c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:10:03 user nova-compute[74994]: INFO nova.compute.manager [None req-4afb53b9-d07a-4239-a304-f4adf2162a5c tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Terminating instance
Nov 28 11:10:03 user nova-compute[74994]: DEBUG nova.compute.manager [None req-4afb53b9-d07a-4239-a304-f4adf2162a5c tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 11:10:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:10:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:10:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:10:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:10:03 user nova-compute[74994]: DEBUG nova.compute.manager [req-04c3e112-de6f-448f-93f5-34250e206186 req-a9991e59-8741-4a2e-991b-02c654156114 service nova] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Received event network-vif-unplugged-5a0be0be-7a6c-49fe-9065-716d88636671 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:10:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-04c3e112-de6f-448f-93f5-34250e206186 req-a9991e59-8741-4a2e-991b-02c654156114 service nova] Acquiring lock "50ab7d36-2d31-46cd-81ec-96646698a6c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:10:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-04c3e112-de6f-448f-93f5-34250e206186 req-a9991e59-8741-4a2e-991b-02c654156114 service nova] Lock "50ab7d36-2d31-46cd-81ec-96646698a6c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:10:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-04c3e112-de6f-448f-93f5-34250e206186 req-a9991e59-8741-4a2e-991b-02c654156114 service nova] Lock "50ab7d36-2d31-46cd-81ec-96646698a6c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:10:03 user nova-compute[74994]: DEBUG nova.compute.manager [req-04c3e112-de6f-448f-93f5-34250e206186 req-a9991e59-8741-4a2e-991b-02c654156114 service nova] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] No waiting events found dispatching network-vif-unplugged-5a0be0be-7a6c-49fe-9065-716d88636671 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:10:03 user nova-compute[74994]: DEBUG nova.compute.manager [req-04c3e112-de6f-448f-93f5-34250e206186 req-a9991e59-8741-4a2e-991b-02c654156114 service nova] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Received event network-vif-unplugged-5a0be0be-7a6c-49fe-9065-716d88636671 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 11:10:04 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Instance destroyed successfully.
Nov 28 11:10:04 user nova-compute[74994]: DEBUG nova.objects.instance [None req-4afb53b9-d07a-4239-a304-f4adf2162a5c tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Lazy-loading 'resources' on Instance uuid 50ab7d36-2d31-46cd-81ec-96646698a6c3 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:10:04 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-4afb53b9-d07a-4239-a304-f4adf2162a5c tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:08:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1579143262',display_name='tempest-VolumesActionsTest-instance-1579143262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1579143262',id=37,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T11:08:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c81266cc350f4f8693946c8db8f28db5',ramdisk_id='',reservation_id='r-r2o1qjq1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1636508076',owner_user_name='tempest-VolumesActionsTest-1636508076-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T11:08:13Z,user_data=None,user_id='4516dcba29d34d3cb95936d073c3dff1',uuid=50ab7d36-2d31-46cd-81ec-96646698a6c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a0be0be-7a6c-49fe-9065-716d88636671", "address": "fa:16:3e:02:33:37", "network": {"id": "14e8cac9-dfee-4ffc-a968-8b6c2e93ce38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1067281528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c81266cc350f4f8693946c8db8f28db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a0be0be-7a", "ovs_interfaceid": "5a0be0be-7a6c-49fe-9065-716d88636671", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 11:10:04 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-4afb53b9-d07a-4239-a304-f4adf2162a5c tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Converting VIF {"id": "5a0be0be-7a6c-49fe-9065-716d88636671", "address": "fa:16:3e:02:33:37", "network": {"id": "14e8cac9-dfee-4ffc-a968-8b6c2e93ce38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1067281528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c81266cc350f4f8693946c8db8f28db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a0be0be-7a", "ovs_interfaceid": "5a0be0be-7a6c-49fe-9065-716d88636671", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:10:04 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-4afb53b9-d07a-4239-a304-f4adf2162a5c tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:33:37,bridge_name='br-int',has_traffic_filtering=True,id=5a0be0be-7a6c-49fe-9065-716d88636671,network=Network(14e8cac9-dfee-4ffc-a968-8b6c2e93ce38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a0be0be-7a') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:10:04 user nova-compute[74994]: DEBUG os_vif [None req-4afb53b9-d07a-4239-a304-f4adf2162a5c tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:33:37,bridge_name='br-int',has_traffic_filtering=True,id=5a0be0be-7a6c-49fe-9065-716d88636671,network=Network(14e8cac9-dfee-4ffc-a968-8b6c2e93ce38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a0be0be-7a') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 11:10:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:10:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a0be0be-7a, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:10:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:10:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:10:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:10:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=24659a42-4649-460a-89ec-ba581b9c0046) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:10:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:10:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:10:04 user nova-compute[74994]: INFO os_vif [None req-4afb53b9-d07a-4239-a304-f4adf2162a5c tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:33:37,bridge_name='br-int',has_traffic_filtering=True,id=5a0be0be-7a6c-49fe-9065-716d88636671,network=Network(14e8cac9-dfee-4ffc-a968-8b6c2e93ce38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a0be0be-7a')
Nov 28 11:10:04 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-4afb53b9-d07a-4239-a304-f4adf2162a5c tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Deleting instance files /opt/stack/data/nova/instances/50ab7d36-2d31-46cd-81ec-96646698a6c3_del
Nov 28 11:10:04 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-4afb53b9-d07a-4239-a304-f4adf2162a5c tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Deletion of /opt/stack/data/nova/instances/50ab7d36-2d31-46cd-81ec-96646698a6c3_del complete
Nov 28 11:10:04 user nova-compute[74994]: INFO nova.compute.manager [None req-4afb53b9-d07a-4239-a304-f4adf2162a5c tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Took 0.72 seconds to destroy the instance on the hypervisor.
Nov 28 11:10:04 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-4afb53b9-d07a-4239-a304-f4adf2162a5c tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 11:10:04 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 11:10:04 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 11:10:04 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:10:04 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Took 0.63 seconds to deallocate network for instance.
Nov 28 11:10:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:10:04 user nova-compute[74994]: DEBUG nova.compute.manager [req-d38c149f-39e6-4302-bdb9-ec2c0142a18b req-ead74a47-a719-46fd-bda4-1aa89f0935e7 service nova] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Received event network-vif-deleted-5a0be0be-7a6c-49fe-9065-716d88636671 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:10:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4afb53b9-d07a-4239-a304-f4adf2162a5c tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:10:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4afb53b9-d07a-4239-a304-f4adf2162a5c tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:10:05 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-4afb53b9-d07a-4239-a304-f4adf2162a5c tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:10:05 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-4afb53b9-d07a-4239-a304-f4adf2162a5c tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:10:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4afb53b9-d07a-4239-a304-f4adf2162a5c tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.282s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:10:05 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-4afb53b9-d07a-4239-a304-f4adf2162a5c tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Deleted allocations for instance 50ab7d36-2d31-46cd-81ec-96646698a6c3
Nov 28 11:10:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4afb53b9-d07a-4239-a304-f4adf2162a5c tempest-VolumesActionsTest-1636508076 tempest-VolumesActionsTest-1636508076-project-member] Lock "50ab7d36-2d31-46cd-81ec-96646698a6c3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.832s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:10:05 user nova-compute[74994]: DEBUG nova.compute.manager [req-ed1bceef-8a4f-4423-ad60-ca553f082006 req-0944a2a4-664c-4a48-9b7e-7688e8058ba8 service nova] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Received event network-vif-plugged-5a0be0be-7a6c-49fe-9065-716d88636671 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:10:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ed1bceef-8a4f-4423-ad60-ca553f082006 req-0944a2a4-664c-4a48-9b7e-7688e8058ba8 service nova] Acquiring lock "50ab7d36-2d31-46cd-81ec-96646698a6c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:10:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ed1bceef-8a4f-4423-ad60-ca553f082006 req-0944a2a4-664c-4a48-9b7e-7688e8058ba8 service nova] Lock "50ab7d36-2d31-46cd-81ec-96646698a6c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:10:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ed1bceef-8a4f-4423-ad60-ca553f082006 req-0944a2a4-664c-4a48-9b7e-7688e8058ba8 service nova] Lock "50ab7d36-2d31-46cd-81ec-96646698a6c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:10:05 user nova-compute[74994]: DEBUG nova.compute.manager [req-ed1bceef-8a4f-4423-ad60-ca553f082006 req-0944a2a4-664c-4a48-9b7e-7688e8058ba8 service nova] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] No waiting events found dispatching network-vif-plugged-5a0be0be-7a6c-49fe-9065-716d88636671 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:10:05 user nova-compute[74994]: WARNING nova.compute.manager [req-ed1bceef-8a4f-4423-ad60-ca553f082006 req-0944a2a4-664c-4a48-9b7e-7688e8058ba8 service nova] [instance: 50ab7d36-2d31-46cd-81ec-96646698a6c3] Received unexpected event network-vif-plugged-5a0be0be-7a6c-49fe-9065-716d88636671 for instance with vm_state deleted and task_state None.
Nov 28 11:10:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:10:10 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:10:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:10:17 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:10:17 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:10:17 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 11:10:19 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:10:20 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:10:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:10:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:10:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:10:20 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 11:10:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:10:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:10:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:10:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:10:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7295ae8a-462e-4b75-af40-35aac439dad0/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:10:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7295ae8a-462e-4b75-af40-35aac439dad0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:10:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7295ae8a-462e-4b75-af40-35aac439dad0/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:10:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7295ae8a-462e-4b75-af40-35aac439dad0/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:10:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bea7f301-29d1-454c-856a-71be9b55fed3/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:10:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bea7f301-29d1-454c-856a-71be9b55fed3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:10:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bea7f301-29d1-454c-856a-71be9b55fed3/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:10:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bea7f301-29d1-454c-856a-71be9b55fed3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:10:21 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:10:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2a2617-b00e-4d38-98a0-cca578b95f0e/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:10:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2a2617-b00e-4d38-98a0-cca578b95f0e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:10:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2a2617-b00e-4d38-98a0-cca578b95f0e/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:10:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2a2617-b00e-4d38-98a0-cca578b95f0e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:10:22 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:10:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2caa913-b0cc-46b7-b90d-fe507bc00b09/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:10:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2caa913-b0cc-46b7-b90d-fe507bc00b09/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:10:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2caa913-b0cc-46b7-b90d-fe507bc00b09/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:10:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2caa913-b0cc-46b7-b90d-fe507bc00b09/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:10:22 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:10:22 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:10:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=8169MB free_disk=24.970680236816406GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 11:10:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:10:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:10:23 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 20716905-c56a-4729-8c5b-9188502dc477 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:10:23 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 7295ae8a-462e-4b75-af40-35aac439dad0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:10:23 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 6f2a2617-b00e-4d38-98a0-cca578b95f0e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:10:23 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance e3b0b960-3f38-4a6f-9017-209fbc2110c9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:10:23 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance bea7f301-29d1-454c-856a-71be9b55fed3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:10:23 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance a2caa913-b0cc-46b7-b90d-fe507bc00b09 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:10:23 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 11:10:23 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 11:10:23 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Refreshing inventories for resource provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 11:10:23 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Updating ProviderTree inventory for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 11:10:23 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Updating inventory in ProviderTree for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 11:10:23 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Refreshing aggregate associations for resource provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a, aggregates: None {{(pid=74994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 11:10:23 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Refreshing trait associations for resource provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=74994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 11:10:23 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:10:23 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:10:23 user nova-compute[74994]: DEBUG nova.compute.manager [req-10b062db-4dfe-49b6-b604-3e987f5b5285 req-dae4bcd1-455e-436e-9d98-2b2272fd3fed service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Received event network-changed-5e571385-8510-4cdd-ae39-ebd481e04a59 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:10:23 user nova-compute[74994]: DEBUG nova.compute.manager [req-10b062db-4dfe-49b6-b604-3e987f5b5285 req-dae4bcd1-455e-436e-9d98-2b2272fd3fed service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Refreshing instance network info cache due to event network-changed-5e571385-8510-4cdd-ae39-ebd481e04a59. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:10:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-10b062db-4dfe-49b6-b604-3e987f5b5285 req-dae4bcd1-455e-436e-9d98-2b2272fd3fed service nova] Acquiring lock "refresh_cache-6f2a2617-b00e-4d38-98a0-cca578b95f0e" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:10:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-10b062db-4dfe-49b6-b604-3e987f5b5285 req-dae4bcd1-455e-436e-9d98-2b2272fd3fed service nova] Acquired lock "refresh_cache-6f2a2617-b00e-4d38-98a0-cca578b95f0e" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:10:23 user nova-compute[74994]: DEBUG nova.network.neutron [req-10b062db-4dfe-49b6-b604-3e987f5b5285 req-dae4bcd1-455e-436e-9d98-2b2272fd3fed service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Refreshing network info cache for port 5e571385-8510-4cdd-ae39-ebd481e04a59 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:10:23 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 11:10:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.741s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:10:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:10:24 user nova-compute[74994]: DEBUG nova.network.neutron [req-10b062db-4dfe-49b6-b604-3e987f5b5285 req-dae4bcd1-455e-436e-9d98-2b2272fd3fed service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Updated VIF entry in instance network info cache for port 5e571385-8510-4cdd-ae39-ebd481e04a59. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:10:24 user nova-compute[74994]: DEBUG nova.network.neutron [req-10b062db-4dfe-49b6-b604-3e987f5b5285 req-dae4bcd1-455e-436e-9d98-2b2272fd3fed service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Updating instance_info_cache with network_info: [{"id": "5e571385-8510-4cdd-ae39-ebd481e04a59", "address": "fa:16:3e:83:bf:50", "network": {"id": "89f2b906-9ef3-4e31-87e5-3e0cd23e8695", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2005181920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9670a509ac14f41a9f44d7299fd2f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e571385-85", "ovs_interfaceid": "5e571385-8510-4cdd-ae39-ebd481e04a59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:10:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-10b062db-4dfe-49b6-b604-3e987f5b5285 req-dae4bcd1-455e-436e-9d98-2b2272fd3fed service nova] Releasing lock "refresh_cache-6f2a2617-b00e-4d38-98a0-cca578b95f0e" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:10:24 user nova-compute[74994]: DEBUG nova.compute.manager [req-91548896-c413-467b-84d6-998f36e2c28a req-af637f16-9d7e-4787-9784-22a86272f729 service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Received event network-changed-5e571385-8510-4cdd-ae39-ebd481e04a59 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:10:24 user nova-compute[74994]: DEBUG nova.compute.manager [req-91548896-c413-467b-84d6-998f36e2c28a req-af637f16-9d7e-4787-9784-22a86272f729 service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Refreshing instance network info cache due to event network-changed-5e571385-8510-4cdd-ae39-ebd481e04a59. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:10:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-91548896-c413-467b-84d6-998f36e2c28a req-af637f16-9d7e-4787-9784-22a86272f729 service nova] Acquiring lock "refresh_cache-6f2a2617-b00e-4d38-98a0-cca578b95f0e" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:10:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-91548896-c413-467b-84d6-998f36e2c28a req-af637f16-9d7e-4787-9784-22a86272f729 service nova] Acquired lock "refresh_cache-6f2a2617-b00e-4d38-98a0-cca578b95f0e" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:10:24 user nova-compute[74994]: DEBUG nova.network.neutron [req-91548896-c413-467b-84d6-998f36e2c28a req-af637f16-9d7e-4787-9784-22a86272f729 service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Refreshing network info cache for port 5e571385-8510-4cdd-ae39-ebd481e04a59 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:10:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d1d01db2-eae7-44a6-9ce3-9539a8d08b17 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Acquiring lock "6f2a2617-b00e-4d38-98a0-cca578b95f0e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:10:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d1d01db2-eae7-44a6-9ce3-9539a8d08b17 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "6f2a2617-b00e-4d38-98a0-cca578b95f0e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:10:24 user nova-compute[74994]: INFO nova.compute.manager [None req-d1d01db2-eae7-44a6-9ce3-9539a8d08b17 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Detaching volume 6eaefd7d-f42c-48b9-9892-c77e46a0c000
Nov 28 11:10:24 user nova-compute[74994]: INFO nova.virt.block_device [None req-d1d01db2-eae7-44a6-9ce3-9539a8d08b17 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Attempting to driver detach volume 6eaefd7d-f42c-48b9-9892-c77e46a0c000 from mountpoint /dev/vdb
Nov 28 11:10:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-d1d01db2-eae7-44a6-9ce3-9539a8d08b17 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Attempting to detach device vdb from instance 6f2a2617-b00e-4d38-98a0-cca578b95f0e from the persistent domain config. {{(pid=74994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 11:10:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-d1d01db2-eae7-44a6-9ce3-9539a8d08b17 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 11:10:24 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:10:24 user nova-compute[74994]:   <source dev="/dev/sdb"/>
Nov 28 11:10:24 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:10:24 user nova-compute[74994]:   <serial>6eaefd7d-f42c-48b9-9892-c77e46a0c000</serial>
Nov 28 11:10:24 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 11:10:24 user nova-compute[74994]: </disk>
Nov 28 11:10:24 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 11:10:24 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-d1d01db2-eae7-44a6-9ce3-9539a8d08b17 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Successfully detached device vdb from instance 6f2a2617-b00e-4d38-98a0-cca578b95f0e from the persistent domain config.
Nov 28 11:10:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-d1d01db2-eae7-44a6-9ce3-9539a8d08b17 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6f2a2617-b00e-4d38-98a0-cca578b95f0e from the live domain config. {{(pid=74994) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 11:10:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-d1d01db2-eae7-44a6-9ce3-9539a8d08b17 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 11:10:24 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:10:24 user nova-compute[74994]:   <source dev="/dev/sdb"/>
Nov 28 11:10:24 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:10:24 user nova-compute[74994]:   <serial>6eaefd7d-f42c-48b9-9892-c77e46a0c000</serial>
Nov 28 11:10:24 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 11:10:24 user nova-compute[74994]: </disk>
Nov 28 11:10:24 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 11:10:24 user nova-compute[74994]: DEBUG nova.network.neutron [req-91548896-c413-467b-84d6-998f36e2c28a req-af637f16-9d7e-4787-9784-22a86272f729 service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Updated VIF entry in instance network info cache for port 5e571385-8510-4cdd-ae39-ebd481e04a59. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:10:24 user nova-compute[74994]: DEBUG nova.network.neutron [req-91548896-c413-467b-84d6-998f36e2c28a req-af637f16-9d7e-4787-9784-22a86272f729 service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Updating instance_info_cache with network_info: [{"id": "5e571385-8510-4cdd-ae39-ebd481e04a59", "address": "fa:16:3e:83:bf:50", "network": {"id": "89f2b906-9ef3-4e31-87e5-3e0cd23e8695", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2005181920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9670a509ac14f41a9f44d7299fd2f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e571385-85", "ovs_interfaceid": "5e571385-8510-4cdd-ae39-ebd481e04a59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:10:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-91548896-c413-467b-84d6-998f36e2c28a req-af637f16-9d7e-4787-9784-22a86272f729 service nova] Releasing lock "refresh_cache-6f2a2617-b00e-4d38-98a0-cca578b95f0e" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:10:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:10:25 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-d1d01db2-eae7-44a6-9ce3-9539a8d08b17 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6f2a2617-b00e-4d38-98a0-cca578b95f0e {{(pid=74994) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 11:10:25 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:10:25 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:10:25 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:10:25 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74994) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 11:10:28 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:10:28 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 11:10:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "refresh_cache-e3b0b960-3f38-4a6f-9017-209fbc2110c9" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:10:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquired lock "refresh_cache-e3b0b960-3f38-4a6f-9017-209fbc2110c9" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:10:28 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Forcefully refreshing network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 11:10:29 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Updating instance_info_cache with network_info: [{"id": "17fb7783-f3dc-41cf-b838-004f2048fdbc", "address": "fa:16:3e:b7:31:25", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17fb7783-f3", "ovs_interfaceid": "17fb7783-f3dc-41cf-b838-004f2048fdbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:10:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Releasing lock "refresh_cache-e3b0b960-3f38-4a6f-9017-209fbc2110c9" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:10:29 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Updated the network info_cache for instance {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 11:10:29 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:10:29 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:10:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:10:31 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:10:33 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:10:33 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Cleaning up deleted instances {{(pid=74994) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 11:10:33 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] There are 0 instances to clean {{(pid=74994) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 11:10:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:10:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:10:38 user nova-compute[74994]: DEBUG nova.compute.manager [req-78fca3ea-e6e2-477c-a8ec-6a792635224e req-eeefb61e-b7a5-45d8-b4a7-3af2f41e1fe9 service nova] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Received event network-changed-d326e9a1-1c44-4c63-9fb0-a22056ee25b5 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:10:38 user nova-compute[74994]: DEBUG nova.compute.manager [req-78fca3ea-e6e2-477c-a8ec-6a792635224e req-eeefb61e-b7a5-45d8-b4a7-3af2f41e1fe9 service nova] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Refreshing instance network info cache due to event network-changed-d326e9a1-1c44-4c63-9fb0-a22056ee25b5. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:10:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-78fca3ea-e6e2-477c-a8ec-6a792635224e req-eeefb61e-b7a5-45d8-b4a7-3af2f41e1fe9 service nova] Acquiring lock "refresh_cache-bea7f301-29d1-454c-856a-71be9b55fed3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:10:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-78fca3ea-e6e2-477c-a8ec-6a792635224e req-eeefb61e-b7a5-45d8-b4a7-3af2f41e1fe9 service nova] Acquired lock "refresh_cache-bea7f301-29d1-454c-856a-71be9b55fed3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:10:38 user nova-compute[74994]: DEBUG nova.network.neutron [req-78fca3ea-e6e2-477c-a8ec-6a792635224e req-eeefb61e-b7a5-45d8-b4a7-3af2f41e1fe9 service nova] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Refreshing network info cache for port d326e9a1-1c44-4c63-9fb0-a22056ee25b5 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:10:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:10:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Acquiring lock "bea7f301-29d1-454c-856a-71be9b55fed3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:10:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "bea7f301-29d1-454c-856a-71be9b55fed3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:10:39 user nova-compute[74994]: DEBUG nova.objects.instance [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lazy-loading 'flavor' on Instance uuid bea7f301-29d1-454c-856a-71be9b55fed3 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:10:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "bea7f301-29d1-454c-856a-71be9b55fed3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:10:39 user nova-compute[74994]: DEBUG nova.network.neutron [req-78fca3ea-e6e2-477c-a8ec-6a792635224e req-eeefb61e-b7a5-45d8-b4a7-3af2f41e1fe9 service nova] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Updated VIF entry in instance network info cache for port d326e9a1-1c44-4c63-9fb0-a22056ee25b5. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:10:39 user nova-compute[74994]: DEBUG nova.network.neutron [req-78fca3ea-e6e2-477c-a8ec-6a792635224e req-eeefb61e-b7a5-45d8-b4a7-3af2f41e1fe9 service nova] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Updating instance_info_cache with network_info: [{"id": "d326e9a1-1c44-4c63-9fb0-a22056ee25b5", "address": "fa:16:3e:d7:87:35", "network": {"id": "962e3ca9-e99b-49cd-bb50-c34d108cdfa7", "bridge": "br-int", "label": "tempest-TestStampPattern-359277306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30dae8b62e14c50b9646b13af2a4258", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd326e9a1-1c", "ovs_interfaceid": "d326e9a1-1c44-4c63-9fb0-a22056ee25b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:10:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-78fca3ea-e6e2-477c-a8ec-6a792635224e req-eeefb61e-b7a5-45d8-b4a7-3af2f41e1fe9 service nova] Releasing lock "refresh_cache-bea7f301-29d1-454c-856a-71be9b55fed3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:10:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Acquiring lock "bea7f301-29d1-454c-856a-71be9b55fed3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:10:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "bea7f301-29d1-454c-856a-71be9b55fed3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:10:39 user nova-compute[74994]: INFO nova.compute.manager [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Attaching volume 061bb77e-623b-4cff-94f2-9a2429c9edbd to /dev/vdb
Nov 28 11:10:39 user nova-compute[74994]: DEBUG os_brick.utils [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:10:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:10:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:10:39 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[dccb0b65-9b62-4a13-a7bc-976cebea8863]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:10:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:10:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:10:39 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43882b2-ad8d-4442-97b3-fe7cdf90f1f1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:10:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:10:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:10:39 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[274c6d0d-461a-45d2-b7ce-a8ed3a6d65de]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:10:39 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13c32c3-d4d9-457f-a0de-e0e88c0fe215]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:10:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:10:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:10:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 11:10:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:10:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:10:39 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 11:10:39 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ee8a1c-7b5d-41dc-8bb8-8d1a5aad8b44]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:10:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 11:10:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 11:10:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 11:10:39 user nova-compute[74994]: DEBUG os_brick.utils [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:10:39 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Updating existing volume attachment record: 551e1eae-cbc4-4f06-8c34-fe33fb0ab66a {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 11:10:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:10:44 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:10:44 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:10:45 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-d1d01db2-eae7-44a6-9ce3-9539a8d08b17 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6f2a2617-b00e-4d38-98a0-cca578b95f0e is timed out.
Nov 28 11:10:45 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-d1d01db2-eae7-44a6-9ce3-9539a8d08b17 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Successfully detached device vdb from instance 6f2a2617-b00e-4d38-98a0-cca578b95f0e from the live domain config.
Nov 28 11:10:45 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1d01db2-eae7-44a6-9ce3-9539a8d08b17 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 11:10:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d01db2-eae7-44a6-9ce3-9539a8d08b17 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:6eaefd7d-f42c-48b9-9892-c77e46a0c000', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EwxLSrVF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:10:45 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-d1d01db2-eae7-44a6-9ce3-9539a8d08b17 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:10:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-d1d01db2-eae7-44a6-9ce3-9539a8d08b17 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:10:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-d1d01db2-eae7-44a6-9ce3-9539a8d08b17 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:10:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:10:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:10:45 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc58f25-f4c8-4876-94d1-d1b3357b2fd6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6eaefd7d-f42c-48b9-9892-c77e46a0c000\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:10:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d01db2-eae7-44a6-9ce3-9539a8d08b17 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 11:10:45 user nova-compute[74994]: No targets found.
Nov 28 11:10:45 user nova-compute[74994]: iSNS:
Nov 28 11:10:45 user nova-compute[74994]: No targets found.
Nov 28 11:10:45 user nova-compute[74994]: STATIC:
Nov 28 11:10:45 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd
Nov 28 11:10:45 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:10:45 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:10:45 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6eaefd7d-f42c-48b9-9892-c77e46a0c000
Nov 28 11:10:45 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:10:45 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:10:45 user nova-compute[74994]: FIRMWARE:
Nov 28 11:10:45 user nova-compute[74994]: No targets found.
Nov 28 11:10:45 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:10:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d01db2-eae7-44a6-9ce3-9539a8d08b17 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 11:10:45 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 11:10:45 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 11:10:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d01db2-eae7-44a6-9ce3-9539a8d08b17 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6eaefd7d-f42c-48b9-9892-c77e46a0c000', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 11:10:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:10:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:10:45 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a0cece-ca61-4111-92b6-4845ebba56ab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eaefd7d-f42c-48b9-9892-c77e46a0c000\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:10:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:10:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:10:45 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[68417c0a-bb81-4c1b-abeb-80d02643a951]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaefd7d-f42c-48b9-9892-c77e46a0c000 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:10:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d01db2-eae7-44a6-9ce3-9539a8d08b17 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)
Nov 28 11:10:45 user nova-compute[74994]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaefd7d-f42c-48b9-9892-c77e46a0c000 (non-flash)
Nov 28 11:10:45 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:10:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d01db2-eae7-44a6-9ce3-9539a8d08b17 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)
Nov 28 11:10:45 user nova-compute[74994]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eaefd7d-f42c-48b9-9892-c77e46a0c000 (non-flash)
Nov 28 11:10:45 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:10:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d01db2-eae7-44a6-9ce3-9539a8d08b17 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb920570dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6eaefd7d-f42c-48b9-9892-c77e46a0c000'): ({'sdb'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 11:10:45 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-d1d01db2-eae7-44a6-9ce3-9539a8d08b17 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Removing single pathed devices sdb {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 11:10:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:10:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:10:45 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6069a9e2-5e91-4c62-ae59-995a5a8a158b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:10:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:10:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:10:45 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a47a16-e98f-4598-b326-6152312bf588]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:10:45 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-d1d01db2-eae7-44a6-9ce3-9539a8d08b17 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Flushing IO for device /dev/sdb {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 11:10:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:10:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:10:45 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c347fcf0-1378-4083-b90e-d6e6e76d11cb]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:10:45 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-d1d01db2-eae7-44a6-9ce3-9539a8d08b17 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 11:10:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:10:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:10:45 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[24584ecf-9fa0-46cc-8157-3371e38cd336]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:10:45 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-d1d01db2-eae7-44a6-9ce3-9539a8d08b17 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 11:10:45 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-d1d01db2-eae7-44a6-9ce3-9539a8d08b17 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] SCSI volumes sdb have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 11:10:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d01db2-eae7-44a6-9ce3-9539a8d08b17 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6eaefd7d-f42c-48b9-9892-c77e46a0c000')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 11:10:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eaefd7d-f42c-48b9-9892-c77e46a0c000 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:10:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eaefd7d-f42c-48b9-9892-c77e46a0c000 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:10:45 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7adc5e57-f11c-4c58-adc1-7d52f5ad6dbb]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:10:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d01db2-eae7-44a6-9ce3-9539a8d08b17 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:10:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eaefd7d-f42c-48b9-9892-c77e46a0c000 -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:10:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eaefd7d-f42c-48b9-9892-c77e46a0c000 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:10:45 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed7d53e-68cd-43d8-ba91-125ab691d2f8]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:6eaefd7d-f42c-48b9-9892-c77e46a0c000, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:6eaefd7d-f42c-48b9-9892-c77e46a0c000, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:10:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d01db2-eae7-44a6-9ce3-9539a8d08b17 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:6eaefd7d-f42c-48b9-9892-c77e46a0c000, portal: 172.16.0.220,3260]
Nov 28 11:10:45 user nova-compute[74994]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:6eaefd7d-f42c-48b9-9892-c77e46a0c000, portal: 172.16.0.220,3260] successful.
Nov 28 11:10:45 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:10:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eaefd7d-f42c-48b9-9892-c77e46a0c000 -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:10:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eaefd7d-f42c-48b9-9892-c77e46a0c000 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:10:45 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba42e71-8bd1-4a1a-a2b6-5bcca2394b04]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:10:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d01db2-eae7-44a6-9ce3-9539a8d08b17 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:10:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-d1d01db2-eae7-44a6-9ce3-9539a8d08b17 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:10:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d01db2-eae7-44a6-9ce3-9539a8d08b17 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] <== disconnect_volume: return (306ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:10:45 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1d01db2-eae7-44a6-9ce3-9539a8d08b17 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:061bb77e-623b-4cff-94f2-9a2429c9edbd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZdricFAL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:10:46 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:10:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:10:46 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:10:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:061bb77e-623b-4cff-94f2-9a2429c9edbd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:061bb77e-623b-4cff-94f2-9a2429c9edbd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:10:46 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 11:10:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061bb77e-623b-4cff-94f2-9a2429c9edbd -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061bb77e-623b-4cff-94f2-9a2429c9edbd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d790013-ba9c-4a0f-b5a1-08a78cc877d8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 11:10:46 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061bb77e-623b-4cff-94f2-9a2429c9edbd -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061bb77e-623b-4cff-94f2-9a2429c9edbd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6c2353-6653-4e12-b6bf-a1b572c2fa30]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:061bb77e-623b-4cff-94f2-9a2429c9edbd] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:061bb77e-623b-4cff-94f2-9a2429c9edbd] added
Nov 28 11:10:46 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061bb77e-623b-4cff-94f2-9a2429c9edbd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061bb77e-623b-4cff-94f2-9a2429c9edbd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f52398c-55cd-4200-95a1-049039839f82]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061bb77e-623b-4cff-94f2-9a2429c9edbd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061bb77e-623b-4cff-94f2-9a2429c9edbd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacf2908-44b8-4879-9554-f72ef27426e2]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061bb77e-623b-4cff-94f2-9a2429c9edbd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZdricFAL {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061bb77e-623b-4cff-94f2-9a2429c9edbd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZdricFAL" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b79ff18-be50-44aa-a640-be11bd58c8f6]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZdricFAL'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061bb77e-623b-4cff-94f2-9a2429c9edbd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061bb77e-623b-4cff-94f2-9a2429c9edbd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4970333f-409b-4856-948f-5c0a400b0580]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG nova.objects.instance [None req-d1d01db2-eae7-44a6-9ce3-9539a8d08b17 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lazy-loading 'flavor' on Instance uuid 6f2a2617-b00e-4d38-98a0-cca578b95f0e {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d416511a-a50a-442f-8978-8541f38ca874]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)
Nov 28 11:10:46 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)
Nov 28 11:10:46 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061bb77e-623b-4cff-94f2-9a2429c9edbd -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-d1d01db2-eae7-44a6-9ce3-9539a8d08b17 tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "6f2a2617-b00e-4d38-98a0-cca578b95f0e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.971s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061bb77e-623b-4cff-94f2-9a2429c9edbd -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f4b6f7-b367-47c4-a7dc-3715522db9f1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:061bb77e-623b-4cff-94f2-9a2429c9edbd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:061bb77e-623b-4cff-94f2-9a2429c9edbd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:061bb77e-623b-4cff-94f2-9a2429c9edbd, portal: 172.16.0.220,3260]
Nov 28 11:10:46 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:061bb77e-623b-4cff-94f2-9a2429c9edbd, portal: 172.16.0.220,3260] successful.
Nov 28 11:10:46 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061bb77e-623b-4cff-94f2-9a2429c9edbd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061bb77e-623b-4cff-94f2-9a2429c9edbd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de12126-1f4f-49fd-96b4-87386056e347]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc61d83-f77c-4af8-b794-45a51c9832e6]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061bb77e-623b-4cff-94f2-9a2429c9edbd (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)
Nov 28 11:10:46 user nova-compute[74994]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061bb77e-623b-4cff-94f2-9a2429c9edbd (non-flash)
Nov 28 11:10:46 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)
Nov 28 11:10:46 user nova-compute[74994]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061bb77e-623b-4cff-94f2-9a2429c9edbd (non-flash)
Nov 28 11:10:46 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:061bb77e-623b-4cff-94f2-9a2429c9edbd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6213eb44-5e0c-496a-a8d7-720dcc52dff9]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:10:46 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: None {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 11:10:47 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 11:10:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:061bb77e-623b-4cff-94f2-9a2429c9edbd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZdricFAL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 11:10:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:10:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '26130663339336634', 'path': '/dev/sdb'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:10:47 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130663339336634', 'path': '/dev/sdb'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 11:10:47 user nova-compute[74994]: DEBUG nova.objects.instance [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lazy-loading 'flavor' on Instance uuid bea7f301-29d1-454c-856a-71be9b55fed3 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:10:47 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 11:10:47 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:10:47 user nova-compute[74994]:   <source dev="/dev/sdb"/>
Nov 28 11:10:47 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:10:47 user nova-compute[74994]:   <serial>061bb77e-623b-4cff-94f2-9a2429c9edbd</serial>
Nov 28 11:10:47 user nova-compute[74994]: </disk>
Nov 28 11:10:47 user nova-compute[74994]:  {{(pid=74994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 11:10:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:10:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:10:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] No VIF found with MAC fa:16:3e:d7:87:35, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:10:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6e0ac9e6-c3ba-4fd6-b783-68b5dd64449d tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "bea7f301-29d1-454c-856a-71be9b55fed3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.828s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:10:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:10:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:10:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:10:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-496d072b-d528-430d-864b-e33bdde480ca tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Acquiring lock "bea7f301-29d1-454c-856a-71be9b55fed3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:10:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-496d072b-d528-430d-864b-e33bdde480ca tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "bea7f301-29d1-454c-856a-71be9b55fed3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:10:50 user nova-compute[74994]: INFO nova.compute.manager [None req-496d072b-d528-430d-864b-e33bdde480ca tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Detaching volume 061bb77e-623b-4cff-94f2-9a2429c9edbd
Nov 28 11:10:50 user nova-compute[74994]: INFO nova.virt.block_device [None req-496d072b-d528-430d-864b-e33bdde480ca tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Attempting to driver detach volume 061bb77e-623b-4cff-94f2-9a2429c9edbd from mountpoint /dev/vdb
Nov 28 11:10:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-496d072b-d528-430d-864b-e33bdde480ca tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Attempting to detach device vdb from instance bea7f301-29d1-454c-856a-71be9b55fed3 from the persistent domain config. {{(pid=74994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 11:10:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-496d072b-d528-430d-864b-e33bdde480ca tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 11:10:50 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:10:50 user nova-compute[74994]:   <source dev="/dev/sdb"/>
Nov 28 11:10:50 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:10:50 user nova-compute[74994]:   <serial>061bb77e-623b-4cff-94f2-9a2429c9edbd</serial>
Nov 28 11:10:50 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 11:10:50 user nova-compute[74994]: </disk>
Nov 28 11:10:50 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 11:10:50 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-496d072b-d528-430d-864b-e33bdde480ca tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Successfully detached device vdb from instance bea7f301-29d1-454c-856a-71be9b55fed3 from the persistent domain config.
Nov 28 11:10:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-496d072b-d528-430d-864b-e33bdde480ca tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bea7f301-29d1-454c-856a-71be9b55fed3 from the live domain config. {{(pid=74994) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 11:10:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-496d072b-d528-430d-864b-e33bdde480ca tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 11:10:50 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:10:50 user nova-compute[74994]:   <source dev="/dev/sdb"/>
Nov 28 11:10:50 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:10:50 user nova-compute[74994]:   <serial>061bb77e-623b-4cff-94f2-9a2429c9edbd</serial>
Nov 28 11:10:50 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 11:10:50 user nova-compute[74994]: </disk>
Nov 28 11:10:50 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 11:10:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-496d072b-d528-430d-864b-e33bdde480ca tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bea7f301-29d1-454c-856a-71be9b55fed3 {{(pid=74994) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 11:10:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:10:54 user nova-compute[74994]: INFO nova.compute.manager [None req-bdd26132-8d53-4152-967b-c3f2b36273d6 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Get console output
Nov 28 11:10:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:10:54 user nova-compute[74994]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 28 11:10:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:10:55 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Acquiring lock "53133e7f-b155-4fa5-9f2b-29993200fa90" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:10:55 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Lock "53133e7f-b155-4fa5-9f2b-29993200fa90" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:10:55 user nova-compute[74994]: DEBUG nova.compute.manager [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 11:10:56 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:10:56 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:10:56 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 11:10:56 user nova-compute[74994]: INFO nova.compute.claims [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Claim successful on node user
Nov 28 11:10:56 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:10:56 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:10:56 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.298s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:10:56 user nova-compute[74994]: DEBUG nova.compute.manager [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 11:10:56 user nova-compute[74994]: DEBUG nova.compute.manager [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 11:10:56 user nova-compute[74994]: DEBUG nova.network.neutron [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 11:10:56 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 11:10:56 user nova-compute[74994]: DEBUG nova.compute.manager [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 11:10:56 user nova-compute[74994]: DEBUG nova.policy [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e6dcb9651a945ae95732a246f6a2857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd213989fc07742e6a087593430826861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 11:10:56 user nova-compute[74994]: DEBUG nova.compute.manager [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 11:10:56 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 11:10:56 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Creating image(s)
Nov 28 11:10:56 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Acquiring lock "/opt/stack/data/nova/instances/53133e7f-b155-4fa5-9f2b-29993200fa90/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:10:56 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Lock "/opt/stack/data/nova/instances/53133e7f-b155-4fa5-9f2b-29993200fa90/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:10:56 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Lock "/opt/stack/data/nova/instances/53133e7f-b155-4fa5-9f2b-29993200fa90/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:10:56 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:10:56 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.178s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:10:56 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Acquiring lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:10:56 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:10:56 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:10:56 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.194s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:10:56 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/53133e7f-b155-4fa5-9f2b-29993200fa90/disk 1073741824 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:10:57 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/53133e7f-b155-4fa5-9f2b-29993200fa90/disk 1073741824" returned: 0 in 0.062s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:10:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:10:57 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:10:57 user nova-compute[74994]: DEBUG nova.network.neutron [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Successfully created port: e3543c90-0e97-4550-9371-32aa9fa1bd91 {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 11:10:57 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.200s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:10:57 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Checking if we can resize image /opt/stack/data/nova/instances/53133e7f-b155-4fa5-9f2b-29993200fa90/disk. size=1073741824 {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 11:10:57 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53133e7f-b155-4fa5-9f2b-29993200fa90/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:10:57 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53133e7f-b155-4fa5-9f2b-29993200fa90/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:10:57 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Cannot resize image /opt/stack/data/nova/instances/53133e7f-b155-4fa5-9f2b-29993200fa90/disk to a smaller size. {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 11:10:57 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Created local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 11:10:57 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Ensure instance console log exists: /opt/stack/data/nova/instances/53133e7f-b155-4fa5-9f2b-29993200fa90/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 11:10:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:10:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:10:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:10:57 user nova-compute[74994]: DEBUG nova.network.neutron [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Successfully updated port: e3543c90-0e97-4550-9371-32aa9fa1bd91 {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 11:10:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Acquiring lock "refresh_cache-53133e7f-b155-4fa5-9f2b-29993200fa90" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:10:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Acquired lock "refresh_cache-53133e7f-b155-4fa5-9f2b-29993200fa90" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:10:57 user nova-compute[74994]: DEBUG nova.network.neutron [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 11:10:57 user nova-compute[74994]: DEBUG nova.compute.manager [req-1174d29b-43a6-4807-8a2f-02672f6953f3 req-584457bf-2d91-40d0-b809-13bbdea3e2e7 service nova] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Received event network-changed-e3543c90-0e97-4550-9371-32aa9fa1bd91 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:10:57 user nova-compute[74994]: DEBUG nova.compute.manager [req-1174d29b-43a6-4807-8a2f-02672f6953f3 req-584457bf-2d91-40d0-b809-13bbdea3e2e7 service nova] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Refreshing instance network info cache due to event network-changed-e3543c90-0e97-4550-9371-32aa9fa1bd91. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:10:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-1174d29b-43a6-4807-8a2f-02672f6953f3 req-584457bf-2d91-40d0-b809-13bbdea3e2e7 service nova] Acquiring lock "refresh_cache-53133e7f-b155-4fa5-9f2b-29993200fa90" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:10:57 user nova-compute[74994]: DEBUG nova.network.neutron [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 11:10:58 user nova-compute[74994]: DEBUG nova.network.neutron [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Updating instance_info_cache with network_info: [{"id": "e3543c90-0e97-4550-9371-32aa9fa1bd91", "address": "fa:16:3e:c8:e5:c2", "network": {"id": "0833228c-a00a-42e2-bcbd-d943e976dc13", "bridge": "br-int", "label": "tempest-VolumesActionsTest-373359983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d213989fc07742e6a087593430826861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3543c90-0e", "ovs_interfaceid": "e3543c90-0e97-4550-9371-32aa9fa1bd91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:10:58 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Releasing lock "refresh_cache-53133e7f-b155-4fa5-9f2b-29993200fa90" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:10:58 user nova-compute[74994]: DEBUG nova.compute.manager [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Instance network_info: |[{"id": "e3543c90-0e97-4550-9371-32aa9fa1bd91", "address": "fa:16:3e:c8:e5:c2", "network": {"id": "0833228c-a00a-42e2-bcbd-d943e976dc13", "bridge": "br-int", "label": "tempest-VolumesActionsTest-373359983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d213989fc07742e6a087593430826861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3543c90-0e", "ovs_interfaceid": "e3543c90-0e97-4550-9371-32aa9fa1bd91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 11:10:58 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-1174d29b-43a6-4807-8a2f-02672f6953f3 req-584457bf-2d91-40d0-b809-13bbdea3e2e7 service nova] Acquired lock "refresh_cache-53133e7f-b155-4fa5-9f2b-29993200fa90" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:10:58 user nova-compute[74994]: DEBUG nova.network.neutron [req-1174d29b-43a6-4807-8a2f-02672f6953f3 req-584457bf-2d91-40d0-b809-13bbdea3e2e7 service nova] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Refreshing network info cache for port e3543c90-0e97-4550-9371-32aa9fa1bd91 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:10:58 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Start _get_guest_xml network_info=[{"id": "e3543c90-0e97-4550-9371-32aa9fa1bd91", "address": "fa:16:3e:c8:e5:c2", "network": {"id": "0833228c-a00a-42e2-bcbd-d943e976dc13", "bridge": "br-int", "label": "tempest-VolumesActionsTest-373359983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d213989fc07742e6a087593430826861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3543c90-0e", "ovs_interfaceid": "e3543c90-0e97-4550-9371-32aa9fa1bd91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'aa939d1b-b8a6-4391-935b-0191bf5ccd0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 11:10:58 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:10:58 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:10:58 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 11:10:58 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 11:10:58 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 11:10:58 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 11:10:58 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 11:10:58 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 11:10:58 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 11:10:58 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 11:10:58 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 11:10:58 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 11:10:58 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 11:10:58 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 11:10:58 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 11:10:58 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 11:10:58 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 11:10:58 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 11:10:58 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:10:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1693080050',display_name='tempest-VolumesActionsTest-instance-1693080050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1693080050',id=39,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d213989fc07742e6a087593430826861',ramdisk_id='',reservation_id='r-fp8xfacx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1285521872',owner_user_name='tempest-VolumesActionsTest-1285521872-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:10:57Z,user_data=None,user_id='7e6dcb9651a945ae95732a246f6a2857',uuid=53133e7f-b155-4fa5-9f2b-29993200fa90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3543c90-0e97-4550-9371-32aa9fa1bd91", "address": "fa:16:3e:c8:e5:c2", "network": {"id": "0833228c-a00a-42e2-bcbd-d943e976dc13", "bridge": "br-int", "label": "tempest-VolumesActionsTest-373359983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d213989fc07742e6a087593430826861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3543c90-0e", "ovs_interfaceid": "e3543c90-0e97-4550-9371-32aa9fa1bd91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 11:10:58 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Converting VIF {"id": "e3543c90-0e97-4550-9371-32aa9fa1bd91", "address": "fa:16:3e:c8:e5:c2", "network": {"id": "0833228c-a00a-42e2-bcbd-d943e976dc13", "bridge": "br-int", "label": "tempest-VolumesActionsTest-373359983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d213989fc07742e6a087593430826861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3543c90-0e", "ovs_interfaceid": "e3543c90-0e97-4550-9371-32aa9fa1bd91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:10:58 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:e5:c2,bridge_name='br-int',has_traffic_filtering=True,id=e3543c90-0e97-4550-9371-32aa9fa1bd91,network=Network(0833228c-a00a-42e2-bcbd-d943e976dc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3543c90-0e') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:10:58 user nova-compute[74994]: DEBUG nova.objects.instance [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Lazy-loading 'pci_devices' on Instance uuid 53133e7f-b155-4fa5-9f2b-29993200fa90 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:10:58 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] End _get_guest_xml xml=<domain type="kvm">
Nov 28 11:10:58 user nova-compute[74994]:   <uuid>53133e7f-b155-4fa5-9f2b-29993200fa90</uuid>
Nov 28 11:10:58 user nova-compute[74994]:   <name>instance-00000027</name>
Nov 28 11:10:58 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 11:10:58 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 11:10:58 user nova-compute[74994]:   <metadata>
Nov 28 11:10:58 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 11:10:58 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 11:10:58 user nova-compute[74994]:       <nova:name>tempest-VolumesActionsTest-instance-1693080050</nova:name>
Nov 28 11:10:58 user nova-compute[74994]:       <nova:creationTime>2023-11-28 11:10:58</nova:creationTime>
Nov 28 11:10:58 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 11:10:58 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 11:10:58 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 11:10:58 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 11:10:58 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 11:10:58 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 11:10:58 user nova-compute[74994]:       </nova:flavor>
Nov 28 11:10:58 user nova-compute[74994]:       <nova:owner>
Nov 28 11:10:58 user nova-compute[74994]:         <nova:user uuid="7e6dcb9651a945ae95732a246f6a2857">tempest-VolumesActionsTest-1285521872-project-member</nova:user>
Nov 28 11:10:58 user nova-compute[74994]:         <nova:project uuid="d213989fc07742e6a087593430826861">tempest-VolumesActionsTest-1285521872</nova:project>
Nov 28 11:10:58 user nova-compute[74994]:       </nova:owner>
Nov 28 11:10:58 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 11:10:58 user nova-compute[74994]:       <nova:ports>
Nov 28 11:10:58 user nova-compute[74994]:         <nova:port uuid="e3543c90-0e97-4550-9371-32aa9fa1bd91">
Nov 28 11:10:58 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 11:10:58 user nova-compute[74994]:         </nova:port>
Nov 28 11:10:58 user nova-compute[74994]:       </nova:ports>
Nov 28 11:10:58 user nova-compute[74994]:     </nova:instance>
Nov 28 11:10:58 user nova-compute[74994]:   </metadata>
Nov 28 11:10:58 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 11:10:58 user nova-compute[74994]:     <system>
Nov 28 11:10:58 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 11:10:58 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 11:10:58 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 11:10:58 user nova-compute[74994]:       <entry name="serial">53133e7f-b155-4fa5-9f2b-29993200fa90</entry>
Nov 28 11:10:58 user nova-compute[74994]:       <entry name="uuid">53133e7f-b155-4fa5-9f2b-29993200fa90</entry>
Nov 28 11:10:58 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 11:10:58 user nova-compute[74994]:     </system>
Nov 28 11:10:58 user nova-compute[74994]:   </sysinfo>
Nov 28 11:10:58 user nova-compute[74994]:   <os>
Nov 28 11:10:58 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 11:10:58 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 11:10:58 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 11:10:58 user nova-compute[74994]:   </os>
Nov 28 11:10:58 user nova-compute[74994]:   <features>
Nov 28 11:10:58 user nova-compute[74994]:     <acpi/>
Nov 28 11:10:58 user nova-compute[74994]:     <apic/>
Nov 28 11:10:58 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 11:10:58 user nova-compute[74994]:   </features>
Nov 28 11:10:58 user nova-compute[74994]:   <clock offset="utc">
Nov 28 11:10:58 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 11:10:58 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 11:10:58 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 11:10:58 user nova-compute[74994]:   </clock>
Nov 28 11:10:58 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 11:10:58 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 11:10:58 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 11:10:58 user nova-compute[74994]:   </cpu>
Nov 28 11:10:58 user nova-compute[74994]:   <devices>
Nov 28 11:10:58 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 11:10:58 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 11:10:58 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/53133e7f-b155-4fa5-9f2b-29993200fa90/disk"/>
Nov 28 11:10:58 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 11:10:58 user nova-compute[74994]:     </disk>
Nov 28 11:10:58 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 11:10:58 user nova-compute[74994]:       <mac address="fa:16:3e:c8:e5:c2"/>
Nov 28 11:10:58 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:10:58 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 11:10:58 user nova-compute[74994]:       <target dev="tape3543c90-0e"/>
Nov 28 11:10:58 user nova-compute[74994]:     </interface>
Nov 28 11:10:58 user nova-compute[74994]:     <serial type="pty">
Nov 28 11:10:58 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/53133e7f-b155-4fa5-9f2b-29993200fa90/console.log" append="off"/>
Nov 28 11:10:58 user nova-compute[74994]:     </serial>
Nov 28 11:10:58 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 11:10:58 user nova-compute[74994]:     <video>
Nov 28 11:10:58 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:10:58 user nova-compute[74994]:     </video>
Nov 28 11:10:58 user nova-compute[74994]:     <rng model="virtio">
Nov 28 11:10:58 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 11:10:58 user nova-compute[74994]:     </rng>
Nov 28 11:10:58 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 11:10:58 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 11:10:58 user nova-compute[74994]:       <stats period="10"/>
Nov 28 11:10:58 user nova-compute[74994]:     </memballoon>
Nov 28 11:10:58 user nova-compute[74994]:   </devices>
Nov 28 11:10:58 user nova-compute[74994]: </domain>
Nov 28 11:10:58 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 11:10:58 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:10:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1693080050',display_name='tempest-VolumesActionsTest-instance-1693080050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1693080050',id=39,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d213989fc07742e6a087593430826861',ramdisk_id='',reservation_id='r-fp8xfacx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1285521872',owner_user_name='tempest-VolumesActionsTest-1285521872-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:10:57Z,user_data=None,user_id='7e6dcb9651a945ae95732a246f6a2857',uuid=53133e7f-b155-4fa5-9f2b-29993200fa90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3543c90-0e97-4550-9371-32aa9fa1bd91", "address": "fa:16:3e:c8:e5:c2", "network": {"id": "0833228c-a00a-42e2-bcbd-d943e976dc13", "bridge": "br-int", "label": "tempest-VolumesActionsTest-373359983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d213989fc07742e6a087593430826861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3543c90-0e", "ovs_interfaceid": "e3543c90-0e97-4550-9371-32aa9fa1bd91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 11:10:58 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Converting VIF {"id": "e3543c90-0e97-4550-9371-32aa9fa1bd91", "address": "fa:16:3e:c8:e5:c2", "network": {"id": "0833228c-a00a-42e2-bcbd-d943e976dc13", "bridge": "br-int", "label": "tempest-VolumesActionsTest-373359983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d213989fc07742e6a087593430826861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3543c90-0e", "ovs_interfaceid": "e3543c90-0e97-4550-9371-32aa9fa1bd91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:10:58 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:e5:c2,bridge_name='br-int',has_traffic_filtering=True,id=e3543c90-0e97-4550-9371-32aa9fa1bd91,network=Network(0833228c-a00a-42e2-bcbd-d943e976dc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3543c90-0e') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:10:58 user nova-compute[74994]: DEBUG os_vif [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:e5:c2,bridge_name='br-int',has_traffic_filtering=True,id=e3543c90-0e97-4550-9371-32aa9fa1bd91,network=Network(0833228c-a00a-42e2-bcbd-d943e976dc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3543c90-0e') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 11:10:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:10:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:10:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 11:10:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:10:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b10877ee-207e-5626-951a-91213fc55671', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:10:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:10:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:10:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:10:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape3543c90-0e, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:10:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape3543c90-0e, col_values=(('qos', UUID('b49193f4-3678-40d4-a564-b58823281ad9')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:10:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape3543c90-0e, col_values=(('external_ids', {'iface-id': 'e3543c90-0e97-4550-9371-32aa9fa1bd91', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:e5:c2', 'vm-uuid': '53133e7f-b155-4fa5-9f2b-29993200fa90'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:10:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:10:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:10:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:10:58 user nova-compute[74994]: INFO os_vif [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:e5:c2,bridge_name='br-int',has_traffic_filtering=True,id=e3543c90-0e97-4550-9371-32aa9fa1bd91,network=Network(0833228c-a00a-42e2-bcbd-d943e976dc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3543c90-0e')
Nov 28 11:10:58 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:10:58 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] No VIF found with MAC fa:16:3e:c8:e5:c2, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:10:58 user nova-compute[74994]: DEBUG nova.network.neutron [req-1174d29b-43a6-4807-8a2f-02672f6953f3 req-584457bf-2d91-40d0-b809-13bbdea3e2e7 service nova] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Updated VIF entry in instance network info cache for port e3543c90-0e97-4550-9371-32aa9fa1bd91. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:10:58 user nova-compute[74994]: DEBUG nova.network.neutron [req-1174d29b-43a6-4807-8a2f-02672f6953f3 req-584457bf-2d91-40d0-b809-13bbdea3e2e7 service nova] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Updating instance_info_cache with network_info: [{"id": "e3543c90-0e97-4550-9371-32aa9fa1bd91", "address": "fa:16:3e:c8:e5:c2", "network": {"id": "0833228c-a00a-42e2-bcbd-d943e976dc13", "bridge": "br-int", "label": "tempest-VolumesActionsTest-373359983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d213989fc07742e6a087593430826861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3543c90-0e", "ovs_interfaceid": "e3543c90-0e97-4550-9371-32aa9fa1bd91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:10:58 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-1174d29b-43a6-4807-8a2f-02672f6953f3 req-584457bf-2d91-40d0-b809-13bbdea3e2e7 service nova] Releasing lock "refresh_cache-53133e7f-b155-4fa5-9f2b-29993200fa90" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:10:59 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:10:59 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:10:59 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:10:59 user nova-compute[74994]: DEBUG nova.compute.manager [req-e24b97b7-9bed-43b9-856f-270e868595e3 req-2a6c6144-8509-43c6-9aca-6ec620f06135 service nova] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Received event network-vif-plugged-e3543c90-0e97-4550-9371-32aa9fa1bd91 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:10:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-e24b97b7-9bed-43b9-856f-270e868595e3 req-2a6c6144-8509-43c6-9aca-6ec620f06135 service nova] Acquiring lock "53133e7f-b155-4fa5-9f2b-29993200fa90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:10:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-e24b97b7-9bed-43b9-856f-270e868595e3 req-2a6c6144-8509-43c6-9aca-6ec620f06135 service nova] Lock "53133e7f-b155-4fa5-9f2b-29993200fa90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:10:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-e24b97b7-9bed-43b9-856f-270e868595e3 req-2a6c6144-8509-43c6-9aca-6ec620f06135 service nova] Lock "53133e7f-b155-4fa5-9f2b-29993200fa90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:10:59 user nova-compute[74994]: DEBUG nova.compute.manager [req-e24b97b7-9bed-43b9-856f-270e868595e3 req-2a6c6144-8509-43c6-9aca-6ec620f06135 service nova] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] No waiting events found dispatching network-vif-plugged-e3543c90-0e97-4550-9371-32aa9fa1bd91 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:10:59 user nova-compute[74994]: WARNING nova.compute.manager [req-e24b97b7-9bed-43b9-856f-270e868595e3 req-2a6c6144-8509-43c6-9aca-6ec620f06135 service nova] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Received unexpected event network-vif-plugged-e3543c90-0e97-4550-9371-32aa9fa1bd91 for instance with vm_state building and task_state spawning.
Nov 28 11:11:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:01 user nova-compute[74994]: DEBUG nova.compute.manager [req-f2ce6df9-935b-4ab1-a609-1b0abc8b9e71 req-3ab59abd-852d-4f8c-93c3-f043863dbf20 service nova] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Received event network-vif-plugged-e3543c90-0e97-4550-9371-32aa9fa1bd91 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:11:01 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f2ce6df9-935b-4ab1-a609-1b0abc8b9e71 req-3ab59abd-852d-4f8c-93c3-f043863dbf20 service nova] Acquiring lock "53133e7f-b155-4fa5-9f2b-29993200fa90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:11:01 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f2ce6df9-935b-4ab1-a609-1b0abc8b9e71 req-3ab59abd-852d-4f8c-93c3-f043863dbf20 service nova] Lock "53133e7f-b155-4fa5-9f2b-29993200fa90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:11:01 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f2ce6df9-935b-4ab1-a609-1b0abc8b9e71 req-3ab59abd-852d-4f8c-93c3-f043863dbf20 service nova] Lock "53133e7f-b155-4fa5-9f2b-29993200fa90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:11:01 user nova-compute[74994]: DEBUG nova.compute.manager [req-f2ce6df9-935b-4ab1-a609-1b0abc8b9e71 req-3ab59abd-852d-4f8c-93c3-f043863dbf20 service nova] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] No waiting events found dispatching network-vif-plugged-e3543c90-0e97-4550-9371-32aa9fa1bd91 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:11:01 user nova-compute[74994]: WARNING nova.compute.manager [req-f2ce6df9-935b-4ab1-a609-1b0abc8b9e71 req-3ab59abd-852d-4f8c-93c3-f043863dbf20 service nova] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Received unexpected event network-vif-plugged-e3543c90-0e97-4550-9371-32aa9fa1bd91 for instance with vm_state building and task_state spawning.
Nov 28 11:11:02 user nova-compute[74994]: DEBUG nova.compute.manager [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 11:11:02 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 11:11:02 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Instance spawned successfully.
Nov 28 11:11:02 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 11:11:02 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:11:02 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:11:02 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:11:02 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:11:02 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:11:02 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:11:02 user nova-compute[74994]: INFO nova.compute.manager [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Took 5.53 seconds to spawn the instance on the hypervisor.
Nov 28 11:11:02 user nova-compute[74994]: DEBUG nova.compute.manager [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 11:11:02 user nova-compute[74994]: INFO nova.compute.manager [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Took 6.16 seconds to build instance.
Nov 28 11:11:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-29026ef1-2cbf-4b98-b0d2-d1263aefc406 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Lock "53133e7f-b155-4fa5-9f2b-29993200fa90" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.261s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:11:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:10 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f3f60220-2159-41af-a81a-4a49c7b93810 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Acquiring lock "a2caa913-b0cc-46b7-b90d-fe507bc00b09" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:11:10 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f3f60220-2159-41af-a81a-4a49c7b93810 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "a2caa913-b0cc-46b7-b90d-fe507bc00b09" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:11:10 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f3f60220-2159-41af-a81a-4a49c7b93810 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Acquiring lock "a2caa913-b0cc-46b7-b90d-fe507bc00b09-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:11:10 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f3f60220-2159-41af-a81a-4a49c7b93810 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "a2caa913-b0cc-46b7-b90d-fe507bc00b09-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.003s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:11:10 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f3f60220-2159-41af-a81a-4a49c7b93810 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "a2caa913-b0cc-46b7-b90d-fe507bc00b09-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:11:10 user nova-compute[74994]: INFO nova.compute.manager [None req-f3f60220-2159-41af-a81a-4a49c7b93810 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Terminating instance
Nov 28 11:11:10 user nova-compute[74994]: DEBUG nova.compute.manager [None req-f3f60220-2159-41af-a81a-4a49c7b93810 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 11:11:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:10 user nova-compute[74994]: DEBUG nova.compute.manager [req-ef6c5219-fd4a-4735-933c-18c89b720b64 req-b9817722-83b1-42a1-a74b-782cf6a1c62e service nova] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Received event network-vif-unplugged-69c7a712-9905-4a77-a0ae-cd64dbd347fd {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:11:10 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ef6c5219-fd4a-4735-933c-18c89b720b64 req-b9817722-83b1-42a1-a74b-782cf6a1c62e service nova] Acquiring lock "a2caa913-b0cc-46b7-b90d-fe507bc00b09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:11:10 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ef6c5219-fd4a-4735-933c-18c89b720b64 req-b9817722-83b1-42a1-a74b-782cf6a1c62e service nova] Lock "a2caa913-b0cc-46b7-b90d-fe507bc00b09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:11:10 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ef6c5219-fd4a-4735-933c-18c89b720b64 req-b9817722-83b1-42a1-a74b-782cf6a1c62e service nova] Lock "a2caa913-b0cc-46b7-b90d-fe507bc00b09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:11:10 user nova-compute[74994]: DEBUG nova.compute.manager [req-ef6c5219-fd4a-4735-933c-18c89b720b64 req-b9817722-83b1-42a1-a74b-782cf6a1c62e service nova] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] No waiting events found dispatching network-vif-unplugged-69c7a712-9905-4a77-a0ae-cd64dbd347fd {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:11:10 user nova-compute[74994]: DEBUG nova.compute.manager [req-ef6c5219-fd4a-4735-933c-18c89b720b64 req-b9817722-83b1-42a1-a74b-782cf6a1c62e service nova] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Received event network-vif-unplugged-69c7a712-9905-4a77-a0ae-cd64dbd347fd for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 11:11:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:10 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Instance destroyed successfully.
Nov 28 11:11:10 user nova-compute[74994]: DEBUG nova.objects.instance [None req-f3f60220-2159-41af-a81a-4a49c7b93810 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lazy-loading 'resources' on Instance uuid a2caa913-b0cc-46b7-b90d-fe507bc00b09 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:11:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:10 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-f3f60220-2159-41af-a81a-4a49c7b93810 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T11:05:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1217374859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1217374859',id=34,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPC+y5ycUWPYQy2XZB6kzbHT0mcdyeioMthsGLt6Hmxof5Ngy9OG06XF/Ob1BE/FlbLo4NkWH5tRCW3J+w+6D0hmLq2Ga7sCt9VMBIw+oANqnW44474dY78DHKN2+O8dQ==',key_name='tempest-keypair-328848665',keypairs=<?>,launch_index=0,launched_at=2023-11-28T11:09:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d3a4dcdeafd6420d8606b37673e3255f',ramdisk_id='',reservation_id='r-taf8uoy1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1700061593',owner_user_name='tempest-AttachVolumeShelveTestJSON-1700061593-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T11:09:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4e1257b844940bebdeab3061c3e0ab4',uuid=a2caa913-b0cc-46b7-b90d-fe507bc00b09,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69c7a712-9905-4a77-a0ae-cd64dbd347fd", "address": "fa:16:3e:38:2c:b1", "network": {"id": "d46e72ec-d7d5-45f7-951a-b4381f0b472b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-179057367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a4dcdeafd6420d8606b37673e3255f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c7a712-99", "ovs_interfaceid": "69c7a712-9905-4a77-a0ae-cd64dbd347fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 11:11:10 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-f3f60220-2159-41af-a81a-4a49c7b93810 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Converting VIF {"id": "69c7a712-9905-4a77-a0ae-cd64dbd347fd", "address": "fa:16:3e:38:2c:b1", "network": {"id": "d46e72ec-d7d5-45f7-951a-b4381f0b472b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-179057367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a4dcdeafd6420d8606b37673e3255f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c7a712-99", "ovs_interfaceid": "69c7a712-9905-4a77-a0ae-cd64dbd347fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:11:10 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-f3f60220-2159-41af-a81a-4a49c7b93810 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:2c:b1,bridge_name='br-int',has_traffic_filtering=True,id=69c7a712-9905-4a77-a0ae-cd64dbd347fd,network=Network(d46e72ec-d7d5-45f7-951a-b4381f0b472b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69c7a712-99') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:11:10 user nova-compute[74994]: DEBUG os_vif [None req-f3f60220-2159-41af-a81a-4a49c7b93810 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:2c:b1,bridge_name='br-int',has_traffic_filtering=True,id=69c7a712-9905-4a77-a0ae-cd64dbd347fd,network=Network(d46e72ec-d7d5-45f7-951a-b4381f0b472b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69c7a712-99') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 11:11:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69c7a712-99, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:11:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:11:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a5acbe31-36da-4bd6-9ee1-8619d1319bca) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:11:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:10 user nova-compute[74994]: INFO os_vif [None req-f3f60220-2159-41af-a81a-4a49c7b93810 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:2c:b1,bridge_name='br-int',has_traffic_filtering=True,id=69c7a712-9905-4a77-a0ae-cd64dbd347fd,network=Network(d46e72ec-d7d5-45f7-951a-b4381f0b472b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69c7a712-99')
Nov 28 11:11:10 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-f3f60220-2159-41af-a81a-4a49c7b93810 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Deleting instance files /opt/stack/data/nova/instances/a2caa913-b0cc-46b7-b90d-fe507bc00b09_del
Nov 28 11:11:10 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-f3f60220-2159-41af-a81a-4a49c7b93810 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Deletion of /opt/stack/data/nova/instances/a2caa913-b0cc-46b7-b90d-fe507bc00b09_del complete
Nov 28 11:11:10 user nova-compute[74994]: INFO nova.compute.manager [None req-f3f60220-2159-41af-a81a-4a49c7b93810 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 28 11:11:10 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-f3f60220-2159-41af-a81a-4a49c7b93810 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 11:11:10 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 11:11:10 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 11:11:11 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-496d072b-d528-430d-864b-e33bdde480ca tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bea7f301-29d1-454c-856a-71be9b55fed3 is timed out.
Nov 28 11:11:11 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-496d072b-d528-430d-864b-e33bdde480ca tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Successfully detached device vdb from instance bea7f301-29d1-454c-856a-71be9b55fed3 from the live domain config.
Nov 28 11:11:11 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-496d072b-d528-430d-864b-e33bdde480ca tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-496d072b-d528-430d-864b-e33bdde480ca tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:061bb77e-623b-4cff-94f2-9a2429c9edbd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZdricFAL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:11:11 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-496d072b-d528-430d-864b-e33bdde480ca tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:11:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-496d072b-d528-430d-864b-e33bdde480ca tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-496d072b-d528-430d-864b-e33bdde480ca tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbe4d0f-41f7-4f9d-b7b1-ea1edf317fc3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:061bb77e-623b-4cff-94f2-9a2429c9edbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-496d072b-d528-430d-864b-e33bdde480ca tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 11:11:11 user nova-compute[74994]: No targets found.
Nov 28 11:11:11 user nova-compute[74994]: iSNS:
Nov 28 11:11:11 user nova-compute[74994]: No targets found.
Nov 28 11:11:11 user nova-compute[74994]: STATIC:
Nov 28 11:11:11 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:061bb77e-623b-4cff-94f2-9a2429c9edbd
Nov 28 11:11:11 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:11:11 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:11:11 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd
Nov 28 11:11:11 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:11:11 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:11:11 user nova-compute[74994]: FIRMWARE:
Nov 28 11:11:11 user nova-compute[74994]: No targets found.
Nov 28 11:11:11 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-496d072b-d528-430d-864b-e33bdde480ca tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 11:11:11 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 11:11:11 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-496d072b-d528-430d-864b-e33bdde480ca tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:061bb77e-623b-4cff-94f2-9a2429c9edbd', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[09be4041-13bb-48c8-956a-14a75e355192]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:061bb77e-623b-4cff-94f2-9a2429c9edbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4070ca8e-d7fc-4714-9ff0-f60614919c77]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061bb77e-623b-4cff-94f2-9a2429c9edbd (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-496d072b-d528-430d-864b-e33bdde480ca tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)
Nov 28 11:11:11 user nova-compute[74994]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061bb77e-623b-4cff-94f2-9a2429c9edbd (non-flash)
Nov 28 11:11:11 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-496d072b-d528-430d-864b-e33bdde480ca tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)
Nov 28 11:11:11 user nova-compute[74994]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061bb77e-623b-4cff-94f2-9a2429c9edbd (non-flash)
Nov 28 11:11:11 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-496d072b-d528-430d-864b-e33bdde480ca tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb92045c700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:061bb77e-623b-4cff-94f2-9a2429c9edbd'): ({'sdb'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-496d072b-d528-430d-864b-e33bdde480ca tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Removing single pathed devices sdb {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9226954-78a1-4279-adc0-d36a3a4bb670]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff42bd0-e3c4-4a78-994d-c3dbb3233962]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-496d072b-d528-430d-864b-e33bdde480ca tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Flushing IO for device /dev/sdb {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec94c68-b446-4b55-8e46-21080330004b]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-496d072b-d528-430d-864b-e33bdde480ca tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c65e8e-7eab-47f8-8adb-477cacb9adfe]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-496d072b-d528-430d-864b-e33bdde480ca tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-496d072b-d528-430d-864b-e33bdde480ca tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] SCSI volumes sdb have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-496d072b-d528-430d-864b-e33bdde480ca tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:061bb77e-623b-4cff-94f2-9a2429c9edbd')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061bb77e-623b-4cff-94f2-9a2429c9edbd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061bb77e-623b-4cff-94f2-9a2429c9edbd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc89a117-14b8-4c5b-9a5b-cb56af57b934]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-496d072b-d528-430d-864b-e33bdde480ca tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061bb77e-623b-4cff-94f2-9a2429c9edbd -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061bb77e-623b-4cff-94f2-9a2429c9edbd -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[260457bc-88bb-4180-885b-03a617a050f7]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:061bb77e-623b-4cff-94f2-9a2429c9edbd, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:061bb77e-623b-4cff-94f2-9a2429c9edbd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-496d072b-d528-430d-864b-e33bdde480ca tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:061bb77e-623b-4cff-94f2-9a2429c9edbd, portal: 172.16.0.220,3260]
Nov 28 11:11:11 user nova-compute[74994]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:061bb77e-623b-4cff-94f2-9a2429c9edbd, portal: 172.16.0.220,3260] successful.
Nov 28 11:11:11 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061bb77e-623b-4cff-94f2-9a2429c9edbd -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061bb77e-623b-4cff-94f2-9a2429c9edbd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f121df6e-7613-4b2a-9c67-9feea66f0ff8]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-496d072b-d528-430d-864b-e33bdde480ca tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-496d072b-d528-430d-864b-e33bdde480ca tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-496d072b-d528-430d-864b-e33bdde480ca tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] <== disconnect_volume: return (355ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-496d072b-d528-430d-864b-e33bdde480ca tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:11:11 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Took 0.85 seconds to deallocate network for instance.
Nov 28 11:11:11 user nova-compute[74994]: DEBUG nova.compute.manager [req-38bb1e62-0679-4843-9529-96cf4ddfa9ea req-ee4c31a9-d4dd-4f41-9b28-9fcdfc85c4a7 service nova] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Received event network-vif-deleted-69c7a712-9905-4a77-a0ae-cd64dbd347fd {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f3f60220-2159-41af-a81a-4a49c7b93810 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:11:11 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f3f60220-2159-41af-a81a-4a49c7b93810 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:11:12 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-f3f60220-2159-41af-a81a-4a49c7b93810 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:11:12 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-f3f60220-2159-41af-a81a-4a49c7b93810 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:11:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f3f60220-2159-41af-a81a-4a49c7b93810 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:11:12 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-f3f60220-2159-41af-a81a-4a49c7b93810 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Deleted allocations for instance a2caa913-b0cc-46b7-b90d-fe507bc00b09
Nov 28 11:11:12 user nova-compute[74994]: DEBUG nova.compute.manager [req-55bc2ce4-de12-42c8-a64f-97953c95824d req-abcc8bfa-fe63-4f0d-a4f6-19e8a45e69de service nova] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Received event network-vif-plugged-69c7a712-9905-4a77-a0ae-cd64dbd347fd {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:11:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-55bc2ce4-de12-42c8-a64f-97953c95824d req-abcc8bfa-fe63-4f0d-a4f6-19e8a45e69de service nova] Acquiring lock "a2caa913-b0cc-46b7-b90d-fe507bc00b09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:11:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-55bc2ce4-de12-42c8-a64f-97953c95824d req-abcc8bfa-fe63-4f0d-a4f6-19e8a45e69de service nova] Lock "a2caa913-b0cc-46b7-b90d-fe507bc00b09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:11:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-55bc2ce4-de12-42c8-a64f-97953c95824d req-abcc8bfa-fe63-4f0d-a4f6-19e8a45e69de service nova] Lock "a2caa913-b0cc-46b7-b90d-fe507bc00b09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:11:12 user nova-compute[74994]: DEBUG nova.compute.manager [req-55bc2ce4-de12-42c8-a64f-97953c95824d req-abcc8bfa-fe63-4f0d-a4f6-19e8a45e69de service nova] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] No waiting events found dispatching network-vif-plugged-69c7a712-9905-4a77-a0ae-cd64dbd347fd {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:11:12 user nova-compute[74994]: WARNING nova.compute.manager [req-55bc2ce4-de12-42c8-a64f-97953c95824d req-abcc8bfa-fe63-4f0d-a4f6-19e8a45e69de service nova] [instance: a2caa913-b0cc-46b7-b90d-fe507bc00b09] Received unexpected event network-vif-plugged-69c7a712-9905-4a77-a0ae-cd64dbd347fd for instance with vm_state deleted and task_state None.
Nov 28 11:11:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f3f60220-2159-41af-a81a-4a49c7b93810 tempest-AttachVolumeShelveTestJSON-1700061593 tempest-AttachVolumeShelveTestJSON-1700061593-project-member] Lock "a2caa913-b0cc-46b7-b90d-fe507bc00b09" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.383s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:11:12 user nova-compute[74994]: DEBUG nova.objects.instance [None req-496d072b-d528-430d-864b-e33bdde480ca tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lazy-loading 'flavor' on Instance uuid bea7f301-29d1-454c-856a-71be9b55fed3 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:11:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-496d072b-d528-430d-864b-e33bdde480ca tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "bea7f301-29d1-454c-856a-71be9b55fed3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.867s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:11:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:18 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:11:19 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:11:19 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 11:11:19 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bc4a12dd-1382-4aab-b3d7-8bd3b5817b1e tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Acquiring lock "6f2a2617-b00e-4d38-98a0-cca578b95f0e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:11:19 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bc4a12dd-1382-4aab-b3d7-8bd3b5817b1e tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "6f2a2617-b00e-4d38-98a0-cca578b95f0e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:11:19 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bc4a12dd-1382-4aab-b3d7-8bd3b5817b1e tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Acquiring lock "6f2a2617-b00e-4d38-98a0-cca578b95f0e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:11:19 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bc4a12dd-1382-4aab-b3d7-8bd3b5817b1e tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "6f2a2617-b00e-4d38-98a0-cca578b95f0e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:11:19 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bc4a12dd-1382-4aab-b3d7-8bd3b5817b1e tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "6f2a2617-b00e-4d38-98a0-cca578b95f0e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:11:19 user nova-compute[74994]: INFO nova.compute.manager [None req-bc4a12dd-1382-4aab-b3d7-8bd3b5817b1e tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Terminating instance
Nov 28 11:11:19 user nova-compute[74994]: DEBUG nova.compute.manager [None req-bc4a12dd-1382-4aab-b3d7-8bd3b5817b1e tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 11:11:19 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:19 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:19 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:19 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:19 user nova-compute[74994]: DEBUG nova.compute.manager [req-80dbb4bf-b1d8-48a2-bbd9-46d3fc03583d req-b7dcf095-4fb0-4760-9db5-0a04d2d2204c service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Received event network-vif-unplugged-5e571385-8510-4cdd-ae39-ebd481e04a59 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:11:19 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-80dbb4bf-b1d8-48a2-bbd9-46d3fc03583d req-b7dcf095-4fb0-4760-9db5-0a04d2d2204c service nova] Acquiring lock "6f2a2617-b00e-4d38-98a0-cca578b95f0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:11:19 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-80dbb4bf-b1d8-48a2-bbd9-46d3fc03583d req-b7dcf095-4fb0-4760-9db5-0a04d2d2204c service nova] Lock "6f2a2617-b00e-4d38-98a0-cca578b95f0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:11:19 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-80dbb4bf-b1d8-48a2-bbd9-46d3fc03583d req-b7dcf095-4fb0-4760-9db5-0a04d2d2204c service nova] Lock "6f2a2617-b00e-4d38-98a0-cca578b95f0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:11:19 user nova-compute[74994]: DEBUG nova.compute.manager [req-80dbb4bf-b1d8-48a2-bbd9-46d3fc03583d req-b7dcf095-4fb0-4760-9db5-0a04d2d2204c service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] No waiting events found dispatching network-vif-unplugged-5e571385-8510-4cdd-ae39-ebd481e04a59 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:11:19 user nova-compute[74994]: DEBUG nova.compute.manager [req-80dbb4bf-b1d8-48a2-bbd9-46d3fc03583d req-b7dcf095-4fb0-4760-9db5-0a04d2d2204c service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Received event network-vif-unplugged-5e571385-8510-4cdd-ae39-ebd481e04a59 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 11:11:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:20 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Instance destroyed successfully.
Nov 28 11:11:20 user nova-compute[74994]: DEBUG nova.objects.instance [None req-bc4a12dd-1382-4aab-b3d7-8bd3b5817b1e tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lazy-loading 'resources' on Instance uuid 6f2a2617-b00e-4d38-98a0-cca578b95f0e {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:11:20 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-bc4a12dd-1382-4aab-b3d7-8bd3b5817b1e tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:06:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-296035444',display_name='tempest-TestMinimumBasicScenario-server-296035444',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-296035444',id=36,image_ref='b21e7b65-3fcd-47eb-9049-6107312cf158',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKsXfdwtbuiSkzh8n1hH3biCADc9dOng+NIhhSAsGkiVH3nT+6DmOVQKMzKS1b3MDm4Qq5GZrs0ayvMtPCGozPYZXRugqpHoak1BLnDAWzKwZZQWioftsJSD9qS8Ye+hxg==',key_name='tempest-TestMinimumBasicScenario-568006080',keypairs=<?>,launch_index=0,launched_at=2023-11-28T11:06:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9670a509ac14f41a9f44d7299fd2f30',ramdisk_id='',reservation_id='r-d2mmhrgx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b21e7b65-3fcd-47eb-9049-6107312cf158',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-756572202',owner_user_name='tempest-TestMinimumBasicScenario-756572202-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T11:08:39Z,user_data=None,user_id='18ba016046ac42599094e626d3fdd860',uuid=6f2a2617-b00e-4d38-98a0-cca578b95f0e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e571385-8510-4cdd-ae39-ebd481e04a59", "address": "fa:16:3e:83:bf:50", "network": {"id": "89f2b906-9ef3-4e31-87e5-3e0cd23e8695", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2005181920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9670a509ac14f41a9f44d7299fd2f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e571385-85", "ovs_interfaceid": "5e571385-8510-4cdd-ae39-ebd481e04a59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 11:11:20 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-bc4a12dd-1382-4aab-b3d7-8bd3b5817b1e tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Converting VIF {"id": "5e571385-8510-4cdd-ae39-ebd481e04a59", "address": "fa:16:3e:83:bf:50", "network": {"id": "89f2b906-9ef3-4e31-87e5-3e0cd23e8695", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2005181920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9670a509ac14f41a9f44d7299fd2f30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e571385-85", "ovs_interfaceid": "5e571385-8510-4cdd-ae39-ebd481e04a59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:11:20 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-bc4a12dd-1382-4aab-b3d7-8bd3b5817b1e tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:bf:50,bridge_name='br-int',has_traffic_filtering=True,id=5e571385-8510-4cdd-ae39-ebd481e04a59,network=Network(89f2b906-9ef3-4e31-87e5-3e0cd23e8695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e571385-85') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:11:20 user nova-compute[74994]: DEBUG os_vif [None req-bc4a12dd-1382-4aab-b3d7-8bd3b5817b1e tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:bf:50,bridge_name='br-int',has_traffic_filtering=True,id=5e571385-8510-4cdd-ae39-ebd481e04a59,network=Network(89f2b906-9ef3-4e31-87e5-3e0cd23e8695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e571385-85') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 11:11:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e571385-85, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:11:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:11:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e49e7353-a4b5-477f-9bb6-4ebf2a564c31) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:11:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:20 user nova-compute[74994]: INFO os_vif [None req-bc4a12dd-1382-4aab-b3d7-8bd3b5817b1e tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:bf:50,bridge_name='br-int',has_traffic_filtering=True,id=5e571385-8510-4cdd-ae39-ebd481e04a59,network=Network(89f2b906-9ef3-4e31-87e5-3e0cd23e8695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e571385-85')
Nov 28 11:11:20 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-bc4a12dd-1382-4aab-b3d7-8bd3b5817b1e tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Deleting instance files /opt/stack/data/nova/instances/6f2a2617-b00e-4d38-98a0-cca578b95f0e_del
Nov 28 11:11:20 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-bc4a12dd-1382-4aab-b3d7-8bd3b5817b1e tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Deletion of /opt/stack/data/nova/instances/6f2a2617-b00e-4d38-98a0-cca578b95f0e_del complete
Nov 28 11:11:20 user nova-compute[74994]: INFO nova.compute.manager [None req-bc4a12dd-1382-4aab-b3d7-8bd3b5817b1e tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 28 11:11:20 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-bc4a12dd-1382-4aab-b3d7-8bd3b5817b1e tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 11:11:20 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 11:11:20 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 11:11:20 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:11:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:11:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:11:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:11:20 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 11:11:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:11:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:11:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:11:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:11:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7295ae8a-462e-4b75-af40-35aac439dad0/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:11:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7295ae8a-462e-4b75-af40-35aac439dad0/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:11:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7295ae8a-462e-4b75-af40-35aac439dad0/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:11:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7295ae8a-462e-4b75-af40-35aac439dad0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:11:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53133e7f-b155-4fa5-9f2b-29993200fa90/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:11:21 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:11:21 user nova-compute[74994]: DEBUG nova.compute.manager [req-3ee85392-757b-4f37-93e9-91eb0c2c2642 req-eb86ad93-4941-4db3-b0c3-39a1c38820f7 service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Received event network-vif-deleted-5e571385-8510-4cdd-ae39-ebd481e04a59 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:11:21 user nova-compute[74994]: INFO nova.compute.manager [req-3ee85392-757b-4f37-93e9-91eb0c2c2642 req-eb86ad93-4941-4db3-b0c3-39a1c38820f7 service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Neutron deleted interface 5e571385-8510-4cdd-ae39-ebd481e04a59; detaching it from the instance and deleting it from the info cache
Nov 28 11:11:21 user nova-compute[74994]: DEBUG nova.network.neutron [req-3ee85392-757b-4f37-93e9-91eb0c2c2642 req-eb86ad93-4941-4db3-b0c3-39a1c38820f7 service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:11:21 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Took 1.12 seconds to deallocate network for instance.
Nov 28 11:11:21 user nova-compute[74994]: DEBUG nova.compute.manager [req-3ee85392-757b-4f37-93e9-91eb0c2c2642 req-eb86ad93-4941-4db3-b0c3-39a1c38820f7 service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Detach interface failed, port_id=5e571385-8510-4cdd-ae39-ebd481e04a59, reason: Instance 6f2a2617-b00e-4d38-98a0-cca578b95f0e could not be found. {{(pid=74994) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 11:11:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53133e7f-b155-4fa5-9f2b-29993200fa90/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:11:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53133e7f-b155-4fa5-9f2b-29993200fa90/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:11:21 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bc4a12dd-1382-4aab-b3d7-8bd3b5817b1e tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:11:21 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bc4a12dd-1382-4aab-b3d7-8bd3b5817b1e tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:11:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53133e7f-b155-4fa5-9f2b-29993200fa90/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:11:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bea7f301-29d1-454c-856a-71be9b55fed3/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:11:21 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-bc4a12dd-1382-4aab-b3d7-8bd3b5817b1e tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:11:21 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-bc4a12dd-1382-4aab-b3d7-8bd3b5817b1e tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:11:21 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bc4a12dd-1382-4aab-b3d7-8bd3b5817b1e tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.343s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:11:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bea7f301-29d1-454c-856a-71be9b55fed3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:11:21 user nova-compute[74994]: DEBUG nova.compute.manager [req-9e1860ba-9309-44d6-bf1a-1d9cd5dc4a72 req-3539e689-e15b-40d0-ad06-46d5b32d9b81 service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Received event network-vif-plugged-5e571385-8510-4cdd-ae39-ebd481e04a59 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:11:21 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9e1860ba-9309-44d6-bf1a-1d9cd5dc4a72 req-3539e689-e15b-40d0-ad06-46d5b32d9b81 service nova] Acquiring lock "6f2a2617-b00e-4d38-98a0-cca578b95f0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:11:21 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9e1860ba-9309-44d6-bf1a-1d9cd5dc4a72 req-3539e689-e15b-40d0-ad06-46d5b32d9b81 service nova] Lock "6f2a2617-b00e-4d38-98a0-cca578b95f0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:11:21 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9e1860ba-9309-44d6-bf1a-1d9cd5dc4a72 req-3539e689-e15b-40d0-ad06-46d5b32d9b81 service nova] Lock "6f2a2617-b00e-4d38-98a0-cca578b95f0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:11:21 user nova-compute[74994]: DEBUG nova.compute.manager [req-9e1860ba-9309-44d6-bf1a-1d9cd5dc4a72 req-3539e689-e15b-40d0-ad06-46d5b32d9b81 service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] No waiting events found dispatching network-vif-plugged-5e571385-8510-4cdd-ae39-ebd481e04a59 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:11:21 user nova-compute[74994]: WARNING nova.compute.manager [req-9e1860ba-9309-44d6-bf1a-1d9cd5dc4a72 req-3539e689-e15b-40d0-ad06-46d5b32d9b81 service nova] [instance: 6f2a2617-b00e-4d38-98a0-cca578b95f0e] Received unexpected event network-vif-plugged-5e571385-8510-4cdd-ae39-ebd481e04a59 for instance with vm_state deleted and task_state None.
Nov 28 11:11:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bea7f301-29d1-454c-856a-71be9b55fed3/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:11:22 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-bc4a12dd-1382-4aab-b3d7-8bd3b5817b1e tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Deleted allocations for instance 6f2a2617-b00e-4d38-98a0-cca578b95f0e
Nov 28 11:11:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bc4a12dd-1382-4aab-b3d7-8bd3b5817b1e tempest-TestMinimumBasicScenario-756572202 tempest-TestMinimumBasicScenario-756572202-project-member] Lock "6f2a2617-b00e-4d38-98a0-cca578b95f0e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.604s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:11:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bea7f301-29d1-454c-856a-71be9b55fed3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:11:22 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:11:22 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:11:22 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:11:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=8278MB free_disk=24.980121612548828GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 11:11:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:11:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:11:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 20716905-c56a-4729-8c5b-9188502dc477 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:11:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 7295ae8a-462e-4b75-af40-35aac439dad0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:11:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance e3b0b960-3f38-4a6f-9017-209fbc2110c9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:11:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance bea7f301-29d1-454c-856a-71be9b55fed3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:11:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 53133e7f-b155-4fa5-9f2b-29993200fa90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:11:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 11:11:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 11:11:22 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:11:22 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:11:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 11:11:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.285s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:11:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:25 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:11:25 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:11:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:29 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:11:29 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:11:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:30 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:11:30 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 11:11:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "refresh_cache-7295ae8a-462e-4b75-af40-35aac439dad0" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:11:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquired lock "refresh_cache-7295ae8a-462e-4b75-af40-35aac439dad0" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:11:30 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Forcefully refreshing network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 11:11:31 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Updating instance_info_cache with network_info: [{"id": "281bdb45-f23e-4ec0-a536-80a82491d3ff", "address": "fa:16:3e:14:2e:38", "network": {"id": "962e3ca9-e99b-49cd-bb50-c34d108cdfa7", "bridge": "br-int", "label": "tempest-TestStampPattern-359277306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30dae8b62e14c50b9646b13af2a4258", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281bdb45-f2", "ovs_interfaceid": "281bdb45-f23e-4ec0-a536-80a82491d3ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:11:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Releasing lock "refresh_cache-7295ae8a-462e-4b75-af40-35aac439dad0" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:11:31 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Updated the network info_cache for instance {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 11:11:32 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:11:34 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:11:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:11:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:11:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:11:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:11:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:11:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:41 user nova-compute[74994]: DEBUG nova.compute.manager [req-1934ae5a-d963-43b0-869f-038e037b29b4 req-1616c687-34d7-4a32-af99-59e065780b05 service nova] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Received event network-changed-d326e9a1-1c44-4c63-9fb0-a22056ee25b5 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:11:41 user nova-compute[74994]: DEBUG nova.compute.manager [req-1934ae5a-d963-43b0-869f-038e037b29b4 req-1616c687-34d7-4a32-af99-59e065780b05 service nova] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Refreshing instance network info cache due to event network-changed-d326e9a1-1c44-4c63-9fb0-a22056ee25b5. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:11:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-1934ae5a-d963-43b0-869f-038e037b29b4 req-1616c687-34d7-4a32-af99-59e065780b05 service nova] Acquiring lock "refresh_cache-bea7f301-29d1-454c-856a-71be9b55fed3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:11:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-1934ae5a-d963-43b0-869f-038e037b29b4 req-1616c687-34d7-4a32-af99-59e065780b05 service nova] Acquired lock "refresh_cache-bea7f301-29d1-454c-856a-71be9b55fed3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:11:41 user nova-compute[74994]: DEBUG nova.network.neutron [req-1934ae5a-d963-43b0-869f-038e037b29b4 req-1616c687-34d7-4a32-af99-59e065780b05 service nova] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Refreshing network info cache for port d326e9a1-1c44-4c63-9fb0-a22056ee25b5 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:11:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8c7771f2-d0e4-4a3f-947c-dd963b459aa9 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Acquiring lock "bea7f301-29d1-454c-856a-71be9b55fed3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:11:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8c7771f2-d0e4-4a3f-947c-dd963b459aa9 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "bea7f301-29d1-454c-856a-71be9b55fed3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:11:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8c7771f2-d0e4-4a3f-947c-dd963b459aa9 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Acquiring lock "bea7f301-29d1-454c-856a-71be9b55fed3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:11:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8c7771f2-d0e4-4a3f-947c-dd963b459aa9 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "bea7f301-29d1-454c-856a-71be9b55fed3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:11:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8c7771f2-d0e4-4a3f-947c-dd963b459aa9 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "bea7f301-29d1-454c-856a-71be9b55fed3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:11:41 user nova-compute[74994]: INFO nova.compute.manager [None req-8c7771f2-d0e4-4a3f-947c-dd963b459aa9 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Terminating instance
Nov 28 11:11:41 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8c7771f2-d0e4-4a3f-947c-dd963b459aa9 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 11:11:41 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:41 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:41 user nova-compute[74994]: DEBUG nova.network.neutron [req-1934ae5a-d963-43b0-869f-038e037b29b4 req-1616c687-34d7-4a32-af99-59e065780b05 service nova] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Updated VIF entry in instance network info cache for port d326e9a1-1c44-4c63-9fb0-a22056ee25b5. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:11:41 user nova-compute[74994]: DEBUG nova.network.neutron [req-1934ae5a-d963-43b0-869f-038e037b29b4 req-1616c687-34d7-4a32-af99-59e065780b05 service nova] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Updating instance_info_cache with network_info: [{"id": "d326e9a1-1c44-4c63-9fb0-a22056ee25b5", "address": "fa:16:3e:d7:87:35", "network": {"id": "962e3ca9-e99b-49cd-bb50-c34d108cdfa7", "bridge": "br-int", "label": "tempest-TestStampPattern-359277306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30dae8b62e14c50b9646b13af2a4258", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd326e9a1-1c", "ovs_interfaceid": "d326e9a1-1c44-4c63-9fb0-a22056ee25b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:11:41 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-1934ae5a-d963-43b0-869f-038e037b29b4 req-1616c687-34d7-4a32-af99-59e065780b05 service nova] Releasing lock "refresh_cache-bea7f301-29d1-454c-856a-71be9b55fed3" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:11:41 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:41 user nova-compute[74994]: DEBUG nova.compute.manager [req-c1b635ee-8795-46ef-9501-8d4ffc52a0a4 req-74697511-2b9b-4751-9938-75234ada249c service nova] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Received event network-vif-unplugged-d326e9a1-1c44-4c63-9fb0-a22056ee25b5 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:11:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c1b635ee-8795-46ef-9501-8d4ffc52a0a4 req-74697511-2b9b-4751-9938-75234ada249c service nova] Acquiring lock "bea7f301-29d1-454c-856a-71be9b55fed3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:11:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c1b635ee-8795-46ef-9501-8d4ffc52a0a4 req-74697511-2b9b-4751-9938-75234ada249c service nova] Lock "bea7f301-29d1-454c-856a-71be9b55fed3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:11:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c1b635ee-8795-46ef-9501-8d4ffc52a0a4 req-74697511-2b9b-4751-9938-75234ada249c service nova] Lock "bea7f301-29d1-454c-856a-71be9b55fed3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:11:41 user nova-compute[74994]: DEBUG nova.compute.manager [req-c1b635ee-8795-46ef-9501-8d4ffc52a0a4 req-74697511-2b9b-4751-9938-75234ada249c service nova] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] No waiting events found dispatching network-vif-unplugged-d326e9a1-1c44-4c63-9fb0-a22056ee25b5 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:11:41 user nova-compute[74994]: DEBUG nova.compute.manager [req-c1b635ee-8795-46ef-9501-8d4ffc52a0a4 req-74697511-2b9b-4751-9938-75234ada249c service nova] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Received event network-vif-unplugged-d326e9a1-1c44-4c63-9fb0-a22056ee25b5 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 11:11:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:42 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Instance destroyed successfully.
Nov 28 11:11:42 user nova-compute[74994]: DEBUG nova.objects.instance [None req-8c7771f2-d0e4-4a3f-947c-dd963b459aa9 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lazy-loading 'resources' on Instance uuid bea7f301-29d1-454c-856a-71be9b55fed3 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:11:42 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-8c7771f2-d0e4-4a3f-947c-dd963b459aa9 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:08:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-580116615',display_name='tempest-TestStampPattern-server-580116615',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-580116615',id=38,image_ref='d624da83-945e-4296-a3cf-d729c0170fed',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLhnKlLbDzesoIgRgKjSwDSGDLbJAHMlDTp+nQM/ojqr/PUamcvyDrok1u7+9cOZfKML/zTkQ8RQndwU5iipCM38Od6vAR2Ip4VAwZazka1mUHBKbAYcoeh2nwnJCVXag==',key_name='tempest-TestStampPattern-30928350',keypairs=<?>,launch_index=0,launched_at=2023-11-28T11:08:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c30dae8b62e14c50b9646b13af2a4258',ramdisk_id='',reservation_id='r-dve1xq6y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='7295ae8a-462e-4b75-af40-35aac439dad0',image_min_disk='1',image_min_ram='0',image_owner_id='c30dae8b62e14c50b9646b13af2a4258',image_owner_project_name='tempest-TestStampPattern-848738200',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-848738200-project-member',image_user_id='c362617247be45c390a743c3a80e1f63',owner_project_name='tempest-TestStampPattern-848738200',owner_user_name='tempest-TestStampPattern-848738200-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T11:08:54Z,user_data=None,user_id='c362617247be45c390a743c3a80e1f63',uuid=bea7f301-29d1-454c-856a-71be9b55fed3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d326e9a1-1c44-4c63-9fb0-a22056ee25b5", "address": "fa:16:3e:d7:87:35", "network": {"id": "962e3ca9-e99b-49cd-bb50-c34d108cdfa7", "bridge": "br-int", "label": "tempest-TestStampPattern-359277306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30dae8b62e14c50b9646b13af2a4258", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd326e9a1-1c", "ovs_interfaceid": "d326e9a1-1c44-4c63-9fb0-a22056ee25b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 11:11:42 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-8c7771f2-d0e4-4a3f-947c-dd963b459aa9 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Converting VIF {"id": "d326e9a1-1c44-4c63-9fb0-a22056ee25b5", "address": "fa:16:3e:d7:87:35", "network": {"id": "962e3ca9-e99b-49cd-bb50-c34d108cdfa7", "bridge": "br-int", "label": "tempest-TestStampPattern-359277306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30dae8b62e14c50b9646b13af2a4258", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd326e9a1-1c", "ovs_interfaceid": "d326e9a1-1c44-4c63-9fb0-a22056ee25b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:11:42 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-8c7771f2-d0e4-4a3f-947c-dd963b459aa9 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:87:35,bridge_name='br-int',has_traffic_filtering=True,id=d326e9a1-1c44-4c63-9fb0-a22056ee25b5,network=Network(962e3ca9-e99b-49cd-bb50-c34d108cdfa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd326e9a1-1c') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:11:42 user nova-compute[74994]: DEBUG os_vif [None req-8c7771f2-d0e4-4a3f-947c-dd963b459aa9 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:87:35,bridge_name='br-int',has_traffic_filtering=True,id=d326e9a1-1c44-4c63-9fb0-a22056ee25b5,network=Network(962e3ca9-e99b-49cd-bb50-c34d108cdfa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd326e9a1-1c') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 11:11:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd326e9a1-1c, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:11:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:11:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c43604b6-d2db-4b3a-970d-24b4d6df8850) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:11:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:42 user nova-compute[74994]: INFO os_vif [None req-8c7771f2-d0e4-4a3f-947c-dd963b459aa9 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:87:35,bridge_name='br-int',has_traffic_filtering=True,id=d326e9a1-1c44-4c63-9fb0-a22056ee25b5,network=Network(962e3ca9-e99b-49cd-bb50-c34d108cdfa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd326e9a1-1c')
Nov 28 11:11:42 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-8c7771f2-d0e4-4a3f-947c-dd963b459aa9 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Deleting instance files /opt/stack/data/nova/instances/bea7f301-29d1-454c-856a-71be9b55fed3_del
Nov 28 11:11:42 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-8c7771f2-d0e4-4a3f-947c-dd963b459aa9 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Deletion of /opt/stack/data/nova/instances/bea7f301-29d1-454c-856a-71be9b55fed3_del complete
Nov 28 11:11:42 user nova-compute[74994]: INFO nova.compute.manager [None req-8c7771f2-d0e4-4a3f-947c-dd963b459aa9 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 28 11:11:42 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-8c7771f2-d0e4-4a3f-947c-dd963b459aa9 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 11:11:42 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 11:11:42 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 11:11:42 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:11:42 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Took 0.49 seconds to deallocate network for instance.
Nov 28 11:11:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8c7771f2-d0e4-4a3f-947c-dd963b459aa9 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:11:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8c7771f2-d0e4-4a3f-947c-dd963b459aa9 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:11:43 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8c7771f2-d0e4-4a3f-947c-dd963b459aa9 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:11:43 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8c7771f2-d0e4-4a3f-947c-dd963b459aa9 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:11:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8c7771f2-d0e4-4a3f-947c-dd963b459aa9 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.197s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:11:43 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-8c7771f2-d0e4-4a3f-947c-dd963b459aa9 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Deleted allocations for instance bea7f301-29d1-454c-856a-71be9b55fed3
Nov 28 11:11:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8c7771f2-d0e4-4a3f-947c-dd963b459aa9 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "bea7f301-29d1-454c-856a-71be9b55fed3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.730s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:11:43 user nova-compute[74994]: DEBUG nova.compute.manager [req-a1886b3d-d08f-4606-956f-07bafe9cd609 req-797381b0-9205-4082-af98-6f816f309397 service nova] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Received event network-vif-deleted-d326e9a1-1c44-4c63-9fb0-a22056ee25b5 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:11:44 user nova-compute[74994]: DEBUG nova.compute.manager [req-100c5771-89fd-4934-b09a-410d22ef8388 req-0fc7aa95-9832-451d-a823-6cf81a5261b3 service nova] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Received event network-vif-plugged-d326e9a1-1c44-4c63-9fb0-a22056ee25b5 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:11:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-100c5771-89fd-4934-b09a-410d22ef8388 req-0fc7aa95-9832-451d-a823-6cf81a5261b3 service nova] Acquiring lock "bea7f301-29d1-454c-856a-71be9b55fed3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:11:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-100c5771-89fd-4934-b09a-410d22ef8388 req-0fc7aa95-9832-451d-a823-6cf81a5261b3 service nova] Lock "bea7f301-29d1-454c-856a-71be9b55fed3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:11:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-100c5771-89fd-4934-b09a-410d22ef8388 req-0fc7aa95-9832-451d-a823-6cf81a5261b3 service nova] Lock "bea7f301-29d1-454c-856a-71be9b55fed3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:11:44 user nova-compute[74994]: DEBUG nova.compute.manager [req-100c5771-89fd-4934-b09a-410d22ef8388 req-0fc7aa95-9832-451d-a823-6cf81a5261b3 service nova] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] No waiting events found dispatching network-vif-plugged-d326e9a1-1c44-4c63-9fb0-a22056ee25b5 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:11:44 user nova-compute[74994]: WARNING nova.compute.manager [req-100c5771-89fd-4934-b09a-410d22ef8388 req-0fc7aa95-9832-451d-a823-6cf81a5261b3 service nova] [instance: bea7f301-29d1-454c-856a-71be9b55fed3] Received unexpected event network-vif-plugged-d326e9a1-1c44-4c63-9fb0-a22056ee25b5 for instance with vm_state deleted and task_state None.
Nov 28 11:11:47 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:11:54 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-606719ad-d68d-4640-aa38-d7ad2da6b1e8 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:11:54 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-606719ad-d68d-4640-aa38-d7ad2da6b1e8 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:11:54 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-606719ad-d68d-4640-aa38-d7ad2da6b1e8 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:11:54 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-606719ad-d68d-4640-aa38-d7ad2da6b1e8 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:11:54 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-606719ad-d68d-4640-aa38-d7ad2da6b1e8 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:11:54 user nova-compute[74994]: INFO nova.compute.manager [None req-606719ad-d68d-4640-aa38-d7ad2da6b1e8 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Terminating instance
Nov 28 11:11:54 user nova-compute[74994]: DEBUG nova.compute.manager [None req-606719ad-d68d-4640-aa38-d7ad2da6b1e8 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG nova.compute.manager [req-1af330ca-7ad1-4b95-8388-76f41aa73a57 req-5c15e5b5-2f0c-48ba-b0a2-f3e5b1a8845e service nova] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Received event network-vif-unplugged-17fb7783-f3dc-41cf-b838-004f2048fdbc {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-1af330ca-7ad1-4b95-8388-76f41aa73a57 req-5c15e5b5-2f0c-48ba-b0a2-f3e5b1a8845e service nova] Acquiring lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-1af330ca-7ad1-4b95-8388-76f41aa73a57 req-5c15e5b5-2f0c-48ba-b0a2-f3e5b1a8845e service nova] Lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-1af330ca-7ad1-4b95-8388-76f41aa73a57 req-5c15e5b5-2f0c-48ba-b0a2-f3e5b1a8845e service nova] Lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG nova.compute.manager [req-1af330ca-7ad1-4b95-8388-76f41aa73a57 req-5c15e5b5-2f0c-48ba-b0a2-f3e5b1a8845e service nova] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] No waiting events found dispatching network-vif-unplugged-17fb7783-f3dc-41cf-b838-004f2048fdbc {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG nova.compute.manager [req-1af330ca-7ad1-4b95-8388-76f41aa73a57 req-5c15e5b5-2f0c-48ba-b0a2-f3e5b1a8845e service nova] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Received event network-vif-unplugged-17fb7783-f3dc-41cf-b838-004f2048fdbc for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:55 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Instance destroyed successfully.
Nov 28 11:11:55 user nova-compute[74994]: DEBUG nova.objects.instance [None req-606719ad-d68d-4640-aa38-d7ad2da6b1e8 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lazy-loading 'resources' on Instance uuid e3b0b960-3f38-4a6f-9017-209fbc2110c9 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-606719ad-d68d-4640-aa38-d7ad2da6b1e8 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:05:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1667657680',display_name='tempest-ServerActionsTestOtherA-server-1667657680',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1667657680',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPW6Lty9ow0zAcm936yuU8WeLpHxpamSCaeKsFRdduK4jmYnIbGWXIhKjvJDlhN8evt/Hb3F2U1wYmR8qRXarp7uOZi0MsdjDWCq+Ku3i87+sooae0XVTHruzSkrMSatFQ==',key_name='tempest-keypair-1409463142',keypairs=<?>,launch_index=0,launched_at=2023-11-28T11:07:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5eb43a8fc7bd47728600741762f71112',ramdisk_id='',reservation_id='r-d1wwwslj',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1927948343',owner_user_name='tempest-ServerActionsTestOtherA-1927948343-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T11:09:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d51be473c7284977a6533756a1f677f9',uuid=e3b0b960-3f38-4a6f-9017-209fbc2110c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "17fb7783-f3dc-41cf-b838-004f2048fdbc", "address": "fa:16:3e:b7:31:25", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17fb7783-f3", "ovs_interfaceid": "17fb7783-f3dc-41cf-b838-004f2048fdbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-606719ad-d68d-4640-aa38-d7ad2da6b1e8 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Converting VIF {"id": "17fb7783-f3dc-41cf-b838-004f2048fdbc", "address": "fa:16:3e:b7:31:25", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17fb7783-f3", "ovs_interfaceid": "17fb7783-f3dc-41cf-b838-004f2048fdbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-606719ad-d68d-4640-aa38-d7ad2da6b1e8 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:31:25,bridge_name='br-int',has_traffic_filtering=True,id=17fb7783-f3dc-41cf-b838-004f2048fdbc,network=Network(16dd32cd-5a00-4111-92e2-283e7635540f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17fb7783-f3') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG os_vif [None req-606719ad-d68d-4640-aa38-d7ad2da6b1e8 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:31:25,bridge_name='br-int',has_traffic_filtering=True,id=17fb7783-f3dc-41cf-b838-004f2048fdbc,network=Network(16dd32cd-5a00-4111-92e2-283e7635540f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17fb7783-f3') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap17fb7783-f3, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eff8028c-3d4b-459f-a84d-2dc167607dae) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:55 user nova-compute[74994]: INFO os_vif [None req-606719ad-d68d-4640-aa38-d7ad2da6b1e8 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:31:25,bridge_name='br-int',has_traffic_filtering=True,id=17fb7783-f3dc-41cf-b838-004f2048fdbc,network=Network(16dd32cd-5a00-4111-92e2-283e7635540f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17fb7783-f3')
Nov 28 11:11:55 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-606719ad-d68d-4640-aa38-d7ad2da6b1e8 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-606719ad-d68d-4640-aa38-d7ad2da6b1e8 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kCgmHZjw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:11:55 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-606719ad-d68d-4640-aa38-d7ad2da6b1e8 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:11:55 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-606719ad-d68d-4640-aa38-d7ad2da6b1e8 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-606719ad-d68d-4640-aa38-d7ad2da6b1e8 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d506ff1-8505-4528-a555-056d9db47a21]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-606719ad-d68d-4640-aa38-d7ad2da6b1e8 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 11:11:55 user nova-compute[74994]: No targets found.
Nov 28 11:11:55 user nova-compute[74994]: iSNS:
Nov 28 11:11:55 user nova-compute[74994]: No targets found.
Nov 28 11:11:55 user nova-compute[74994]: STATIC:
Nov 28 11:11:55 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd
Nov 28 11:11:55 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:11:55 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:11:55 user nova-compute[74994]: FIRMWARE:
Nov 28 11:11:55 user nova-compute[74994]: No targets found.
Nov 28 11:11:55 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-606719ad-d68d-4640-aa38-d7ad2da6b1e8 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 11:11:55 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 11:11:55 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-606719ad-d68d-4640-aa38-d7ad2da6b1e8 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4100a794-381c-4932-a2a4-6c53f170afc8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb1bcd2-0cd7-412c-b5f9-9cd113604656]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-606719ad-d68d-4640-aa38-d7ad2da6b1e8 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)
Nov 28 11:11:55 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-606719ad-d68d-4640-aa38-d7ad2da6b1e8 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd (non-flash)
Nov 28 11:11:55 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-606719ad-d68d-4640-aa38-d7ad2da6b1e8 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9206e1f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd'): ({'sdd'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-606719ad-d68d-4640-aa38-d7ad2da6b1e8 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Removing single pathed devices sdd {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87cae60-b9ce-4776-9417-4e8794e1ba1e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a091ae6-ffcd-4dfb-b1a1-30fea13e6548]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-606719ad-d68d-4640-aa38-d7ad2da6b1e8 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Flushing IO for device /dev/sdd {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd50be9c-6ffd-4b84-91e6-d4c81aa0f0ef]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-606719ad-d68d-4640-aa38-d7ad2da6b1e8 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:55 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:11:56 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:11:56 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe6535d-a810-4d1d-8eea-435d4528019c]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:11:56 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-606719ad-d68d-4640-aa38-d7ad2da6b1e8 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 11:11:56 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-606719ad-d68d-4640-aa38-d7ad2da6b1e8 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] SCSI volumes sdd have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 11:11:56 user nova-compute[74994]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO42f3447-822b57b28999cfd5', '/dev/disk/by-id/scsi-23832326235376232', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_42f3447') {{(pid=86494) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 11:11:56 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0540b152-6df9-4d08-90f6-625955284c68]: (4, None) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:11:56 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-606719ad-d68d-4640-aa38-d7ad2da6b1e8 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 11:11:56 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:11:56 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:11:56 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e0f752-7e7f-4414-90ad-4932d4df0ee0]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:11:56 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-606719ad-d68d-4640-aa38-d7ad2da6b1e8 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:11:56 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:11:56 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd -p 172.16.0.220:3260 --logout" returned: 0 in 0.026s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:11:56 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df0b464-c46b-478f-bb86-9db2433cfb50]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:11:56 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-606719ad-d68d-4640-aa38-d7ad2da6b1e8 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd, portal: 172.16.0.220,3260]
Nov 28 11:11:56 user nova-compute[74994]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd, portal: 172.16.0.220,3260] successful.
Nov 28 11:11:56 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:11:56 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:11:56 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc3edc15-080f-4593-9a75-5d2719dfe0dd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:11:56 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7894aa5e-d5a4-44de-a258-6aca00204349]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:11:56 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-606719ad-d68d-4640-aa38-d7ad2da6b1e8 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:11:56 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-606719ad-d68d-4640-aa38-d7ad2da6b1e8 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:11:56 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-606719ad-d68d-4640-aa38-d7ad2da6b1e8 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] <== disconnect_volume: return (287ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:11:56 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-606719ad-d68d-4640-aa38-d7ad2da6b1e8 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 11:11:56 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-606719ad-d68d-4640-aa38-d7ad2da6b1e8 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Deleting instance files /opt/stack/data/nova/instances/e3b0b960-3f38-4a6f-9017-209fbc2110c9_del
Nov 28 11:11:56 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-606719ad-d68d-4640-aa38-d7ad2da6b1e8 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Deletion of /opt/stack/data/nova/instances/e3b0b960-3f38-4a6f-9017-209fbc2110c9_del complete
Nov 28 11:11:56 user nova-compute[74994]: INFO nova.compute.manager [None req-606719ad-d68d-4640-aa38-d7ad2da6b1e8 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 28 11:11:56 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-606719ad-d68d-4640-aa38-d7ad2da6b1e8 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 11:11:56 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 11:11:56 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 11:11:56 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:11:57 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:11:57 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Took 0.90 seconds to deallocate network for instance.
Nov 28 11:11:57 user nova-compute[74994]: DEBUG nova.compute.manager [req-00e604de-cf21-41b7-b217-116509dff40f req-648fb135-ad41-4c3e-9a97-b7872165bb4d service nova] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Received event network-vif-deleted-17fb7783-f3dc-41cf-b838-004f2048fdbc {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:11:57 user nova-compute[74994]: DEBUG nova.compute.manager [req-595b622a-bff2-4466-9547-9afd5c04bb57 req-7dc6442d-2f76-40e0-af3f-1a4c00879ced service nova] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Received event network-vif-plugged-17fb7783-f3dc-41cf-b838-004f2048fdbc {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:11:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-595b622a-bff2-4466-9547-9afd5c04bb57 req-7dc6442d-2f76-40e0-af3f-1a4c00879ced service nova] Acquiring lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:11:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-595b622a-bff2-4466-9547-9afd5c04bb57 req-7dc6442d-2f76-40e0-af3f-1a4c00879ced service nova] Lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:11:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-595b622a-bff2-4466-9547-9afd5c04bb57 req-7dc6442d-2f76-40e0-af3f-1a4c00879ced service nova] Lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:11:57 user nova-compute[74994]: DEBUG nova.compute.manager [req-595b622a-bff2-4466-9547-9afd5c04bb57 req-7dc6442d-2f76-40e0-af3f-1a4c00879ced service nova] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] No waiting events found dispatching network-vif-plugged-17fb7783-f3dc-41cf-b838-004f2048fdbc {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:11:57 user nova-compute[74994]: WARNING nova.compute.manager [req-595b622a-bff2-4466-9547-9afd5c04bb57 req-7dc6442d-2f76-40e0-af3f-1a4c00879ced service nova] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Received unexpected event network-vif-plugged-17fb7783-f3dc-41cf-b838-004f2048fdbc for instance with vm_state active and task_state deleting.
Nov 28 11:11:57 user nova-compute[74994]: DEBUG nova.compute.manager [req-595b622a-bff2-4466-9547-9afd5c04bb57 req-7dc6442d-2f76-40e0-af3f-1a4c00879ced service nova] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Received event network-vif-plugged-17fb7783-f3dc-41cf-b838-004f2048fdbc {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:11:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-595b622a-bff2-4466-9547-9afd5c04bb57 req-7dc6442d-2f76-40e0-af3f-1a4c00879ced service nova] Acquiring lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:11:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-595b622a-bff2-4466-9547-9afd5c04bb57 req-7dc6442d-2f76-40e0-af3f-1a4c00879ced service nova] Lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:11:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-595b622a-bff2-4466-9547-9afd5c04bb57 req-7dc6442d-2f76-40e0-af3f-1a4c00879ced service nova] Lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:11:57 user nova-compute[74994]: DEBUG nova.compute.manager [req-595b622a-bff2-4466-9547-9afd5c04bb57 req-7dc6442d-2f76-40e0-af3f-1a4c00879ced service nova] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] No waiting events found dispatching network-vif-plugged-17fb7783-f3dc-41cf-b838-004f2048fdbc {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:11:57 user nova-compute[74994]: WARNING nova.compute.manager [req-595b622a-bff2-4466-9547-9afd5c04bb57 req-7dc6442d-2f76-40e0-af3f-1a4c00879ced service nova] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Received unexpected event network-vif-plugged-17fb7783-f3dc-41cf-b838-004f2048fdbc for instance with vm_state active and task_state deleting.
Nov 28 11:11:57 user nova-compute[74994]: DEBUG nova.compute.manager [req-595b622a-bff2-4466-9547-9afd5c04bb57 req-7dc6442d-2f76-40e0-af3f-1a4c00879ced service nova] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Received event network-vif-plugged-17fb7783-f3dc-41cf-b838-004f2048fdbc {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:11:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-595b622a-bff2-4466-9547-9afd5c04bb57 req-7dc6442d-2f76-40e0-af3f-1a4c00879ced service nova] Acquiring lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:11:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-595b622a-bff2-4466-9547-9afd5c04bb57 req-7dc6442d-2f76-40e0-af3f-1a4c00879ced service nova] Lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:11:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-595b622a-bff2-4466-9547-9afd5c04bb57 req-7dc6442d-2f76-40e0-af3f-1a4c00879ced service nova] Lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:11:57 user nova-compute[74994]: DEBUG nova.compute.manager [req-595b622a-bff2-4466-9547-9afd5c04bb57 req-7dc6442d-2f76-40e0-af3f-1a4c00879ced service nova] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] No waiting events found dispatching network-vif-plugged-17fb7783-f3dc-41cf-b838-004f2048fdbc {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:11:57 user nova-compute[74994]: WARNING nova.compute.manager [req-595b622a-bff2-4466-9547-9afd5c04bb57 req-7dc6442d-2f76-40e0-af3f-1a4c00879ced service nova] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Received unexpected event network-vif-plugged-17fb7783-f3dc-41cf-b838-004f2048fdbc for instance with vm_state active and task_state deleting.
Nov 28 11:11:57 user nova-compute[74994]: DEBUG nova.compute.manager [req-595b622a-bff2-4466-9547-9afd5c04bb57 req-7dc6442d-2f76-40e0-af3f-1a4c00879ced service nova] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Received event network-vif-unplugged-17fb7783-f3dc-41cf-b838-004f2048fdbc {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:11:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-595b622a-bff2-4466-9547-9afd5c04bb57 req-7dc6442d-2f76-40e0-af3f-1a4c00879ced service nova] Acquiring lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:11:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-595b622a-bff2-4466-9547-9afd5c04bb57 req-7dc6442d-2f76-40e0-af3f-1a4c00879ced service nova] Lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:11:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-595b622a-bff2-4466-9547-9afd5c04bb57 req-7dc6442d-2f76-40e0-af3f-1a4c00879ced service nova] Lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:11:57 user nova-compute[74994]: DEBUG nova.compute.manager [req-595b622a-bff2-4466-9547-9afd5c04bb57 req-7dc6442d-2f76-40e0-af3f-1a4c00879ced service nova] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] No waiting events found dispatching network-vif-unplugged-17fb7783-f3dc-41cf-b838-004f2048fdbc {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:11:57 user nova-compute[74994]: DEBUG nova.compute.manager [req-595b622a-bff2-4466-9547-9afd5c04bb57 req-7dc6442d-2f76-40e0-af3f-1a4c00879ced service nova] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Received event network-vif-unplugged-17fb7783-f3dc-41cf-b838-004f2048fdbc for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 11:11:57 user nova-compute[74994]: DEBUG nova.compute.manager [req-595b622a-bff2-4466-9547-9afd5c04bb57 req-7dc6442d-2f76-40e0-af3f-1a4c00879ced service nova] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Received event network-vif-plugged-17fb7783-f3dc-41cf-b838-004f2048fdbc {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:11:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-595b622a-bff2-4466-9547-9afd5c04bb57 req-7dc6442d-2f76-40e0-af3f-1a4c00879ced service nova] Acquiring lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:11:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-595b622a-bff2-4466-9547-9afd5c04bb57 req-7dc6442d-2f76-40e0-af3f-1a4c00879ced service nova] Lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:11:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-595b622a-bff2-4466-9547-9afd5c04bb57 req-7dc6442d-2f76-40e0-af3f-1a4c00879ced service nova] Lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:11:57 user nova-compute[74994]: DEBUG nova.compute.manager [req-595b622a-bff2-4466-9547-9afd5c04bb57 req-7dc6442d-2f76-40e0-af3f-1a4c00879ced service nova] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] No waiting events found dispatching network-vif-plugged-17fb7783-f3dc-41cf-b838-004f2048fdbc {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:11:57 user nova-compute[74994]: WARNING nova.compute.manager [req-595b622a-bff2-4466-9547-9afd5c04bb57 req-7dc6442d-2f76-40e0-af3f-1a4c00879ced service nova] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Received unexpected event network-vif-plugged-17fb7783-f3dc-41cf-b838-004f2048fdbc for instance with vm_state active and task_state deleting.
Nov 28 11:11:57 user nova-compute[74994]: INFO nova.compute.manager [None req-606719ad-d68d-4640-aa38-d7ad2da6b1e8 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Took 0.73 seconds to detach 1 volumes for instance.
Nov 28 11:11:57 user nova-compute[74994]: DEBUG nova.compute.manager [None req-606719ad-d68d-4640-aa38-d7ad2da6b1e8 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: e3b0b960-3f38-4a6f-9017-209fbc2110c9] Deleting volume: cc3edc15-080f-4593-9a75-5d2719dfe0dd {{(pid=74994) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 11:11:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-606719ad-d68d-4640-aa38-d7ad2da6b1e8 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:11:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-606719ad-d68d-4640-aa38-d7ad2da6b1e8 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:11:58 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-606719ad-d68d-4640-aa38-d7ad2da6b1e8 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:11:58 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-606719ad-d68d-4640-aa38-d7ad2da6b1e8 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:11:58 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-606719ad-d68d-4640-aa38-d7ad2da6b1e8 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.208s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:11:58 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-606719ad-d68d-4640-aa38-d7ad2da6b1e8 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Deleted allocations for instance e3b0b960-3f38-4a6f-9017-209fbc2110c9
Nov 28 11:11:58 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-606719ad-d68d-4640-aa38-d7ad2da6b1e8 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "e3b0b960-3f38-4a6f-9017-209fbc2110c9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.322s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:12:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:12:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:12:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:12:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:12:12 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:12:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:12:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:12:20 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:12:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:12:21 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:12:21 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 11:12:22 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:12:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:12:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:12:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:12:22 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 11:12:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7295ae8a-462e-4b75-af40-35aac439dad0/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:12:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7295ae8a-462e-4b75-af40-35aac439dad0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:12:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7295ae8a-462e-4b75-af40-35aac439dad0/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:12:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7295ae8a-462e-4b75-af40-35aac439dad0/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:12:22 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53133e7f-b155-4fa5-9f2b-29993200fa90/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:12:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53133e7f-b155-4fa5-9f2b-29993200fa90/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:12:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53133e7f-b155-4fa5-9f2b-29993200fa90/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:12:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53133e7f-b155-4fa5-9f2b-29993200fa90/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:12:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:12:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:12:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:12:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:12:24 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:12:24 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:12:24 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=8664MB free_disk=25.016456604003906GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 11:12:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:12:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:12:24 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 20716905-c56a-4729-8c5b-9188502dc477 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:12:24 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 7295ae8a-462e-4b75-af40-35aac439dad0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:12:24 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 53133e7f-b155-4fa5-9f2b-29993200fa90 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:12:24 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 11:12:24 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 11:12:24 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:12:24 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:12:24 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 11:12:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.292s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:12:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:12:26 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:12:26 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:12:29 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:12:30 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:12:30 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 11:12:30 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Didn't find any instances for network info cache update. {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 11:12:30 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:12:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:12:33 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:12:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:12:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:12:43 user nova-compute[74994]: DEBUG nova.compute.manager [req-8b05a784-aaeb-4633-a068-966da6a1e013 req-d1b6fbcd-fd21-4685-9c05-8ac0ca010c3d service nova] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Received event network-changed-281bdb45-f23e-4ec0-a536-80a82491d3ff {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:12:43 user nova-compute[74994]: DEBUG nova.compute.manager [req-8b05a784-aaeb-4633-a068-966da6a1e013 req-d1b6fbcd-fd21-4685-9c05-8ac0ca010c3d service nova] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Refreshing instance network info cache due to event network-changed-281bdb45-f23e-4ec0-a536-80a82491d3ff. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:12:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8b05a784-aaeb-4633-a068-966da6a1e013 req-d1b6fbcd-fd21-4685-9c05-8ac0ca010c3d service nova] Acquiring lock "refresh_cache-7295ae8a-462e-4b75-af40-35aac439dad0" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:12:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8b05a784-aaeb-4633-a068-966da6a1e013 req-d1b6fbcd-fd21-4685-9c05-8ac0ca010c3d service nova] Acquired lock "refresh_cache-7295ae8a-462e-4b75-af40-35aac439dad0" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:12:43 user nova-compute[74994]: DEBUG nova.network.neutron [req-8b05a784-aaeb-4633-a068-966da6a1e013 req-d1b6fbcd-fd21-4685-9c05-8ac0ca010c3d service nova] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Refreshing network info cache for port 281bdb45-f23e-4ec0-a536-80a82491d3ff {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:12:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-93969d62-148b-4e48-9094-7643ba4c2112 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Acquiring lock "7295ae8a-462e-4b75-af40-35aac439dad0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:12:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-93969d62-148b-4e48-9094-7643ba4c2112 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "7295ae8a-462e-4b75-af40-35aac439dad0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:12:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-93969d62-148b-4e48-9094-7643ba4c2112 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Acquiring lock "7295ae8a-462e-4b75-af40-35aac439dad0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:12:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-93969d62-148b-4e48-9094-7643ba4c2112 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "7295ae8a-462e-4b75-af40-35aac439dad0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:12:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-93969d62-148b-4e48-9094-7643ba4c2112 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "7295ae8a-462e-4b75-af40-35aac439dad0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:12:43 user nova-compute[74994]: INFO nova.compute.manager [None req-93969d62-148b-4e48-9094-7643ba4c2112 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Terminating instance
Nov 28 11:12:43 user nova-compute[74994]: DEBUG nova.compute.manager [None req-93969d62-148b-4e48-9094-7643ba4c2112 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 11:12:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:12:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:12:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:12:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:12:43 user nova-compute[74994]: DEBUG nova.network.neutron [req-8b05a784-aaeb-4633-a068-966da6a1e013 req-d1b6fbcd-fd21-4685-9c05-8ac0ca010c3d service nova] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Updated VIF entry in instance network info cache for port 281bdb45-f23e-4ec0-a536-80a82491d3ff. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:12:43 user nova-compute[74994]: DEBUG nova.network.neutron [req-8b05a784-aaeb-4633-a068-966da6a1e013 req-d1b6fbcd-fd21-4685-9c05-8ac0ca010c3d service nova] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Updating instance_info_cache with network_info: [{"id": "281bdb45-f23e-4ec0-a536-80a82491d3ff", "address": "fa:16:3e:14:2e:38", "network": {"id": "962e3ca9-e99b-49cd-bb50-c34d108cdfa7", "bridge": "br-int", "label": "tempest-TestStampPattern-359277306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30dae8b62e14c50b9646b13af2a4258", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281bdb45-f2", "ovs_interfaceid": "281bdb45-f23e-4ec0-a536-80a82491d3ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:12:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8b05a784-aaeb-4633-a068-966da6a1e013 req-d1b6fbcd-fd21-4685-9c05-8ac0ca010c3d service nova] Releasing lock "refresh_cache-7295ae8a-462e-4b75-af40-35aac439dad0" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:12:43 user nova-compute[74994]: DEBUG nova.compute.manager [req-602a1a61-c671-4b7d-b29e-09bc92e509fc req-eb1a603e-396b-450c-91ed-370aae8ab19f service nova] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Received event network-vif-unplugged-281bdb45-f23e-4ec0-a536-80a82491d3ff {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:12:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-602a1a61-c671-4b7d-b29e-09bc92e509fc req-eb1a603e-396b-450c-91ed-370aae8ab19f service nova] Acquiring lock "7295ae8a-462e-4b75-af40-35aac439dad0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:12:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-602a1a61-c671-4b7d-b29e-09bc92e509fc req-eb1a603e-396b-450c-91ed-370aae8ab19f service nova] Lock "7295ae8a-462e-4b75-af40-35aac439dad0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:12:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-602a1a61-c671-4b7d-b29e-09bc92e509fc req-eb1a603e-396b-450c-91ed-370aae8ab19f service nova] Lock "7295ae8a-462e-4b75-af40-35aac439dad0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:12:43 user nova-compute[74994]: DEBUG nova.compute.manager [req-602a1a61-c671-4b7d-b29e-09bc92e509fc req-eb1a603e-396b-450c-91ed-370aae8ab19f service nova] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] No waiting events found dispatching network-vif-unplugged-281bdb45-f23e-4ec0-a536-80a82491d3ff {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:12:43 user nova-compute[74994]: DEBUG nova.compute.manager [req-602a1a61-c671-4b7d-b29e-09bc92e509fc req-eb1a603e-396b-450c-91ed-370aae8ab19f service nova] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Received event network-vif-unplugged-281bdb45-f23e-4ec0-a536-80a82491d3ff for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 11:12:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:12:43 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Instance destroyed successfully.
Nov 28 11:12:43 user nova-compute[74994]: DEBUG nova.objects.instance [None req-93969d62-148b-4e48-9094-7643ba4c2112 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lazy-loading 'resources' on Instance uuid 7295ae8a-462e-4b75-af40-35aac439dad0 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:12:43 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-93969d62-148b-4e48-9094-7643ba4c2112 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:05:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-2015365400',display_name='tempest-TestStampPattern-server-2015365400',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2015365400',id=35,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLhnKlLbDzesoIgRgKjSwDSGDLbJAHMlDTp+nQM/ojqr/PUamcvyDrok1u7+9cOZfKML/zTkQ8RQndwU5iipCM38Od6vAR2Ip4VAwZazka1mUHBKbAYcoeh2nwnJCVXag==',key_name='tempest-TestStampPattern-30928350',keypairs=<?>,launch_index=0,launched_at=2023-11-28T11:05:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c30dae8b62e14c50b9646b13af2a4258',ramdisk_id='',reservation_id='r-kkzjmcd0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-848738200',owner_user_name='tempest-TestStampPattern-848738200-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T11:08:45Z,user_data=None,user_id='c362617247be45c390a743c3a80e1f63',uuid=7295ae8a-462e-4b75-af40-35aac439dad0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "281bdb45-f23e-4ec0-a536-80a82491d3ff", "address": "fa:16:3e:14:2e:38", "network": {"id": "962e3ca9-e99b-49cd-bb50-c34d108cdfa7", "bridge": "br-int", "label": "tempest-TestStampPattern-359277306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30dae8b62e14c50b9646b13af2a4258", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281bdb45-f2", "ovs_interfaceid": "281bdb45-f23e-4ec0-a536-80a82491d3ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 11:12:43 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-93969d62-148b-4e48-9094-7643ba4c2112 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Converting VIF {"id": "281bdb45-f23e-4ec0-a536-80a82491d3ff", "address": "fa:16:3e:14:2e:38", "network": {"id": "962e3ca9-e99b-49cd-bb50-c34d108cdfa7", "bridge": "br-int", "label": "tempest-TestStampPattern-359277306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c30dae8b62e14c50b9646b13af2a4258", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281bdb45-f2", "ovs_interfaceid": "281bdb45-f23e-4ec0-a536-80a82491d3ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:12:43 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-93969d62-148b-4e48-9094-7643ba4c2112 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:2e:38,bridge_name='br-int',has_traffic_filtering=True,id=281bdb45-f23e-4ec0-a536-80a82491d3ff,network=Network(962e3ca9-e99b-49cd-bb50-c34d108cdfa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap281bdb45-f2') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:12:43 user nova-compute[74994]: DEBUG os_vif [None req-93969d62-148b-4e48-9094-7643ba4c2112 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:2e:38,bridge_name='br-int',has_traffic_filtering=True,id=281bdb45-f23e-4ec0-a536-80a82491d3ff,network=Network(962e3ca9-e99b-49cd-bb50-c34d108cdfa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap281bdb45-f2') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 11:12:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:12:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap281bdb45-f2, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:12:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:12:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:12:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:12:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f65febf8-2015-472d-bbe5-2353537243eb) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:12:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:12:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:12:43 user nova-compute[74994]: INFO os_vif [None req-93969d62-148b-4e48-9094-7643ba4c2112 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:2e:38,bridge_name='br-int',has_traffic_filtering=True,id=281bdb45-f23e-4ec0-a536-80a82491d3ff,network=Network(962e3ca9-e99b-49cd-bb50-c34d108cdfa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap281bdb45-f2')
Nov 28 11:12:43 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-93969d62-148b-4e48-9094-7643ba4c2112 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Deleting instance files /opt/stack/data/nova/instances/7295ae8a-462e-4b75-af40-35aac439dad0_del
Nov 28 11:12:43 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-93969d62-148b-4e48-9094-7643ba4c2112 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Deletion of /opt/stack/data/nova/instances/7295ae8a-462e-4b75-af40-35aac439dad0_del complete
Nov 28 11:12:44 user nova-compute[74994]: INFO nova.compute.manager [None req-93969d62-148b-4e48-9094-7643ba4c2112 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 28 11:12:44 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-93969d62-148b-4e48-9094-7643ba4c2112 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 11:12:44 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 11:12:44 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 11:12:44 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:12:44 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Took 0.47 seconds to deallocate network for instance.
Nov 28 11:12:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-93969d62-148b-4e48-9094-7643ba4c2112 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:12:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-93969d62-148b-4e48-9094-7643ba4c2112 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:12:44 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-93969d62-148b-4e48-9094-7643ba4c2112 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:12:44 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-93969d62-148b-4e48-9094-7643ba4c2112 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:12:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-93969d62-148b-4e48-9094-7643ba4c2112 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.203s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:12:44 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-93969d62-148b-4e48-9094-7643ba4c2112 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Deleted allocations for instance 7295ae8a-462e-4b75-af40-35aac439dad0
Nov 28 11:12:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-93969d62-148b-4e48-9094-7643ba4c2112 tempest-TestStampPattern-848738200 tempest-TestStampPattern-848738200-project-member] Lock "7295ae8a-462e-4b75-af40-35aac439dad0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.806s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:12:45 user nova-compute[74994]: DEBUG nova.compute.manager [req-3f7cf5c7-22fc-49d9-a323-698d6eb6cbca req-d8a7ba32-e0cb-482e-b2ff-70e65a781cdd service nova] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Received event network-vif-deleted-281bdb45-f23e-4ec0-a536-80a82491d3ff {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:12:45 user nova-compute[74994]: DEBUG nova.compute.manager [req-ba7cc2ba-f714-4db2-b171-2eb8a4bb0514 req-d86771d1-085b-4625-845a-4c80f583c3d8 service nova] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Received event network-vif-plugged-281bdb45-f23e-4ec0-a536-80a82491d3ff {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:12:45 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ba7cc2ba-f714-4db2-b171-2eb8a4bb0514 req-d86771d1-085b-4625-845a-4c80f583c3d8 service nova] Acquiring lock "7295ae8a-462e-4b75-af40-35aac439dad0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:12:45 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ba7cc2ba-f714-4db2-b171-2eb8a4bb0514 req-d86771d1-085b-4625-845a-4c80f583c3d8 service nova] Lock "7295ae8a-462e-4b75-af40-35aac439dad0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:12:45 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ba7cc2ba-f714-4db2-b171-2eb8a4bb0514 req-d86771d1-085b-4625-845a-4c80f583c3d8 service nova] Lock "7295ae8a-462e-4b75-af40-35aac439dad0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:12:45 user nova-compute[74994]: DEBUG nova.compute.manager [req-ba7cc2ba-f714-4db2-b171-2eb8a4bb0514 req-d86771d1-085b-4625-845a-4c80f583c3d8 service nova] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] No waiting events found dispatching network-vif-plugged-281bdb45-f23e-4ec0-a536-80a82491d3ff {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:12:45 user nova-compute[74994]: WARNING nova.compute.manager [req-ba7cc2ba-f714-4db2-b171-2eb8a4bb0514 req-d86771d1-085b-4625-845a-4c80f583c3d8 service nova] [instance: 7295ae8a-462e-4b75-af40-35aac439dad0] Received unexpected event network-vif-plugged-281bdb45-f23e-4ec0-a536-80a82491d3ff for instance with vm_state deleted and task_state None.
Nov 28 11:12:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ddddbbf8-faa7-4c80-aa14-7848b0222b81 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Acquiring lock "53133e7f-b155-4fa5-9f2b-29993200fa90" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:12:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ddddbbf8-faa7-4c80-aa14-7848b0222b81 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Lock "53133e7f-b155-4fa5-9f2b-29993200fa90" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:12:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ddddbbf8-faa7-4c80-aa14-7848b0222b81 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Acquiring lock "53133e7f-b155-4fa5-9f2b-29993200fa90-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:12:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ddddbbf8-faa7-4c80-aa14-7848b0222b81 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Lock "53133e7f-b155-4fa5-9f2b-29993200fa90-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:12:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ddddbbf8-faa7-4c80-aa14-7848b0222b81 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Lock "53133e7f-b155-4fa5-9f2b-29993200fa90-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:12:46 user nova-compute[74994]: INFO nova.compute.manager [None req-ddddbbf8-faa7-4c80-aa14-7848b0222b81 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Terminating instance
Nov 28 11:12:46 user nova-compute[74994]: DEBUG nova.compute.manager [None req-ddddbbf8-faa7-4c80-aa14-7848b0222b81 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 11:12:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:12:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:12:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:12:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:12:46 user nova-compute[74994]: DEBUG nova.compute.manager [req-28d3e028-2d3c-44c4-bc93-46048d097455 req-2de01721-8885-4261-9100-727bef4d55f4 service nova] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Received event network-vif-unplugged-e3543c90-0e97-4550-9371-32aa9fa1bd91 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:12:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-28d3e028-2d3c-44c4-bc93-46048d097455 req-2de01721-8885-4261-9100-727bef4d55f4 service nova] Acquiring lock "53133e7f-b155-4fa5-9f2b-29993200fa90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:12:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-28d3e028-2d3c-44c4-bc93-46048d097455 req-2de01721-8885-4261-9100-727bef4d55f4 service nova] Lock "53133e7f-b155-4fa5-9f2b-29993200fa90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:12:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-28d3e028-2d3c-44c4-bc93-46048d097455 req-2de01721-8885-4261-9100-727bef4d55f4 service nova] Lock "53133e7f-b155-4fa5-9f2b-29993200fa90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:12:46 user nova-compute[74994]: DEBUG nova.compute.manager [req-28d3e028-2d3c-44c4-bc93-46048d097455 req-2de01721-8885-4261-9100-727bef4d55f4 service nova] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] No waiting events found dispatching network-vif-unplugged-e3543c90-0e97-4550-9371-32aa9fa1bd91 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:12:46 user nova-compute[74994]: DEBUG nova.compute.manager [req-28d3e028-2d3c-44c4-bc93-46048d097455 req-2de01721-8885-4261-9100-727bef4d55f4 service nova] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Received event network-vif-unplugged-e3543c90-0e97-4550-9371-32aa9fa1bd91 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 11:12:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:12:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:12:46 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Instance destroyed successfully.
Nov 28 11:12:46 user nova-compute[74994]: DEBUG nova.objects.instance [None req-ddddbbf8-faa7-4c80-aa14-7848b0222b81 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Lazy-loading 'resources' on Instance uuid 53133e7f-b155-4fa5-9f2b-29993200fa90 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:12:46 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-ddddbbf8-faa7-4c80-aa14-7848b0222b81 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:10:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1693080050',display_name='tempest-VolumesActionsTest-instance-1693080050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1693080050',id=39,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T11:11:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d213989fc07742e6a087593430826861',ramdisk_id='',reservation_id='r-fp8xfacx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1285521872',owner_user_name='tempest-VolumesActionsTest-1285521872-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T11:11:02Z,user_data=None,user_id='7e6dcb9651a945ae95732a246f6a2857',uuid=53133e7f-b155-4fa5-9f2b-29993200fa90,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e3543c90-0e97-4550-9371-32aa9fa1bd91", "address": "fa:16:3e:c8:e5:c2", "network": {"id": "0833228c-a00a-42e2-bcbd-d943e976dc13", "bridge": "br-int", "label": "tempest-VolumesActionsTest-373359983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d213989fc07742e6a087593430826861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3543c90-0e", "ovs_interfaceid": "e3543c90-0e97-4550-9371-32aa9fa1bd91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 11:12:46 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-ddddbbf8-faa7-4c80-aa14-7848b0222b81 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Converting VIF {"id": "e3543c90-0e97-4550-9371-32aa9fa1bd91", "address": "fa:16:3e:c8:e5:c2", "network": {"id": "0833228c-a00a-42e2-bcbd-d943e976dc13", "bridge": "br-int", "label": "tempest-VolumesActionsTest-373359983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d213989fc07742e6a087593430826861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3543c90-0e", "ovs_interfaceid": "e3543c90-0e97-4550-9371-32aa9fa1bd91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:12:46 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-ddddbbf8-faa7-4c80-aa14-7848b0222b81 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:e5:c2,bridge_name='br-int',has_traffic_filtering=True,id=e3543c90-0e97-4550-9371-32aa9fa1bd91,network=Network(0833228c-a00a-42e2-bcbd-d943e976dc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3543c90-0e') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:12:46 user nova-compute[74994]: DEBUG os_vif [None req-ddddbbf8-faa7-4c80-aa14-7848b0222b81 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:e5:c2,bridge_name='br-int',has_traffic_filtering=True,id=e3543c90-0e97-4550-9371-32aa9fa1bd91,network=Network(0833228c-a00a-42e2-bcbd-d943e976dc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3543c90-0e') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 11:12:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:12:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape3543c90-0e, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:12:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:12:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:12:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b49193f4-3678-40d4-a564-b58823281ad9) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:12:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:12:46 user nova-compute[74994]: INFO os_vif [None req-ddddbbf8-faa7-4c80-aa14-7848b0222b81 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:e5:c2,bridge_name='br-int',has_traffic_filtering=True,id=e3543c90-0e97-4550-9371-32aa9fa1bd91,network=Network(0833228c-a00a-42e2-bcbd-d943e976dc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3543c90-0e')
Nov 28 11:12:46 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-ddddbbf8-faa7-4c80-aa14-7848b0222b81 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Deleting instance files /opt/stack/data/nova/instances/53133e7f-b155-4fa5-9f2b-29993200fa90_del
Nov 28 11:12:46 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-ddddbbf8-faa7-4c80-aa14-7848b0222b81 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Deletion of /opt/stack/data/nova/instances/53133e7f-b155-4fa5-9f2b-29993200fa90_del complete
Nov 28 11:12:47 user nova-compute[74994]: INFO nova.compute.manager [None req-ddddbbf8-faa7-4c80-aa14-7848b0222b81 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 28 11:12:47 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-ddddbbf8-faa7-4c80-aa14-7848b0222b81 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 11:12:47 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 11:12:47 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 11:12:47 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:12:47 user nova-compute[74994]: DEBUG nova.compute.manager [req-04ac9931-eb13-4ded-8e26-97c3e6173fa6 req-0ec75f1c-6895-4ba8-9808-36f2485f2737 service nova] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Received event network-vif-deleted-e3543c90-0e97-4550-9371-32aa9fa1bd91 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:12:47 user nova-compute[74994]: INFO nova.compute.manager [req-04ac9931-eb13-4ded-8e26-97c3e6173fa6 req-0ec75f1c-6895-4ba8-9808-36f2485f2737 service nova] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Neutron deleted interface e3543c90-0e97-4550-9371-32aa9fa1bd91; detaching it from the instance and deleting it from the info cache
Nov 28 11:12:47 user nova-compute[74994]: DEBUG nova.network.neutron [req-04ac9931-eb13-4ded-8e26-97c3e6173fa6 req-0ec75f1c-6895-4ba8-9808-36f2485f2737 service nova] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:12:47 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Took 0.40 seconds to deallocate network for instance.
Nov 28 11:12:47 user nova-compute[74994]: DEBUG nova.compute.manager [req-04ac9931-eb13-4ded-8e26-97c3e6173fa6 req-0ec75f1c-6895-4ba8-9808-36f2485f2737 service nova] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Detach interface failed, port_id=e3543c90-0e97-4550-9371-32aa9fa1bd91, reason: Instance 53133e7f-b155-4fa5-9f2b-29993200fa90 could not be found. {{(pid=74994) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 11:12:47 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ddddbbf8-faa7-4c80-aa14-7848b0222b81 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:12:47 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ddddbbf8-faa7-4c80-aa14-7848b0222b81 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:12:47 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-ddddbbf8-faa7-4c80-aa14-7848b0222b81 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:12:47 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-ddddbbf8-faa7-4c80-aa14-7848b0222b81 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:12:47 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ddddbbf8-faa7-4c80-aa14-7848b0222b81 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.140s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:12:47 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-ddddbbf8-faa7-4c80-aa14-7848b0222b81 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Deleted allocations for instance 53133e7f-b155-4fa5-9f2b-29993200fa90
Nov 28 11:12:47 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-ddddbbf8-faa7-4c80-aa14-7848b0222b81 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Lock "53133e7f-b155-4fa5-9f2b-29993200fa90" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.561s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:12:48 user nova-compute[74994]: DEBUG nova.compute.manager [req-d603c992-5aea-4103-b0bd-1e0892ed31b4 req-66c69936-12b9-48ac-a152-98d60fcfbc31 service nova] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Received event network-vif-plugged-e3543c90-0e97-4550-9371-32aa9fa1bd91 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:12:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d603c992-5aea-4103-b0bd-1e0892ed31b4 req-66c69936-12b9-48ac-a152-98d60fcfbc31 service nova] Acquiring lock "53133e7f-b155-4fa5-9f2b-29993200fa90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:12:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d603c992-5aea-4103-b0bd-1e0892ed31b4 req-66c69936-12b9-48ac-a152-98d60fcfbc31 service nova] Lock "53133e7f-b155-4fa5-9f2b-29993200fa90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:12:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d603c992-5aea-4103-b0bd-1e0892ed31b4 req-66c69936-12b9-48ac-a152-98d60fcfbc31 service nova] Lock "53133e7f-b155-4fa5-9f2b-29993200fa90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:12:48 user nova-compute[74994]: DEBUG nova.compute.manager [req-d603c992-5aea-4103-b0bd-1e0892ed31b4 req-66c69936-12b9-48ac-a152-98d60fcfbc31 service nova] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] No waiting events found dispatching network-vif-plugged-e3543c90-0e97-4550-9371-32aa9fa1bd91 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:12:48 user nova-compute[74994]: WARNING nova.compute.manager [req-d603c992-5aea-4103-b0bd-1e0892ed31b4 req-66c69936-12b9-48ac-a152-98d60fcfbc31 service nova] [instance: 53133e7f-b155-4fa5-9f2b-29993200fa90] Received unexpected event network-vif-plugged-e3543c90-0e97-4550-9371-32aa9fa1bd91 for instance with vm_state deleted and task_state None.
Nov 28 11:12:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9ef9b266-abac-42f4-a194-5e7ce5faeec3 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "20716905-c56a-4729-8c5b-9188502dc477" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:12:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9ef9b266-abac-42f4-a194-5e7ce5faeec3 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "20716905-c56a-4729-8c5b-9188502dc477" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:12:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9ef9b266-abac-42f4-a194-5e7ce5faeec3 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "20716905-c56a-4729-8c5b-9188502dc477-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:12:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9ef9b266-abac-42f4-a194-5e7ce5faeec3 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "20716905-c56a-4729-8c5b-9188502dc477-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:12:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9ef9b266-abac-42f4-a194-5e7ce5faeec3 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "20716905-c56a-4729-8c5b-9188502dc477-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:12:50 user nova-compute[74994]: INFO nova.compute.manager [None req-9ef9b266-abac-42f4-a194-5e7ce5faeec3 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Terminating instance
Nov 28 11:12:50 user nova-compute[74994]: DEBUG nova.compute.manager [None req-9ef9b266-abac-42f4-a194-5e7ce5faeec3 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 11:12:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:12:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:12:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:12:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:12:51 user nova-compute[74994]: DEBUG nova.compute.manager [req-896ab37a-b420-4bc4-801d-93fccb05f884 req-32804dea-ce0b-4f09-9d74-b31a2aec6e61 service nova] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Received event network-vif-unplugged-10b84648-2b56-4451-b4f3-3ec4ad7b7771 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:12:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-896ab37a-b420-4bc4-801d-93fccb05f884 req-32804dea-ce0b-4f09-9d74-b31a2aec6e61 service nova] Acquiring lock "20716905-c56a-4729-8c5b-9188502dc477-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:12:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-896ab37a-b420-4bc4-801d-93fccb05f884 req-32804dea-ce0b-4f09-9d74-b31a2aec6e61 service nova] Lock "20716905-c56a-4729-8c5b-9188502dc477-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:12:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-896ab37a-b420-4bc4-801d-93fccb05f884 req-32804dea-ce0b-4f09-9d74-b31a2aec6e61 service nova] Lock "20716905-c56a-4729-8c5b-9188502dc477-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:12:51 user nova-compute[74994]: DEBUG nova.compute.manager [req-896ab37a-b420-4bc4-801d-93fccb05f884 req-32804dea-ce0b-4f09-9d74-b31a2aec6e61 service nova] [instance: 20716905-c56a-4729-8c5b-9188502dc477] No waiting events found dispatching network-vif-unplugged-10b84648-2b56-4451-b4f3-3ec4ad7b7771 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:12:51 user nova-compute[74994]: DEBUG nova.compute.manager [req-896ab37a-b420-4bc4-801d-93fccb05f884 req-32804dea-ce0b-4f09-9d74-b31a2aec6e61 service nova] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Received event network-vif-unplugged-10b84648-2b56-4451-b4f3-3ec4ad7b7771 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 11:12:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:12:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:12:51 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Instance destroyed successfully.
Nov 28 11:12:51 user nova-compute[74994]: DEBUG nova.objects.instance [None req-9ef9b266-abac-42f4-a194-5e7ce5faeec3 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lazy-loading 'resources' on Instance uuid 20716905-c56a-4729-8c5b-9188502dc477 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:12:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-9ef9b266-abac-42f4-a194-5e7ce5faeec3 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T10:53:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2083256391',display_name='tempest-ServerActionsTestOtherA-server-2083256391',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2083256391',id=18,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPW6Lty9ow0zAcm936yuU8WeLpHxpamSCaeKsFRdduK4jmYnIbGWXIhKjvJDlhN8evt/Hb3F2U1wYmR8qRXarp7uOZi0MsdjDWCq+Ku3i87+sooae0XVTHruzSkrMSatFQ==',key_name='tempest-keypair-1409463142',keypairs=<?>,launch_index=0,launched_at=2023-11-28T10:53:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5eb43a8fc7bd47728600741762f71112',ramdisk_id='',reservation_id='r-wrqbieqq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1927948343',owner_user_name='tempest-ServerActionsTestOtherA-1927948343-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T10:53:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d51be473c7284977a6533756a1f677f9',uuid=20716905-c56a-4729-8c5b-9188502dc477,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10b84648-2b56-4451-b4f3-3ec4ad7b7771", "address": "fa:16:3e:96:e0:ac", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b84648-2b", "ovs_interfaceid": "10b84648-2b56-4451-b4f3-3ec4ad7b7771", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 11:12:51 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-9ef9b266-abac-42f4-a194-5e7ce5faeec3 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Converting VIF {"id": "10b84648-2b56-4451-b4f3-3ec4ad7b7771", "address": "fa:16:3e:96:e0:ac", "network": {"id": "16dd32cd-5a00-4111-92e2-283e7635540f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-490143931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eb43a8fc7bd47728600741762f71112", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b84648-2b", "ovs_interfaceid": "10b84648-2b56-4451-b4f3-3ec4ad7b7771", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:12:51 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-9ef9b266-abac-42f4-a194-5e7ce5faeec3 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:e0:ac,bridge_name='br-int',has_traffic_filtering=True,id=10b84648-2b56-4451-b4f3-3ec4ad7b7771,network=Network(16dd32cd-5a00-4111-92e2-283e7635540f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10b84648-2b') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:12:51 user nova-compute[74994]: DEBUG os_vif [None req-9ef9b266-abac-42f4-a194-5e7ce5faeec3 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:e0:ac,bridge_name='br-int',has_traffic_filtering=True,id=10b84648-2b56-4451-b4f3-3ec4ad7b7771,network=Network(16dd32cd-5a00-4111-92e2-283e7635540f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10b84648-2b') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 11:12:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:12:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap10b84648-2b, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:12:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:12:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:12:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:12:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fe1c3a25-4efe-458e-af04-2a8dd45b76a0) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:12:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:12:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:12:51 user nova-compute[74994]: INFO os_vif [None req-9ef9b266-abac-42f4-a194-5e7ce5faeec3 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:e0:ac,bridge_name='br-int',has_traffic_filtering=True,id=10b84648-2b56-4451-b4f3-3ec4ad7b7771,network=Network(16dd32cd-5a00-4111-92e2-283e7635540f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10b84648-2b')
Nov 28 11:12:51 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-9ef9b266-abac-42f4-a194-5e7ce5faeec3 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Deleting instance files /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477_del
Nov 28 11:12:51 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-9ef9b266-abac-42f4-a194-5e7ce5faeec3 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Deletion of /opt/stack/data/nova/instances/20716905-c56a-4729-8c5b-9188502dc477_del complete
Nov 28 11:12:51 user nova-compute[74994]: INFO nova.compute.manager [None req-9ef9b266-abac-42f4-a194-5e7ce5faeec3 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 28 11:12:51 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-9ef9b266-abac-42f4-a194-5e7ce5faeec3 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 11:12:51 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 11:12:51 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 20716905-c56a-4729-8c5b-9188502dc477] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 11:12:52 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:12:52 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Took 0.79 seconds to deallocate network for instance.
Nov 28 11:12:52 user nova-compute[74994]: DEBUG nova.compute.manager [req-6260d243-2dc4-488a-84ac-44a5f8618da0 req-365608ef-8184-49bf-a36f-ee97733be230 service nova] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Received event network-vif-deleted-10b84648-2b56-4451-b4f3-3ec4ad7b7771 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:12:52 user nova-compute[74994]: INFO nova.compute.manager [req-6260d243-2dc4-488a-84ac-44a5f8618da0 req-365608ef-8184-49bf-a36f-ee97733be230 service nova] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Neutron deleted interface 10b84648-2b56-4451-b4f3-3ec4ad7b7771; detaching it from the instance and deleting it from the info cache
Nov 28 11:12:52 user nova-compute[74994]: DEBUG nova.network.neutron [req-6260d243-2dc4-488a-84ac-44a5f8618da0 req-365608ef-8184-49bf-a36f-ee97733be230 service nova] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:12:52 user nova-compute[74994]: DEBUG nova.compute.manager [req-6260d243-2dc4-488a-84ac-44a5f8618da0 req-365608ef-8184-49bf-a36f-ee97733be230 service nova] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Detach interface failed, port_id=10b84648-2b56-4451-b4f3-3ec4ad7b7771, reason: Instance 20716905-c56a-4729-8c5b-9188502dc477 could not be found. {{(pid=74994) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 11:12:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9ef9b266-abac-42f4-a194-5e7ce5faeec3 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:12:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9ef9b266-abac-42f4-a194-5e7ce5faeec3 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:12:52 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-9ef9b266-abac-42f4-a194-5e7ce5faeec3 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:12:52 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-9ef9b266-abac-42f4-a194-5e7ce5faeec3 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:12:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9ef9b266-abac-42f4-a194-5e7ce5faeec3 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.129s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:12:52 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-9ef9b266-abac-42f4-a194-5e7ce5faeec3 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Deleted allocations for instance 20716905-c56a-4729-8c5b-9188502dc477
Nov 28 11:12:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9ef9b266-abac-42f4-a194-5e7ce5faeec3 tempest-ServerActionsTestOtherA-1927948343 tempest-ServerActionsTestOtherA-1927948343-project-member] Lock "20716905-c56a-4729-8c5b-9188502dc477" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.071s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:12:53 user nova-compute[74994]: DEBUG nova.compute.manager [req-ff0246da-d4b8-46f7-b960-e1d58b45da28 req-ecfaf2e5-0f61-4b7f-84c8-74e03230e38e service nova] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Received event network-vif-plugged-10b84648-2b56-4451-b4f3-3ec4ad7b7771 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:12:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ff0246da-d4b8-46f7-b960-e1d58b45da28 req-ecfaf2e5-0f61-4b7f-84c8-74e03230e38e service nova] Acquiring lock "20716905-c56a-4729-8c5b-9188502dc477-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:12:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ff0246da-d4b8-46f7-b960-e1d58b45da28 req-ecfaf2e5-0f61-4b7f-84c8-74e03230e38e service nova] Lock "20716905-c56a-4729-8c5b-9188502dc477-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:12:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ff0246da-d4b8-46f7-b960-e1d58b45da28 req-ecfaf2e5-0f61-4b7f-84c8-74e03230e38e service nova] Lock "20716905-c56a-4729-8c5b-9188502dc477-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:12:53 user nova-compute[74994]: DEBUG nova.compute.manager [req-ff0246da-d4b8-46f7-b960-e1d58b45da28 req-ecfaf2e5-0f61-4b7f-84c8-74e03230e38e service nova] [instance: 20716905-c56a-4729-8c5b-9188502dc477] No waiting events found dispatching network-vif-plugged-10b84648-2b56-4451-b4f3-3ec4ad7b7771 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:12:53 user nova-compute[74994]: WARNING nova.compute.manager [req-ff0246da-d4b8-46f7-b960-e1d58b45da28 req-ecfaf2e5-0f61-4b7f-84c8-74e03230e38e service nova] [instance: 20716905-c56a-4729-8c5b-9188502dc477] Received unexpected event network-vif-plugged-10b84648-2b56-4451-b4f3-3ec4ad7b7771 for instance with vm_state deleted and task_state None.
Nov 28 11:12:56 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:13:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:13:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:13:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:13:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:13:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:13:21 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:21 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:13:21 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:22 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:13:22 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 11:13:22 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:23 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:13:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:13:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:13:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:13:23 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 11:13:23 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:13:23 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:13:23 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=9041MB free_disk=25.193599700927734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 11:13:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:13:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:13:23 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 11:13:23 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 11:13:23 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:13:23 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:13:24 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 11:13:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.160s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:13:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:26 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:13:26 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:13:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:30 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:13:30 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 11:13:30 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Rebuilding the list of instances to heal {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 11:13:30 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Didn't find any instances for network info cache update. {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 11:13:30 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:13:31 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:32 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:13:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Acquiring lock "258716ef-0a49-49bf-b893-effff4fe9307" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:13:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "258716ef-0a49-49bf-b893-effff4fe9307" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:13:32 user nova-compute[74994]: DEBUG nova.compute.manager [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 11:13:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:13:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:13:32 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 11:13:32 user nova-compute[74994]: INFO nova.compute.claims [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Claim successful on node user
Nov 28 11:13:32 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:13:32 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:13:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.196s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:13:32 user nova-compute[74994]: DEBUG nova.compute.manager [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 11:13:32 user nova-compute[74994]: DEBUG nova.compute.manager [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 11:13:32 user nova-compute[74994]: DEBUG nova.network.neutron [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 11:13:32 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 11:13:33 user nova-compute[74994]: DEBUG nova.compute.manager [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 11:13:33 user nova-compute[74994]: DEBUG nova.policy [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '879781a7540a448aac2e1c3a89f712bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc76d73b2a1142409262135e96f3cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 11:13:33 user nova-compute[74994]: DEBUG nova.compute.manager [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 11:13:33 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 11:13:33 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Creating image(s)
Nov 28 11:13:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Acquiring lock "/opt/stack/data/nova/instances/258716ef-0a49-49bf-b893-effff4fe9307/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:13:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "/opt/stack/data/nova/instances/258716ef-0a49-49bf-b893-effff4fe9307/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:13:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "/opt/stack/data/nova/instances/258716ef-0a49-49bf-b893-effff4fe9307/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:13:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:13:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.170s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:13:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Acquiring lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:13:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:13:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:13:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.183s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:13:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/258716ef-0a49-49bf-b893-effff4fe9307/disk 1073741824 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:13:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/258716ef-0a49-49bf-b893-effff4fe9307/disk 1073741824" returned: 0 in 0.047s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:13:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:13:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:13:33 user nova-compute[74994]: DEBUG nova.network.neutron [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Successfully created port: b675b07b-e0c7-46bb-8a13-acddbd4d4488 {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 11:13:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.173s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:13:33 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Checking if we can resize image /opt/stack/data/nova/instances/258716ef-0a49-49bf-b893-effff4fe9307/disk. size=1073741824 {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 11:13:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/258716ef-0a49-49bf-b893-effff4fe9307/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:13:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/258716ef-0a49-49bf-b893-effff4fe9307/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:13:33 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Cannot resize image /opt/stack/data/nova/instances/258716ef-0a49-49bf-b893-effff4fe9307/disk to a smaller size. {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 11:13:33 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Created local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 11:13:33 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Ensure instance console log exists: /opt/stack/data/nova/instances/258716ef-0a49-49bf-b893-effff4fe9307/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 11:13:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:13:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:13:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG nova.network.neutron [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Successfully updated port: b675b07b-e0c7-46bb-8a13-acddbd4d4488 {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Acquiring lock "refresh_cache-258716ef-0a49-49bf-b893-effff4fe9307" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Acquired lock "refresh_cache-258716ef-0a49-49bf-b893-effff4fe9307" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG nova.network.neutron [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG nova.compute.manager [req-95854fe4-bc5a-4054-9f44-e9cf02412536 req-ec74cc07-b146-4041-af67-74a6a02cd9be service nova] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Received event network-changed-b675b07b-e0c7-46bb-8a13-acddbd4d4488 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG nova.compute.manager [req-95854fe4-bc5a-4054-9f44-e9cf02412536 req-ec74cc07-b146-4041-af67-74a6a02cd9be service nova] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Refreshing instance network info cache due to event network-changed-b675b07b-e0c7-46bb-8a13-acddbd4d4488. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-95854fe4-bc5a-4054-9f44-e9cf02412536 req-ec74cc07-b146-4041-af67-74a6a02cd9be service nova] Acquiring lock "refresh_cache-258716ef-0a49-49bf-b893-effff4fe9307" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG nova.network.neutron [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG nova.network.neutron [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Updating instance_info_cache with network_info: [{"id": "b675b07b-e0c7-46bb-8a13-acddbd4d4488", "address": "fa:16:3e:d4:93:c3", "network": {"id": "45bc19c0-a3b5-478a-8289-a0f75228a260", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1070183224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc76d73b2a1142409262135e96f3cc82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb675b07b-e0", "ovs_interfaceid": "b675b07b-e0c7-46bb-8a13-acddbd4d4488", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Releasing lock "refresh_cache-258716ef-0a49-49bf-b893-effff4fe9307" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG nova.compute.manager [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Instance network_info: |[{"id": "b675b07b-e0c7-46bb-8a13-acddbd4d4488", "address": "fa:16:3e:d4:93:c3", "network": {"id": "45bc19c0-a3b5-478a-8289-a0f75228a260", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1070183224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc76d73b2a1142409262135e96f3cc82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb675b07b-e0", "ovs_interfaceid": "b675b07b-e0c7-46bb-8a13-acddbd4d4488", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-95854fe4-bc5a-4054-9f44-e9cf02412536 req-ec74cc07-b146-4041-af67-74a6a02cd9be service nova] Acquired lock "refresh_cache-258716ef-0a49-49bf-b893-effff4fe9307" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG nova.network.neutron [req-95854fe4-bc5a-4054-9f44-e9cf02412536 req-ec74cc07-b146-4041-af67-74a6a02cd9be service nova] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Refreshing network info cache for port b675b07b-e0c7-46bb-8a13-acddbd4d4488 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Start _get_guest_xml network_info=[{"id": "b675b07b-e0c7-46bb-8a13-acddbd4d4488", "address": "fa:16:3e:d4:93:c3", "network": {"id": "45bc19c0-a3b5-478a-8289-a0f75228a260", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1070183224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc76d73b2a1142409262135e96f3cc82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb675b07b-e0", "ovs_interfaceid": "b675b07b-e0c7-46bb-8a13-acddbd4d4488", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'aa939d1b-b8a6-4391-935b-0191bf5ccd0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 11:13:34 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:13:34 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:13:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:13:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-457682885',display_name='tempest-VolumesSnapshotTestJSON-instance-457682885',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-457682885',id=40,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOzBSRLIsegYbt2MKCLQ+pjy3KEWNjCbWm4lRWApA4dgdIfSfxdTnc0NEvRzu+2EuFsV7TfskEzr2cFMkhzXBt9oHLfyqsP2CPn9gGdx6Zp0GUPen9Yz5jtnMOAWbADEkw==',key_name='tempest-keypair-440809517',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc76d73b2a1142409262135e96f3cc82',ramdisk_id='',reservation_id='r-pmwof59n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-496080761',owner_user_name='tempest-VolumesSnapshotTestJSON-496080761-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:13:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='879781a7540a448aac2e1c3a89f712bb',uuid=258716ef-0a49-49bf-b893-effff4fe9307,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b675b07b-e0c7-46bb-8a13-acddbd4d4488", "address": "fa:16:3e:d4:93:c3", "network": {"id": "45bc19c0-a3b5-478a-8289-a0f75228a260", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1070183224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc76d73b2a1142409262135e96f3cc82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb675b07b-e0", "ovs_interfaceid": "b675b07b-e0c7-46bb-8a13-acddbd4d4488", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Converting VIF {"id": "b675b07b-e0c7-46bb-8a13-acddbd4d4488", "address": "fa:16:3e:d4:93:c3", "network": {"id": "45bc19c0-a3b5-478a-8289-a0f75228a260", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1070183224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc76d73b2a1142409262135e96f3cc82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb675b07b-e0", "ovs_interfaceid": "b675b07b-e0c7-46bb-8a13-acddbd4d4488", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:93:c3,bridge_name='br-int',has_traffic_filtering=True,id=b675b07b-e0c7-46bb-8a13-acddbd4d4488,network=Network(45bc19c0-a3b5-478a-8289-a0f75228a260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb675b07b-e0') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG nova.objects.instance [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lazy-loading 'pci_devices' on Instance uuid 258716ef-0a49-49bf-b893-effff4fe9307 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] End _get_guest_xml xml=<domain type="kvm">
Nov 28 11:13:34 user nova-compute[74994]:   <uuid>258716ef-0a49-49bf-b893-effff4fe9307</uuid>
Nov 28 11:13:34 user nova-compute[74994]:   <name>instance-00000028</name>
Nov 28 11:13:34 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 11:13:34 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 11:13:34 user nova-compute[74994]:   <metadata>
Nov 28 11:13:34 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 11:13:34 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 11:13:34 user nova-compute[74994]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-457682885</nova:name>
Nov 28 11:13:34 user nova-compute[74994]:       <nova:creationTime>2023-11-28 11:13:34</nova:creationTime>
Nov 28 11:13:34 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 11:13:34 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 11:13:34 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 11:13:34 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 11:13:34 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 11:13:34 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 11:13:34 user nova-compute[74994]:       </nova:flavor>
Nov 28 11:13:34 user nova-compute[74994]:       <nova:owner>
Nov 28 11:13:34 user nova-compute[74994]:         <nova:user uuid="879781a7540a448aac2e1c3a89f712bb">tempest-VolumesSnapshotTestJSON-496080761-project-member</nova:user>
Nov 28 11:13:34 user nova-compute[74994]:         <nova:project uuid="cc76d73b2a1142409262135e96f3cc82">tempest-VolumesSnapshotTestJSON-496080761</nova:project>
Nov 28 11:13:34 user nova-compute[74994]:       </nova:owner>
Nov 28 11:13:34 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 11:13:34 user nova-compute[74994]:       <nova:ports>
Nov 28 11:13:34 user nova-compute[74994]:         <nova:port uuid="b675b07b-e0c7-46bb-8a13-acddbd4d4488">
Nov 28 11:13:34 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 28 11:13:34 user nova-compute[74994]:         </nova:port>
Nov 28 11:13:34 user nova-compute[74994]:       </nova:ports>
Nov 28 11:13:34 user nova-compute[74994]:     </nova:instance>
Nov 28 11:13:34 user nova-compute[74994]:   </metadata>
Nov 28 11:13:34 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 11:13:34 user nova-compute[74994]:     <system>
Nov 28 11:13:34 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 11:13:34 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 11:13:34 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 11:13:34 user nova-compute[74994]:       <entry name="serial">258716ef-0a49-49bf-b893-effff4fe9307</entry>
Nov 28 11:13:34 user nova-compute[74994]:       <entry name="uuid">258716ef-0a49-49bf-b893-effff4fe9307</entry>
Nov 28 11:13:34 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 11:13:34 user nova-compute[74994]:     </system>
Nov 28 11:13:34 user nova-compute[74994]:   </sysinfo>
Nov 28 11:13:34 user nova-compute[74994]:   <os>
Nov 28 11:13:34 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 11:13:34 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 11:13:34 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 11:13:34 user nova-compute[74994]:   </os>
Nov 28 11:13:34 user nova-compute[74994]:   <features>
Nov 28 11:13:34 user nova-compute[74994]:     <acpi/>
Nov 28 11:13:34 user nova-compute[74994]:     <apic/>
Nov 28 11:13:34 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 11:13:34 user nova-compute[74994]:   </features>
Nov 28 11:13:34 user nova-compute[74994]:   <clock offset="utc">
Nov 28 11:13:34 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 11:13:34 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 11:13:34 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 11:13:34 user nova-compute[74994]:   </clock>
Nov 28 11:13:34 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 11:13:34 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 11:13:34 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 11:13:34 user nova-compute[74994]:   </cpu>
Nov 28 11:13:34 user nova-compute[74994]:   <devices>
Nov 28 11:13:34 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 11:13:34 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 11:13:34 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/258716ef-0a49-49bf-b893-effff4fe9307/disk"/>
Nov 28 11:13:34 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 11:13:34 user nova-compute[74994]:     </disk>
Nov 28 11:13:34 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 11:13:34 user nova-compute[74994]:       <mac address="fa:16:3e:d4:93:c3"/>
Nov 28 11:13:34 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:13:34 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 11:13:34 user nova-compute[74994]:       <target dev="tapb675b07b-e0"/>
Nov 28 11:13:34 user nova-compute[74994]:     </interface>
Nov 28 11:13:34 user nova-compute[74994]:     <serial type="pty">
Nov 28 11:13:34 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/258716ef-0a49-49bf-b893-effff4fe9307/console.log" append="off"/>
Nov 28 11:13:34 user nova-compute[74994]:     </serial>
Nov 28 11:13:34 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 11:13:34 user nova-compute[74994]:     <video>
Nov 28 11:13:34 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:13:34 user nova-compute[74994]:     </video>
Nov 28 11:13:34 user nova-compute[74994]:     <rng model="virtio">
Nov 28 11:13:34 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 11:13:34 user nova-compute[74994]:     </rng>
Nov 28 11:13:34 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 11:13:34 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 11:13:34 user nova-compute[74994]:       <stats period="10"/>
Nov 28 11:13:34 user nova-compute[74994]:     </memballoon>
Nov 28 11:13:34 user nova-compute[74994]:   </devices>
Nov 28 11:13:34 user nova-compute[74994]: </domain>
Nov 28 11:13:34 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:13:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-457682885',display_name='tempest-VolumesSnapshotTestJSON-instance-457682885',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-457682885',id=40,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOzBSRLIsegYbt2MKCLQ+pjy3KEWNjCbWm4lRWApA4dgdIfSfxdTnc0NEvRzu+2EuFsV7TfskEzr2cFMkhzXBt9oHLfyqsP2CPn9gGdx6Zp0GUPen9Yz5jtnMOAWbADEkw==',key_name='tempest-keypair-440809517',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc76d73b2a1142409262135e96f3cc82',ramdisk_id='',reservation_id='r-pmwof59n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-496080761',owner_user_name='tempest-VolumesSnapshotTestJSON-496080761-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:13:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='879781a7540a448aac2e1c3a89f712bb',uuid=258716ef-0a49-49bf-b893-effff4fe9307,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b675b07b-e0c7-46bb-8a13-acddbd4d4488", "address": "fa:16:3e:d4:93:c3", "network": {"id": "45bc19c0-a3b5-478a-8289-a0f75228a260", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1070183224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc76d73b2a1142409262135e96f3cc82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb675b07b-e0", "ovs_interfaceid": "b675b07b-e0c7-46bb-8a13-acddbd4d4488", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Converting VIF {"id": "b675b07b-e0c7-46bb-8a13-acddbd4d4488", "address": "fa:16:3e:d4:93:c3", "network": {"id": "45bc19c0-a3b5-478a-8289-a0f75228a260", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1070183224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc76d73b2a1142409262135e96f3cc82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb675b07b-e0", "ovs_interfaceid": "b675b07b-e0c7-46bb-8a13-acddbd4d4488", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:93:c3,bridge_name='br-int',has_traffic_filtering=True,id=b675b07b-e0c7-46bb-8a13-acddbd4d4488,network=Network(45bc19c0-a3b5-478a-8289-a0f75228a260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb675b07b-e0') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG os_vif [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:93:c3,bridge_name='br-int',has_traffic_filtering=True,id=b675b07b-e0c7-46bb-8a13-acddbd4d4488,network=Network(45bc19c0-a3b5-478a-8289-a0f75228a260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb675b07b-e0') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8ecd92c6-c5d5-5e55-84c2-6bc26d342ccd', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb675b07b-e0, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb675b07b-e0, col_values=(('qos', UUID('520dda6a-0dbf-40fa-ab72-4489c95ee1ef')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb675b07b-e0, col_values=(('external_ids', {'iface-id': 'b675b07b-e0c7-46bb-8a13-acddbd4d4488', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:93:c3', 'vm-uuid': '258716ef-0a49-49bf-b893-effff4fe9307'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:34 user nova-compute[74994]: INFO os_vif [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:93:c3,bridge_name='br-int',has_traffic_filtering=True,id=b675b07b-e0c7-46bb-8a13-acddbd4d4488,network=Network(45bc19c0-a3b5-478a-8289-a0f75228a260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb675b07b-e0')
Nov 28 11:13:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] No VIF found with MAC fa:16:3e:d4:93:c3, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG nova.network.neutron [req-95854fe4-bc5a-4054-9f44-e9cf02412536 req-ec74cc07-b146-4041-af67-74a6a02cd9be service nova] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Updated VIF entry in instance network info cache for port b675b07b-e0c7-46bb-8a13-acddbd4d4488. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG nova.network.neutron [req-95854fe4-bc5a-4054-9f44-e9cf02412536 req-ec74cc07-b146-4041-af67-74a6a02cd9be service nova] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Updating instance_info_cache with network_info: [{"id": "b675b07b-e0c7-46bb-8a13-acddbd4d4488", "address": "fa:16:3e:d4:93:c3", "network": {"id": "45bc19c0-a3b5-478a-8289-a0f75228a260", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1070183224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc76d73b2a1142409262135e96f3cc82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb675b07b-e0", "ovs_interfaceid": "b675b07b-e0c7-46bb-8a13-acddbd4d4488", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:13:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-95854fe4-bc5a-4054-9f44-e9cf02412536 req-ec74cc07-b146-4041-af67-74a6a02cd9be service nova] Releasing lock "refresh_cache-258716ef-0a49-49bf-b893-effff4fe9307" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:13:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:36 user nova-compute[74994]: DEBUG nova.compute.manager [req-e6758c94-18de-4dd5-ada2-7bb7a94fba5e req-2bdb2f3c-8001-4a55-a448-81a5cc42dbf2 service nova] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Received event network-vif-plugged-b675b07b-e0c7-46bb-8a13-acddbd4d4488 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:13:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-e6758c94-18de-4dd5-ada2-7bb7a94fba5e req-2bdb2f3c-8001-4a55-a448-81a5cc42dbf2 service nova] Acquiring lock "258716ef-0a49-49bf-b893-effff4fe9307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:13:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-e6758c94-18de-4dd5-ada2-7bb7a94fba5e req-2bdb2f3c-8001-4a55-a448-81a5cc42dbf2 service nova] Lock "258716ef-0a49-49bf-b893-effff4fe9307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:13:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-e6758c94-18de-4dd5-ada2-7bb7a94fba5e req-2bdb2f3c-8001-4a55-a448-81a5cc42dbf2 service nova] Lock "258716ef-0a49-49bf-b893-effff4fe9307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:13:36 user nova-compute[74994]: DEBUG nova.compute.manager [req-e6758c94-18de-4dd5-ada2-7bb7a94fba5e req-2bdb2f3c-8001-4a55-a448-81a5cc42dbf2 service nova] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] No waiting events found dispatching network-vif-plugged-b675b07b-e0c7-46bb-8a13-acddbd4d4488 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:13:36 user nova-compute[74994]: WARNING nova.compute.manager [req-e6758c94-18de-4dd5-ada2-7bb7a94fba5e req-2bdb2f3c-8001-4a55-a448-81a5cc42dbf2 service nova] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Received unexpected event network-vif-plugged-b675b07b-e0c7-46bb-8a13-acddbd4d4488 for instance with vm_state building and task_state spawning.
Nov 28 11:13:36 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:13:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Acquiring lock "9cee93d4-276b-4cc0-907a-2918d598d665" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:13:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Lock "9cee93d4-276b-4cc0-907a-2918d598d665" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:13:37 user nova-compute[74994]: DEBUG nova.compute.manager [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 11:13:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:13:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:13:37 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 11:13:37 user nova-compute[74994]: INFO nova.compute.claims [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Claim successful on node user
Nov 28 11:13:38 user nova-compute[74994]: DEBUG nova.compute.manager [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 11:13:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 11:13:38 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Instance spawned successfully.
Nov 28 11:13:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 11:13:38 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:13:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:13:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:13:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:13:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:13:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:13:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:13:38 user nova-compute[74994]: DEBUG nova.compute.manager [req-1a0adafd-237c-45f9-ac86-ea50ebe15c02 req-501a9849-3b85-48fa-9dda-e893b46d6435 service nova] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Received event network-vif-plugged-b675b07b-e0c7-46bb-8a13-acddbd4d4488 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:13:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-1a0adafd-237c-45f9-ac86-ea50ebe15c02 req-501a9849-3b85-48fa-9dda-e893b46d6435 service nova] Acquiring lock "258716ef-0a49-49bf-b893-effff4fe9307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:13:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-1a0adafd-237c-45f9-ac86-ea50ebe15c02 req-501a9849-3b85-48fa-9dda-e893b46d6435 service nova] Lock "258716ef-0a49-49bf-b893-effff4fe9307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:13:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-1a0adafd-237c-45f9-ac86-ea50ebe15c02 req-501a9849-3b85-48fa-9dda-e893b46d6435 service nova] Lock "258716ef-0a49-49bf-b893-effff4fe9307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:13:38 user nova-compute[74994]: DEBUG nova.compute.manager [req-1a0adafd-237c-45f9-ac86-ea50ebe15c02 req-501a9849-3b85-48fa-9dda-e893b46d6435 service nova] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] No waiting events found dispatching network-vif-plugged-b675b07b-e0c7-46bb-8a13-acddbd4d4488 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:13:38 user nova-compute[74994]: WARNING nova.compute.manager [req-1a0adafd-237c-45f9-ac86-ea50ebe15c02 req-501a9849-3b85-48fa-9dda-e893b46d6435 service nova] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Received unexpected event network-vif-plugged-b675b07b-e0c7-46bb-8a13-acddbd4d4488 for instance with vm_state building and task_state spawning.
Nov 28 11:13:38 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:13:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.294s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:13:38 user nova-compute[74994]: DEBUG nova.compute.manager [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 11:13:38 user nova-compute[74994]: INFO nova.compute.manager [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Took 5.14 seconds to spawn the instance on the hypervisor.
Nov 28 11:13:38 user nova-compute[74994]: DEBUG nova.compute.manager [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 11:13:38 user nova-compute[74994]: DEBUG nova.compute.manager [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 11:13:38 user nova-compute[74994]: DEBUG nova.network.neutron [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 11:13:38 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 11:13:38 user nova-compute[74994]: DEBUG nova.compute.manager [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 11:13:38 user nova-compute[74994]: INFO nova.compute.manager [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Took 5.73 seconds to build instance.
Nov 28 11:13:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4828126e-6146-40d2-ba7c-bc5ff718194d tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "258716ef-0a49-49bf-b893-effff4fe9307" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.834s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:13:38 user nova-compute[74994]: DEBUG nova.policy [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e6dcb9651a945ae95732a246f6a2857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd213989fc07742e6a087593430826861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 11:13:38 user nova-compute[74994]: DEBUG nova.compute.manager [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 11:13:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 11:13:38 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Creating image(s)
Nov 28 11:13:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Acquiring lock "/opt/stack/data/nova/instances/9cee93d4-276b-4cc0-907a-2918d598d665/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:13:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Lock "/opt/stack/data/nova/instances/9cee93d4-276b-4cc0-907a-2918d598d665/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:13:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Lock "/opt/stack/data/nova/instances/9cee93d4-276b-4cc0-907a-2918d598d665/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:13:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:13:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.220s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:13:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Acquiring lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:13:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:13:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:13:38 user nova-compute[74994]: DEBUG nova.network.neutron [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Successfully created port: 72e4811c-7bd4-4ddc-baa9-1b6446eb6241 {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 11:13:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.217s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:13:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/9cee93d4-276b-4cc0-907a-2918d598d665/disk 1073741824 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:13:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/9cee93d4-276b-4cc0-907a-2918d598d665/disk 1073741824" returned: 0 in 0.049s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:13:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:13:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:13:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.180s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:13:39 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9cee93d4-276b-4cc0-907a-2918d598d665/disk. size=1073741824 {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 11:13:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cee93d4-276b-4cc0-907a-2918d598d665/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:13:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cee93d4-276b-4cc0-907a-2918d598d665/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:13:39 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Cannot resize image /opt/stack/data/nova/instances/9cee93d4-276b-4cc0-907a-2918d598d665/disk to a smaller size. {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 11:13:39 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Created local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 11:13:39 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Ensure instance console log exists: /opt/stack/data/nova/instances/9cee93d4-276b-4cc0-907a-2918d598d665/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 11:13:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:13:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:13:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:13:39 user nova-compute[74994]: DEBUG nova.network.neutron [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Successfully updated port: 72e4811c-7bd4-4ddc-baa9-1b6446eb6241 {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 11:13:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Acquiring lock "refresh_cache-9cee93d4-276b-4cc0-907a-2918d598d665" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:13:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Acquired lock "refresh_cache-9cee93d4-276b-4cc0-907a-2918d598d665" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:13:39 user nova-compute[74994]: DEBUG nova.network.neutron [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 11:13:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:39 user nova-compute[74994]: DEBUG nova.compute.manager [req-63ab48a6-b797-4ac9-a331-4d6b735656d3 req-5d8e36ac-bdf1-43c7-9916-ed8d79a66adc service nova] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Received event network-changed-72e4811c-7bd4-4ddc-baa9-1b6446eb6241 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:13:39 user nova-compute[74994]: DEBUG nova.compute.manager [req-63ab48a6-b797-4ac9-a331-4d6b735656d3 req-5d8e36ac-bdf1-43c7-9916-ed8d79a66adc service nova] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Refreshing instance network info cache due to event network-changed-72e4811c-7bd4-4ddc-baa9-1b6446eb6241. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:13:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-63ab48a6-b797-4ac9-a331-4d6b735656d3 req-5d8e36ac-bdf1-43c7-9916-ed8d79a66adc service nova] Acquiring lock "refresh_cache-9cee93d4-276b-4cc0-907a-2918d598d665" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:13:39 user nova-compute[74994]: DEBUG nova.network.neutron [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 11:13:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:40 user nova-compute[74994]: DEBUG nova.network.neutron [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Updating instance_info_cache with network_info: [{"id": "72e4811c-7bd4-4ddc-baa9-1b6446eb6241", "address": "fa:16:3e:89:7e:23", "network": {"id": "0833228c-a00a-42e2-bcbd-d943e976dc13", "bridge": "br-int", "label": "tempest-VolumesActionsTest-373359983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d213989fc07742e6a087593430826861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e4811c-7b", "ovs_interfaceid": "72e4811c-7bd4-4ddc-baa9-1b6446eb6241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:13:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Releasing lock "refresh_cache-9cee93d4-276b-4cc0-907a-2918d598d665" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:13:40 user nova-compute[74994]: DEBUG nova.compute.manager [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Instance network_info: |[{"id": "72e4811c-7bd4-4ddc-baa9-1b6446eb6241", "address": "fa:16:3e:89:7e:23", "network": {"id": "0833228c-a00a-42e2-bcbd-d943e976dc13", "bridge": "br-int", "label": "tempest-VolumesActionsTest-373359983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d213989fc07742e6a087593430826861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e4811c-7b", "ovs_interfaceid": "72e4811c-7bd4-4ddc-baa9-1b6446eb6241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 11:13:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-63ab48a6-b797-4ac9-a331-4d6b735656d3 req-5d8e36ac-bdf1-43c7-9916-ed8d79a66adc service nova] Acquired lock "refresh_cache-9cee93d4-276b-4cc0-907a-2918d598d665" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:13:40 user nova-compute[74994]: DEBUG nova.network.neutron [req-63ab48a6-b797-4ac9-a331-4d6b735656d3 req-5d8e36ac-bdf1-43c7-9916-ed8d79a66adc service nova] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Refreshing network info cache for port 72e4811c-7bd4-4ddc-baa9-1b6446eb6241 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:13:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Start _get_guest_xml network_info=[{"id": "72e4811c-7bd4-4ddc-baa9-1b6446eb6241", "address": "fa:16:3e:89:7e:23", "network": {"id": "0833228c-a00a-42e2-bcbd-d943e976dc13", "bridge": "br-int", "label": "tempest-VolumesActionsTest-373359983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d213989fc07742e6a087593430826861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e4811c-7b", "ovs_interfaceid": "72e4811c-7bd4-4ddc-baa9-1b6446eb6241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'aa939d1b-b8a6-4391-935b-0191bf5ccd0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 11:13:40 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:13:40 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:13:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 11:13:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 11:13:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 11:13:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 11:13:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 11:13:40 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 11:13:40 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 11:13:40 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 11:13:40 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 11:13:40 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 11:13:40 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 11:13:40 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 11:13:40 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 11:13:40 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 11:13:40 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 11:13:40 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 11:13:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:13:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1066832720',display_name='tempest-VolumesActionsTest-instance-1066832720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1066832720',id=41,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d213989fc07742e6a087593430826861',ramdisk_id='',reservation_id='r-2cppa39n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1285521872',owner_user_name='tempest-VolumesActionsTest-1285521872-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:13:38Z,user_data=None,user_id='7e6dcb9651a945ae95732a246f6a2857',uuid=9cee93d4-276b-4cc0-907a-2918d598d665,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72e4811c-7bd4-4ddc-baa9-1b6446eb6241", "address": "fa:16:3e:89:7e:23", "network": {"id": "0833228c-a00a-42e2-bcbd-d943e976dc13", "bridge": "br-int", "label": "tempest-VolumesActionsTest-373359983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d213989fc07742e6a087593430826861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e4811c-7b", "ovs_interfaceid": "72e4811c-7bd4-4ddc-baa9-1b6446eb6241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 11:13:40 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Converting VIF {"id": "72e4811c-7bd4-4ddc-baa9-1b6446eb6241", "address": "fa:16:3e:89:7e:23", "network": {"id": "0833228c-a00a-42e2-bcbd-d943e976dc13", "bridge": "br-int", "label": "tempest-VolumesActionsTest-373359983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d213989fc07742e6a087593430826861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e4811c-7b", "ovs_interfaceid": "72e4811c-7bd4-4ddc-baa9-1b6446eb6241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:13:40 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:7e:23,bridge_name='br-int',has_traffic_filtering=True,id=72e4811c-7bd4-4ddc-baa9-1b6446eb6241,network=Network(0833228c-a00a-42e2-bcbd-d943e976dc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72e4811c-7b') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:13:40 user nova-compute[74994]: DEBUG nova.objects.instance [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Lazy-loading 'pci_devices' on Instance uuid 9cee93d4-276b-4cc0-907a-2918d598d665 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:13:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] End _get_guest_xml xml=<domain type="kvm">
Nov 28 11:13:40 user nova-compute[74994]:   <uuid>9cee93d4-276b-4cc0-907a-2918d598d665</uuid>
Nov 28 11:13:40 user nova-compute[74994]:   <name>instance-00000029</name>
Nov 28 11:13:40 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 11:13:40 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 11:13:40 user nova-compute[74994]:   <metadata>
Nov 28 11:13:40 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 11:13:40 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 11:13:40 user nova-compute[74994]:       <nova:name>tempest-VolumesActionsTest-instance-1066832720</nova:name>
Nov 28 11:13:40 user nova-compute[74994]:       <nova:creationTime>2023-11-28 11:13:40</nova:creationTime>
Nov 28 11:13:40 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 11:13:40 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 11:13:40 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 11:13:40 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 11:13:40 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 11:13:40 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 11:13:40 user nova-compute[74994]:       </nova:flavor>
Nov 28 11:13:40 user nova-compute[74994]:       <nova:owner>
Nov 28 11:13:40 user nova-compute[74994]:         <nova:user uuid="7e6dcb9651a945ae95732a246f6a2857">tempest-VolumesActionsTest-1285521872-project-member</nova:user>
Nov 28 11:13:40 user nova-compute[74994]:         <nova:project uuid="d213989fc07742e6a087593430826861">tempest-VolumesActionsTest-1285521872</nova:project>
Nov 28 11:13:40 user nova-compute[74994]:       </nova:owner>
Nov 28 11:13:40 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 11:13:40 user nova-compute[74994]:       <nova:ports>
Nov 28 11:13:40 user nova-compute[74994]:         <nova:port uuid="72e4811c-7bd4-4ddc-baa9-1b6446eb6241">
Nov 28 11:13:40 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 11:13:40 user nova-compute[74994]:         </nova:port>
Nov 28 11:13:40 user nova-compute[74994]:       </nova:ports>
Nov 28 11:13:40 user nova-compute[74994]:     </nova:instance>
Nov 28 11:13:40 user nova-compute[74994]:   </metadata>
Nov 28 11:13:40 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 11:13:40 user nova-compute[74994]:     <system>
Nov 28 11:13:40 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 11:13:40 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 11:13:40 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 11:13:40 user nova-compute[74994]:       <entry name="serial">9cee93d4-276b-4cc0-907a-2918d598d665</entry>
Nov 28 11:13:40 user nova-compute[74994]:       <entry name="uuid">9cee93d4-276b-4cc0-907a-2918d598d665</entry>
Nov 28 11:13:40 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 11:13:40 user nova-compute[74994]:     </system>
Nov 28 11:13:40 user nova-compute[74994]:   </sysinfo>
Nov 28 11:13:40 user nova-compute[74994]:   <os>
Nov 28 11:13:40 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 11:13:40 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 11:13:40 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 11:13:40 user nova-compute[74994]:   </os>
Nov 28 11:13:40 user nova-compute[74994]:   <features>
Nov 28 11:13:40 user nova-compute[74994]:     <acpi/>
Nov 28 11:13:40 user nova-compute[74994]:     <apic/>
Nov 28 11:13:40 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 11:13:40 user nova-compute[74994]:   </features>
Nov 28 11:13:40 user nova-compute[74994]:   <clock offset="utc">
Nov 28 11:13:40 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 11:13:40 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 11:13:40 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 11:13:40 user nova-compute[74994]:   </clock>
Nov 28 11:13:40 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 11:13:40 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 11:13:40 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 11:13:40 user nova-compute[74994]:   </cpu>
Nov 28 11:13:40 user nova-compute[74994]:   <devices>
Nov 28 11:13:40 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 11:13:40 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 11:13:40 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/9cee93d4-276b-4cc0-907a-2918d598d665/disk"/>
Nov 28 11:13:40 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 11:13:40 user nova-compute[74994]:     </disk>
Nov 28 11:13:40 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 11:13:40 user nova-compute[74994]:       <mac address="fa:16:3e:89:7e:23"/>
Nov 28 11:13:40 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:13:40 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 11:13:40 user nova-compute[74994]:       <target dev="tap72e4811c-7b"/>
Nov 28 11:13:40 user nova-compute[74994]:     </interface>
Nov 28 11:13:40 user nova-compute[74994]:     <serial type="pty">
Nov 28 11:13:40 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/9cee93d4-276b-4cc0-907a-2918d598d665/console.log" append="off"/>
Nov 28 11:13:40 user nova-compute[74994]:     </serial>
Nov 28 11:13:40 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 11:13:40 user nova-compute[74994]:     <video>
Nov 28 11:13:40 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:13:40 user nova-compute[74994]:     </video>
Nov 28 11:13:40 user nova-compute[74994]:     <rng model="virtio">
Nov 28 11:13:40 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 11:13:40 user nova-compute[74994]:     </rng>
Nov 28 11:13:40 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 11:13:40 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 11:13:40 user nova-compute[74994]:       <stats period="10"/>
Nov 28 11:13:40 user nova-compute[74994]:     </memballoon>
Nov 28 11:13:40 user nova-compute[74994]:   </devices>
Nov 28 11:13:40 user nova-compute[74994]: </domain>
Nov 28 11:13:40 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 11:13:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:13:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1066832720',display_name='tempest-VolumesActionsTest-instance-1066832720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1066832720',id=41,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d213989fc07742e6a087593430826861',ramdisk_id='',reservation_id='r-2cppa39n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1285521872',owner_user_name='tempest-VolumesActionsTest-1285521872-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:13:38Z,user_data=None,user_id='7e6dcb9651a945ae95732a246f6a2857',uuid=9cee93d4-276b-4cc0-907a-2918d598d665,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72e4811c-7bd4-4ddc-baa9-1b6446eb6241", "address": "fa:16:3e:89:7e:23", "network": {"id": "0833228c-a00a-42e2-bcbd-d943e976dc13", "bridge": "br-int", "label": "tempest-VolumesActionsTest-373359983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d213989fc07742e6a087593430826861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e4811c-7b", "ovs_interfaceid": "72e4811c-7bd4-4ddc-baa9-1b6446eb6241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 11:13:40 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Converting VIF {"id": "72e4811c-7bd4-4ddc-baa9-1b6446eb6241", "address": "fa:16:3e:89:7e:23", "network": {"id": "0833228c-a00a-42e2-bcbd-d943e976dc13", "bridge": "br-int", "label": "tempest-VolumesActionsTest-373359983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d213989fc07742e6a087593430826861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e4811c-7b", "ovs_interfaceid": "72e4811c-7bd4-4ddc-baa9-1b6446eb6241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:13:40 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:7e:23,bridge_name='br-int',has_traffic_filtering=True,id=72e4811c-7bd4-4ddc-baa9-1b6446eb6241,network=Network(0833228c-a00a-42e2-bcbd-d943e976dc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72e4811c-7b') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:13:40 user nova-compute[74994]: DEBUG os_vif [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:7e:23,bridge_name='br-int',has_traffic_filtering=True,id=72e4811c-7bd4-4ddc-baa9-1b6446eb6241,network=Network(0833228c-a00a-42e2-bcbd-d943e976dc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72e4811c-7b') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 11:13:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:13:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 11:13:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3cd29d61-c636-59ff-b4b4-a239add2f095', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:13:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:13:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72e4811c-7b, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:13:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap72e4811c-7b, col_values=(('qos', UUID('c33fb8f0-c301-419f-8f45-6527119e0bfd')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:13:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap72e4811c-7b, col_values=(('external_ids', {'iface-id': '72e4811c-7bd4-4ddc-baa9-1b6446eb6241', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:7e:23', 'vm-uuid': '9cee93d4-276b-4cc0-907a-2918d598d665'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:13:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:13:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:40 user nova-compute[74994]: INFO os_vif [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:7e:23,bridge_name='br-int',has_traffic_filtering=True,id=72e4811c-7bd4-4ddc-baa9-1b6446eb6241,network=Network(0833228c-a00a-42e2-bcbd-d943e976dc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72e4811c-7b')
Nov 28 11:13:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:13:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] No VIF found with MAC fa:16:3e:89:7e:23, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:13:40 user nova-compute[74994]: DEBUG nova.network.neutron [req-63ab48a6-b797-4ac9-a331-4d6b735656d3 req-5d8e36ac-bdf1-43c7-9916-ed8d79a66adc service nova] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Updated VIF entry in instance network info cache for port 72e4811c-7bd4-4ddc-baa9-1b6446eb6241. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:13:40 user nova-compute[74994]: DEBUG nova.network.neutron [req-63ab48a6-b797-4ac9-a331-4d6b735656d3 req-5d8e36ac-bdf1-43c7-9916-ed8d79a66adc service nova] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Updating instance_info_cache with network_info: [{"id": "72e4811c-7bd4-4ddc-baa9-1b6446eb6241", "address": "fa:16:3e:89:7e:23", "network": {"id": "0833228c-a00a-42e2-bcbd-d943e976dc13", "bridge": "br-int", "label": "tempest-VolumesActionsTest-373359983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d213989fc07742e6a087593430826861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e4811c-7b", "ovs_interfaceid": "72e4811c-7bd4-4ddc-baa9-1b6446eb6241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:13:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-63ab48a6-b797-4ac9-a331-4d6b735656d3 req-5d8e36ac-bdf1-43c7-9916-ed8d79a66adc service nova] Releasing lock "refresh_cache-9cee93d4-276b-4cc0-907a-2918d598d665" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:13:41 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:41 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:41 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:41 user nova-compute[74994]: DEBUG nova.compute.manager [req-bf5aa392-1400-45ff-95b4-ec8172e1366d req-f2f7c187-b76b-4649-bf8c-ba0cdca25eb8 service nova] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Received event network-vif-plugged-72e4811c-7bd4-4ddc-baa9-1b6446eb6241 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:13:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bf5aa392-1400-45ff-95b4-ec8172e1366d req-f2f7c187-b76b-4649-bf8c-ba0cdca25eb8 service nova] Acquiring lock "9cee93d4-276b-4cc0-907a-2918d598d665-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:13:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bf5aa392-1400-45ff-95b4-ec8172e1366d req-f2f7c187-b76b-4649-bf8c-ba0cdca25eb8 service nova] Lock "9cee93d4-276b-4cc0-907a-2918d598d665-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:13:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bf5aa392-1400-45ff-95b4-ec8172e1366d req-f2f7c187-b76b-4649-bf8c-ba0cdca25eb8 service nova] Lock "9cee93d4-276b-4cc0-907a-2918d598d665-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:13:41 user nova-compute[74994]: DEBUG nova.compute.manager [req-bf5aa392-1400-45ff-95b4-ec8172e1366d req-f2f7c187-b76b-4649-bf8c-ba0cdca25eb8 service nova] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] No waiting events found dispatching network-vif-plugged-72e4811c-7bd4-4ddc-baa9-1b6446eb6241 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:13:41 user nova-compute[74994]: WARNING nova.compute.manager [req-bf5aa392-1400-45ff-95b4-ec8172e1366d req-f2f7c187-b76b-4649-bf8c-ba0cdca25eb8 service nova] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Received unexpected event network-vif-plugged-72e4811c-7bd4-4ddc-baa9-1b6446eb6241 for instance with vm_state building and task_state spawning.
Nov 28 11:13:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:43 user nova-compute[74994]: DEBUG nova.compute.manager [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 11:13:43 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 11:13:43 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Instance spawned successfully.
Nov 28 11:13:43 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 11:13:43 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:13:43 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:13:43 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:13:43 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:13:43 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:13:43 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:13:44 user nova-compute[74994]: DEBUG nova.compute.manager [req-e08d7190-fb2d-43c9-96cc-f56e5ffbf774 req-d829aebf-7741-4222-96b7-a65f47e1fc05 service nova] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Received event network-vif-plugged-72e4811c-7bd4-4ddc-baa9-1b6446eb6241 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:13:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-e08d7190-fb2d-43c9-96cc-f56e5ffbf774 req-d829aebf-7741-4222-96b7-a65f47e1fc05 service nova] Acquiring lock "9cee93d4-276b-4cc0-907a-2918d598d665-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:13:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-e08d7190-fb2d-43c9-96cc-f56e5ffbf774 req-d829aebf-7741-4222-96b7-a65f47e1fc05 service nova] Lock "9cee93d4-276b-4cc0-907a-2918d598d665-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:13:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-e08d7190-fb2d-43c9-96cc-f56e5ffbf774 req-d829aebf-7741-4222-96b7-a65f47e1fc05 service nova] Lock "9cee93d4-276b-4cc0-907a-2918d598d665-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:13:44 user nova-compute[74994]: DEBUG nova.compute.manager [req-e08d7190-fb2d-43c9-96cc-f56e5ffbf774 req-d829aebf-7741-4222-96b7-a65f47e1fc05 service nova] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] No waiting events found dispatching network-vif-plugged-72e4811c-7bd4-4ddc-baa9-1b6446eb6241 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:13:44 user nova-compute[74994]: WARNING nova.compute.manager [req-e08d7190-fb2d-43c9-96cc-f56e5ffbf774 req-d829aebf-7741-4222-96b7-a65f47e1fc05 service nova] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Received unexpected event network-vif-plugged-72e4811c-7bd4-4ddc-baa9-1b6446eb6241 for instance with vm_state building and task_state spawning.
Nov 28 11:13:44 user nova-compute[74994]: INFO nova.compute.manager [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Took 5.56 seconds to spawn the instance on the hypervisor.
Nov 28 11:13:44 user nova-compute[74994]: DEBUG nova.compute.manager [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 11:13:44 user nova-compute[74994]: INFO nova.compute.manager [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Took 6.26 seconds to build instance.
Nov 28 11:13:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-58585abd-1d91-4439-baf2-fd571e2fb090 tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Lock "9cee93d4-276b-4cc0-907a-2918d598d665" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.388s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:13:44 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:13:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:13:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:13:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:13:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:55 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Acquiring lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:13:55 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:13:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:55 user nova-compute[74994]: DEBUG nova.compute.manager [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 11:13:55 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:13:55 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:13:55 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 11:13:55 user nova-compute[74994]: INFO nova.compute.claims [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Claim successful on node user
Nov 28 11:13:55 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:13:55 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:13:55 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.231s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:13:55 user nova-compute[74994]: DEBUG nova.compute.manager [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 11:13:55 user nova-compute[74994]: DEBUG nova.compute.manager [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 11:13:55 user nova-compute[74994]: DEBUG nova.network.neutron [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 11:13:55 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 11:13:55 user nova-compute[74994]: DEBUG nova.compute.manager [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 11:13:55 user nova-compute[74994]: DEBUG nova.policy [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '48a8f622cb634f478095ff72fde0b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6f53748392c4f07bcf976431a90ceb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 11:13:55 user nova-compute[74994]: DEBUG nova.compute.manager [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 11:13:55 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 11:13:55 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Creating image(s)
Nov 28 11:13:55 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Acquiring lock "/opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:13:55 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Lock "/opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:13:55 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Lock "/opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:13:55 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:13:55 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.288s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:13:55 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Acquiring lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:13:55 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:13:55 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:13:56 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.195s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:13:56 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk 1073741824 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:13:56 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk 1073741824" returned: 0 in 0.064s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:13:56 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:13:56 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:13:56 user nova-compute[74994]: DEBUG nova.network.neutron [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Successfully created port: f74e1103-305e-48c3-941a-df5a1dc39873 {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 11:13:56 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.187s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:13:56 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Checking if we can resize image /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk. size=1073741824 {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 11:13:56 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:13:56 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:13:56 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Cannot resize image /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk to a smaller size. {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 11:13:56 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Created local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 11:13:56 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Ensure instance console log exists: /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 11:13:56 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:13:56 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:13:56 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:13:56 user nova-compute[74994]: DEBUG nova.network.neutron [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Successfully updated port: f74e1103-305e-48c3-941a-df5a1dc39873 {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 11:13:56 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Acquiring lock "refresh_cache-58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:13:56 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Acquired lock "refresh_cache-58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:13:56 user nova-compute[74994]: DEBUG nova.network.neutron [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 11:13:56 user nova-compute[74994]: DEBUG nova.compute.manager [req-d27bfa15-4273-4853-8c3d-c06874617dbb req-eaa2c44a-fa98-4a18-b12b-4f7c0b47cff0 service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Received event network-changed-f74e1103-305e-48c3-941a-df5a1dc39873 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:13:56 user nova-compute[74994]: DEBUG nova.compute.manager [req-d27bfa15-4273-4853-8c3d-c06874617dbb req-eaa2c44a-fa98-4a18-b12b-4f7c0b47cff0 service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Refreshing instance network info cache due to event network-changed-f74e1103-305e-48c3-941a-df5a1dc39873. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:13:56 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d27bfa15-4273-4853-8c3d-c06874617dbb req-eaa2c44a-fa98-4a18-b12b-4f7c0b47cff0 service nova] Acquiring lock "refresh_cache-58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:13:56 user nova-compute[74994]: DEBUG nova.network.neutron [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 11:13:57 user nova-compute[74994]: DEBUG nova.network.neutron [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Updating instance_info_cache with network_info: [{"id": "f74e1103-305e-48c3-941a-df5a1dc39873", "address": "fa:16:3e:5e:26:7f", "network": {"id": "5adf74ed-a983-4b41-a530-3e79a364db73", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2074174508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6f53748392c4f07bcf976431a90ceb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74e1103-30", "ovs_interfaceid": "f74e1103-305e-48c3-941a-df5a1dc39873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:13:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Releasing lock "refresh_cache-58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:13:57 user nova-compute[74994]: DEBUG nova.compute.manager [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Instance network_info: |[{"id": "f74e1103-305e-48c3-941a-df5a1dc39873", "address": "fa:16:3e:5e:26:7f", "network": {"id": "5adf74ed-a983-4b41-a530-3e79a364db73", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2074174508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6f53748392c4f07bcf976431a90ceb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74e1103-30", "ovs_interfaceid": "f74e1103-305e-48c3-941a-df5a1dc39873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 11:13:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d27bfa15-4273-4853-8c3d-c06874617dbb req-eaa2c44a-fa98-4a18-b12b-4f7c0b47cff0 service nova] Acquired lock "refresh_cache-58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:13:57 user nova-compute[74994]: DEBUG nova.network.neutron [req-d27bfa15-4273-4853-8c3d-c06874617dbb req-eaa2c44a-fa98-4a18-b12b-4f7c0b47cff0 service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Refreshing network info cache for port f74e1103-305e-48c3-941a-df5a1dc39873 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:13:57 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Start _get_guest_xml network_info=[{"id": "f74e1103-305e-48c3-941a-df5a1dc39873", "address": "fa:16:3e:5e:26:7f", "network": {"id": "5adf74ed-a983-4b41-a530-3e79a364db73", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2074174508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6f53748392c4f07bcf976431a90ceb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74e1103-30", "ovs_interfaceid": "f74e1103-305e-48c3-941a-df5a1dc39873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'aa939d1b-b8a6-4391-935b-0191bf5ccd0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 11:13:57 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:13:57 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:13:57 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 11:13:57 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 11:13:57 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 11:13:57 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 11:13:57 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 11:13:57 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 11:13:57 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 11:13:57 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 11:13:57 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 11:13:57 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 11:13:57 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 11:13:57 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 11:13:57 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 11:13:57 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 11:13:57 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 11:13:57 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 11:13:57 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:13:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1052735740',display_name='tempest-ServerStableDeviceRescueTest-server-1052735740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1052735740',id=42,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvIMFBxCfGNOfXT7o2GQq2zAQvFOyOHwsqXQTy9EM88+ITJHWPj8RbVSw1m5OzDtto+mvTb2iAylNkJ25WSwMYGIsi1p2TfiDNsdNhJGcGABqRneTPc1XQ+A6T2HvtnvQ==',key_name='tempest-keypair-449219025',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6f53748392c4f07bcf976431a90ceb3',ramdisk_id='',reservation_id='r-ysh20ttk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1260621891',owner_user_name='tempest-ServerStableDeviceRescueTest-1260621891-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:13:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48a8f622cb634f478095ff72fde0b223',uuid=58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f74e1103-305e-48c3-941a-df5a1dc39873", "address": "fa:16:3e:5e:26:7f", "network": {"id": "5adf74ed-a983-4b41-a530-3e79a364db73", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2074174508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6f53748392c4f07bcf976431a90ceb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74e1103-30", "ovs_interfaceid": "f74e1103-305e-48c3-941a-df5a1dc39873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 11:13:57 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Converting VIF {"id": "f74e1103-305e-48c3-941a-df5a1dc39873", "address": "fa:16:3e:5e:26:7f", "network": {"id": "5adf74ed-a983-4b41-a530-3e79a364db73", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2074174508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6f53748392c4f07bcf976431a90ceb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74e1103-30", "ovs_interfaceid": "f74e1103-305e-48c3-941a-df5a1dc39873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:13:57 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:26:7f,bridge_name='br-int',has_traffic_filtering=True,id=f74e1103-305e-48c3-941a-df5a1dc39873,network=Network(5adf74ed-a983-4b41-a530-3e79a364db73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf74e1103-30') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:13:57 user nova-compute[74994]: DEBUG nova.objects.instance [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Lazy-loading 'pci_devices' on Instance uuid 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:13:57 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] End _get_guest_xml xml=<domain type="kvm">
Nov 28 11:13:57 user nova-compute[74994]:   <uuid>58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f</uuid>
Nov 28 11:13:57 user nova-compute[74994]:   <name>instance-0000002a</name>
Nov 28 11:13:57 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 11:13:57 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 11:13:57 user nova-compute[74994]:   <metadata>
Nov 28 11:13:57 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 11:13:57 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 11:13:57 user nova-compute[74994]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1052735740</nova:name>
Nov 28 11:13:57 user nova-compute[74994]:       <nova:creationTime>2023-11-28 11:13:57</nova:creationTime>
Nov 28 11:13:57 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 11:13:57 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 11:13:57 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 11:13:57 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 11:13:57 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 11:13:57 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 11:13:57 user nova-compute[74994]:       </nova:flavor>
Nov 28 11:13:57 user nova-compute[74994]:       <nova:owner>
Nov 28 11:13:57 user nova-compute[74994]:         <nova:user uuid="48a8f622cb634f478095ff72fde0b223">tempest-ServerStableDeviceRescueTest-1260621891-project-member</nova:user>
Nov 28 11:13:57 user nova-compute[74994]:         <nova:project uuid="e6f53748392c4f07bcf976431a90ceb3">tempest-ServerStableDeviceRescueTest-1260621891</nova:project>
Nov 28 11:13:57 user nova-compute[74994]:       </nova:owner>
Nov 28 11:13:57 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 11:13:57 user nova-compute[74994]:       <nova:ports>
Nov 28 11:13:57 user nova-compute[74994]:         <nova:port uuid="f74e1103-305e-48c3-941a-df5a1dc39873">
Nov 28 11:13:57 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 11:13:57 user nova-compute[74994]:         </nova:port>
Nov 28 11:13:57 user nova-compute[74994]:       </nova:ports>
Nov 28 11:13:57 user nova-compute[74994]:     </nova:instance>
Nov 28 11:13:57 user nova-compute[74994]:   </metadata>
Nov 28 11:13:57 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 11:13:57 user nova-compute[74994]:     <system>
Nov 28 11:13:57 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 11:13:57 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 11:13:57 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 11:13:57 user nova-compute[74994]:       <entry name="serial">58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f</entry>
Nov 28 11:13:57 user nova-compute[74994]:       <entry name="uuid">58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f</entry>
Nov 28 11:13:57 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 11:13:57 user nova-compute[74994]:     </system>
Nov 28 11:13:57 user nova-compute[74994]:   </sysinfo>
Nov 28 11:13:57 user nova-compute[74994]:   <os>
Nov 28 11:13:57 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 11:13:57 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 11:13:57 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 11:13:57 user nova-compute[74994]:   </os>
Nov 28 11:13:57 user nova-compute[74994]:   <features>
Nov 28 11:13:57 user nova-compute[74994]:     <acpi/>
Nov 28 11:13:57 user nova-compute[74994]:     <apic/>
Nov 28 11:13:57 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 11:13:57 user nova-compute[74994]:   </features>
Nov 28 11:13:57 user nova-compute[74994]:   <clock offset="utc">
Nov 28 11:13:57 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 11:13:57 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 11:13:57 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 11:13:57 user nova-compute[74994]:   </clock>
Nov 28 11:13:57 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 11:13:57 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 11:13:57 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 11:13:57 user nova-compute[74994]:   </cpu>
Nov 28 11:13:57 user nova-compute[74994]:   <devices>
Nov 28 11:13:57 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 11:13:57 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 11:13:57 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk"/>
Nov 28 11:13:57 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 11:13:57 user nova-compute[74994]:     </disk>
Nov 28 11:13:57 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 11:13:57 user nova-compute[74994]:       <mac address="fa:16:3e:5e:26:7f"/>
Nov 28 11:13:57 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:13:57 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 11:13:57 user nova-compute[74994]:       <target dev="tapf74e1103-30"/>
Nov 28 11:13:57 user nova-compute[74994]:     </interface>
Nov 28 11:13:57 user nova-compute[74994]:     <serial type="pty">
Nov 28 11:13:57 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/console.log" append="off"/>
Nov 28 11:13:57 user nova-compute[74994]:     </serial>
Nov 28 11:13:57 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 11:13:57 user nova-compute[74994]:     <video>
Nov 28 11:13:57 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:13:57 user nova-compute[74994]:     </video>
Nov 28 11:13:57 user nova-compute[74994]:     <rng model="virtio">
Nov 28 11:13:57 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 11:13:57 user nova-compute[74994]:     </rng>
Nov 28 11:13:57 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 11:13:57 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 11:13:57 user nova-compute[74994]:       <stats period="10"/>
Nov 28 11:13:57 user nova-compute[74994]:     </memballoon>
Nov 28 11:13:57 user nova-compute[74994]:   </devices>
Nov 28 11:13:57 user nova-compute[74994]: </domain>
Nov 28 11:13:57 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 11:13:57 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:13:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1052735740',display_name='tempest-ServerStableDeviceRescueTest-server-1052735740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1052735740',id=42,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvIMFBxCfGNOfXT7o2GQq2zAQvFOyOHwsqXQTy9EM88+ITJHWPj8RbVSw1m5OzDtto+mvTb2iAylNkJ25WSwMYGIsi1p2TfiDNsdNhJGcGABqRneTPc1XQ+A6T2HvtnvQ==',key_name='tempest-keypair-449219025',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6f53748392c4f07bcf976431a90ceb3',ramdisk_id='',reservation_id='r-ysh20ttk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1260621891',owner_user_name='tempest-ServerStableDeviceRescueTest-1260621891-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:13:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48a8f622cb634f478095ff72fde0b223',uuid=58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f74e1103-305e-48c3-941a-df5a1dc39873", "address": "fa:16:3e:5e:26:7f", "network": {"id": "5adf74ed-a983-4b41-a530-3e79a364db73", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2074174508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6f53748392c4f07bcf976431a90ceb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74e1103-30", "ovs_interfaceid": "f74e1103-305e-48c3-941a-df5a1dc39873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 11:13:57 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Converting VIF {"id": "f74e1103-305e-48c3-941a-df5a1dc39873", "address": "fa:16:3e:5e:26:7f", "network": {"id": "5adf74ed-a983-4b41-a530-3e79a364db73", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2074174508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6f53748392c4f07bcf976431a90ceb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74e1103-30", "ovs_interfaceid": "f74e1103-305e-48c3-941a-df5a1dc39873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:13:57 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:26:7f,bridge_name='br-int',has_traffic_filtering=True,id=f74e1103-305e-48c3-941a-df5a1dc39873,network=Network(5adf74ed-a983-4b41-a530-3e79a364db73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf74e1103-30') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:13:57 user nova-compute[74994]: DEBUG os_vif [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:26:7f,bridge_name='br-int',has_traffic_filtering=True,id=f74e1103-305e-48c3-941a-df5a1dc39873,network=Network(5adf74ed-a983-4b41-a530-3e79a364db73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf74e1103-30') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 11:13:57 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:57 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:13:57 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 11:13:57 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:57 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9127b111-e4bd-53eb-8cad-9c63fc00617a', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:13:57 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:57 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:13:57 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:57 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf74e1103-30, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:13:57 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf74e1103-30, col_values=(('qos', UUID('e2f195f2-c513-4482-b6cb-fc781d74b0ed')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:13:57 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf74e1103-30, col_values=(('external_ids', {'iface-id': 'f74e1103-305e-48c3-941a-df5a1dc39873', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:26:7f', 'vm-uuid': '58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:13:57 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:57 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:13:57 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:57 user nova-compute[74994]: INFO os_vif [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:26:7f,bridge_name='br-int',has_traffic_filtering=True,id=f74e1103-305e-48c3-941a-df5a1dc39873,network=Network(5adf74ed-a983-4b41-a530-3e79a364db73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf74e1103-30')
Nov 28 11:13:57 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:13:57 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] No VIF found with MAC fa:16:3e:5e:26:7f, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:13:57 user nova-compute[74994]: DEBUG nova.network.neutron [req-d27bfa15-4273-4853-8c3d-c06874617dbb req-eaa2c44a-fa98-4a18-b12b-4f7c0b47cff0 service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Updated VIF entry in instance network info cache for port f74e1103-305e-48c3-941a-df5a1dc39873. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:13:57 user nova-compute[74994]: DEBUG nova.network.neutron [req-d27bfa15-4273-4853-8c3d-c06874617dbb req-eaa2c44a-fa98-4a18-b12b-4f7c0b47cff0 service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Updating instance_info_cache with network_info: [{"id": "f74e1103-305e-48c3-941a-df5a1dc39873", "address": "fa:16:3e:5e:26:7f", "network": {"id": "5adf74ed-a983-4b41-a530-3e79a364db73", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2074174508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6f53748392c4f07bcf976431a90ceb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74e1103-30", "ovs_interfaceid": "f74e1103-305e-48c3-941a-df5a1dc39873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:13:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d27bfa15-4273-4853-8c3d-c06874617dbb req-eaa2c44a-fa98-4a18-b12b-4f7c0b47cff0 service nova] Releasing lock "refresh_cache-58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:13:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:59 user nova-compute[74994]: DEBUG nova.compute.manager [req-6a340dc7-3306-4f7f-b50f-cb97e43cb24a req-d21f2f95-915f-4df2-9ea9-7f8c64357279 service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Received event network-vif-plugged-f74e1103-305e-48c3-941a-df5a1dc39873 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:13:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6a340dc7-3306-4f7f-b50f-cb97e43cb24a req-d21f2f95-915f-4df2-9ea9-7f8c64357279 service nova] Acquiring lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:13:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6a340dc7-3306-4f7f-b50f-cb97e43cb24a req-d21f2f95-915f-4df2-9ea9-7f8c64357279 service nova] Lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:13:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6a340dc7-3306-4f7f-b50f-cb97e43cb24a req-d21f2f95-915f-4df2-9ea9-7f8c64357279 service nova] Lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:13:59 user nova-compute[74994]: DEBUG nova.compute.manager [req-6a340dc7-3306-4f7f-b50f-cb97e43cb24a req-d21f2f95-915f-4df2-9ea9-7f8c64357279 service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] No waiting events found dispatching network-vif-plugged-f74e1103-305e-48c3-941a-df5a1dc39873 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:13:59 user nova-compute[74994]: WARNING nova.compute.manager [req-6a340dc7-3306-4f7f-b50f-cb97e43cb24a req-d21f2f95-915f-4df2-9ea9-7f8c64357279 service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Received unexpected event network-vif-plugged-f74e1103-305e-48c3-941a-df5a1dc39873 for instance with vm_state building and task_state spawning.
Nov 28 11:13:59 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:59 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:59 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:13:59 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:14:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:14:01 user nova-compute[74994]: DEBUG nova.compute.manager [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 11:14:01 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 11:14:01 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Instance spawned successfully.
Nov 28 11:14:01 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 11:14:01 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:14:01 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:14:01 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:14:01 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:14:01 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:14:01 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:14:01 user nova-compute[74994]: INFO nova.compute.manager [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Took 5.52 seconds to spawn the instance on the hypervisor.
Nov 28 11:14:01 user nova-compute[74994]: DEBUG nova.compute.manager [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 11:14:01 user nova-compute[74994]: DEBUG nova.compute.manager [req-2b7179f9-fb41-433a-9f37-87f7f213495a req-6e55c4f6-6bc2-4511-b0d4-3bf421e845ab service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Received event network-vif-plugged-f74e1103-305e-48c3-941a-df5a1dc39873 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:14:01 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-2b7179f9-fb41-433a-9f37-87f7f213495a req-6e55c4f6-6bc2-4511-b0d4-3bf421e845ab service nova] Acquiring lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:14:01 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-2b7179f9-fb41-433a-9f37-87f7f213495a req-6e55c4f6-6bc2-4511-b0d4-3bf421e845ab service nova] Lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:14:01 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-2b7179f9-fb41-433a-9f37-87f7f213495a req-6e55c4f6-6bc2-4511-b0d4-3bf421e845ab service nova] Lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:14:01 user nova-compute[74994]: DEBUG nova.compute.manager [req-2b7179f9-fb41-433a-9f37-87f7f213495a req-6e55c4f6-6bc2-4511-b0d4-3bf421e845ab service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] No waiting events found dispatching network-vif-plugged-f74e1103-305e-48c3-941a-df5a1dc39873 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:14:01 user nova-compute[74994]: WARNING nova.compute.manager [req-2b7179f9-fb41-433a-9f37-87f7f213495a req-6e55c4f6-6bc2-4511-b0d4-3bf421e845ab service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Received unexpected event network-vif-plugged-f74e1103-305e-48c3-941a-df5a1dc39873 for instance with vm_state building and task_state spawning.
Nov 28 11:14:01 user nova-compute[74994]: INFO nova.compute.manager [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Took 6.09 seconds to build instance.
Nov 28 11:14:01 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-73ab10ee-03db-449a-bf4b-39b350b531c7 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.203s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:14:02 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:14:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:14:07 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:14:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:14:12 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:14:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:14:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:14:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:14:22 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:14:22 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:14:24 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:14:24 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 11:14:24 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:14:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:14:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:14:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:14:24 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 11:14:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/258716ef-0a49-49bf-b893-effff4fe9307/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:14:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/258716ef-0a49-49bf-b893-effff4fe9307/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:14:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/258716ef-0a49-49bf-b893-effff4fe9307/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:14:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/258716ef-0a49-49bf-b893-effff4fe9307/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:14:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:14:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:14:25 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:14:25 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:14:25 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:14:25 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cee93d4-276b-4cc0-907a-2918d598d665/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:14:25 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cee93d4-276b-4cc0-907a-2918d598d665/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:14:25 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cee93d4-276b-4cc0-907a-2918d598d665/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:14:25 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cee93d4-276b-4cc0-907a-2918d598d665/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:14:26 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:14:26 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:14:26 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=8508MB free_disk=25.097034454345703GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 11:14:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:14:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:14:26 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 258716ef-0a49-49bf-b893-effff4fe9307 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:14:26 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 9cee93d4-276b-4cc0-907a-2918d598d665 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:14:26 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:14:26 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 11:14:26 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 11:14:26 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:14:26 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:14:26 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 11:14:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.241s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:14:27 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:14:29 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:14:29 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:14:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:14:30 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:14:31 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:14:31 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 11:14:31 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Rebuilding the list of instances to heal {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 11:14:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "refresh_cache-258716ef-0a49-49bf-b893-effff4fe9307" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:14:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquired lock "refresh_cache-258716ef-0a49-49bf-b893-effff4fe9307" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:14:31 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Forcefully refreshing network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 11:14:31 user nova-compute[74994]: DEBUG nova.objects.instance [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lazy-loading 'info_cache' on Instance uuid 258716ef-0a49-49bf-b893-effff4fe9307 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:14:32 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Updating instance_info_cache with network_info: [{"id": "b675b07b-e0c7-46bb-8a13-acddbd4d4488", "address": "fa:16:3e:d4:93:c3", "network": {"id": "45bc19c0-a3b5-478a-8289-a0f75228a260", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1070183224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc76d73b2a1142409262135e96f3cc82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb675b07b-e0", "ovs_interfaceid": "b675b07b-e0c7-46bb-8a13-acddbd4d4488", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:14:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Releasing lock "refresh_cache-258716ef-0a49-49bf-b893-effff4fe9307" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:14:32 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Updated the network info_cache for instance {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 11:14:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:14:34 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:14:35 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:14:37 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:14:37 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:14:37 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:14:37 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:14:37 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:14:37 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:14:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:14:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:14:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:14:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:14:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:14:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:14:47 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:14:47 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:14:47 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:14:47 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:14:47 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:14:47 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:14:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:14:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:14:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:14:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:14:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:14:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:14:57 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:15:02 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:15:07 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:15:07 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:15:07 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:15:07 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:15:07 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:15:07 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:15:12 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:15:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:15:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:15:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:15:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:15:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:15:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:15:21 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:15:22 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:15:22 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:15:22 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:15:22 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:15:22 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:15:22 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:15:23 user nova-compute[74994]: DEBUG nova.compute.manager [req-c7df4c68-9429-4f86-895c-69160a5f35a1 req-04a7a2cf-1214-4f77-87e6-5d03c8a6a39a service nova] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Received event network-changed-b675b07b-e0c7-46bb-8a13-acddbd4d4488 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:15:23 user nova-compute[74994]: DEBUG nova.compute.manager [req-c7df4c68-9429-4f86-895c-69160a5f35a1 req-04a7a2cf-1214-4f77-87e6-5d03c8a6a39a service nova] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Refreshing instance network info cache due to event network-changed-b675b07b-e0c7-46bb-8a13-acddbd4d4488. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:15:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c7df4c68-9429-4f86-895c-69160a5f35a1 req-04a7a2cf-1214-4f77-87e6-5d03c8a6a39a service nova] Acquiring lock "refresh_cache-258716ef-0a49-49bf-b893-effff4fe9307" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:15:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c7df4c68-9429-4f86-895c-69160a5f35a1 req-04a7a2cf-1214-4f77-87e6-5d03c8a6a39a service nova] Acquired lock "refresh_cache-258716ef-0a49-49bf-b893-effff4fe9307" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:15:23 user nova-compute[74994]: DEBUG nova.network.neutron [req-c7df4c68-9429-4f86-895c-69160a5f35a1 req-04a7a2cf-1214-4f77-87e6-5d03c8a6a39a service nova] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Refreshing network info cache for port b675b07b-e0c7-46bb-8a13-acddbd4d4488 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:15:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Acquiring lock "258716ef-0a49-49bf-b893-effff4fe9307" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:15:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "258716ef-0a49-49bf-b893-effff4fe9307" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:15:23 user nova-compute[74994]: DEBUG nova.objects.instance [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lazy-loading 'flavor' on Instance uuid 258716ef-0a49-49bf-b893-effff4fe9307 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:15:23 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Ignoring supplied device name: /dev/vdb
Nov 28 11:15:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "258716ef-0a49-49bf-b893-effff4fe9307" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:15:23 user nova-compute[74994]: DEBUG nova.network.neutron [req-c7df4c68-9429-4f86-895c-69160a5f35a1 req-04a7a2cf-1214-4f77-87e6-5d03c8a6a39a service nova] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Updated VIF entry in instance network info cache for port b675b07b-e0c7-46bb-8a13-acddbd4d4488. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:15:23 user nova-compute[74994]: DEBUG nova.network.neutron [req-c7df4c68-9429-4f86-895c-69160a5f35a1 req-04a7a2cf-1214-4f77-87e6-5d03c8a6a39a service nova] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Updating instance_info_cache with network_info: [{"id": "b675b07b-e0c7-46bb-8a13-acddbd4d4488", "address": "fa:16:3e:d4:93:c3", "network": {"id": "45bc19c0-a3b5-478a-8289-a0f75228a260", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1070183224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc76d73b2a1142409262135e96f3cc82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb675b07b-e0", "ovs_interfaceid": "b675b07b-e0c7-46bb-8a13-acddbd4d4488", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:15:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Acquiring lock "258716ef-0a49-49bf-b893-effff4fe9307" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:15:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "258716ef-0a49-49bf-b893-effff4fe9307" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:15:24 user nova-compute[74994]: INFO nova.compute.manager [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Attaching volume f81d013f-fd50-406b-88c3-bc851777e340 to /dev/vdb
Nov 28 11:15:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c7df4c68-9429-4f86-895c-69160a5f35a1 req-04a7a2cf-1214-4f77-87e6-5d03c8a6a39a service nova] Releasing lock "refresh_cache-258716ef-0a49-49bf-b893-effff4fe9307" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:15:24 user nova-compute[74994]: DEBUG os_brick.utils [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:15:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:15:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:15:24 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc6a856-e931-4e9e-b521-f8c04b1bc876]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:15:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:15:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:15:24 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd235ef-4e13-48c2-8b5d-b62c5c915bbf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:15:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:15:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:15:24 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[103c5ddc-f9c8-4b9a-b37a-83f21c17abec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:15:24 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2459e99d-43ad-4280-9d21-af23707bcb72]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:15:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:15:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:15:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 11:15:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:15:24 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:15:24 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 11:15:24 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7adf0a1-08cb-415a-98fa-a6e551ac3d92]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:15:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 11:15:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 11:15:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 11:15:24 user nova-compute[74994]: DEBUG os_brick.utils [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:15:24 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Updating existing volume attachment record: 573b3e29-9370-41a3-b53d-c0a640eb87eb {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 11:15:24 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:15:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:15:25 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:15:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:15:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:15:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:15:25 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 11:15:25 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/258716ef-0a49-49bf-b893-effff4fe9307/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:15:25 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/258716ef-0a49-49bf-b893-effff4fe9307/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:15:25 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/258716ef-0a49-49bf-b893-effff4fe9307/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:15:25 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/258716ef-0a49-49bf-b893-effff4fe9307/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:15:25 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:15:26 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:15:26 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:15:26 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:15:26 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cee93d4-276b-4cc0-907a-2918d598d665/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:15:26 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cee93d4-276b-4cc0-907a-2918d598d665/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:15:26 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cee93d4-276b-4cc0-907a-2918d598d665/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:15:26 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cee93d4-276b-4cc0-907a-2918d598d665/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:15:27 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:15:27 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:15:27 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=8768MB free_disk=25.09606170654297GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 11:15:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:15:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:15:27 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 258716ef-0a49-49bf-b893-effff4fe9307 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:15:27 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 9cee93d4-276b-4cc0-907a-2918d598d665 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:15:27 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:15:27 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 11:15:27 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 11:15:27 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Refreshing inventories for resource provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 11:15:27 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Updating ProviderTree inventory for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 11:15:27 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Updating inventory in ProviderTree for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 11:15:27 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Refreshing aggregate associations for resource provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a, aggregates: None {{(pid=74994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 11:15:27 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Refreshing trait associations for resource provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=74994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 11:15:27 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:15:27 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:15:27 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 11:15:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.464s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:15:27 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:15:27 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:15:28 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:15:28 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:15:28 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 11:15:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6c89746a-9649-460a-8d20-7e79b95faa2d tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Acquiring lock "9cee93d4-276b-4cc0-907a-2918d598d665" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:15:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6c89746a-9649-460a-8d20-7e79b95faa2d tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Lock "9cee93d4-276b-4cc0-907a-2918d598d665" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:15:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6c89746a-9649-460a-8d20-7e79b95faa2d tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Acquiring lock "9cee93d4-276b-4cc0-907a-2918d598d665-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:15:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6c89746a-9649-460a-8d20-7e79b95faa2d tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Lock "9cee93d4-276b-4cc0-907a-2918d598d665-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:15:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6c89746a-9649-460a-8d20-7e79b95faa2d tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Lock "9cee93d4-276b-4cc0-907a-2918d598d665-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:15:28 user nova-compute[74994]: INFO nova.compute.manager [None req-6c89746a-9649-460a-8d20-7e79b95faa2d tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Terminating instance
Nov 28 11:15:28 user nova-compute[74994]: DEBUG nova.compute.manager [None req-6c89746a-9649-460a-8d20-7e79b95faa2d tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 11:15:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:15:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:15:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:15:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:15:29 user nova-compute[74994]: DEBUG nova.compute.manager [req-e1cee017-42fc-4e4a-91bd-a7f3d96a4ba2 req-0b9bc874-e078-4d98-b4f0-9492dd362719 service nova] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Received event network-vif-unplugged-72e4811c-7bd4-4ddc-baa9-1b6446eb6241 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:15:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-e1cee017-42fc-4e4a-91bd-a7f3d96a4ba2 req-0b9bc874-e078-4d98-b4f0-9492dd362719 service nova] Acquiring lock "9cee93d4-276b-4cc0-907a-2918d598d665-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:15:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-e1cee017-42fc-4e4a-91bd-a7f3d96a4ba2 req-0b9bc874-e078-4d98-b4f0-9492dd362719 service nova] Lock "9cee93d4-276b-4cc0-907a-2918d598d665-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:15:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-e1cee017-42fc-4e4a-91bd-a7f3d96a4ba2 req-0b9bc874-e078-4d98-b4f0-9492dd362719 service nova] Lock "9cee93d4-276b-4cc0-907a-2918d598d665-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:15:29 user nova-compute[74994]: DEBUG nova.compute.manager [req-e1cee017-42fc-4e4a-91bd-a7f3d96a4ba2 req-0b9bc874-e078-4d98-b4f0-9492dd362719 service nova] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] No waiting events found dispatching network-vif-unplugged-72e4811c-7bd4-4ddc-baa9-1b6446eb6241 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:15:29 user nova-compute[74994]: DEBUG nova.compute.manager [req-e1cee017-42fc-4e4a-91bd-a7f3d96a4ba2 req-0b9bc874-e078-4d98-b4f0-9492dd362719 service nova] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Received event network-vif-unplugged-72e4811c-7bd4-4ddc-baa9-1b6446eb6241 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 11:15:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:15:29 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Instance destroyed successfully.
Nov 28 11:15:29 user nova-compute[74994]: DEBUG nova.objects.instance [None req-6c89746a-9649-460a-8d20-7e79b95faa2d tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Lazy-loading 'resources' on Instance uuid 9cee93d4-276b-4cc0-907a-2918d598d665 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:15:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-6c89746a-9649-460a-8d20-7e79b95faa2d tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:13:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1066832720',display_name='tempest-VolumesActionsTest-instance-1066832720',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1066832720',id=41,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T11:13:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d213989fc07742e6a087593430826861',ramdisk_id='',reservation_id='r-2cppa39n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1285521872',owner_user_name='tempest-VolumesActionsTest-1285521872-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T11:13:44Z,user_data=None,user_id='7e6dcb9651a945ae95732a246f6a2857',uuid=9cee93d4-276b-4cc0-907a-2918d598d665,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72e4811c-7bd4-4ddc-baa9-1b6446eb6241", "address": "fa:16:3e:89:7e:23", "network": {"id": "0833228c-a00a-42e2-bcbd-d943e976dc13", "bridge": "br-int", "label": "tempest-VolumesActionsTest-373359983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d213989fc07742e6a087593430826861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e4811c-7b", "ovs_interfaceid": "72e4811c-7bd4-4ddc-baa9-1b6446eb6241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 11:15:29 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-6c89746a-9649-460a-8d20-7e79b95faa2d tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Converting VIF {"id": "72e4811c-7bd4-4ddc-baa9-1b6446eb6241", "address": "fa:16:3e:89:7e:23", "network": {"id": "0833228c-a00a-42e2-bcbd-d943e976dc13", "bridge": "br-int", "label": "tempest-VolumesActionsTest-373359983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d213989fc07742e6a087593430826861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e4811c-7b", "ovs_interfaceid": "72e4811c-7bd4-4ddc-baa9-1b6446eb6241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:15:29 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-6c89746a-9649-460a-8d20-7e79b95faa2d tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:7e:23,bridge_name='br-int',has_traffic_filtering=True,id=72e4811c-7bd4-4ddc-baa9-1b6446eb6241,network=Network(0833228c-a00a-42e2-bcbd-d943e976dc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72e4811c-7b') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:15:29 user nova-compute[74994]: DEBUG os_vif [None req-6c89746a-9649-460a-8d20-7e79b95faa2d tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:7e:23,bridge_name='br-int',has_traffic_filtering=True,id=72e4811c-7bd4-4ddc-baa9-1b6446eb6241,network=Network(0833228c-a00a-42e2-bcbd-d943e976dc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72e4811c-7b') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 11:15:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:15:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72e4811c-7b, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:15:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:15:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:15:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:15:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c33fb8f0-c301-419f-8f45-6527119e0bfd) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:15:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:15:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:15:29 user nova-compute[74994]: INFO os_vif [None req-6c89746a-9649-460a-8d20-7e79b95faa2d tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:7e:23,bridge_name='br-int',has_traffic_filtering=True,id=72e4811c-7bd4-4ddc-baa9-1b6446eb6241,network=Network(0833228c-a00a-42e2-bcbd-d943e976dc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72e4811c-7b')
Nov 28 11:15:29 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-6c89746a-9649-460a-8d20-7e79b95faa2d tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Deleting instance files /opt/stack/data/nova/instances/9cee93d4-276b-4cc0-907a-2918d598d665_del
Nov 28 11:15:29 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-6c89746a-9649-460a-8d20-7e79b95faa2d tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Deletion of /opt/stack/data/nova/instances/9cee93d4-276b-4cc0-907a-2918d598d665_del complete
Nov 28 11:15:29 user nova-compute[74994]: INFO nova.compute.manager [None req-6c89746a-9649-460a-8d20-7e79b95faa2d tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 28 11:15:29 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-6c89746a-9649-460a-8d20-7e79b95faa2d tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 11:15:29 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 11:15:29 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 11:15:30 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:15:30 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Took 0.50 seconds to deallocate network for instance.
Nov 28 11:15:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:15:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6c89746a-9649-460a-8d20-7e79b95faa2d tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:15:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6c89746a-9649-460a-8d20-7e79b95faa2d tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:15:30 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-6c89746a-9649-460a-8d20-7e79b95faa2d tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:15:30 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-6c89746a-9649-460a-8d20-7e79b95faa2d tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:15:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6c89746a-9649-460a-8d20-7e79b95faa2d tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.199s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:15:30 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-6c89746a-9649-460a-8d20-7e79b95faa2d tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Deleted allocations for instance 9cee93d4-276b-4cc0-907a-2918d598d665
Nov 28 11:15:30 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:15:30 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:15:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6c89746a-9649-460a-8d20-7e79b95faa2d tempest-VolumesActionsTest-1285521872 tempest-VolumesActionsTest-1285521872-project-member] Lock "9cee93d4-276b-4cc0-907a-2918d598d665" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.844s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:15:30 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 11:15:30 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LHOIuDUE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:15:30 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:15:30 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:15:30 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:15:30 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:15:30 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:15:30 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:15:30 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 11:15:30 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340 -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:15:30 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:15:30 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[224a21da-e50e-48c9-a4fe-e172b5762b5f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:15:30 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 11:15:30 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:15:30 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340 -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:15:30 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:15:30 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa18d66d-7b2c-4cc3-9399-6badc9bf28cf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:15:30 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340] added
Nov 28 11:15:30 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:15:30 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:15:30 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:15:30 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e88a47-92e7-4e4f-9acb-c042be0866d2]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:15:30 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:15:30 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:15:30 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:15:30 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b9db34-0f8c-4715-b960-1e5525e410e2]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:15:30 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:15:30 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LHOIuDUE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:15:30 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LHOIuDUE" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:15:30 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[604b1c7f-7c42-4fb1-a55e-23ec97653385]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:15:30 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LHOIuDUE'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:15:30 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:15:30 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:15:30 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d975fe06-30be-4e52-81ee-b0f9fefbca33]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:15:30 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:15:30 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:15:30 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:15:30 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[420600f6-9fc7-4068-a7be-cb2dcf0317ed]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:15:30 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 11:15:30 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:15:30 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 11:15:30 user nova-compute[74994]:  {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:15:30 user nova-compute[74994]: WARNING os_brick.initiator.connectors.iscsi [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 11:15:30 user nova-compute[74994]: 
Nov 28 11:15:30 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340 -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:15:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:15:31 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e094b1-00c2-4b13-8170-94e56b3a3bb1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:15:31 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340, portal: 172.16.0.220,3260]
Nov 28 11:15:31 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340, portal: 172.16.0.220,3260] successful.
Nov 28 11:15:31 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:15:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:15:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:15:31 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fadfde-1dfb-457f-89f8-e06b031b8ca2]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:15:31 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:15:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:15:31 user nova-compute[74994]: DEBUG nova.compute.manager [req-c0dea430-f221-43aa-b5b5-a5c642852504 req-ed167ea9-4d04-4240-a5fb-a3ca851608ac service nova] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Received event network-vif-plugged-72e4811c-7bd4-4ddc-baa9-1b6446eb6241 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:15:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c0dea430-f221-43aa-b5b5-a5c642852504 req-ed167ea9-4d04-4240-a5fb-a3ca851608ac service nova] Acquiring lock "9cee93d4-276b-4cc0-907a-2918d598d665-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:15:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c0dea430-f221-43aa-b5b5-a5c642852504 req-ed167ea9-4d04-4240-a5fb-a3ca851608ac service nova] Lock "9cee93d4-276b-4cc0-907a-2918d598d665-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:15:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c0dea430-f221-43aa-b5b5-a5c642852504 req-ed167ea9-4d04-4240-a5fb-a3ca851608ac service nova] Lock "9cee93d4-276b-4cc0-907a-2918d598d665-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:15:31 user nova-compute[74994]: DEBUG nova.compute.manager [req-c0dea430-f221-43aa-b5b5-a5c642852504 req-ed167ea9-4d04-4240-a5fb-a3ca851608ac service nova] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] No waiting events found dispatching network-vif-plugged-72e4811c-7bd4-4ddc-baa9-1b6446eb6241 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:15:31 user nova-compute[74994]: WARNING nova.compute.manager [req-c0dea430-f221-43aa-b5b5-a5c642852504 req-ed167ea9-4d04-4240-a5fb-a3ca851608ac service nova] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Received unexpected event network-vif-plugged-72e4811c-7bd4-4ddc-baa9-1b6446eb6241 for instance with vm_state deleted and task_state None.
Nov 28 11:15:31 user nova-compute[74994]: DEBUG nova.compute.manager [req-c0dea430-f221-43aa-b5b5-a5c642852504 req-ed167ea9-4d04-4240-a5fb-a3ca851608ac service nova] [instance: 9cee93d4-276b-4cc0-907a-2918d598d665] Received event network-vif-deleted-72e4811c-7bd4-4ddc-baa9-1b6446eb6241 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:15:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:15:31 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d435e1-d8b1-4b17-b488-daafec5a0b9d]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:15:31 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340 (non-flash)
Nov 28 11:15:31 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:15:31 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340 (non-flash)
Nov 28 11:15:31 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:15:31 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:15:31 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 11:15:31 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 11:15:31 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 11:15:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:15:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:15:31 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[69654df7-b879-447c-bd56-8abd4178f370]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:15:31 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 11:15:31 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LHOIuDUE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 11:15:32 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:15:32 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '26633303236356332', 'path': '/dev/sdb'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:15:32 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633303236356332', 'path': '/dev/sdb'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 11:15:32 user nova-compute[74994]: DEBUG nova.objects.instance [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lazy-loading 'flavor' on Instance uuid 258716ef-0a49-49bf-b893-effff4fe9307 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:15:32 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 11:15:32 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:15:32 user nova-compute[74994]:   <source dev="/dev/sdb"/>
Nov 28 11:15:32 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:15:32 user nova-compute[74994]:   <serial>f81d013f-fd50-406b-88c3-bc851777e340</serial>
Nov 28 11:15:32 user nova-compute[74994]: </disk>
Nov 28 11:15:32 user nova-compute[74994]:  {{(pid=74994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 11:15:32 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:15:32 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:15:32 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] No VIF found with MAC fa:16:3e:d4:93:c3, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:15:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9997b4e8-e2a2-4957-9582-18e686a641f5 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "258716ef-0a49-49bf-b893-effff4fe9307" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.683s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:15:33 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:15:33 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 11:15:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "refresh_cache-58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:15:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquired lock "refresh_cache-58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:15:33 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Forcefully refreshing network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 11:15:34 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Updating instance_info_cache with network_info: [{"id": "f74e1103-305e-48c3-941a-df5a1dc39873", "address": "fa:16:3e:5e:26:7f", "network": {"id": "5adf74ed-a983-4b41-a530-3e79a364db73", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2074174508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6f53748392c4f07bcf976431a90ceb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74e1103-30", "ovs_interfaceid": "f74e1103-305e-48c3-941a-df5a1dc39873", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:15:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Releasing lock "refresh_cache-58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:15:34 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Updated the network info_cache for instance {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 11:15:34 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:15:34 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74994) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 11:15:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:15:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:15:35 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:15:35 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:15:36 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:15:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:15:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:15:44 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:15:46 user nova-compute[74994]: DEBUG nova.compute.manager [req-c6888800-74d8-4703-8e4c-76453b536dff req-56d8fd39-1073-4c21-91f0-3b75d870d580 service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Received event network-changed-f74e1103-305e-48c3-941a-df5a1dc39873 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:15:46 user nova-compute[74994]: DEBUG nova.compute.manager [req-c6888800-74d8-4703-8e4c-76453b536dff req-56d8fd39-1073-4c21-91f0-3b75d870d580 service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Refreshing instance network info cache due to event network-changed-f74e1103-305e-48c3-941a-df5a1dc39873. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:15:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c6888800-74d8-4703-8e4c-76453b536dff req-56d8fd39-1073-4c21-91f0-3b75d870d580 service nova] Acquiring lock "refresh_cache-58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:15:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c6888800-74d8-4703-8e4c-76453b536dff req-56d8fd39-1073-4c21-91f0-3b75d870d580 service nova] Acquired lock "refresh_cache-58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:15:46 user nova-compute[74994]: DEBUG nova.network.neutron [req-c6888800-74d8-4703-8e4c-76453b536dff req-56d8fd39-1073-4c21-91f0-3b75d870d580 service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Refreshing network info cache for port f74e1103-305e-48c3-941a-df5a1dc39873 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:15:47 user nova-compute[74994]: DEBUG nova.network.neutron [req-c6888800-74d8-4703-8e4c-76453b536dff req-56d8fd39-1073-4c21-91f0-3b75d870d580 service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Updated VIF entry in instance network info cache for port f74e1103-305e-48c3-941a-df5a1dc39873. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:15:47 user nova-compute[74994]: DEBUG nova.network.neutron [req-c6888800-74d8-4703-8e4c-76453b536dff req-56d8fd39-1073-4c21-91f0-3b75d870d580 service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Updating instance_info_cache with network_info: [{"id": "f74e1103-305e-48c3-941a-df5a1dc39873", "address": "fa:16:3e:5e:26:7f", "network": {"id": "5adf74ed-a983-4b41-a530-3e79a364db73", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2074174508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6f53748392c4f07bcf976431a90ceb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74e1103-30", "ovs_interfaceid": "f74e1103-305e-48c3-941a-df5a1dc39873", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:15:47 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-c6888800-74d8-4703-8e4c-76453b536dff req-56d8fd39-1073-4c21-91f0-3b75d870d580 service nova] Releasing lock "refresh_cache-58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:15:47 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:15:47 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Cleaning up deleted instances {{(pid=74994) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 11:15:47 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] There are 0 instances to clean {{(pid=74994) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 11:15:47 user nova-compute[74994]: DEBUG nova.compute.manager [None req-6f411ab3-0959-41c1-bb55-3efaa0607694 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 11:15:47 user nova-compute[74994]: INFO nova.compute.manager [None req-6f411ab3-0959-41c1-bb55-3efaa0607694 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] instance snapshotting
Nov 28 11:15:47 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-6f411ab3-0959-41c1-bb55-3efaa0607694 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Beginning live snapshot process
Nov 28 11:15:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-6f411ab3-0959-41c1-bb55-3efaa0607694 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk --force-share --output=json -f qcow2 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:15:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-6f411ab3-0959-41c1-bb55-3efaa0607694 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk --force-share --output=json -f qcow2" returned: 0 in 0.191s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:15:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-6f411ab3-0959-41c1-bb55-3efaa0607694 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk --force-share --output=json -f qcow2 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:15:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-6f411ab3-0959-41c1-bb55-3efaa0607694 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk --force-share --output=json -f qcow2" returned: 0 in 0.189s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:15:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-6f411ab3-0959-41c1-bb55-3efaa0607694 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:15:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-6f411ab3-0959-41c1-bb55-3efaa0607694 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.179s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:15:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-6f411ab3-0959-41c1-bb55-3efaa0607694 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp03snln5s/ce1383b8d3a34bc284308453caa5789e.delta 1073741824 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:15:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-6f411ab3-0959-41c1-bb55-3efaa0607694 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp03snln5s/ce1383b8d3a34bc284308453caa5789e.delta 1073741824" returned: 0 in 0.047s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:15:48 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-6f411ab3-0959-41c1-bb55-3efaa0607694 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 28 11:15:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-6f411ab3-0959-41c1-bb55-3efaa0607694 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 11:15:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:15:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-6f411ab3-0959-41c1-bb55-3efaa0607694 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74994) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 11:15:49 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-6f411ab3-0959-41c1-bb55-3efaa0607694 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 28 11:15:49 user nova-compute[74994]: DEBUG nova.privsep.utils [None req-6f411ab3-0959-41c1-bb55-3efaa0607694 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74994) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 11:15:49 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-6f411ab3-0959-41c1-bb55-3efaa0607694 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp03snln5s/ce1383b8d3a34bc284308453caa5789e.delta /opt/stack/data/nova/instances/snapshots/tmp03snln5s/ce1383b8d3a34bc284308453caa5789e {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:15:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:15:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-6f411ab3-0959-41c1-bb55-3efaa0607694 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp03snln5s/ce1383b8d3a34bc284308453caa5789e.delta /opt/stack/data/nova/instances/snapshots/tmp03snln5s/ce1383b8d3a34bc284308453caa5789e" returned: 0 in 0.512s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:15:50 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-6f411ab3-0959-41c1-bb55-3efaa0607694 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Snapshot extracted, beginning image upload
Nov 28 11:15:52 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-6f411ab3-0959-41c1-bb55-3efaa0607694 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Snapshot image upload complete
Nov 28 11:15:52 user nova-compute[74994]: INFO nova.compute.manager [None req-6f411ab3-0959-41c1-bb55-3efaa0607694 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Took 5.21 seconds to snapshot the instance on the hypervisor.
Nov 28 11:15:53 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:15:53 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Triggering sync for uuid 258716ef-0a49-49bf-b893-effff4fe9307 {{(pid=74994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 11:15:53 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Triggering sync for uuid 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f {{(pid=74994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 11:15:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "258716ef-0a49-49bf-b893-effff4fe9307" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:15:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "258716ef-0a49-49bf-b893-effff4fe9307" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:15:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:15:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:15:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-67ad1cb1-7d2a-45a9-b5ac-b388fa0ad022 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Acquiring lock "258716ef-0a49-49bf-b893-effff4fe9307" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:15:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "258716ef-0a49-49bf-b893-effff4fe9307" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:15:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-67ad1cb1-7d2a-45a9-b5ac-b388fa0ad022 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "258716ef-0a49-49bf-b893-effff4fe9307" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.024s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:15:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:15:53 user nova-compute[74994]: INFO nova.compute.manager [None req-67ad1cb1-7d2a-45a9-b5ac-b388fa0ad022 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Detaching volume f81d013f-fd50-406b-88c3-bc851777e340
Nov 28 11:15:53 user nova-compute[74994]: INFO nova.virt.block_device [None req-67ad1cb1-7d2a-45a9-b5ac-b388fa0ad022 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Attempting to driver detach volume f81d013f-fd50-406b-88c3-bc851777e340 from mountpoint /dev/vdb
Nov 28 11:15:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-a3c89a1b-3a64-4b46-9151-d855a2068acb tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Acquiring lock "258716ef-0a49-49bf-b893-effff4fe9307" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:15:53 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-67ad1cb1-7d2a-45a9-b5ac-b388fa0ad022 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Attempting to detach device vdb from instance 258716ef-0a49-49bf-b893-effff4fe9307 from the persistent domain config. {{(pid=74994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 11:15:53 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-67ad1cb1-7d2a-45a9-b5ac-b388fa0ad022 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 11:15:53 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:15:53 user nova-compute[74994]:   <source dev="/dev/sdb"/>
Nov 28 11:15:53 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:15:53 user nova-compute[74994]:   <serial>f81d013f-fd50-406b-88c3-bc851777e340</serial>
Nov 28 11:15:53 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 11:15:53 user nova-compute[74994]: </disk>
Nov 28 11:15:53 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 11:15:53 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-67ad1cb1-7d2a-45a9-b5ac-b388fa0ad022 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Successfully detached device vdb from instance 258716ef-0a49-49bf-b893-effff4fe9307 from the persistent domain config.
Nov 28 11:15:53 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-67ad1cb1-7d2a-45a9-b5ac-b388fa0ad022 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 258716ef-0a49-49bf-b893-effff4fe9307 from the live domain config. {{(pid=74994) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 11:15:53 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-67ad1cb1-7d2a-45a9-b5ac-b388fa0ad022 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 11:15:53 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:15:53 user nova-compute[74994]:   <source dev="/dev/sdb"/>
Nov 28 11:15:53 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:15:53 user nova-compute[74994]:   <serial>f81d013f-fd50-406b-88c3-bc851777e340</serial>
Nov 28 11:15:53 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 11:15:53 user nova-compute[74994]: </disk>
Nov 28 11:15:53 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 11:15:53 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-67ad1cb1-7d2a-45a9-b5ac-b388fa0ad022 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 258716ef-0a49-49bf-b893-effff4fe9307 {{(pid=74994) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 11:15:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:15:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:15:59 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:16:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:16:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:16:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:16:13 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-67ad1cb1-7d2a-45a9-b5ac-b388fa0ad022 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 258716ef-0a49-49bf-b893-effff4fe9307 is timed out.
Nov 28 11:16:13 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-67ad1cb1-7d2a-45a9-b5ac-b388fa0ad022 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Successfully detached device vdb from instance 258716ef-0a49-49bf-b893-effff4fe9307 from the live domain config.
Nov 28 11:16:13 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67ad1cb1-7d2a-45a9-b5ac-b388fa0ad022 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 11:16:13 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ad1cb1-7d2a-45a9-b5ac-b388fa0ad022 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LHOIuDUE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:16:13 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-67ad1cb1-7d2a-45a9-b5ac-b388fa0ad022 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:16:13 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-67ad1cb1-7d2a-45a9-b5ac-b388fa0ad022 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:16:13 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-67ad1cb1-7d2a-45a9-b5ac-b388fa0ad022 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:16:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:16:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:16:13 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1de840-ac1b-471e-8226-11120cf26a38]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:16:13 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ad1cb1-7d2a-45a9-b5ac-b388fa0ad022 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 11:16:13 user nova-compute[74994]: No targets found.
Nov 28 11:16:13 user nova-compute[74994]: iSNS:
Nov 28 11:16:13 user nova-compute[74994]: No targets found.
Nov 28 11:16:13 user nova-compute[74994]: STATIC:
Nov 28 11:16:13 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340
Nov 28 11:16:13 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:16:13 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:16:13 user nova-compute[74994]: FIRMWARE:
Nov 28 11:16:13 user nova-compute[74994]: No targets found.
Nov 28 11:16:13 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:16:13 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ad1cb1-7d2a-45a9-b5ac-b388fa0ad022 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 11:16:13 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 11:16:13 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 11:16:13 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ad1cb1-7d2a-45a9-b5ac-b388fa0ad022 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 11:16:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:16:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:16:13 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb137ba8-6d37-4236-a1dd-fcd79e7954e9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:16:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:16:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:16:13 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[20874935-acc4-42b1-82da-f604903b17a4]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:16:13 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ad1cb1-7d2a-45a9-b5ac-b388fa0ad022 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340 (non-flash)
Nov 28 11:16:13 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:16:13 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ad1cb1-7d2a-45a9-b5ac-b388fa0ad022 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340 (non-flash)
Nov 28 11:16:13 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:16:14 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ad1cb1-7d2a-45a9-b5ac-b388fa0ad022 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb95c0efd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340'): ({'sdb'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 11:16:14 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-67ad1cb1-7d2a-45a9-b5ac-b388fa0ad022 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Removing single pathed devices sdb {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 11:16:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:16:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:16:14 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4aad01e-67ef-4e5f-893e-f2189e736520]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:16:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:16:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:16:14 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b5c084-d381-4c85-ba87-f50dd71649e9]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:16:14 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-67ad1cb1-7d2a-45a9-b5ac-b388fa0ad022 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Flushing IO for device /dev/sdb {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 11:16:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:16:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:16:14 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a022a4-35f7-41aa-af22-4baf63e2f275]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:16:14 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-67ad1cb1-7d2a-45a9-b5ac-b388fa0ad022 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 11:16:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:16:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.060s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:16:14 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c3243c-60cb-49eb-b53c-cc6c5a858516]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:16:14 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-67ad1cb1-7d2a-45a9-b5ac-b388fa0ad022 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 11:16:14 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-67ad1cb1-7d2a-45a9-b5ac-b388fa0ad022 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] SCSI volumes sdb have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 11:16:14 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ad1cb1-7d2a-45a9-b5ac-b388fa0ad022 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 11:16:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:16:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:16:14 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[974d8b0d-9e13-4edc-b211-cadc018c54f6]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:16:14 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ad1cb1-7d2a-45a9-b5ac-b388fa0ad022 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:16:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340 -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:16:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:16:14 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7480f989-80c6-404e-9f92-d3a991aa47cf]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:16:14 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ad1cb1-7d2a-45a9-b5ac-b388fa0ad022 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340, portal: 172.16.0.220,3260]
Nov 28 11:16:14 user nova-compute[74994]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340, portal: 172.16.0.220,3260] successful.
Nov 28 11:16:14 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:16:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340 -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:16:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:16:14 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83a6baa-40b6-438b-b884-f81368589d6d]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:16:14 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ad1cb1-7d2a-45a9-b5ac-b388fa0ad022 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:16:14 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-67ad1cb1-7d2a-45a9-b5ac-b388fa0ad022 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:16:14 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ad1cb1-7d2a-45a9-b5ac-b388fa0ad022 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] <== disconnect_volume: return (319ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:16:14 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67ad1cb1-7d2a-45a9-b5ac-b388fa0ad022 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 11:16:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:16:15 user nova-compute[74994]: DEBUG nova.objects.instance [None req-67ad1cb1-7d2a-45a9-b5ac-b388fa0ad022 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lazy-loading 'flavor' on Instance uuid 258716ef-0a49-49bf-b893-effff4fe9307 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:16:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-67ad1cb1-7d2a-45a9-b5ac-b388fa0ad022 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "258716ef-0a49-49bf-b893-effff4fe9307" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.797s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:16:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-a3c89a1b-3a64-4b46-9151-d855a2068acb tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "258716ef-0a49-49bf-b893-effff4fe9307" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.709s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:16:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-a3c89a1b-3a64-4b46-9151-d855a2068acb tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Acquiring lock "258716ef-0a49-49bf-b893-effff4fe9307-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:16:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-a3c89a1b-3a64-4b46-9151-d855a2068acb tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "258716ef-0a49-49bf-b893-effff4fe9307-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:16:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-a3c89a1b-3a64-4b46-9151-d855a2068acb tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "258716ef-0a49-49bf-b893-effff4fe9307-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:16:15 user nova-compute[74994]: INFO nova.compute.manager [None req-a3c89a1b-3a64-4b46-9151-d855a2068acb tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Terminating instance
Nov 28 11:16:15 user nova-compute[74994]: DEBUG nova.compute.manager [None req-a3c89a1b-3a64-4b46-9151-d855a2068acb tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 11:16:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:16:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:16:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:16:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:16:15 user nova-compute[74994]: DEBUG nova.compute.manager [req-d00542ce-0899-4442-944b-9270fc85e115 req-055bde01-1dac-4188-814c-173fae881af4 service nova] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Received event network-vif-unplugged-b675b07b-e0c7-46bb-8a13-acddbd4d4488 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:16:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d00542ce-0899-4442-944b-9270fc85e115 req-055bde01-1dac-4188-814c-173fae881af4 service nova] Acquiring lock "258716ef-0a49-49bf-b893-effff4fe9307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:16:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d00542ce-0899-4442-944b-9270fc85e115 req-055bde01-1dac-4188-814c-173fae881af4 service nova] Lock "258716ef-0a49-49bf-b893-effff4fe9307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:16:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d00542ce-0899-4442-944b-9270fc85e115 req-055bde01-1dac-4188-814c-173fae881af4 service nova] Lock "258716ef-0a49-49bf-b893-effff4fe9307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:16:15 user nova-compute[74994]: DEBUG nova.compute.manager [req-d00542ce-0899-4442-944b-9270fc85e115 req-055bde01-1dac-4188-814c-173fae881af4 service nova] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] No waiting events found dispatching network-vif-unplugged-b675b07b-e0c7-46bb-8a13-acddbd4d4488 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:16:15 user nova-compute[74994]: DEBUG nova.compute.manager [req-d00542ce-0899-4442-944b-9270fc85e115 req-055bde01-1dac-4188-814c-173fae881af4 service nova] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Received event network-vif-unplugged-b675b07b-e0c7-46bb-8a13-acddbd4d4488 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 11:16:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:16:15 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Instance destroyed successfully.
Nov 28 11:16:15 user nova-compute[74994]: DEBUG nova.objects.instance [None req-a3c89a1b-3a64-4b46-9151-d855a2068acb tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lazy-loading 'resources' on Instance uuid 258716ef-0a49-49bf-b893-effff4fe9307 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:16:15 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-a3c89a1b-3a64-4b46-9151-d855a2068acb tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:13:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-457682885',display_name='tempest-VolumesSnapshotTestJSON-instance-457682885',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-457682885',id=40,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOzBSRLIsegYbt2MKCLQ+pjy3KEWNjCbWm4lRWApA4dgdIfSfxdTnc0NEvRzu+2EuFsV7TfskEzr2cFMkhzXBt9oHLfyqsP2CPn9gGdx6Zp0GUPen9Yz5jtnMOAWbADEkw==',key_name='tempest-keypair-440809517',keypairs=<?>,launch_index=0,launched_at=2023-11-28T11:13:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cc76d73b2a1142409262135e96f3cc82',ramdisk_id='',reservation_id='r-pmwof59n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-496080761',owner_user_name='tempest-VolumesSnapshotTestJSON-496080761-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T11:13:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='879781a7540a448aac2e1c3a89f712bb',uuid=258716ef-0a49-49bf-b893-effff4fe9307,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b675b07b-e0c7-46bb-8a13-acddbd4d4488", "address": "fa:16:3e:d4:93:c3", "network": {"id": "45bc19c0-a3b5-478a-8289-a0f75228a260", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1070183224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc76d73b2a1142409262135e96f3cc82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb675b07b-e0", "ovs_interfaceid": "b675b07b-e0c7-46bb-8a13-acddbd4d4488", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 11:16:15 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-a3c89a1b-3a64-4b46-9151-d855a2068acb tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Converting VIF {"id": "b675b07b-e0c7-46bb-8a13-acddbd4d4488", "address": "fa:16:3e:d4:93:c3", "network": {"id": "45bc19c0-a3b5-478a-8289-a0f75228a260", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1070183224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc76d73b2a1142409262135e96f3cc82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb675b07b-e0", "ovs_interfaceid": "b675b07b-e0c7-46bb-8a13-acddbd4d4488", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:16:15 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-a3c89a1b-3a64-4b46-9151-d855a2068acb tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:93:c3,bridge_name='br-int',has_traffic_filtering=True,id=b675b07b-e0c7-46bb-8a13-acddbd4d4488,network=Network(45bc19c0-a3b5-478a-8289-a0f75228a260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb675b07b-e0') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:16:15 user nova-compute[74994]: DEBUG os_vif [None req-a3c89a1b-3a64-4b46-9151-d855a2068acb tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:93:c3,bridge_name='br-int',has_traffic_filtering=True,id=b675b07b-e0c7-46bb-8a13-acddbd4d4488,network=Network(45bc19c0-a3b5-478a-8289-a0f75228a260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb675b07b-e0') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 11:16:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:16:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb675b07b-e0, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:16:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:16:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:16:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:16:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=520dda6a-0dbf-40fa-ab72-4489c95ee1ef) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:16:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:16:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:16:15 user nova-compute[74994]: INFO os_vif [None req-a3c89a1b-3a64-4b46-9151-d855a2068acb tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:93:c3,bridge_name='br-int',has_traffic_filtering=True,id=b675b07b-e0c7-46bb-8a13-acddbd4d4488,network=Network(45bc19c0-a3b5-478a-8289-a0f75228a260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb675b07b-e0')
Nov 28 11:16:15 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3c89a1b-3a64-4b46-9151-d855a2068acb tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 11:16:15 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c89a1b-3a64-4b46-9151-d855a2068acb tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:f81d013f-fd50-406b-88c3-bc851777e340', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LHOIuDUE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:16:15 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-a3c89a1b-3a64-4b46-9151-d855a2068acb tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:16:15 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-a3c89a1b-3a64-4b46-9151-d855a2068acb tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:16:15 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-a3c89a1b-3a64-4b46-9151-d855a2068acb tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:16:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:16:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:16:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:16:15 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[774c2e12-b212-471d-8dd4-418c5db51d6b]: Unexpected error while running command.
Nov 28 11:16:15 user nova-compute[74994]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 28 11:16:15 user nova-compute[74994]: Exit code: 21
Nov 28 11:16:15 user nova-compute[74994]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 28 11:16:15 user nova-compute[74994]: Stderr: '' {{(pid=86494) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Nov 28 11:16:15 user nova-compute[74994]: Traceback (most recent call last):
Nov 28 11:16:15 user nova-compute[74994]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Nov 28 11:16:15 user nova-compute[74994]:     ret = func(*f_args, **f_kwargs)
Nov 28 11:16:15 user nova-compute[74994]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Nov 28 11:16:15 user nova-compute[74994]:     return func(*args, **kwargs)
Nov 28 11:16:15 user nova-compute[74994]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Nov 28 11:16:15 user nova-compute[74994]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Nov 28 11:16:15 user nova-compute[74994]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Nov 28 11:16:15 user nova-compute[74994]:     return putils.execute(on_execute=on_execute,
Nov 28 11:16:15 user nova-compute[74994]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Nov 28 11:16:15 user nova-compute[74994]:     raise ProcessExecutionError(exit_code=_returncode,
Nov 28 11:16:15 user nova-compute[74994]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 28 11:16:15 user nova-compute[74994]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 28 11:16:15 user nova-compute[74994]: Exit code: 21
Nov 28 11:16:15 user nova-compute[74994]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 28 11:16:15 user nova-compute[74994]: Stderr: ''
Nov 28 11:16:15 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[774c2e12-b212-471d-8dd4-418c5db51d6b]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:16:15 user nova-compute[74994]: ERROR os_brick.initiator.connectors.iscsi [None req-a3c89a1b-3a64-4b46-9151-d855a2068acb tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 28 11:16:15 user nova-compute[74994]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 28 11:16:15 user nova-compute[74994]: Exit code: 21
Nov 28 11:16:15 user nova-compute[74994]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 28 11:16:15 user nova-compute[74994]: Stderr: ''
Nov 28 11:16:15 user nova-compute[74994]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Nov 28 11:16:15 user nova-compute[74994]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Nov 28 11:16:15 user nova-compute[74994]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Nov 28 11:16:15 user nova-compute[74994]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Nov 28 11:16:15 user nova-compute[74994]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Nov 28 11:16:15 user nova-compute[74994]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Nov 28 11:16:15 user nova-compute[74994]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Nov 28 11:16:15 user nova-compute[74994]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Nov 28 11:16:15 user nova-compute[74994]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Nov 28 11:16:15 user nova-compute[74994]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Nov 28 11:16:15 user nova-compute[74994]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Nov 28 11:16:15 user nova-compute[74994]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Nov 28 11:16:15 user nova-compute[74994]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Nov 28 11:16:15 user nova-compute[74994]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Nov 28 11:16:15 user nova-compute[74994]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Nov 28 11:16:15 user nova-compute[74994]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 28 11:16:15 user nova-compute[74994]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Nov 28 11:16:15 user nova-compute[74994]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Nov 28 11:16:15 user nova-compute[74994]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 28 11:16:15 user nova-compute[74994]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Nov 28 11:16:15 user nova-compute[74994]: ERROR os_brick.initiator.connectors.iscsi 
Nov 28 11:16:15 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c89a1b-3a64-4b46-9151-d855a2068acb tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=74994) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Nov 28 11:16:15 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-a3c89a1b-3a64-4b46-9151-d855a2068acb tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.029s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:16:15 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c89a1b-3a64-4b46-9151-d855a2068acb tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] <== disconnect_volume: return (30ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:16:15 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3c89a1b-3a64-4b46-9151-d855a2068acb tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 11:16:15 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-a3c89a1b-3a64-4b46-9151-d855a2068acb tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Deleting instance files /opt/stack/data/nova/instances/258716ef-0a49-49bf-b893-effff4fe9307_del
Nov 28 11:16:15 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-a3c89a1b-3a64-4b46-9151-d855a2068acb tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Deletion of /opt/stack/data/nova/instances/258716ef-0a49-49bf-b893-effff4fe9307_del complete
Nov 28 11:16:16 user nova-compute[74994]: INFO nova.compute.manager [None req-a3c89a1b-3a64-4b46-9151-d855a2068acb tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 28 11:16:16 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-a3c89a1b-3a64-4b46-9151-d855a2068acb tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 11:16:16 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 11:16:16 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 11:16:16 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:16:16 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Took 0.75 seconds to deallocate network for instance.
Nov 28 11:16:16 user nova-compute[74994]: WARNING nova.volume.cinder [None req-a3c89a1b-3a64-4b46-9151-d855a2068acb tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Attachment 573b3e29-9370-41a3-b53d-c0a640eb87eb does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 573b3e29-9370-41a3-b53d-c0a640eb87eb. (HTTP 404) (Request-ID: req-bda9cbd2-db48-49b7-b3fe-fd1ffb4a1db8)
Nov 28 11:16:16 user nova-compute[74994]: INFO nova.compute.manager [None req-a3c89a1b-3a64-4b46-9151-d855a2068acb tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Took 0.03 seconds to detach 1 volumes for instance.
Nov 28 11:16:16 user nova-compute[74994]: DEBUG nova.compute.manager [req-39e3dffd-138e-4c02-a374-9426145496d7 req-ba12a22d-aafe-4f76-997e-7f8375cdb38a service nova] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Received event network-vif-deleted-b675b07b-e0c7-46bb-8a13-acddbd4d4488 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:16:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-a3c89a1b-3a64-4b46-9151-d855a2068acb tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:16:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-a3c89a1b-3a64-4b46-9151-d855a2068acb tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:16:17 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-a3c89a1b-3a64-4b46-9151-d855a2068acb tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:16:17 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-a3c89a1b-3a64-4b46-9151-d855a2068acb tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:16:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-a3c89a1b-3a64-4b46-9151-d855a2068acb tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.183s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:16:17 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-a3c89a1b-3a64-4b46-9151-d855a2068acb tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Deleted allocations for instance 258716ef-0a49-49bf-b893-effff4fe9307
Nov 28 11:16:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-a3c89a1b-3a64-4b46-9151-d855a2068acb tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "258716ef-0a49-49bf-b893-effff4fe9307" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.998s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:16:17 user nova-compute[74994]: DEBUG nova.compute.manager [req-1809007c-854e-497b-a8c4-55305cc8b02e req-c59618d8-2007-49a0-afab-b685770e2952 service nova] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Received event network-vif-plugged-b675b07b-e0c7-46bb-8a13-acddbd4d4488 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:16:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-1809007c-854e-497b-a8c4-55305cc8b02e req-c59618d8-2007-49a0-afab-b685770e2952 service nova] Acquiring lock "258716ef-0a49-49bf-b893-effff4fe9307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:16:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-1809007c-854e-497b-a8c4-55305cc8b02e req-c59618d8-2007-49a0-afab-b685770e2952 service nova] Lock "258716ef-0a49-49bf-b893-effff4fe9307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:16:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-1809007c-854e-497b-a8c4-55305cc8b02e req-c59618d8-2007-49a0-afab-b685770e2952 service nova] Lock "258716ef-0a49-49bf-b893-effff4fe9307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:16:17 user nova-compute[74994]: DEBUG nova.compute.manager [req-1809007c-854e-497b-a8c4-55305cc8b02e req-c59618d8-2007-49a0-afab-b685770e2952 service nova] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] No waiting events found dispatching network-vif-plugged-b675b07b-e0c7-46bb-8a13-acddbd4d4488 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:16:17 user nova-compute[74994]: WARNING nova.compute.manager [req-1809007c-854e-497b-a8c4-55305cc8b02e req-c59618d8-2007-49a0-afab-b685770e2952 service nova] [instance: 258716ef-0a49-49bf-b893-effff4fe9307] Received unexpected event network-vif-plugged-b675b07b-e0c7-46bb-8a13-acddbd4d4488 for instance with vm_state deleted and task_state None.
Nov 28 11:16:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:16:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:16:24 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:16:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:16:26 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:16:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:16:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:16:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:16:26 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 11:16:26 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:16:26 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:16:26 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:16:26 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:16:27 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:16:27 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:16:27 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=8935MB free_disk=25.101215362548828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 11:16:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:16:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:16:27 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:16:27 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 11:16:27 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 11:16:27 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:16:27 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:16:27 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 11:16:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.203s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:16:28 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:16:28 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 11:16:30 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:16:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:16:32 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:16:32 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:16:35 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:16:35 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 11:16:35 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Rebuilding the list of instances to heal {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 11:16:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "refresh_cache-58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:16:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquired lock "refresh_cache-58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:16:35 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Forcefully refreshing network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 11:16:35 user nova-compute[74994]: DEBUG nova.objects.instance [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lazy-loading 'info_cache' on Instance uuid 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:16:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:16:35 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Updating instance_info_cache with network_info: [{"id": "f74e1103-305e-48c3-941a-df5a1dc39873", "address": "fa:16:3e:5e:26:7f", "network": {"id": "5adf74ed-a983-4b41-a530-3e79a364db73", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2074174508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6f53748392c4f07bcf976431a90ceb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74e1103-30", "ovs_interfaceid": "f74e1103-305e-48c3-941a-df5a1dc39873", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:16:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Releasing lock "refresh_cache-58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:16:35 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Updated the network info_cache for instance {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 11:16:37 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:16:37 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:16:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:16:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:16:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:16:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:16:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:00 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Acquiring lock "e6803632-6fc3-4b5d-abf4-cc2665a7a26a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:17:00 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "e6803632-6fc3-4b5d-abf4-cc2665a7a26a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:17:00 user nova-compute[74994]: DEBUG nova.compute.manager [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 11:17:00 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:17:00 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:17:00 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 11:17:00 user nova-compute[74994]: INFO nova.compute.claims [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Claim successful on node user
Nov 28 11:17:00 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:17:00 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:17:00 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.207s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:17:00 user nova-compute[74994]: DEBUG nova.compute.manager [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 11:17:00 user nova-compute[74994]: DEBUG nova.compute.manager [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 11:17:00 user nova-compute[74994]: DEBUG nova.network.neutron [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 11:17:00 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 11:17:00 user nova-compute[74994]: DEBUG nova.compute.manager [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 11:17:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:17:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:17:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:17:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:17:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:01 user nova-compute[74994]: DEBUG nova.compute.manager [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 11:17:01 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 11:17:01 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Creating image(s)
Nov 28 11:17:01 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Acquiring lock "/opt/stack/data/nova/instances/e6803632-6fc3-4b5d-abf4-cc2665a7a26a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:17:01 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "/opt/stack/data/nova/instances/e6803632-6fc3-4b5d-abf4-cc2665a7a26a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:17:01 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "/opt/stack/data/nova/instances/e6803632-6fc3-4b5d-abf4-cc2665a7a26a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:17:01 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:17:01 user nova-compute[74994]: DEBUG nova.policy [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '879781a7540a448aac2e1c3a89f712bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc76d73b2a1142409262135e96f3cc82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 11:17:01 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.168s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:17:01 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Acquiring lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:17:01 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:17:01 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:17:01 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.170s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:17:01 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/e6803632-6fc3-4b5d-abf4-cc2665a7a26a/disk 1073741824 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:17:01 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/e6803632-6fc3-4b5d-abf4-cc2665a7a26a/disk 1073741824" returned: 0 in 0.046s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:17:01 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:17:01 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:17:01 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.172s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:17:01 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e6803632-6fc3-4b5d-abf4-cc2665a7a26a/disk. size=1073741824 {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 11:17:01 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6803632-6fc3-4b5d-abf4-cc2665a7a26a/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:17:01 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6803632-6fc3-4b5d-abf4-cc2665a7a26a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:17:01 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Cannot resize image /opt/stack/data/nova/instances/e6803632-6fc3-4b5d-abf4-cc2665a7a26a/disk to a smaller size. {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 11:17:01 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Created local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 11:17:01 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Ensure instance console log exists: /opt/stack/data/nova/instances/e6803632-6fc3-4b5d-abf4-cc2665a7a26a/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 11:17:01 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:17:01 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:17:01 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:17:01 user nova-compute[74994]: DEBUG nova.network.neutron [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Successfully created port: f3314941-1e6a-4f3a-a608-0a6949c6f8f7 {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 11:17:02 user nova-compute[74994]: DEBUG nova.network.neutron [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Successfully updated port: f3314941-1e6a-4f3a-a608-0a6949c6f8f7 {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 11:17:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Acquiring lock "refresh_cache-e6803632-6fc3-4b5d-abf4-cc2665a7a26a" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:17:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Acquired lock "refresh_cache-e6803632-6fc3-4b5d-abf4-cc2665a7a26a" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:17:02 user nova-compute[74994]: DEBUG nova.network.neutron [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 11:17:02 user nova-compute[74994]: DEBUG nova.compute.manager [req-6b03cec4-f890-4413-99e0-66b7296b9474 req-6058bc6f-916b-4549-a0a5-d260aea81bb7 service nova] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Received event network-changed-f3314941-1e6a-4f3a-a608-0a6949c6f8f7 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:17:02 user nova-compute[74994]: DEBUG nova.compute.manager [req-6b03cec4-f890-4413-99e0-66b7296b9474 req-6058bc6f-916b-4549-a0a5-d260aea81bb7 service nova] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Refreshing instance network info cache due to event network-changed-f3314941-1e6a-4f3a-a608-0a6949c6f8f7. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:17:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6b03cec4-f890-4413-99e0-66b7296b9474 req-6058bc6f-916b-4549-a0a5-d260aea81bb7 service nova] Acquiring lock "refresh_cache-e6803632-6fc3-4b5d-abf4-cc2665a7a26a" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:17:02 user nova-compute[74994]: DEBUG nova.network.neutron [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 11:17:02 user nova-compute[74994]: DEBUG nova.network.neutron [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Updating instance_info_cache with network_info: [{"id": "f3314941-1e6a-4f3a-a608-0a6949c6f8f7", "address": "fa:16:3e:54:c8:ad", "network": {"id": "45bc19c0-a3b5-478a-8289-a0f75228a260", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1070183224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc76d73b2a1142409262135e96f3cc82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3314941-1e", "ovs_interfaceid": "f3314941-1e6a-4f3a-a608-0a6949c6f8f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:17:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Releasing lock "refresh_cache-e6803632-6fc3-4b5d-abf4-cc2665a7a26a" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:17:03 user nova-compute[74994]: DEBUG nova.compute.manager [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Instance network_info: |[{"id": "f3314941-1e6a-4f3a-a608-0a6949c6f8f7", "address": "fa:16:3e:54:c8:ad", "network": {"id": "45bc19c0-a3b5-478a-8289-a0f75228a260", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1070183224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc76d73b2a1142409262135e96f3cc82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3314941-1e", "ovs_interfaceid": "f3314941-1e6a-4f3a-a608-0a6949c6f8f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 11:17:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6b03cec4-f890-4413-99e0-66b7296b9474 req-6058bc6f-916b-4549-a0a5-d260aea81bb7 service nova] Acquired lock "refresh_cache-e6803632-6fc3-4b5d-abf4-cc2665a7a26a" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:17:03 user nova-compute[74994]: DEBUG nova.network.neutron [req-6b03cec4-f890-4413-99e0-66b7296b9474 req-6058bc6f-916b-4549-a0a5-d260aea81bb7 service nova] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Refreshing network info cache for port f3314941-1e6a-4f3a-a608-0a6949c6f8f7 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:17:03 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Start _get_guest_xml network_info=[{"id": "f3314941-1e6a-4f3a-a608-0a6949c6f8f7", "address": "fa:16:3e:54:c8:ad", "network": {"id": "45bc19c0-a3b5-478a-8289-a0f75228a260", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1070183224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc76d73b2a1142409262135e96f3cc82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3314941-1e", "ovs_interfaceid": "f3314941-1e6a-4f3a-a608-0a6949c6f8f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'aa939d1b-b8a6-4391-935b-0191bf5ccd0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 11:17:03 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:17:03 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:17:03 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 11:17:03 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 11:17:03 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 11:17:03 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 11:17:03 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 11:17:03 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 11:17:03 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 11:17:03 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 11:17:03 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 11:17:03 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 11:17:03 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 11:17:03 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 11:17:03 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 11:17:03 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 11:17:03 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 11:17:03 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 11:17:03 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:16:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-836557515',display_name='tempest-VolumesSnapshotTestJSON-instance-836557515',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-836557515',id=43,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIghOlWB/ukamtDInEteS4pADIotKgIwiS2cPJsqoIP4TM3lbW8eAXX+HTj9k7f7e5WmcssOzLPd5W0aiyv4d6EhZLtjSn60KxaHY6tSl5W2voRjL5Ngxf3VYhd/wXD0Ug==',key_name='tempest-keypair-1862203321',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc76d73b2a1142409262135e96f3cc82',ramdisk_id='',reservation_id='r-xr8vj762',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-496080761',owner_user_name='tempest-VolumesSnapshotTestJSON-496080761-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:17:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='879781a7540a448aac2e1c3a89f712bb',uuid=e6803632-6fc3-4b5d-abf4-cc2665a7a26a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3314941-1e6a-4f3a-a608-0a6949c6f8f7", "address": "fa:16:3e:54:c8:ad", "network": {"id": "45bc19c0-a3b5-478a-8289-a0f75228a260", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1070183224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc76d73b2a1142409262135e96f3cc82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3314941-1e", "ovs_interfaceid": "f3314941-1e6a-4f3a-a608-0a6949c6f8f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 11:17:03 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Converting VIF {"id": "f3314941-1e6a-4f3a-a608-0a6949c6f8f7", "address": "fa:16:3e:54:c8:ad", "network": {"id": "45bc19c0-a3b5-478a-8289-a0f75228a260", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1070183224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc76d73b2a1142409262135e96f3cc82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3314941-1e", "ovs_interfaceid": "f3314941-1e6a-4f3a-a608-0a6949c6f8f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:17:03 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:c8:ad,bridge_name='br-int',has_traffic_filtering=True,id=f3314941-1e6a-4f3a-a608-0a6949c6f8f7,network=Network(45bc19c0-a3b5-478a-8289-a0f75228a260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3314941-1e') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:17:03 user nova-compute[74994]: DEBUG nova.objects.instance [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lazy-loading 'pci_devices' on Instance uuid e6803632-6fc3-4b5d-abf4-cc2665a7a26a {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:17:03 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] End _get_guest_xml xml=<domain type="kvm">
Nov 28 11:17:03 user nova-compute[74994]:   <uuid>e6803632-6fc3-4b5d-abf4-cc2665a7a26a</uuid>
Nov 28 11:17:03 user nova-compute[74994]:   <name>instance-0000002b</name>
Nov 28 11:17:03 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 11:17:03 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 11:17:03 user nova-compute[74994]:   <metadata>
Nov 28 11:17:03 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 11:17:03 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 11:17:03 user nova-compute[74994]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-836557515</nova:name>
Nov 28 11:17:03 user nova-compute[74994]:       <nova:creationTime>2023-11-28 11:17:03</nova:creationTime>
Nov 28 11:17:03 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 11:17:03 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 11:17:03 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 11:17:03 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 11:17:03 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 11:17:03 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 11:17:03 user nova-compute[74994]:       </nova:flavor>
Nov 28 11:17:03 user nova-compute[74994]:       <nova:owner>
Nov 28 11:17:03 user nova-compute[74994]:         <nova:user uuid="879781a7540a448aac2e1c3a89f712bb">tempest-VolumesSnapshotTestJSON-496080761-project-member</nova:user>
Nov 28 11:17:03 user nova-compute[74994]:         <nova:project uuid="cc76d73b2a1142409262135e96f3cc82">tempest-VolumesSnapshotTestJSON-496080761</nova:project>
Nov 28 11:17:03 user nova-compute[74994]:       </nova:owner>
Nov 28 11:17:03 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 11:17:03 user nova-compute[74994]:       <nova:ports>
Nov 28 11:17:03 user nova-compute[74994]:         <nova:port uuid="f3314941-1e6a-4f3a-a608-0a6949c6f8f7">
Nov 28 11:17:03 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 11:17:03 user nova-compute[74994]:         </nova:port>
Nov 28 11:17:03 user nova-compute[74994]:       </nova:ports>
Nov 28 11:17:03 user nova-compute[74994]:     </nova:instance>
Nov 28 11:17:03 user nova-compute[74994]:   </metadata>
Nov 28 11:17:03 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 11:17:03 user nova-compute[74994]:     <system>
Nov 28 11:17:03 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 11:17:03 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 11:17:03 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 11:17:03 user nova-compute[74994]:       <entry name="serial">e6803632-6fc3-4b5d-abf4-cc2665a7a26a</entry>
Nov 28 11:17:03 user nova-compute[74994]:       <entry name="uuid">e6803632-6fc3-4b5d-abf4-cc2665a7a26a</entry>
Nov 28 11:17:03 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 11:17:03 user nova-compute[74994]:     </system>
Nov 28 11:17:03 user nova-compute[74994]:   </sysinfo>
Nov 28 11:17:03 user nova-compute[74994]:   <os>
Nov 28 11:17:03 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 11:17:03 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 11:17:03 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 11:17:03 user nova-compute[74994]:   </os>
Nov 28 11:17:03 user nova-compute[74994]:   <features>
Nov 28 11:17:03 user nova-compute[74994]:     <acpi/>
Nov 28 11:17:03 user nova-compute[74994]:     <apic/>
Nov 28 11:17:03 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 11:17:03 user nova-compute[74994]:   </features>
Nov 28 11:17:03 user nova-compute[74994]:   <clock offset="utc">
Nov 28 11:17:03 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 11:17:03 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 11:17:03 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 11:17:03 user nova-compute[74994]:   </clock>
Nov 28 11:17:03 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 11:17:03 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 11:17:03 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 11:17:03 user nova-compute[74994]:   </cpu>
Nov 28 11:17:03 user nova-compute[74994]:   <devices>
Nov 28 11:17:03 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 11:17:03 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 11:17:03 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/e6803632-6fc3-4b5d-abf4-cc2665a7a26a/disk"/>
Nov 28 11:17:03 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 11:17:03 user nova-compute[74994]:     </disk>
Nov 28 11:17:03 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 11:17:03 user nova-compute[74994]:       <mac address="fa:16:3e:54:c8:ad"/>
Nov 28 11:17:03 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:17:03 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 11:17:03 user nova-compute[74994]:       <target dev="tapf3314941-1e"/>
Nov 28 11:17:03 user nova-compute[74994]:     </interface>
Nov 28 11:17:03 user nova-compute[74994]:     <serial type="pty">
Nov 28 11:17:03 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/e6803632-6fc3-4b5d-abf4-cc2665a7a26a/console.log" append="off"/>
Nov 28 11:17:03 user nova-compute[74994]:     </serial>
Nov 28 11:17:03 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 11:17:03 user nova-compute[74994]:     <video>
Nov 28 11:17:03 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:17:03 user nova-compute[74994]:     </video>
Nov 28 11:17:03 user nova-compute[74994]:     <rng model="virtio">
Nov 28 11:17:03 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 11:17:03 user nova-compute[74994]:     </rng>
Nov 28 11:17:03 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 11:17:03 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 11:17:03 user nova-compute[74994]:       <stats period="10"/>
Nov 28 11:17:03 user nova-compute[74994]:     </memballoon>
Nov 28 11:17:03 user nova-compute[74994]:   </devices>
Nov 28 11:17:03 user nova-compute[74994]: </domain>
Nov 28 11:17:03 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 11:17:03 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:16:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-836557515',display_name='tempest-VolumesSnapshotTestJSON-instance-836557515',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-836557515',id=43,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIghOlWB/ukamtDInEteS4pADIotKgIwiS2cPJsqoIP4TM3lbW8eAXX+HTj9k7f7e5WmcssOzLPd5W0aiyv4d6EhZLtjSn60KxaHY6tSl5W2voRjL5Ngxf3VYhd/wXD0Ug==',key_name='tempest-keypair-1862203321',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc76d73b2a1142409262135e96f3cc82',ramdisk_id='',reservation_id='r-xr8vj762',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-496080761',owner_user_name='tempest-VolumesSnapshotTestJSON-496080761-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:17:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='879781a7540a448aac2e1c3a89f712bb',uuid=e6803632-6fc3-4b5d-abf4-cc2665a7a26a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3314941-1e6a-4f3a-a608-0a6949c6f8f7", "address": "fa:16:3e:54:c8:ad", "network": {"id": "45bc19c0-a3b5-478a-8289-a0f75228a260", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1070183224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc76d73b2a1142409262135e96f3cc82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3314941-1e", "ovs_interfaceid": "f3314941-1e6a-4f3a-a608-0a6949c6f8f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 11:17:03 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Converting VIF {"id": "f3314941-1e6a-4f3a-a608-0a6949c6f8f7", "address": "fa:16:3e:54:c8:ad", "network": {"id": "45bc19c0-a3b5-478a-8289-a0f75228a260", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1070183224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc76d73b2a1142409262135e96f3cc82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3314941-1e", "ovs_interfaceid": "f3314941-1e6a-4f3a-a608-0a6949c6f8f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:17:03 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:c8:ad,bridge_name='br-int',has_traffic_filtering=True,id=f3314941-1e6a-4f3a-a608-0a6949c6f8f7,network=Network(45bc19c0-a3b5-478a-8289-a0f75228a260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3314941-1e') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:17:03 user nova-compute[74994]: DEBUG os_vif [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:c8:ad,bridge_name='br-int',has_traffic_filtering=True,id=f3314941-1e6a-4f3a-a608-0a6949c6f8f7,network=Network(45bc19c0-a3b5-478a-8289-a0f75228a260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3314941-1e') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 11:17:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:17:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 11:17:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e6369ee1-5fe3-58a0-b4ea-0dc8c953236b', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:17:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3314941-1e, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:17:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf3314941-1e, col_values=(('qos', UUID('493a717d-e0a2-4c22-850b-5ebd44354292')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:17:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf3314941-1e, col_values=(('external_ids', {'iface-id': 'f3314941-1e6a-4f3a-a608-0a6949c6f8f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:c8:ad', 'vm-uuid': 'e6803632-6fc3-4b5d-abf4-cc2665a7a26a'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:17:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:17:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:03 user nova-compute[74994]: INFO os_vif [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:c8:ad,bridge_name='br-int',has_traffic_filtering=True,id=f3314941-1e6a-4f3a-a608-0a6949c6f8f7,network=Network(45bc19c0-a3b5-478a-8289-a0f75228a260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3314941-1e')
Nov 28 11:17:03 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:17:03 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] No VIF found with MAC fa:16:3e:54:c8:ad, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:17:03 user nova-compute[74994]: DEBUG nova.network.neutron [req-6b03cec4-f890-4413-99e0-66b7296b9474 req-6058bc6f-916b-4549-a0a5-d260aea81bb7 service nova] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Updated VIF entry in instance network info cache for port f3314941-1e6a-4f3a-a608-0a6949c6f8f7. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:17:03 user nova-compute[74994]: DEBUG nova.network.neutron [req-6b03cec4-f890-4413-99e0-66b7296b9474 req-6058bc6f-916b-4549-a0a5-d260aea81bb7 service nova] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Updating instance_info_cache with network_info: [{"id": "f3314941-1e6a-4f3a-a608-0a6949c6f8f7", "address": "fa:16:3e:54:c8:ad", "network": {"id": "45bc19c0-a3b5-478a-8289-a0f75228a260", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1070183224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc76d73b2a1142409262135e96f3cc82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3314941-1e", "ovs_interfaceid": "f3314941-1e6a-4f3a-a608-0a6949c6f8f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:17:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6b03cec4-f890-4413-99e0-66b7296b9474 req-6058bc6f-916b-4549-a0a5-d260aea81bb7 service nova] Releasing lock "refresh_cache-e6803632-6fc3-4b5d-abf4-cc2665a7a26a" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:17:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:04 user nova-compute[74994]: DEBUG nova.compute.manager [req-76a47e81-8ffb-4e29-8ba5-0b5a828702c0 req-57b00fac-c195-4860-af84-13e28b645ded service nova] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Received event network-vif-plugged-f3314941-1e6a-4f3a-a608-0a6949c6f8f7 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:17:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-76a47e81-8ffb-4e29-8ba5-0b5a828702c0 req-57b00fac-c195-4860-af84-13e28b645ded service nova] Acquiring lock "e6803632-6fc3-4b5d-abf4-cc2665a7a26a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:17:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-76a47e81-8ffb-4e29-8ba5-0b5a828702c0 req-57b00fac-c195-4860-af84-13e28b645ded service nova] Lock "e6803632-6fc3-4b5d-abf4-cc2665a7a26a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:17:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-76a47e81-8ffb-4e29-8ba5-0b5a828702c0 req-57b00fac-c195-4860-af84-13e28b645ded service nova] Lock "e6803632-6fc3-4b5d-abf4-cc2665a7a26a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:17:04 user nova-compute[74994]: DEBUG nova.compute.manager [req-76a47e81-8ffb-4e29-8ba5-0b5a828702c0 req-57b00fac-c195-4860-af84-13e28b645ded service nova] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] No waiting events found dispatching network-vif-plugged-f3314941-1e6a-4f3a-a608-0a6949c6f8f7 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:17:04 user nova-compute[74994]: WARNING nova.compute.manager [req-76a47e81-8ffb-4e29-8ba5-0b5a828702c0 req-57b00fac-c195-4860-af84-13e28b645ded service nova] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Received unexpected event network-vif-plugged-f3314941-1e6a-4f3a-a608-0a6949c6f8f7 for instance with vm_state building and task_state spawning.
Nov 28 11:17:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:06 user nova-compute[74994]: DEBUG nova.compute.manager [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 11:17:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 11:17:06 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Instance spawned successfully.
Nov 28 11:17:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 11:17:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:17:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:17:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:17:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:17:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:17:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:17:06 user nova-compute[74994]: INFO nova.compute.manager [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Took 5.77 seconds to spawn the instance on the hypervisor.
Nov 28 11:17:06 user nova-compute[74994]: DEBUG nova.compute.manager [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 11:17:06 user nova-compute[74994]: INFO nova.compute.manager [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Took 6.31 seconds to build instance.
Nov 28 11:17:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1bfe68ac-526d-4fb3-a5bf-edfed67640f1 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "e6803632-6fc3-4b5d-abf4-cc2665a7a26a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.411s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:17:07 user nova-compute[74994]: DEBUG nova.compute.manager [req-ae6b5c50-1005-4ff5-be5f-59edf0618dc9 req-f166bb91-e5de-491d-a82c-0d0a5f33e88c service nova] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Received event network-vif-plugged-f3314941-1e6a-4f3a-a608-0a6949c6f8f7 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:17:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ae6b5c50-1005-4ff5-be5f-59edf0618dc9 req-f166bb91-e5de-491d-a82c-0d0a5f33e88c service nova] Acquiring lock "e6803632-6fc3-4b5d-abf4-cc2665a7a26a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:17:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ae6b5c50-1005-4ff5-be5f-59edf0618dc9 req-f166bb91-e5de-491d-a82c-0d0a5f33e88c service nova] Lock "e6803632-6fc3-4b5d-abf4-cc2665a7a26a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:17:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ae6b5c50-1005-4ff5-be5f-59edf0618dc9 req-f166bb91-e5de-491d-a82c-0d0a5f33e88c service nova] Lock "e6803632-6fc3-4b5d-abf4-cc2665a7a26a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:17:07 user nova-compute[74994]: DEBUG nova.compute.manager [req-ae6b5c50-1005-4ff5-be5f-59edf0618dc9 req-f166bb91-e5de-491d-a82c-0d0a5f33e88c service nova] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] No waiting events found dispatching network-vif-plugged-f3314941-1e6a-4f3a-a608-0a6949c6f8f7 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:17:07 user nova-compute[74994]: WARNING nova.compute.manager [req-ae6b5c50-1005-4ff5-be5f-59edf0618dc9 req-f166bb91-e5de-491d-a82c-0d0a5f33e88c service nova] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Received unexpected event network-vif-plugged-f3314941-1e6a-4f3a-a608-0a6949c6f8f7 for instance with vm_state active and task_state None.
Nov 28 11:17:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:17:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:17:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:17:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:17:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:17:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:17:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:17:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:17:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:26 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:17:27 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:17:27 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 11:17:27 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:17:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:17:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:17:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:17:27 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 11:17:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6803632-6fc3-4b5d-abf4-cc2665a7a26a/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:17:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6803632-6fc3-4b5d-abf4-cc2665a7a26a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:17:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6803632-6fc3-4b5d-abf4-cc2665a7a26a/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:17:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6803632-6fc3-4b5d-abf4-cc2665a7a26a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:17:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:17:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:17:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:17:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:17:28 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:17:28 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:17:28 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=8775MB free_disk=25.055801391601562GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 11:17:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:17:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:17:28 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:17:28 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance e6803632-6fc3-4b5d-abf4-cc2665a7a26a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:17:28 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 11:17:28 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 11:17:28 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:17:28 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:17:28 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 11:17:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.265s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:17:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:33 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:17:34 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:17:34 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:17:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:37 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:17:37 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 11:17:37 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Rebuilding the list of instances to heal {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 11:17:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "refresh_cache-58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:17:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquired lock "refresh_cache-58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:17:37 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Forcefully refreshing network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 11:17:37 user nova-compute[74994]: DEBUG nova.objects.instance [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lazy-loading 'info_cache' on Instance uuid 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:17:38 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Updating instance_info_cache with network_info: [{"id": "f74e1103-305e-48c3-941a-df5a1dc39873", "address": "fa:16:3e:5e:26:7f", "network": {"id": "5adf74ed-a983-4b41-a530-3e79a364db73", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2074174508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6f53748392c4f07bcf976431a90ceb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74e1103-30", "ovs_interfaceid": "f74e1103-305e-48c3-941a-df5a1dc39873", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:17:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Releasing lock "refresh_cache-58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:17:38 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Updated the network info_cache for instance {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 11:17:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:38 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:17:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Acquiring lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:17:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:17:39 user nova-compute[74994]: DEBUG nova.objects.instance [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Lazy-loading 'flavor' on Instance uuid 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:17:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:17:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Acquiring lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:17:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:17:39 user nova-compute[74994]: INFO nova.compute.manager [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Attaching volume 8e996227-a705-4cd3-a100-a57c80861401 to /dev/vdb
Nov 28 11:17:39 user nova-compute[74994]: DEBUG os_brick.utils [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:17:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:17:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:17:39 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ad2090-e6b3-4dcc-9ed0-17c5fca4d684]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:17:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:17:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:17:39 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef415c2-317a-4ad7-9446-7f72cd3f3be9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:17:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:17:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:17:39 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc68a4ab-b778-4fdb-8bf5-6a5143f2fbd0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:17:39 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabd52ec-3fb8-42b7-b502-a2ad41c34593]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:17:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:17:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:17:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 11:17:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:17:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:17:39 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 11:17:39 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d3bd77-dc32-44cc-bf62-dda20fcb6c10]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:17:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 11:17:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 11:17:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 11:17:39 user nova-compute[74994]: DEBUG os_brick.utils [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:17:39 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Updating existing volume attachment record: 2641964a-98bb-4246-aa00-5db9bbcba59a {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 11:17:39 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:17:39 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:17:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:17:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:17:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:17:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:17:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:45 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 11:17:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TiDqrfAw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:17:45 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:17:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:17:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:17:45 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:17:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:17:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:17:45 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 11:17:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:17:45 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Acquiring lock "76f339ed-a2e6-43e1-a16b-03000fdf537b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:17:45 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Lock "76f339ed-a2e6-43e1-a16b-03000fdf537b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:17:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:17:45 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0704954d-cf39-4db9-a1cf-a5c0cac6f645]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:17:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 11:17:45 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:17:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:17:45 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 11:17:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:17:45 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9388de-24c3-4742-a621-17119f391274]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:17:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401] added
Nov 28 11:17:45 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:17:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1fd330-07ea-4249-84ac-44a856fc6e9f]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c0d8dd-01fb-4d60-9717-78c77b6d07a0]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TiDqrfAw {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TiDqrfAw" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[87509ad9-3b2f-4e02-acff-5ee65c7be610]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TiDqrfAw'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 11:17:46 user nova-compute[74994]: INFO nova.compute.claims [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Claim successful on node user
Nov 28 11:17:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf295a8-1eb0-478d-a548-82c5909fb485]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1a4000-094b-46b3-af28-fd64c67e4e75]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 11:17:46 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 11:17:46 user nova-compute[74994]:  {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:17:46 user nova-compute[74994]: WARNING os_brick.initiator.connectors.iscsi [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 11:17:46 user nova-compute[74994]: 
Nov 28 11:17:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6ea41b-035f-4443-b735-95aa2edc30ce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401, portal: 172.16.0.220,3260]
Nov 28 11:17:46 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401, portal: 172.16.0.220,3260] successful.
Nov 28 11:17:46 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f2f761-41ba-40b7-ad96-d460b2804a1a]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[be65467f-13ba-4f6d-b2b7-e5810701bd74]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 (non-flash)
Nov 28 11:17:46 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 (non-flash)
Nov 28 11:17:46 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[112516e5-6752-4651-aae8-1c6d7b666cdb]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TiDqrfAw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.252s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 11:17:46 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 11:17:46 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG nova.policy [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd485b9995c6c4298a7913d7f6789668a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab62edca70864fd89abac6aeaad57a0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 11:17:46 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Creating image(s)
Nov 28 11:17:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Acquiring lock "/opt/stack/data/nova/instances/76f339ed-a2e6-43e1-a16b-03000fdf537b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Lock "/opt/stack/data/nova/instances/76f339ed-a2e6-43e1-a16b-03000fdf537b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Lock "/opt/stack/data/nova/instances/76f339ed-a2e6-43e1-a16b-03000fdf537b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.172s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Acquiring lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.176s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/76f339ed-a2e6-43e1-a16b-03000fdf537b/disk 1073741824 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/76f339ed-a2e6-43e1-a16b-03000fdf537b/disk 1073741824" returned: 0 in 0.078s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:17:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:17:47 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Successfully created port: b00e25d1-164f-4256-824a-b4c6a6aa2349 {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 11:17:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.195s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:17:47 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Checking if we can resize image /opt/stack/data/nova/instances/76f339ed-a2e6-43e1-a16b-03000fdf537b/disk. size=1073741824 {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 11:17:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76f339ed-a2e6-43e1-a16b-03000fdf537b/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:17:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:17:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23536626431343931', 'path': '/dev/sdb'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:17:47 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23536626431343931', 'path': '/dev/sdb'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 11:17:47 user nova-compute[74994]: DEBUG nova.objects.instance [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Lazy-loading 'flavor' on Instance uuid 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:17:47 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 11:17:47 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:17:47 user nova-compute[74994]:   <source dev="/dev/sdb"/>
Nov 28 11:17:47 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:17:47 user nova-compute[74994]:   <serial>8e996227-a705-4cd3-a100-a57c80861401</serial>
Nov 28 11:17:47 user nova-compute[74994]: </disk>
Nov 28 11:17:47 user nova-compute[74994]:  {{(pid=74994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 11:17:47 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76f339ed-a2e6-43e1-a16b-03000fdf537b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:17:47 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Cannot resize image /opt/stack/data/nova/instances/76f339ed-a2e6-43e1-a16b-03000fdf537b/disk to a smaller size. {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 11:17:47 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Created local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 11:17:47 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Ensure instance console log exists: /opt/stack/data/nova/instances/76f339ed-a2e6-43e1-a16b-03000fdf537b/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 11:17:47 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:17:47 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:17:47 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:17:47 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:17:47 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:17:47 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] No VIF found with MAC fa:16:3e:5e:26:7f, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:17:47 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Successfully updated port: b00e25d1-164f-4256-824a-b4c6a6aa2349 {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 11:17:47 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Acquiring lock "refresh_cache-76f339ed-a2e6-43e1-a16b-03000fdf537b" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:17:47 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Acquired lock "refresh_cache-76f339ed-a2e6-43e1-a16b-03000fdf537b" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:17:47 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 11:17:47 user nova-compute[74994]: DEBUG nova.compute.manager [req-4b025fe7-4b62-47a8-b94c-1fd248dd7610 req-5f333c45-8f86-472b-b8fe-a4c94594630b service nova] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Received event network-changed-b00e25d1-164f-4256-824a-b4c6a6aa2349 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:17:47 user nova-compute[74994]: DEBUG nova.compute.manager [req-4b025fe7-4b62-47a8-b94c-1fd248dd7610 req-5f333c45-8f86-472b-b8fe-a4c94594630b service nova] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Refreshing instance network info cache due to event network-changed-b00e25d1-164f-4256-824a-b4c6a6aa2349. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:17:47 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4b025fe7-4b62-47a8-b94c-1fd248dd7610 req-5f333c45-8f86-472b-b8fe-a4c94594630b service nova] Acquiring lock "refresh_cache-76f339ed-a2e6-43e1-a16b-03000fdf537b" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:17:47 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 11:17:47 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-137df2d5-aeb5-4dba-a9ab-161dcd52d4d2 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.596s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:17:48 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Updating instance_info_cache with network_info: [{"id": "b00e25d1-164f-4256-824a-b4c6a6aa2349", "address": "fa:16:3e:1b:c2:4c", "network": {"id": "03d7d77d-3b3c-40c6-8222-d00322cd02a9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ab811d435da94c6aaf6156b0c318c9ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00e25d1-16", "ovs_interfaceid": "b00e25d1-164f-4256-824a-b4c6a6aa2349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:17:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Releasing lock "refresh_cache-76f339ed-a2e6-43e1-a16b-03000fdf537b" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:17:48 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Instance network_info: |[{"id": "b00e25d1-164f-4256-824a-b4c6a6aa2349", "address": "fa:16:3e:1b:c2:4c", "network": {"id": "03d7d77d-3b3c-40c6-8222-d00322cd02a9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ab811d435da94c6aaf6156b0c318c9ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00e25d1-16", "ovs_interfaceid": "b00e25d1-164f-4256-824a-b4c6a6aa2349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 11:17:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4b025fe7-4b62-47a8-b94c-1fd248dd7610 req-5f333c45-8f86-472b-b8fe-a4c94594630b service nova] Acquired lock "refresh_cache-76f339ed-a2e6-43e1-a16b-03000fdf537b" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:17:48 user nova-compute[74994]: DEBUG nova.network.neutron [req-4b025fe7-4b62-47a8-b94c-1fd248dd7610 req-5f333c45-8f86-472b-b8fe-a4c94594630b service nova] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Refreshing network info cache for port b00e25d1-164f-4256-824a-b4c6a6aa2349 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:17:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Start _get_guest_xml network_info=[{"id": "b00e25d1-164f-4256-824a-b4c6a6aa2349", "address": "fa:16:3e:1b:c2:4c", "network": {"id": "03d7d77d-3b3c-40c6-8222-d00322cd02a9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ab811d435da94c6aaf6156b0c318c9ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00e25d1-16", "ovs_interfaceid": "b00e25d1-164f-4256-824a-b4c6a6aa2349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'aa939d1b-b8a6-4391-935b-0191bf5ccd0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 11:17:48 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:17:48 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:17:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 11:17:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 11:17:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 11:17:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 11:17:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 11:17:48 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 11:17:48 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 11:17:48 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 11:17:48 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 11:17:48 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 11:17:48 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 11:17:48 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 11:17:48 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 11:17:48 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 11:17:48 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 11:17:48 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 11:17:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:17:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-908923343',display_name='tempest-VolumesNegativeTest-instance-908923343',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-908923343',id=44,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab62edca70864fd89abac6aeaad57a0a',ramdisk_id='',reservation_id='r-ajo4bl87',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1598920742',owner_user_name='tempest-VolumesNegativeTest-1598920742-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:17:46Z,user_data=None,user_id='d485b9995c6c4298a7913d7f6789668a',uuid=76f339ed-a2e6-43e1-a16b-03000fdf537b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b00e25d1-164f-4256-824a-b4c6a6aa2349", "address": "fa:16:3e:1b:c2:4c", "network": {"id": "03d7d77d-3b3c-40c6-8222-d00322cd02a9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ab811d435da94c6aaf6156b0c318c9ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00e25d1-16", "ovs_interfaceid": "b00e25d1-164f-4256-824a-b4c6a6aa2349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 11:17:48 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Converting VIF {"id": "b00e25d1-164f-4256-824a-b4c6a6aa2349", "address": "fa:16:3e:1b:c2:4c", "network": {"id": "03d7d77d-3b3c-40c6-8222-d00322cd02a9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ab811d435da94c6aaf6156b0c318c9ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00e25d1-16", "ovs_interfaceid": "b00e25d1-164f-4256-824a-b4c6a6aa2349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:17:48 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:c2:4c,bridge_name='br-int',has_traffic_filtering=True,id=b00e25d1-164f-4256-824a-b4c6a6aa2349,network=Network(03d7d77d-3b3c-40c6-8222-d00322cd02a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb00e25d1-16') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:17:48 user nova-compute[74994]: DEBUG nova.objects.instance [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Lazy-loading 'pci_devices' on Instance uuid 76f339ed-a2e6-43e1-a16b-03000fdf537b {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:17:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] End _get_guest_xml xml=<domain type="kvm">
Nov 28 11:17:48 user nova-compute[74994]:   <uuid>76f339ed-a2e6-43e1-a16b-03000fdf537b</uuid>
Nov 28 11:17:48 user nova-compute[74994]:   <name>instance-0000002c</name>
Nov 28 11:17:48 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 11:17:48 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 11:17:48 user nova-compute[74994]:   <metadata>
Nov 28 11:17:48 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 11:17:48 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 11:17:48 user nova-compute[74994]:       <nova:name>tempest-VolumesNegativeTest-instance-908923343</nova:name>
Nov 28 11:17:48 user nova-compute[74994]:       <nova:creationTime>2023-11-28 11:17:48</nova:creationTime>
Nov 28 11:17:48 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 11:17:48 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 11:17:48 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 11:17:48 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 11:17:48 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 11:17:48 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 11:17:48 user nova-compute[74994]:       </nova:flavor>
Nov 28 11:17:48 user nova-compute[74994]:       <nova:owner>
Nov 28 11:17:48 user nova-compute[74994]:         <nova:user uuid="d485b9995c6c4298a7913d7f6789668a">tempest-VolumesNegativeTest-1598920742-project-member</nova:user>
Nov 28 11:17:48 user nova-compute[74994]:         <nova:project uuid="ab62edca70864fd89abac6aeaad57a0a">tempest-VolumesNegativeTest-1598920742</nova:project>
Nov 28 11:17:48 user nova-compute[74994]:       </nova:owner>
Nov 28 11:17:48 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 11:17:48 user nova-compute[74994]:       <nova:ports>
Nov 28 11:17:48 user nova-compute[74994]:         <nova:port uuid="b00e25d1-164f-4256-824a-b4c6a6aa2349">
Nov 28 11:17:48 user nova-compute[74994]:           <nova:ip type="fixed" address="192.168.233.152" ipVersion="4"/>
Nov 28 11:17:48 user nova-compute[74994]:         </nova:port>
Nov 28 11:17:48 user nova-compute[74994]:       </nova:ports>
Nov 28 11:17:48 user nova-compute[74994]:     </nova:instance>
Nov 28 11:17:48 user nova-compute[74994]:   </metadata>
Nov 28 11:17:48 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 11:17:48 user nova-compute[74994]:     <system>
Nov 28 11:17:48 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 11:17:48 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 11:17:48 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 11:17:48 user nova-compute[74994]:       <entry name="serial">76f339ed-a2e6-43e1-a16b-03000fdf537b</entry>
Nov 28 11:17:48 user nova-compute[74994]:       <entry name="uuid">76f339ed-a2e6-43e1-a16b-03000fdf537b</entry>
Nov 28 11:17:48 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 11:17:48 user nova-compute[74994]:     </system>
Nov 28 11:17:48 user nova-compute[74994]:   </sysinfo>
Nov 28 11:17:48 user nova-compute[74994]:   <os>
Nov 28 11:17:48 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 11:17:48 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 11:17:48 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 11:17:48 user nova-compute[74994]:   </os>
Nov 28 11:17:48 user nova-compute[74994]:   <features>
Nov 28 11:17:48 user nova-compute[74994]:     <acpi/>
Nov 28 11:17:48 user nova-compute[74994]:     <apic/>
Nov 28 11:17:48 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 11:17:48 user nova-compute[74994]:   </features>
Nov 28 11:17:48 user nova-compute[74994]:   <clock offset="utc">
Nov 28 11:17:48 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 11:17:48 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 11:17:48 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 11:17:48 user nova-compute[74994]:   </clock>
Nov 28 11:17:48 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 11:17:48 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 11:17:48 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 11:17:48 user nova-compute[74994]:   </cpu>
Nov 28 11:17:48 user nova-compute[74994]:   <devices>
Nov 28 11:17:48 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 11:17:48 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 11:17:48 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/76f339ed-a2e6-43e1-a16b-03000fdf537b/disk"/>
Nov 28 11:17:48 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 11:17:48 user nova-compute[74994]:     </disk>
Nov 28 11:17:48 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 11:17:48 user nova-compute[74994]:       <mac address="fa:16:3e:1b:c2:4c"/>
Nov 28 11:17:48 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:17:48 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 11:17:48 user nova-compute[74994]:       <target dev="tapb00e25d1-16"/>
Nov 28 11:17:48 user nova-compute[74994]:     </interface>
Nov 28 11:17:48 user nova-compute[74994]:     <serial type="pty">
Nov 28 11:17:48 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/76f339ed-a2e6-43e1-a16b-03000fdf537b/console.log" append="off"/>
Nov 28 11:17:48 user nova-compute[74994]:     </serial>
Nov 28 11:17:48 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 11:17:48 user nova-compute[74994]:     <video>
Nov 28 11:17:48 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:17:48 user nova-compute[74994]:     </video>
Nov 28 11:17:48 user nova-compute[74994]:     <rng model="virtio">
Nov 28 11:17:48 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 11:17:48 user nova-compute[74994]:     </rng>
Nov 28 11:17:48 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 11:17:48 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 11:17:48 user nova-compute[74994]:       <stats period="10"/>
Nov 28 11:17:48 user nova-compute[74994]:     </memballoon>
Nov 28 11:17:48 user nova-compute[74994]:   </devices>
Nov 28 11:17:48 user nova-compute[74994]: </domain>
Nov 28 11:17:48 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 11:17:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:17:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-908923343',display_name='tempest-VolumesNegativeTest-instance-908923343',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-908923343',id=44,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab62edca70864fd89abac6aeaad57a0a',ramdisk_id='',reservation_id='r-ajo4bl87',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1598920742',owner_user_name='tempest-VolumesNegativeTest-1598920742-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:17:46Z,user_data=None,user_id='d485b9995c6c4298a7913d7f6789668a',uuid=76f339ed-a2e6-43e1-a16b-03000fdf537b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b00e25d1-164f-4256-824a-b4c6a6aa2349", "address": "fa:16:3e:1b:c2:4c", "network": {"id": "03d7d77d-3b3c-40c6-8222-d00322cd02a9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ab811d435da94c6aaf6156b0c318c9ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00e25d1-16", "ovs_interfaceid": "b00e25d1-164f-4256-824a-b4c6a6aa2349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 11:17:48 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Converting VIF {"id": "b00e25d1-164f-4256-824a-b4c6a6aa2349", "address": "fa:16:3e:1b:c2:4c", "network": {"id": "03d7d77d-3b3c-40c6-8222-d00322cd02a9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ab811d435da94c6aaf6156b0c318c9ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00e25d1-16", "ovs_interfaceid": "b00e25d1-164f-4256-824a-b4c6a6aa2349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:17:48 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:c2:4c,bridge_name='br-int',has_traffic_filtering=True,id=b00e25d1-164f-4256-824a-b4c6a6aa2349,network=Network(03d7d77d-3b3c-40c6-8222-d00322cd02a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb00e25d1-16') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:17:48 user nova-compute[74994]: DEBUG os_vif [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:c2:4c,bridge_name='br-int',has_traffic_filtering=True,id=b00e25d1-164f-4256-824a-b4c6a6aa2349,network=Network(03d7d77d-3b3c-40c6-8222-d00322cd02a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb00e25d1-16') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 11:17:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:17:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 11:17:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bc08aa5a-856f-5236-a224-ce13bdd7898e', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:17:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:17:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb00e25d1-16, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:17:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb00e25d1-16, col_values=(('qos', UUID('fb1b1526-8724-4bf2-a47c-32aa0dce31d4')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:17:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb00e25d1-16, col_values=(('external_ids', {'iface-id': 'b00e25d1-164f-4256-824a-b4c6a6aa2349', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:c2:4c', 'vm-uuid': '76f339ed-a2e6-43e1-a16b-03000fdf537b'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:17:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:17:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:48 user nova-compute[74994]: INFO os_vif [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:c2:4c,bridge_name='br-int',has_traffic_filtering=True,id=b00e25d1-164f-4256-824a-b4c6a6aa2349,network=Network(03d7d77d-3b3c-40c6-8222-d00322cd02a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb00e25d1-16')
Nov 28 11:17:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:17:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] No VIF found with MAC fa:16:3e:1b:c2:4c, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:17:48 user nova-compute[74994]: DEBUG nova.network.neutron [req-4b025fe7-4b62-47a8-b94c-1fd248dd7610 req-5f333c45-8f86-472b-b8fe-a4c94594630b service nova] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Updated VIF entry in instance network info cache for port b00e25d1-164f-4256-824a-b4c6a6aa2349. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:17:48 user nova-compute[74994]: DEBUG nova.network.neutron [req-4b025fe7-4b62-47a8-b94c-1fd248dd7610 req-5f333c45-8f86-472b-b8fe-a4c94594630b service nova] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Updating instance_info_cache with network_info: [{"id": "b00e25d1-164f-4256-824a-b4c6a6aa2349", "address": "fa:16:3e:1b:c2:4c", "network": {"id": "03d7d77d-3b3c-40c6-8222-d00322cd02a9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ab811d435da94c6aaf6156b0c318c9ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00e25d1-16", "ovs_interfaceid": "b00e25d1-164f-4256-824a-b4c6a6aa2349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:17:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4b025fe7-4b62-47a8-b94c-1fd248dd7610 req-5f333c45-8f86-472b-b8fe-a4c94594630b service nova] Releasing lock "refresh_cache-76f339ed-a2e6-43e1-a16b-03000fdf537b" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:17:49 user nova-compute[74994]: INFO nova.compute.manager [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Rescuing
Nov 28 11:17:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Acquiring lock "refresh_cache-58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:17:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Acquired lock "refresh_cache-58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:17:49 user nova-compute[74994]: DEBUG nova.network.neutron [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 11:17:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:49 user nova-compute[74994]: DEBUG nova.network.neutron [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Updating instance_info_cache with network_info: [{"id": "f74e1103-305e-48c3-941a-df5a1dc39873", "address": "fa:16:3e:5e:26:7f", "network": {"id": "5adf74ed-a983-4b41-a530-3e79a364db73", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2074174508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6f53748392c4f07bcf976431a90ceb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74e1103-30", "ovs_interfaceid": "f74e1103-305e-48c3-941a-df5a1dc39873", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:17:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Releasing lock "refresh_cache-58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:17:49 user nova-compute[74994]: DEBUG nova.compute.manager [req-43bfd28f-c3a3-4864-930a-1a335096687e req-fa6b61b8-113a-4b53-8434-5a46bceb7ca0 service nova] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Received event network-vif-plugged-b00e25d1-164f-4256-824a-b4c6a6aa2349 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:17:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-43bfd28f-c3a3-4864-930a-1a335096687e req-fa6b61b8-113a-4b53-8434-5a46bceb7ca0 service nova] Acquiring lock "76f339ed-a2e6-43e1-a16b-03000fdf537b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:17:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-43bfd28f-c3a3-4864-930a-1a335096687e req-fa6b61b8-113a-4b53-8434-5a46bceb7ca0 service nova] Lock "76f339ed-a2e6-43e1-a16b-03000fdf537b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:17:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-43bfd28f-c3a3-4864-930a-1a335096687e req-fa6b61b8-113a-4b53-8434-5a46bceb7ca0 service nova] Lock "76f339ed-a2e6-43e1-a16b-03000fdf537b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:17:49 user nova-compute[74994]: DEBUG nova.compute.manager [req-43bfd28f-c3a3-4864-930a-1a335096687e req-fa6b61b8-113a-4b53-8434-5a46bceb7ca0 service nova] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] No waiting events found dispatching network-vif-plugged-b00e25d1-164f-4256-824a-b4c6a6aa2349 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:17:49 user nova-compute[74994]: WARNING nova.compute.manager [req-43bfd28f-c3a3-4864-930a-1a335096687e req-fa6b61b8-113a-4b53-8434-5a46bceb7ca0 service nova] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Received unexpected event network-vif-plugged-b00e25d1-164f-4256-824a-b4c6a6aa2349 for instance with vm_state building and task_state spawning.
Nov 28 11:17:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:50 user nova-compute[74994]: DEBUG nova.compute.manager [req-3c547c40-7ef4-483d-891f-b2da27ddd880 req-746117c7-7036-477b-93b2-c98037c4f0a2 service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Received event network-vif-unplugged-f74e1103-305e-48c3-941a-df5a1dc39873 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:17:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-3c547c40-7ef4-483d-891f-b2da27ddd880 req-746117c7-7036-477b-93b2-c98037c4f0a2 service nova] Acquiring lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:17:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-3c547c40-7ef4-483d-891f-b2da27ddd880 req-746117c7-7036-477b-93b2-c98037c4f0a2 service nova] Lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:17:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-3c547c40-7ef4-483d-891f-b2da27ddd880 req-746117c7-7036-477b-93b2-c98037c4f0a2 service nova] Lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:17:50 user nova-compute[74994]: DEBUG nova.compute.manager [req-3c547c40-7ef4-483d-891f-b2da27ddd880 req-746117c7-7036-477b-93b2-c98037c4f0a2 service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] No waiting events found dispatching network-vif-unplugged-f74e1103-305e-48c3-941a-df5a1dc39873 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:17:50 user nova-compute[74994]: WARNING nova.compute.manager [req-3c547c40-7ef4-483d-891f-b2da27ddd880 req-746117c7-7036-477b-93b2-c98037c4f0a2 service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Received unexpected event network-vif-unplugged-f74e1103-305e-48c3-941a-df5a1dc39873 for instance with vm_state active and task_state rescuing.
Nov 28 11:17:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:50 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Instance destroyed successfully.
Nov 28 11:17:50 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Attempting a stable device rescue
Nov 28 11:17:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74994) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 11:17:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Instance directory exists: not creating {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 11:17:50 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Creating image(s)
Nov 28 11:17:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Acquiring lock "/opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:17:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Lock "/opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:17:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Lock "/opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:17:50 user nova-compute[74994]: DEBUG nova.objects.instance [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Lazy-loading 'trusted_certs' on Instance uuid 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:17:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Acquiring lock "03384d4bafba67c2645866d5a788a018f007d884" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:17:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Lock "03384d4bafba67c2645866d5a788a018f007d884" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:17:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03384d4bafba67c2645866d5a788a018f007d884.part --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:17:52 user nova-compute[74994]: DEBUG nova.compute.manager [req-408a3d50-dcc1-4eab-b4ec-5ea33d5c9cd5 req-34590c82-2644-4d16-8c6a-36aab8c18e6c service nova] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Received event network-vif-plugged-b00e25d1-164f-4256-824a-b4c6a6aa2349 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:17:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-408a3d50-dcc1-4eab-b4ec-5ea33d5c9cd5 req-34590c82-2644-4d16-8c6a-36aab8c18e6c service nova] Acquiring lock "76f339ed-a2e6-43e1-a16b-03000fdf537b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:17:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-408a3d50-dcc1-4eab-b4ec-5ea33d5c9cd5 req-34590c82-2644-4d16-8c6a-36aab8c18e6c service nova] Lock "76f339ed-a2e6-43e1-a16b-03000fdf537b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:17:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-408a3d50-dcc1-4eab-b4ec-5ea33d5c9cd5 req-34590c82-2644-4d16-8c6a-36aab8c18e6c service nova] Lock "76f339ed-a2e6-43e1-a16b-03000fdf537b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:17:52 user nova-compute[74994]: DEBUG nova.compute.manager [req-408a3d50-dcc1-4eab-b4ec-5ea33d5c9cd5 req-34590c82-2644-4d16-8c6a-36aab8c18e6c service nova] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] No waiting events found dispatching network-vif-plugged-b00e25d1-164f-4256-824a-b4c6a6aa2349 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:17:52 user nova-compute[74994]: WARNING nova.compute.manager [req-408a3d50-dcc1-4eab-b4ec-5ea33d5c9cd5 req-34590c82-2644-4d16-8c6a-36aab8c18e6c service nova] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Received unexpected event network-vif-plugged-b00e25d1-164f-4256-824a-b4c6a6aa2349 for instance with vm_state building and task_state spawning.
Nov 28 11:17:52 user nova-compute[74994]: DEBUG nova.compute.manager [req-4e8fe476-6fc2-4ae6-a18e-253aac40d3d1 req-3392bf50-f08c-49e8-8af8-bbb61889f935 service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Received event network-vif-plugged-f74e1103-305e-48c3-941a-df5a1dc39873 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:17:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4e8fe476-6fc2-4ae6-a18e-253aac40d3d1 req-3392bf50-f08c-49e8-8af8-bbb61889f935 service nova] Acquiring lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:17:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4e8fe476-6fc2-4ae6-a18e-253aac40d3d1 req-3392bf50-f08c-49e8-8af8-bbb61889f935 service nova] Lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:17:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4e8fe476-6fc2-4ae6-a18e-253aac40d3d1 req-3392bf50-f08c-49e8-8af8-bbb61889f935 service nova] Lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:17:52 user nova-compute[74994]: DEBUG nova.compute.manager [req-4e8fe476-6fc2-4ae6-a18e-253aac40d3d1 req-3392bf50-f08c-49e8-8af8-bbb61889f935 service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] No waiting events found dispatching network-vif-plugged-f74e1103-305e-48c3-941a-df5a1dc39873 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:17:52 user nova-compute[74994]: WARNING nova.compute.manager [req-4e8fe476-6fc2-4ae6-a18e-253aac40d3d1 req-3392bf50-f08c-49e8-8af8-bbb61889f935 service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Received unexpected event network-vif-plugged-f74e1103-305e-48c3-941a-df5a1dc39873 for instance with vm_state active and task_state rescuing.
Nov 28 11:17:52 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 11:17:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 11:17:52 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Instance spawned successfully.
Nov 28 11:17:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 11:17:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:17:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:17:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:17:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:17:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:17:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:17:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03384d4bafba67c2645866d5a788a018f007d884.part --force-share --output=json" returned: 0 in 0.178s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:17:52 user nova-compute[74994]: DEBUG nova.virt.images [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] 093e080d-d836-4e12-bb3e-2625b611a66a was qcow2, converting to raw {{(pid=74994) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 11:17:52 user nova-compute[74994]: DEBUG nova.privsep.utils [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74994) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 11:17:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/03384d4bafba67c2645866d5a788a018f007d884.part /opt/stack/data/nova/instances/_base/03384d4bafba67c2645866d5a788a018f007d884.converted {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:17:52 user nova-compute[74994]: INFO nova.compute.manager [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Took 5.69 seconds to spawn the instance on the hypervisor.
Nov 28 11:17:52 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 11:17:52 user nova-compute[74994]: INFO nova.compute.manager [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Took 6.33 seconds to build instance.
Nov 28 11:17:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8ae123b8-5d0a-4bbc-81a0-029f64acba01 tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Lock "76f339ed-a2e6-43e1-a16b-03000fdf537b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.462s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:17:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/03384d4bafba67c2645866d5a788a018f007d884.part /opt/stack/data/nova/instances/_base/03384d4bafba67c2645866d5a788a018f007d884.converted" returned: 0 in 0.448s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:17:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03384d4bafba67c2645866d5a788a018f007d884.converted --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:17:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03384d4bafba67c2645866d5a788a018f007d884.converted --force-share --output=json" returned: 0 in 0.179s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:17:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Lock "03384d4bafba67c2645866d5a788a018f007d884" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.249s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:17:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Acquiring lock "03384d4bafba67c2645866d5a788a018f007d884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:17:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Lock "03384d4bafba67c2645866d5a788a018f007d884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:17:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03384d4bafba67c2645866d5a788a018f007d884 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03384d4bafba67c2645866d5a788a018f007d884 --force-share --output=json" returned: 0 in 0.211s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/03384d4bafba67c2645866d5a788a018f007d884,backing_fmt=raw /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk.rescue {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/03384d4bafba67c2645866d5a788a018f007d884,backing_fmt=raw /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk.rescue" returned: 0 in 0.055s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Lock "03384d4bafba67c2645866d5a788a018f007d884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG nova.objects.instance [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Lazy-loading 'migration_context' on Instance uuid 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG nova.objects.base [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Object Instance<58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Created local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Start _get_guest_xml network_info=[{"id": "f74e1103-305e-48c3-941a-df5a1dc39873", "address": "fa:16:3e:5e:26:7f", "network": {"id": "5adf74ed-a983-4b41-a530-3e79a364db73", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2074174508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2074174508-network", "vif_mac": "fa:16:3e:5e:26:7f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6f53748392c4f07bcf976431a90ceb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74e1103-30", "ovs_interfaceid": "f74e1103-305e-48c3-941a-df5a1dc39873", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '093e080d-d836-4e12-bb3e-2625b611a66a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'aa939d1b-b8a6-4391-935b-0191bf5ccd0a'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TiDqrfAw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f', 'attached_at': '', 'detached_at': '', 'volume_id': '8e996227-a705-4cd3-a100-a57c80861401', 'serial': '8e996227-a705-4cd3-a100-a57c80861401'}, 'attachment_id': '2641964a-98bb-4246-aa00-5db9bbcba59a', 'boot_index': None, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG nova.objects.instance [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Lazy-loading 'resources' on Instance uuid 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG nova.objects.base [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Object Instance<58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG nova.objects.instance [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Lazy-loading 'numa_topology' on Instance uuid 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG nova.objects.base [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Object Instance<58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 11:17:53 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:17:53 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:17:53 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG nova.objects.instance [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Lazy-loading 'vcpu_model' on Instance uuid 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG nova.objects.base [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Object Instance<58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TiDqrfAw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:17:53 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:17:53 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:17:53 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:17:53 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:17:53 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 11:17:53 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 -p 172.16.0.220:3260" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4535844-989b-4fd8-92f1-3f2314a15757]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = TiDqrfAw\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 28 11:17:53 user nova-compute[74994]: node.name = iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401
Nov 28 11:17:53 user nova-compute[74994]: node.tpgt = -1
Nov 28 11:17:53 user nova-compute[74994]: node.startup = automatic
Nov 28 11:17:53 user nova-compute[74994]: node.leading_login = No
Nov 28 11:17:53 user nova-compute[74994]: iface.iscsi_ifacename = default
Nov 28 11:17:53 user nova-compute[74994]: iface.net_ifacename = <empty>
Nov 28 11:17:53 user nova-compute[74994]: iface.ipaddress = <empty>
Nov 28 11:17:53 user nova-compute[74994]: iface.prefix_len = 0
Nov 28 11:17:53 user nova-compute[74994]: iface.hwaddress = <empty>
Nov 28 11:17:53 user nova-compute[74994]: iface.transport_name = tcp
Nov 28 11:17:53 user nova-compute[74994]: iface.initiatorname = <empty>
Nov 28 11:17:53 user nova-compute[74994]: iface.state = <empty>
Nov 28 11:17:53 user nova-compute[74994]: iface.vlan_id = 0
Nov 28 11:17:53 user nova-compute[74994]: iface.vlan_priority = 0
Nov 28 11:17:53 user nova-compute[74994]: iface.vlan_state = <empty>
Nov 28 11:17:53 user nova-compute[74994]: iface.iface_num = 0
Nov 28 11:17:53 user nova-compute[74994]: iface.mtu = 0
Nov 28 11:17:53 user nova-compute[74994]: iface.port = 0
Nov 28 11:17:53 user nova-compute[74994]: iface.bootproto = <empty>
Nov 28 11:17:53 user nova-compute[74994]: iface.subnet_mask = <empty>
Nov 28 11:17:53 user nova-compute[74994]: iface.gateway = <empty>
Nov 28 11:17:53 user nova-compute[74994]: iface.dhcp_alt_client_id_state = <empty>
Nov 28 11:17:53 user nova-compute[74994]: iface.dhcp_alt_client_id = <empty>
Nov 28 11:17:53 user nova-compute[74994]: iface.dhcp_dns = <empty>
Nov 28 11:17:53 user nova-compute[74994]: iface.dhcp_learn_iqn = <empty>
Nov 28 11:17:53 user nova-compute[74994]: iface.dhcp_req_vendor_id_state = <empty>
Nov 28 11:17:53 user nova-compute[74994]: iface.dhcp_vendor_id_state = <empty>
Nov 28 11:17:53 user nova-compute[74994]: iface.dhcp_vendor_id = <empty>
Nov 28 11:17:53 user nova-compute[74994]: iface.dhcp_slp_da = <empty>
Nov 28 11:17:53 user nova-compute[74994]: iface.fragmentation = <empty>
Nov 28 11:17:53 user nova-compute[74994]: iface.gratuitous_arp = <empty>
Nov 28 11:17:53 user nova-compute[74994]: iface.incoming_forwarding = <empty>
Nov 28 11:17:53 user nova-compute[74994]: iface.tos_state = <empty>
Nov 28 11:17:53 user nova-compute[74994]: iface.tos = 0
Nov 28 11:17:53 user nova-compute[74994]: iface.ttl = 0
Nov 28 11:17:53 user nova-compute[74994]: iface.delayed_ack = <empty>
Nov 28 11:17:53 user nova-compute[74994]: iface.tcp_nagle = <empty>
Nov 28 11:17:53 user nova-compute[74994]: iface.tcp_wsf_state = <empty>
Nov 28 11:17:53 user nova-compute[74994]: iface.tcp_wsf = 0
Nov 28 11:17:53 user nova-compute[74994]: iface.tcp_timer_scale = 0
Nov 28 11:17:53 user nova-compute[74994]: iface.tcp_timestamp = <empty>
Nov 28 11:17:53 user nova-compute[74994]: iface.redirect = <empty>
Nov 28 11:17:53 user nova-compute[74994]: iface.def_task_mgmt_timeout = 0
Nov 28 11:17:53 user nova-compute[74994]: iface.header_digest = <empty>
Nov 28 11:17:53 user nova-compute[74994]: iface.data_digest = <empty>
Nov 28 11:17:53 user nova-compute[74994]: iface.immediate_data = <empty>
Nov 28 11:17:53 user nova-compute[74994]: iface.initial_r2t = <empty>
Nov 28 11:17:53 user nova-compute[74994]: iface.data_seq_inorder = <empty>
Nov 28 11:17:53 user nova-compute[74994]: iface.data_pdu_inorder = <empty>
Nov 28 11:17:53 user nova-compute[74994]: iface.erl = 0
Nov 28 11:17:53 user nova-compute[74994]: iface.max_receive_data_len = 0
Nov 28 11:17:53 user nova-compute[74994]: iface.first_burst_len = 0
Nov 28 11:17:53 user nova-compute[74994]: iface.max_outstanding_r2t = 0
Nov 28 11:17:53 user nova-compute[74994]: iface.max_burst_len = 0
Nov 28 11:17:53 user nova-compute[74994]: iface.chap_auth = <empty>
Nov 28 11:17:53 user nova-compute[74994]: iface.bidi_chap = <empty>
Nov 28 11:17:53 user nova-compute[74994]: iface.strict_login_compliance = <empty>
Nov 28 11:17:53 user nova-compute[74994]: iface.discovery_auth = <empty>
Nov 28 11:17:53 user nova-compute[74994]: iface.discovery_logout = <empty>
Nov 28 11:17:53 user nova-compute[74994]: node.discovery_address = <empty>
Nov 28 11:17:53 user nova-compute[74994]: node.discovery_port = 0
Nov 28 11:17:53 user nova-compute[74994]: node.discovery_type = static
Nov 28 11:17:53 user nova-compute[74994]: node.session.initial_cmdsn = 0
Nov 28 11:17:53 user nova-compute[74994]: node.session.initial_login_retry_max = 8
Nov 28 11:17:53 user nova-compute[74994]: node.session.xmit_thread_priority = -20
Nov 28 11:17:53 user nova-compute[74994]: node.session.cmds_max = 128
Nov 28 11:17:53 user nova-compute[74994]: node.session.queue_depth = 32
Nov 28 11:17:53 user nova-compute[74994]: node.session.nr_sessions = 1
Nov 28 11:17:53 user nova-compute[74994]: node.session.auth.authmethod = CHAP
Nov 28 11:17:53 user nova-compute[74994]: node.session.auth.username = TiDqrfAw
Nov 28 11:17:53 user nova-compute[74994]: node.session.auth.password = ***
Nov 28 11:17:53 user nova-compute[74994]: node.session.auth.username_in = <empty>
Nov 28 11:17:53 user nova-compute[74994]: node.session.auth.password_in = <empty>
Nov 28 11:17:53 user nova-compute[74994]: node.session.auth.chap_algs = MD5
Nov 28 11:17:53 user nova-compute[74994]: node.session.timeo.replacement_timeout = 120
Nov 28 11:17:53 user nova-compute[74994]: node.session.err_timeo.abort_timeout = 15
Nov 28 11:17:53 user nova-compute[74994]: node.session.err_timeo.lu_reset_timeout = 30
Nov 28 11:17:53 user nova-compute[74994]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 28 11:17:53 user nova-compute[74994]: node.session.err_timeo.host_reset_timeout = 60
Nov 28 11:17:53 user nova-compute[74994]: node.session.iscsi.FastAbort = Yes
Nov 28 11:17:53 user nova-compute[74994]: node.session.iscsi.InitialR2T = No
Nov 28 11:17:53 user nova-compute[74994]: node.session.iscsi.ImmediateData = Yes
Nov 28 11:17:53 user nova-compute[74994]: node.session.iscsi.FirstBurstLength = 262144
Nov 28 11:17:53 user nova-compute[74994]: node.session.iscsi.MaxBurstLength = 16776192
Nov 28 11:17:53 user nova-compute[74994]: node.session.iscsi.DefaultTime2Retain = 0
Nov 28 11:17:53 user nova-compute[74994]: node.session.iscsi.DefaultTime2Wait = 2
Nov 28 11:17:53 user nova-compute[74994]: node.session.iscsi.MaxConnections = 1
Nov 28 11:17:53 user nova-compute[74994]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 28 11:17:53 user nova-compute[74994]: node.session.iscsi.ERL = 0
Nov 28 11:17:53 user nova-compute[74994]: node.session.scan = manual
Nov 28 11:17:53 user nova-compute[74994]: node.session.reopen_max = 0
Nov 28 11:17:53 user nova-compute[74994]: node.conn[0].address = 172.16.0.220
Nov 28 11:17:53 user nova-compute[74994]: node.conn[0].port = 3260
Nov 28 11:17:53 user nova-compute[74994]: node.conn[0].startup = manual
Nov 28 11:17:53 user nova-compute[74994]: node.conn[0].tcp.window_size = 524288
Nov 28 11:17:53 user nova-compute[74994]: node.conn[0].tcp.type_of_service = 0
Nov 28 11:17:53 user nova-compute[74994]: node.conn[0].timeo.logout_timeout = 15
Nov 28 11:17:53 user nova-compute[74994]: node.conn[0].timeo.login_timeout = 15
Nov 28 11:17:53 user nova-compute[74994]: node.conn[0].timeo.auth_timeout = 45
Nov 28 11:17:53 user nova-compute[74994]: node.conn[0].timeo.noop_out_interval = 5
Nov 28 11:17:53 user nova-compute[74994]: node.conn[0].timeo.noop_out_timeout = 5
Nov 28 11:17:53 user nova-compute[74994]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 28 11:17:53 user nova-compute[74994]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 28 11:17:53 user nova-compute[74994]: node.conn[0].iscsi.HeaderDigest = None
Nov 28 11:17:53 user nova-compute[74994]: node.conn[0].iscsi.DataDigest = None
Nov 28 11:17:53 user nova-compute[74994]: node.conn[0].iscsi.IFMarker = No
Nov 28 11:17:53 user nova-compute[74994]: node.conn[0].iscsi.OFMarker = No
Nov 28 11:17:53 user nova-compute[74994]: # END RECORD
Nov 28 11:17:53 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b6e936-4f21-413e-baf8-a15638499333]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f23698-c059-4b8c-9c42-bcb0f8aa515e]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TiDqrfAw {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TiDqrfAw" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2b6e60-052f-4a52-8c8b-b3d32e589ae8]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TiDqrfAw'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[52524b5c-ae4a-4d83-88be-52e382ea853f]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0cf168-7f3c-4c5f-8738-604400571172]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 (non-flash)
Nov 28 11:17:53 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 (non-flash)
Nov 28 11:17:53 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.147s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] HCTL ('33', '0', '0', 0) found on session 49 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc172f6-de19-4979-ac40-411c6e61c7dd]: (4, ('0 0 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Searching for a device in session 49 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TiDqrfAw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.176s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] <== connect_volume: return (178ms) {'type': 'block', 'scsi_wwn': '23536626431343931', 'path': '/dev/sdb'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23536626431343931', 'path': '/dev/sdb'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:13:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1052735740',display_name='tempest-ServerStableDeviceRescueTest-server-1052735740',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1052735740',id=42,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvIMFBxCfGNOfXT7o2GQq2zAQvFOyOHwsqXQTy9EM88+ITJHWPj8RbVSw1m5OzDtto+mvTb2iAylNkJ25WSwMYGIsi1p2TfiDNsdNhJGcGABqRneTPc1XQ+A6T2HvtnvQ==',key_name='tempest-keypair-449219025',keypairs=<?>,launch_index=0,launched_at=2023-11-28T11:14:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6f53748392c4f07bcf976431a90ceb3',ramdisk_id='',reservation_id='r-ysh20ttk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1260621891',owner_user_name='tempest-ServerStableDeviceRescueTest-1260621891-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:15:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48a8f622cb634f478095ff72fde0b223',uuid=58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f74e1103-305e-48c3-941a-df5a1dc39873", "address": "fa:16:3e:5e:26:7f", "network": {"id": "5adf74ed-a983-4b41-a530-3e79a364db73", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2074174508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2074174508-network", "vif_mac": "fa:16:3e:5e:26:7f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6f53748392c4f07bcf976431a90ceb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74e1103-30", "ovs_interfaceid": "f74e1103-305e-48c3-941a-df5a1dc39873", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Converting VIF {"id": "f74e1103-305e-48c3-941a-df5a1dc39873", "address": "fa:16:3e:5e:26:7f", "network": {"id": "5adf74ed-a983-4b41-a530-3e79a364db73", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2074174508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2074174508-network", "vif_mac": "fa:16:3e:5e:26:7f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6f53748392c4f07bcf976431a90ceb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74e1103-30", "ovs_interfaceid": "f74e1103-305e-48c3-941a-df5a1dc39873", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:26:7f,bridge_name='br-int',has_traffic_filtering=True,id=f74e1103-305e-48c3-941a-df5a1dc39873,network=Network(5adf74ed-a983-4b41-a530-3e79a364db73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf74e1103-30') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG nova.objects.instance [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Lazy-loading 'pci_devices' on Instance uuid 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG nova.objects.base [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Object Instance<58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] End _get_guest_xml xml=<domain type="kvm">
Nov 28 11:17:53 user nova-compute[74994]:   <uuid>58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f</uuid>
Nov 28 11:17:53 user nova-compute[74994]:   <name>instance-0000002a</name>
Nov 28 11:17:53 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 11:17:53 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 11:17:53 user nova-compute[74994]:   <metadata>
Nov 28 11:17:53 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 11:17:53 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 11:17:53 user nova-compute[74994]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1052735740</nova:name>
Nov 28 11:17:53 user nova-compute[74994]:       <nova:creationTime>2023-11-28 11:17:53</nova:creationTime>
Nov 28 11:17:53 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 11:17:53 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 11:17:53 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 11:17:53 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 11:17:53 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 11:17:53 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 11:17:53 user nova-compute[74994]:       </nova:flavor>
Nov 28 11:17:53 user nova-compute[74994]:       <nova:owner>
Nov 28 11:17:53 user nova-compute[74994]:         <nova:user uuid="48a8f622cb634f478095ff72fde0b223">tempest-ServerStableDeviceRescueTest-1260621891-project-member</nova:user>
Nov 28 11:17:53 user nova-compute[74994]:         <nova:project uuid="e6f53748392c4f07bcf976431a90ceb3">tempest-ServerStableDeviceRescueTest-1260621891</nova:project>
Nov 28 11:17:53 user nova-compute[74994]:       </nova:owner>
Nov 28 11:17:53 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 11:17:53 user nova-compute[74994]:       <nova:ports>
Nov 28 11:17:53 user nova-compute[74994]:         <nova:port uuid="f74e1103-305e-48c3-941a-df5a1dc39873">
Nov 28 11:17:53 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 11:17:53 user nova-compute[74994]:         </nova:port>
Nov 28 11:17:53 user nova-compute[74994]:       </nova:ports>
Nov 28 11:17:53 user nova-compute[74994]:     </nova:instance>
Nov 28 11:17:53 user nova-compute[74994]:   </metadata>
Nov 28 11:17:53 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 11:17:53 user nova-compute[74994]:     <system>
Nov 28 11:17:53 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 11:17:53 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 11:17:53 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 11:17:53 user nova-compute[74994]:       <entry name="serial">58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f</entry>
Nov 28 11:17:53 user nova-compute[74994]:       <entry name="uuid">58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f</entry>
Nov 28 11:17:53 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 11:17:53 user nova-compute[74994]:     </system>
Nov 28 11:17:53 user nova-compute[74994]:   </sysinfo>
Nov 28 11:17:53 user nova-compute[74994]:   <os>
Nov 28 11:17:53 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 11:17:53 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 11:17:53 user nova-compute[74994]:   </os>
Nov 28 11:17:53 user nova-compute[74994]:   <features>
Nov 28 11:17:53 user nova-compute[74994]:     <acpi/>
Nov 28 11:17:53 user nova-compute[74994]:     <apic/>
Nov 28 11:17:53 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 11:17:53 user nova-compute[74994]:   </features>
Nov 28 11:17:53 user nova-compute[74994]:   <clock offset="utc">
Nov 28 11:17:53 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 11:17:53 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 11:17:53 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 11:17:53 user nova-compute[74994]:   </clock>
Nov 28 11:17:53 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 11:17:53 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 11:17:53 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 11:17:53 user nova-compute[74994]:   </cpu>
Nov 28 11:17:53 user nova-compute[74994]:   <devices>
Nov 28 11:17:53 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 11:17:53 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 11:17:53 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk"/>
Nov 28 11:17:53 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 11:17:53 user nova-compute[74994]:     </disk>
Nov 28 11:17:53 user nova-compute[74994]:     <disk type="block" device="disk">
Nov 28 11:17:53 user nova-compute[74994]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:17:53 user nova-compute[74994]:       <source dev="/dev/sdb"/>
Nov 28 11:17:53 user nova-compute[74994]:       <target dev="vdb" bus="virtio"/>
Nov 28 11:17:53 user nova-compute[74994]:       <serial>8e996227-a705-4cd3-a100-a57c80861401</serial>
Nov 28 11:17:53 user nova-compute[74994]:     </disk>
Nov 28 11:17:53 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 11:17:53 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 11:17:53 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk.rescue"/>
Nov 28 11:17:53 user nova-compute[74994]:       <target dev="vdc" bus="virtio"/>
Nov 28 11:17:53 user nova-compute[74994]:       <boot order="1"/>
Nov 28 11:17:53 user nova-compute[74994]:     </disk>
Nov 28 11:17:53 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 11:17:53 user nova-compute[74994]:       <mac address="fa:16:3e:5e:26:7f"/>
Nov 28 11:17:53 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:17:53 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 11:17:53 user nova-compute[74994]:       <target dev="tapf74e1103-30"/>
Nov 28 11:17:53 user nova-compute[74994]:     </interface>
Nov 28 11:17:53 user nova-compute[74994]:     <serial type="pty">
Nov 28 11:17:53 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/console.log" append="off"/>
Nov 28 11:17:53 user nova-compute[74994]:     </serial>
Nov 28 11:17:53 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 11:17:53 user nova-compute[74994]:     <video>
Nov 28 11:17:53 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:17:53 user nova-compute[74994]:     </video>
Nov 28 11:17:53 user nova-compute[74994]:     <rng model="virtio">
Nov 28 11:17:53 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 11:17:53 user nova-compute[74994]:     </rng>
Nov 28 11:17:53 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 11:17:53 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 11:17:53 user nova-compute[74994]:       <stats period="10"/>
Nov 28 11:17:53 user nova-compute[74994]:     </memballoon>
Nov 28 11:17:53 user nova-compute[74994]:   </devices>
Nov 28 11:17:53 user nova-compute[74994]: </domain>
Nov 28 11:17:53 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 11:17:53 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Instance destroyed successfully.
Nov 28 11:17:53 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:17:53 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] No VIF found with MAC fa:16:3e:5e:26:7f, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:17:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:55 user nova-compute[74994]: DEBUG nova.compute.manager [req-985584ac-41fd-4813-a40a-7103cbf83312 req-c432b813-34d3-41f2-bdf4-6d370b91a362 service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Received event network-vif-plugged-f74e1103-305e-48c3-941a-df5a1dc39873 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:17:55 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-985584ac-41fd-4813-a40a-7103cbf83312 req-c432b813-34d3-41f2-bdf4-6d370b91a362 service nova] Acquiring lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:17:55 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-985584ac-41fd-4813-a40a-7103cbf83312 req-c432b813-34d3-41f2-bdf4-6d370b91a362 service nova] Lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:17:55 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-985584ac-41fd-4813-a40a-7103cbf83312 req-c432b813-34d3-41f2-bdf4-6d370b91a362 service nova] Lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:17:55 user nova-compute[74994]: DEBUG nova.compute.manager [req-985584ac-41fd-4813-a40a-7103cbf83312 req-c432b813-34d3-41f2-bdf4-6d370b91a362 service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] No waiting events found dispatching network-vif-plugged-f74e1103-305e-48c3-941a-df5a1dc39873 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:17:55 user nova-compute[74994]: WARNING nova.compute.manager [req-985584ac-41fd-4813-a40a-7103cbf83312 req-c432b813-34d3-41f2-bdf4-6d370b91a362 service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Received unexpected event network-vif-plugged-f74e1103-305e-48c3-941a-df5a1dc39873 for instance with vm_state active and task_state rescuing.
Nov 28 11:17:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:17:57 user nova-compute[74994]: DEBUG nova.compute.manager [req-5ede3bd2-569a-4aae-84aa-eb4cdc1b8ab5 req-106a9eea-b1ff-4989-8f6c-53067c8b8cf0 service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Received event network-vif-plugged-f74e1103-305e-48c3-941a-df5a1dc39873 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:17:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-5ede3bd2-569a-4aae-84aa-eb4cdc1b8ab5 req-106a9eea-b1ff-4989-8f6c-53067c8b8cf0 service nova] Acquiring lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:17:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-5ede3bd2-569a-4aae-84aa-eb4cdc1b8ab5 req-106a9eea-b1ff-4989-8f6c-53067c8b8cf0 service nova] Lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:17:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-5ede3bd2-569a-4aae-84aa-eb4cdc1b8ab5 req-106a9eea-b1ff-4989-8f6c-53067c8b8cf0 service nova] Lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:17:57 user nova-compute[74994]: DEBUG nova.compute.manager [req-5ede3bd2-569a-4aae-84aa-eb4cdc1b8ab5 req-106a9eea-b1ff-4989-8f6c-53067c8b8cf0 service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] No waiting events found dispatching network-vif-plugged-f74e1103-305e-48c3-941a-df5a1dc39873 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:17:57 user nova-compute[74994]: WARNING nova.compute.manager [req-5ede3bd2-569a-4aae-84aa-eb4cdc1b8ab5 req-106a9eea-b1ff-4989-8f6c-53067c8b8cf0 service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Received unexpected event network-vif-plugged-f74e1103-305e-48c3-941a-df5a1dc39873 for instance with vm_state active and task_state rescuing.
Nov 28 11:17:57 user nova-compute[74994]: DEBUG nova.compute.manager [None req-44f24f27-cbd8-40d6-8ed8-758efcdd1584 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 11:17:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:18:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:18:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:18:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:18:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:18:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:18:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:18:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:18:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:18:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:18:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:18:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:18:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:18:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:18:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:18:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:18:27 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:18:27 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 11:18:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:18:28 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:18:28 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:18:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:18:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:18:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:18:28 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 11:18:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76f339ed-a2e6-43e1-a16b-03000fdf537b/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:18:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76f339ed-a2e6-43e1-a16b-03000fdf537b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:18:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76f339ed-a2e6-43e1-a16b-03000fdf537b/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:18:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76f339ed-a2e6-43e1-a16b-03000fdf537b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:18:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6803632-6fc3-4b5d-abf4-cc2665a7a26a/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:18:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6803632-6fc3-4b5d-abf4-cc2665a7a26a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:18:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6803632-6fc3-4b5d-abf4-cc2665a7a26a/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:18:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6803632-6fc3-4b5d-abf4-cc2665a7a26a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:18:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:18:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:18:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:18:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:18:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:18:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk.rescue --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:18:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:18:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk.rescue --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:18:30 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:18:30 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:18:30 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:18:30 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=8706MB free_disk=24.92824935913086GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 11:18:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:18:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:18:30 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:18:30 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance e6803632-6fc3-4b5d-abf4-cc2665a7a26a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:18:30 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 76f339ed-a2e6-43e1-a16b-03000fdf537b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:18:30 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 11:18:30 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 11:18:30 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:18:30 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:18:30 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 11:18:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.284s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:18:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:18:34 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:18:34 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:18:36 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:18:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:18:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:18:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:18:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:18:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:18:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:18:38 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:18:38 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 11:18:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "refresh_cache-e6803632-6fc3-4b5d-abf4-cc2665a7a26a" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:18:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquired lock "refresh_cache-e6803632-6fc3-4b5d-abf4-cc2665a7a26a" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:18:38 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Forcefully refreshing network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 11:18:39 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Updating instance_info_cache with network_info: [{"id": "f3314941-1e6a-4f3a-a608-0a6949c6f8f7", "address": "fa:16:3e:54:c8:ad", "network": {"id": "45bc19c0-a3b5-478a-8289-a0f75228a260", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1070183224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc76d73b2a1142409262135e96f3cc82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3314941-1e", "ovs_interfaceid": "f3314941-1e6a-4f3a-a608-0a6949c6f8f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:18:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Releasing lock "refresh_cache-e6803632-6fc3-4b5d-abf4-cc2665a7a26a" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:18:39 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Updated the network info_cache for instance {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 11:18:39 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:18:41 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:18:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:18:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:18:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:18:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:18:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:18:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:18:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:18:51 user nova-compute[74994]: DEBUG nova.compute.manager [req-d5c666ad-59c9-4af5-9deb-5b3cb343467a req-f3c1e883-07c2-4049-8644-f181f0dbb743 service nova] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Received event network-changed-f3314941-1e6a-4f3a-a608-0a6949c6f8f7 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:18:51 user nova-compute[74994]: DEBUG nova.compute.manager [req-d5c666ad-59c9-4af5-9deb-5b3cb343467a req-f3c1e883-07c2-4049-8644-f181f0dbb743 service nova] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Refreshing instance network info cache due to event network-changed-f3314941-1e6a-4f3a-a608-0a6949c6f8f7. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:18:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d5c666ad-59c9-4af5-9deb-5b3cb343467a req-f3c1e883-07c2-4049-8644-f181f0dbb743 service nova] Acquiring lock "refresh_cache-e6803632-6fc3-4b5d-abf4-cc2665a7a26a" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:18:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d5c666ad-59c9-4af5-9deb-5b3cb343467a req-f3c1e883-07c2-4049-8644-f181f0dbb743 service nova] Acquired lock "refresh_cache-e6803632-6fc3-4b5d-abf4-cc2665a7a26a" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:18:51 user nova-compute[74994]: DEBUG nova.network.neutron [req-d5c666ad-59c9-4af5-9deb-5b3cb343467a req-f3c1e883-07c2-4049-8644-f181f0dbb743 service nova] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Refreshing network info cache for port f3314941-1e6a-4f3a-a608-0a6949c6f8f7 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:18:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Acquiring lock "e6803632-6fc3-4b5d-abf4-cc2665a7a26a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:18:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "e6803632-6fc3-4b5d-abf4-cc2665a7a26a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:18:51 user nova-compute[74994]: DEBUG nova.objects.instance [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lazy-loading 'flavor' on Instance uuid e6803632-6fc3-4b5d-abf4-cc2665a7a26a {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:18:51 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Ignoring supplied device name: /dev/vdb
Nov 28 11:18:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "e6803632-6fc3-4b5d-abf4-cc2665a7a26a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:18:51 user nova-compute[74994]: DEBUG nova.network.neutron [req-d5c666ad-59c9-4af5-9deb-5b3cb343467a req-f3c1e883-07c2-4049-8644-f181f0dbb743 service nova] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Updated VIF entry in instance network info cache for port f3314941-1e6a-4f3a-a608-0a6949c6f8f7. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:18:51 user nova-compute[74994]: DEBUG nova.network.neutron [req-d5c666ad-59c9-4af5-9deb-5b3cb343467a req-f3c1e883-07c2-4049-8644-f181f0dbb743 service nova] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Updating instance_info_cache with network_info: [{"id": "f3314941-1e6a-4f3a-a608-0a6949c6f8f7", "address": "fa:16:3e:54:c8:ad", "network": {"id": "45bc19c0-a3b5-478a-8289-a0f75228a260", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1070183224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc76d73b2a1142409262135e96f3cc82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3314941-1e", "ovs_interfaceid": "f3314941-1e6a-4f3a-a608-0a6949c6f8f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:18:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d5c666ad-59c9-4af5-9deb-5b3cb343467a req-f3c1e883-07c2-4049-8644-f181f0dbb743 service nova] Releasing lock "refresh_cache-e6803632-6fc3-4b5d-abf4-cc2665a7a26a" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:18:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Acquiring lock "e6803632-6fc3-4b5d-abf4-cc2665a7a26a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:18:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "e6803632-6fc3-4b5d-abf4-cc2665a7a26a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:18:51 user nova-compute[74994]: INFO nova.compute.manager [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Attaching volume 80e247b4-4e54-4b32-8709-14ad6a51f324 to /dev/vdb
Nov 28 11:18:51 user nova-compute[74994]: DEBUG os_brick.utils [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:18:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:18:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:18:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b053eaf0-56e9-4ec8-a74d-f475daf9f9fe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:18:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:18:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:18:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32f64bd-0edd-47f0-9fe8-d6ba96bcd234]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:18:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:18:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:18:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[56491632-c224-46cc-96f5-ee726fb69e9d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:18:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[86330a1f-5447-4dd5-937e-bae8a14c197b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:18:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:18:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:18:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 11:18:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:18:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:18:51 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 11:18:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[983bb962-4f57-4244-ae82-58e242d77678]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:18:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 11:18:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 11:18:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 11:18:51 user nova-compute[74994]: DEBUG os_brick.utils [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:18:51 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Updating existing volume attachment record: a67c93a1-3f1f-4825-a094-bc066f0953f2 {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 11:18:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:18:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pRuKdMhI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:18:58 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:18:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:18:58 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:18:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:18:58 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 11:18:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324 -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[47efc7f6-3465-473a-94c8-4a7d931f289a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 11:18:58 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324 -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[634e9fcb-36dd-444d-9b1a-0491f774b660]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324] added
Nov 28 11:18:58 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c91a7b-faed-4604-a83e-14f654758a96]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0771fd0-43ba-4b44-b062-e94454b1fe83]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pRuKdMhI {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pRuKdMhI" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b81efc-33a4-4aeb-a722-d1a396e0559c]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pRuKdMhI'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e47ffcb-e884-44ee-a6f6-f5cb61061426]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[696281ca-1fc2-48ab-9ca6-a3ac9d11a1c1]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 (non-flash)
Nov 28 11:18:58 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 (non-flash)
Nov 28 11:18:58 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324 -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2edba442-9eb6-4713-bf47-caac03a19986]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324, portal: 172.16.0.220,3260]
Nov 28 11:18:58 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324, portal: 172.16.0.220,3260] successful.
Nov 28 11:18:58 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a352afe9-b8a7-40af-871a-0635444696c1]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4e8b56-4d5b-4e69-a3fa-6c8579453c5d]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 (non-flash)
Nov 28 11:18:58 user nova-compute[74994]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324 (non-flash)
Nov 28 11:18:58 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 (non-flash)
Nov 28 11:18:58 user nova-compute[74994]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324 (non-flash)
Nov 28 11:18:58 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a08aaa-045e-48c7-b88f-74796768a822]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:18:58 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: None {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 11:18:59 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 11:18:59 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pRuKdMhI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 11:18:59 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:18:59 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23030313536343765', 'path': '/dev/sdc'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:18:59 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030313536343765', 'path': '/dev/sdc'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 11:18:59 user nova-compute[74994]: DEBUG nova.objects.instance [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lazy-loading 'flavor' on Instance uuid e6803632-6fc3-4b5d-abf4-cc2665a7a26a {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:18:59 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 11:18:59 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:18:59 user nova-compute[74994]:   <source dev="/dev/sdc"/>
Nov 28 11:18:59 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:18:59 user nova-compute[74994]:   <serial>80e247b4-4e54-4b32-8709-14ad6a51f324</serial>
Nov 28 11:18:59 user nova-compute[74994]: </disk>
Nov 28 11:18:59 user nova-compute[74994]:  {{(pid=74994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 11:19:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:00 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:19:00 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:19:00 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] No VIF found with MAC fa:16:3e:54:c8:ad, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:19:00 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5199c38d-d73e-4ee3-ac5e-96d91a8efe76 tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "e6803632-6fc3-4b5d-abf4-cc2665a7a26a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.567s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:19:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:19:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:19:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:19:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:19:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1c5049a2-882a-4b5b-9db8-7a3b7d15af0b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Acquiring lock "e6803632-6fc3-4b5d-abf4-cc2665a7a26a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:19:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1c5049a2-882a-4b5b-9db8-7a3b7d15af0b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "e6803632-6fc3-4b5d-abf4-cc2665a7a26a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:19:17 user nova-compute[74994]: INFO nova.compute.manager [None req-1c5049a2-882a-4b5b-9db8-7a3b7d15af0b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Detaching volume 80e247b4-4e54-4b32-8709-14ad6a51f324
Nov 28 11:19:17 user nova-compute[74994]: INFO nova.virt.block_device [None req-1c5049a2-882a-4b5b-9db8-7a3b7d15af0b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Attempting to driver detach volume 80e247b4-4e54-4b32-8709-14ad6a51f324 from mountpoint /dev/vdb
Nov 28 11:19:17 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1c5049a2-882a-4b5b-9db8-7a3b7d15af0b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Attempting to detach device vdb from instance e6803632-6fc3-4b5d-abf4-cc2665a7a26a from the persistent domain config. {{(pid=74994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 11:19:17 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-1c5049a2-882a-4b5b-9db8-7a3b7d15af0b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 11:19:17 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:19:17 user nova-compute[74994]:   <source dev="/dev/sdc"/>
Nov 28 11:19:17 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:19:17 user nova-compute[74994]:   <serial>80e247b4-4e54-4b32-8709-14ad6a51f324</serial>
Nov 28 11:19:17 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 11:19:17 user nova-compute[74994]: </disk>
Nov 28 11:19:17 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 11:19:17 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-1c5049a2-882a-4b5b-9db8-7a3b7d15af0b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Successfully detached device vdb from instance e6803632-6fc3-4b5d-abf4-cc2665a7a26a from the persistent domain config.
Nov 28 11:19:17 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1c5049a2-882a-4b5b-9db8-7a3b7d15af0b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e6803632-6fc3-4b5d-abf4-cc2665a7a26a from the live domain config. {{(pid=74994) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 11:19:17 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-1c5049a2-882a-4b5b-9db8-7a3b7d15af0b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 11:19:17 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:19:17 user nova-compute[74994]:   <source dev="/dev/sdc"/>
Nov 28 11:19:17 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:19:17 user nova-compute[74994]:   <serial>80e247b4-4e54-4b32-8709-14ad6a51f324</serial>
Nov 28 11:19:17 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 11:19:17 user nova-compute[74994]: </disk>
Nov 28 11:19:17 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 11:19:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bdcc878a-be0b-4b9d-bd01-7535d701b28b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Acquiring lock "e6803632-6fc3-4b5d-abf4-cc2665a7a26a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:19:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:19:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:19:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:19:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:19:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:18 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-1c5049a2-882a-4b5b-9db8-7a3b7d15af0b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e6803632-6fc3-4b5d-abf4-cc2665a7a26a {{(pid=74994) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 11:19:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:27 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:19:27 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 11:19:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:28 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:19:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:19:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:19:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:19:28 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 11:19:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76f339ed-a2e6-43e1-a16b-03000fdf537b/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:19:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76f339ed-a2e6-43e1-a16b-03000fdf537b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:19:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76f339ed-a2e6-43e1-a16b-03000fdf537b/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:19:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76f339ed-a2e6-43e1-a16b-03000fdf537b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:19:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6803632-6fc3-4b5d-abf4-cc2665a7a26a/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:19:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6803632-6fc3-4b5d-abf4-cc2665a7a26a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:19:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6803632-6fc3-4b5d-abf4-cc2665a7a26a/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:19:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6803632-6fc3-4b5d-abf4-cc2665a7a26a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:19:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:19:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:19:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:19:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:19:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:19:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk.rescue --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:19:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:19:29 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk.rescue --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:19:30 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:19:30 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:19:30 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:19:30 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=8794MB free_disk=24.918949127197266GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 11:19:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:19:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:19:30 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:19:30 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance e6803632-6fc3-4b5d-abf4-cc2665a7a26a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:19:30 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 76f339ed-a2e6-43e1-a16b-03000fdf537b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:19:30 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 11:19:30 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 11:19:30 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:19:30 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:19:30 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 11:19:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.369s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:19:32 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:19:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:19:34 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:19:35 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:19:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-44338bdf-b39f-4e0b-bb2d-17b89b2458bf tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Acquiring lock "76f339ed-a2e6-43e1-a16b-03000fdf537b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:19:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-44338bdf-b39f-4e0b-bb2d-17b89b2458bf tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Lock "76f339ed-a2e6-43e1-a16b-03000fdf537b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:19:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-44338bdf-b39f-4e0b-bb2d-17b89b2458bf tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Acquiring lock "76f339ed-a2e6-43e1-a16b-03000fdf537b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:19:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-44338bdf-b39f-4e0b-bb2d-17b89b2458bf tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Lock "76f339ed-a2e6-43e1-a16b-03000fdf537b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:19:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-44338bdf-b39f-4e0b-bb2d-17b89b2458bf tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Lock "76f339ed-a2e6-43e1-a16b-03000fdf537b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:19:36 user nova-compute[74994]: INFO nova.compute.manager [None req-44338bdf-b39f-4e0b-bb2d-17b89b2458bf tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Terminating instance
Nov 28 11:19:36 user nova-compute[74994]: DEBUG nova.compute.manager [None req-44338bdf-b39f-4e0b-bb2d-17b89b2458bf tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 11:19:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:36 user nova-compute[74994]: DEBUG nova.compute.manager [req-e332417a-de8d-4814-83c9-e3838c79a050 req-2e06c501-8361-449a-a084-531f6f64a113 service nova] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Received event network-vif-unplugged-b00e25d1-164f-4256-824a-b4c6a6aa2349 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:19:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-e332417a-de8d-4814-83c9-e3838c79a050 req-2e06c501-8361-449a-a084-531f6f64a113 service nova] Acquiring lock "76f339ed-a2e6-43e1-a16b-03000fdf537b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:19:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-e332417a-de8d-4814-83c9-e3838c79a050 req-2e06c501-8361-449a-a084-531f6f64a113 service nova] Lock "76f339ed-a2e6-43e1-a16b-03000fdf537b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:19:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-e332417a-de8d-4814-83c9-e3838c79a050 req-2e06c501-8361-449a-a084-531f6f64a113 service nova] Lock "76f339ed-a2e6-43e1-a16b-03000fdf537b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:19:36 user nova-compute[74994]: DEBUG nova.compute.manager [req-e332417a-de8d-4814-83c9-e3838c79a050 req-2e06c501-8361-449a-a084-531f6f64a113 service nova] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] No waiting events found dispatching network-vif-unplugged-b00e25d1-164f-4256-824a-b4c6a6aa2349 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:19:36 user nova-compute[74994]: DEBUG nova.compute.manager [req-e332417a-de8d-4814-83c9-e3838c79a050 req-2e06c501-8361-449a-a084-531f6f64a113 service nova] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Received event network-vif-unplugged-b00e25d1-164f-4256-824a-b4c6a6aa2349 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 11:19:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:36 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Instance destroyed successfully.
Nov 28 11:19:36 user nova-compute[74994]: DEBUG nova.objects.instance [None req-44338bdf-b39f-4e0b-bb2d-17b89b2458bf tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Lazy-loading 'resources' on Instance uuid 76f339ed-a2e6-43e1-a16b-03000fdf537b {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:19:36 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-44338bdf-b39f-4e0b-bb2d-17b89b2458bf tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:17:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-908923343',display_name='tempest-VolumesNegativeTest-instance-908923343',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-908923343',id=44,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T11:17:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab62edca70864fd89abac6aeaad57a0a',ramdisk_id='',reservation_id='r-ajo4bl87',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1598920742',owner_user_name='tempest-VolumesNegativeTest-1598920742-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T11:17:52Z,user_data=None,user_id='d485b9995c6c4298a7913d7f6789668a',uuid=76f339ed-a2e6-43e1-a16b-03000fdf537b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b00e25d1-164f-4256-824a-b4c6a6aa2349", "address": "fa:16:3e:1b:c2:4c", "network": {"id": "03d7d77d-3b3c-40c6-8222-d00322cd02a9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ab811d435da94c6aaf6156b0c318c9ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00e25d1-16", "ovs_interfaceid": "b00e25d1-164f-4256-824a-b4c6a6aa2349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 11:19:36 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-44338bdf-b39f-4e0b-bb2d-17b89b2458bf tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Converting VIF {"id": "b00e25d1-164f-4256-824a-b4c6a6aa2349", "address": "fa:16:3e:1b:c2:4c", "network": {"id": "03d7d77d-3b3c-40c6-8222-d00322cd02a9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ab811d435da94c6aaf6156b0c318c9ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00e25d1-16", "ovs_interfaceid": "b00e25d1-164f-4256-824a-b4c6a6aa2349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:19:36 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-44338bdf-b39f-4e0b-bb2d-17b89b2458bf tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:c2:4c,bridge_name='br-int',has_traffic_filtering=True,id=b00e25d1-164f-4256-824a-b4c6a6aa2349,network=Network(03d7d77d-3b3c-40c6-8222-d00322cd02a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb00e25d1-16') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:19:36 user nova-compute[74994]: DEBUG os_vif [None req-44338bdf-b39f-4e0b-bb2d-17b89b2458bf tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:c2:4c,bridge_name='br-int',has_traffic_filtering=True,id=b00e25d1-164f-4256-824a-b4c6a6aa2349,network=Network(03d7d77d-3b3c-40c6-8222-d00322cd02a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb00e25d1-16') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 11:19:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb00e25d1-16, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:19:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:19:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fb1b1526-8724-4bf2-a47c-32aa0dce31d4) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:19:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:36 user nova-compute[74994]: INFO os_vif [None req-44338bdf-b39f-4e0b-bb2d-17b89b2458bf tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:c2:4c,bridge_name='br-int',has_traffic_filtering=True,id=b00e25d1-164f-4256-824a-b4c6a6aa2349,network=Network(03d7d77d-3b3c-40c6-8222-d00322cd02a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb00e25d1-16')
Nov 28 11:19:36 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-44338bdf-b39f-4e0b-bb2d-17b89b2458bf tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Deleting instance files /opt/stack/data/nova/instances/76f339ed-a2e6-43e1-a16b-03000fdf537b_del
Nov 28 11:19:36 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-44338bdf-b39f-4e0b-bb2d-17b89b2458bf tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Deletion of /opt/stack/data/nova/instances/76f339ed-a2e6-43e1-a16b-03000fdf537b_del complete
Nov 28 11:19:37 user nova-compute[74994]: INFO nova.compute.manager [None req-44338bdf-b39f-4e0b-bb2d-17b89b2458bf tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 28 11:19:37 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-44338bdf-b39f-4e0b-bb2d-17b89b2458bf tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 11:19:37 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 11:19:37 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 11:19:37 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:37 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:37 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:19:37 user nova-compute[74994]: DEBUG nova.compute.manager [req-fa51aff3-c097-41ae-9422-302d8faec518 req-44094c7f-fee4-4497-bc75-a128dcaf96ca service nova] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Received event network-vif-deleted-b00e25d1-164f-4256-824a-b4c6a6aa2349 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:19:37 user nova-compute[74994]: INFO nova.compute.manager [req-fa51aff3-c097-41ae-9422-302d8faec518 req-44094c7f-fee4-4497-bc75-a128dcaf96ca service nova] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Neutron deleted interface b00e25d1-164f-4256-824a-b4c6a6aa2349; detaching it from the instance and deleting it from the info cache
Nov 28 11:19:37 user nova-compute[74994]: DEBUG nova.network.neutron [req-fa51aff3-c097-41ae-9422-302d8faec518 req-44094c7f-fee4-4497-bc75-a128dcaf96ca service nova] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:19:37 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Took 0.56 seconds to deallocate network for instance.
Nov 28 11:19:37 user nova-compute[74994]: DEBUG nova.compute.manager [req-fa51aff3-c097-41ae-9422-302d8faec518 req-44094c7f-fee4-4497-bc75-a128dcaf96ca service nova] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Detach interface failed, port_id=b00e25d1-164f-4256-824a-b4c6a6aa2349, reason: Instance 76f339ed-a2e6-43e1-a16b-03000fdf537b could not be found. {{(pid=74994) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 11:19:37 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-44338bdf-b39f-4e0b-bb2d-17b89b2458bf tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:19:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-44338bdf-b39f-4e0b-bb2d-17b89b2458bf tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:19:37 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:37 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-44338bdf-b39f-4e0b-bb2d-17b89b2458bf tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:19:37 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-44338bdf-b39f-4e0b-bb2d-17b89b2458bf tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:19:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-44338bdf-b39f-4e0b-bb2d-17b89b2458bf tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.185s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:19:37 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-44338bdf-b39f-4e0b-bb2d-17b89b2458bf tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Deleted allocations for instance 76f339ed-a2e6-43e1-a16b-03000fdf537b
Nov 28 11:19:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-44338bdf-b39f-4e0b-bb2d-17b89b2458bf tempest-VolumesNegativeTest-1598920742 tempest-VolumesNegativeTest-1598920742-project-member] Lock "76f339ed-a2e6-43e1-a16b-03000fdf537b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.894s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:19:38 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-1c5049a2-882a-4b5b-9db8-7a3b7d15af0b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e6803632-6fc3-4b5d-abf4-cc2665a7a26a is timed out.
Nov 28 11:19:38 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-1c5049a2-882a-4b5b-9db8-7a3b7d15af0b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Successfully detached device vdb from instance e6803632-6fc3-4b5d-abf4-cc2665a7a26a from the live domain config.
Nov 28 11:19:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c5049a2-882a-4b5b-9db8-7a3b7d15af0b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5049a2-882a-4b5b-9db8-7a3b7d15af0b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pRuKdMhI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:19:38 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-1c5049a2-882a-4b5b-9db8-7a3b7d15af0b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:19:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-1c5049a2-882a-4b5b-9db8-7a3b7d15af0b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-1c5049a2-882a-4b5b-9db8-7a3b7d15af0b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeac2494-c238-4529-a0d5-35a681277da8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5049a2-882a-4b5b-9db8-7a3b7d15af0b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 11:19:38 user nova-compute[74994]: No targets found.
Nov 28 11:19:38 user nova-compute[74994]: iSNS:
Nov 28 11:19:38 user nova-compute[74994]: No targets found.
Nov 28 11:19:38 user nova-compute[74994]: STATIC:
Nov 28 11:19:38 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324
Nov 28 11:19:38 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:19:38 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:19:38 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401
Nov 28 11:19:38 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:19:38 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:19:38 user nova-compute[74994]: FIRMWARE:
Nov 28 11:19:38 user nova-compute[74994]: No targets found.
Nov 28 11:19:38 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5049a2-882a-4b5b-9db8-7a3b7d15af0b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 11:19:38 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 11:19:38 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5049a2-882a-4b5b-9db8-7a3b7d15af0b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d78e20-8318-44c3-b3dc-0950b0ae8f5a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[92deeb47-f163-4885-b4f1-30ebaa32de04]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5049a2-882a-4b5b-9db8-7a3b7d15af0b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 (non-flash)
Nov 28 11:19:38 user nova-compute[74994]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324 (non-flash)
Nov 28 11:19:38 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5049a2-882a-4b5b-9db8-7a3b7d15af0b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 (non-flash)
Nov 28 11:19:38 user nova-compute[74994]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324 (non-flash)
Nov 28 11:19:38 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5049a2-882a-4b5b-9db8-7a3b7d15af0b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb920512710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324'): ({'sdc'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-1c5049a2-882a-4b5b-9db8-7a3b7d15af0b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Removing single pathed devices sdc {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af501f0-95fc-4d2d-8c1f-9752fcd98dac]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe13bd8-0cef-488b-aaa4-b07fa9e22534]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-1c5049a2-882a-4b5b-9db8-7a3b7d15af0b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Flushing IO for device /dev/sdc {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[328f1468-2b79-41cc-b7c3-1ef12e506b97]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG nova.compute.manager [req-e9482178-aa79-4b26-88c9-5cfe6d6fb6ac req-51cd6ed0-ecda-47cc-b34b-5b427ade1a34 service nova] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Received event network-vif-plugged-b00e25d1-164f-4256-824a-b4c6a6aa2349 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-e9482178-aa79-4b26-88c9-5cfe6d6fb6ac req-51cd6ed0-ecda-47cc-b34b-5b427ade1a34 service nova] Acquiring lock "76f339ed-a2e6-43e1-a16b-03000fdf537b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-e9482178-aa79-4b26-88c9-5cfe6d6fb6ac req-51cd6ed0-ecda-47cc-b34b-5b427ade1a34 service nova] Lock "76f339ed-a2e6-43e1-a16b-03000fdf537b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-e9482178-aa79-4b26-88c9-5cfe6d6fb6ac req-51cd6ed0-ecda-47cc-b34b-5b427ade1a34 service nova] Lock "76f339ed-a2e6-43e1-a16b-03000fdf537b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG nova.compute.manager [req-e9482178-aa79-4b26-88c9-5cfe6d6fb6ac req-51cd6ed0-ecda-47cc-b34b-5b427ade1a34 service nova] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] No waiting events found dispatching network-vif-plugged-b00e25d1-164f-4256-824a-b4c6a6aa2349 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:19:38 user nova-compute[74994]: WARNING nova.compute.manager [req-e9482178-aa79-4b26-88c9-5cfe6d6fb6ac req-51cd6ed0-ecda-47cc-b34b-5b427ade1a34 service nova] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Received unexpected event network-vif-plugged-b00e25d1-164f-4256-824a-b4c6a6aa2349 for instance with vm_state deleted and task_state None.
Nov 28 11:19:38 user nova-compute[74994]: DEBUG nova.compute.manager [req-e9482178-aa79-4b26-88c9-5cfe6d6fb6ac req-51cd6ed0-ecda-47cc-b34b-5b427ade1a34 service nova] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Received event network-vif-plugged-b00e25d1-164f-4256-824a-b4c6a6aa2349 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-e9482178-aa79-4b26-88c9-5cfe6d6fb6ac req-51cd6ed0-ecda-47cc-b34b-5b427ade1a34 service nova] Acquiring lock "76f339ed-a2e6-43e1-a16b-03000fdf537b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-e9482178-aa79-4b26-88c9-5cfe6d6fb6ac req-51cd6ed0-ecda-47cc-b34b-5b427ade1a34 service nova] Lock "76f339ed-a2e6-43e1-a16b-03000fdf537b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-e9482178-aa79-4b26-88c9-5cfe6d6fb6ac req-51cd6ed0-ecda-47cc-b34b-5b427ade1a34 service nova] Lock "76f339ed-a2e6-43e1-a16b-03000fdf537b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG nova.compute.manager [req-e9482178-aa79-4b26-88c9-5cfe6d6fb6ac req-51cd6ed0-ecda-47cc-b34b-5b427ade1a34 service nova] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] No waiting events found dispatching network-vif-plugged-b00e25d1-164f-4256-824a-b4c6a6aa2349 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:19:38 user nova-compute[74994]: WARNING nova.compute.manager [req-e9482178-aa79-4b26-88c9-5cfe6d6fb6ac req-51cd6ed0-ecda-47cc-b34b-5b427ade1a34 service nova] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Received unexpected event network-vif-plugged-b00e25d1-164f-4256-824a-b4c6a6aa2349 for instance with vm_state deleted and task_state None.
Nov 28 11:19:38 user nova-compute[74994]: DEBUG nova.compute.manager [req-e9482178-aa79-4b26-88c9-5cfe6d6fb6ac req-51cd6ed0-ecda-47cc-b34b-5b427ade1a34 service nova] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Received event network-vif-plugged-b00e25d1-164f-4256-824a-b4c6a6aa2349 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-e9482178-aa79-4b26-88c9-5cfe6d6fb6ac req-51cd6ed0-ecda-47cc-b34b-5b427ade1a34 service nova] Acquiring lock "76f339ed-a2e6-43e1-a16b-03000fdf537b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-e9482178-aa79-4b26-88c9-5cfe6d6fb6ac req-51cd6ed0-ecda-47cc-b34b-5b427ade1a34 service nova] Lock "76f339ed-a2e6-43e1-a16b-03000fdf537b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-e9482178-aa79-4b26-88c9-5cfe6d6fb6ac req-51cd6ed0-ecda-47cc-b34b-5b427ade1a34 service nova] Lock "76f339ed-a2e6-43e1-a16b-03000fdf537b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG nova.compute.manager [req-e9482178-aa79-4b26-88c9-5cfe6d6fb6ac req-51cd6ed0-ecda-47cc-b34b-5b427ade1a34 service nova] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] No waiting events found dispatching network-vif-plugged-b00e25d1-164f-4256-824a-b4c6a6aa2349 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:19:38 user nova-compute[74994]: WARNING nova.compute.manager [req-e9482178-aa79-4b26-88c9-5cfe6d6fb6ac req-51cd6ed0-ecda-47cc-b34b-5b427ade1a34 service nova] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Received unexpected event network-vif-plugged-b00e25d1-164f-4256-824a-b4c6a6aa2349 for instance with vm_state deleted and task_state None.
Nov 28 11:19:38 user nova-compute[74994]: DEBUG nova.compute.manager [req-e9482178-aa79-4b26-88c9-5cfe6d6fb6ac req-51cd6ed0-ecda-47cc-b34b-5b427ade1a34 service nova] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Received event network-vif-unplugged-b00e25d1-164f-4256-824a-b4c6a6aa2349 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-e9482178-aa79-4b26-88c9-5cfe6d6fb6ac req-51cd6ed0-ecda-47cc-b34b-5b427ade1a34 service nova] Acquiring lock "76f339ed-a2e6-43e1-a16b-03000fdf537b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-e9482178-aa79-4b26-88c9-5cfe6d6fb6ac req-51cd6ed0-ecda-47cc-b34b-5b427ade1a34 service nova] Lock "76f339ed-a2e6-43e1-a16b-03000fdf537b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-e9482178-aa79-4b26-88c9-5cfe6d6fb6ac req-51cd6ed0-ecda-47cc-b34b-5b427ade1a34 service nova] Lock "76f339ed-a2e6-43e1-a16b-03000fdf537b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG nova.compute.manager [req-e9482178-aa79-4b26-88c9-5cfe6d6fb6ac req-51cd6ed0-ecda-47cc-b34b-5b427ade1a34 service nova] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] No waiting events found dispatching network-vif-unplugged-b00e25d1-164f-4256-824a-b4c6a6aa2349 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:19:38 user nova-compute[74994]: WARNING nova.compute.manager [req-e9482178-aa79-4b26-88c9-5cfe6d6fb6ac req-51cd6ed0-ecda-47cc-b34b-5b427ade1a34 service nova] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Received unexpected event network-vif-unplugged-b00e25d1-164f-4256-824a-b4c6a6aa2349 for instance with vm_state deleted and task_state None.
Nov 28 11:19:38 user nova-compute[74994]: DEBUG nova.compute.manager [req-e9482178-aa79-4b26-88c9-5cfe6d6fb6ac req-51cd6ed0-ecda-47cc-b34b-5b427ade1a34 service nova] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Received event network-vif-plugged-b00e25d1-164f-4256-824a-b4c6a6aa2349 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-e9482178-aa79-4b26-88c9-5cfe6d6fb6ac req-51cd6ed0-ecda-47cc-b34b-5b427ade1a34 service nova] Acquiring lock "76f339ed-a2e6-43e1-a16b-03000fdf537b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-e9482178-aa79-4b26-88c9-5cfe6d6fb6ac req-51cd6ed0-ecda-47cc-b34b-5b427ade1a34 service nova] Lock "76f339ed-a2e6-43e1-a16b-03000fdf537b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-e9482178-aa79-4b26-88c9-5cfe6d6fb6ac req-51cd6ed0-ecda-47cc-b34b-5b427ade1a34 service nova] Lock "76f339ed-a2e6-43e1-a16b-03000fdf537b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG nova.compute.manager [req-e9482178-aa79-4b26-88c9-5cfe6d6fb6ac req-51cd6ed0-ecda-47cc-b34b-5b427ade1a34 service nova] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] No waiting events found dispatching network-vif-plugged-b00e25d1-164f-4256-824a-b4c6a6aa2349 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:19:38 user nova-compute[74994]: WARNING nova.compute.manager [req-e9482178-aa79-4b26-88c9-5cfe6d6fb6ac req-51cd6ed0-ecda-47cc-b34b-5b427ade1a34 service nova] [instance: 76f339ed-a2e6-43e1-a16b-03000fdf537b] Received unexpected event network-vif-plugged-b00e25d1-164f-4256-824a-b4c6a6aa2349 for instance with vm_state deleted and task_state None.
Nov 28 11:19:38 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-1c5049a2-882a-4b5b-9db8-7a3b7d15af0b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f698df6d-c972-4bb2-894e-e2b4b8f2c5d9]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-1c5049a2-882a-4b5b-9db8-7a3b7d15af0b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-1c5049a2-882a-4b5b-9db8-7a3b7d15af0b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] SCSI volumes sdc have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5049a2-882a-4b5b-9db8-7a3b7d15af0b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1a53d6-ad84-438f-befa-a8d3b10f7c2b]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5049a2-882a-4b5b-9db8-7a3b7d15af0b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324 -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ead39ec-c8e5-4f9f-ae51-b76f63f72d5f]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5049a2-882a-4b5b-9db8-7a3b7d15af0b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324, portal: 172.16.0.220,3260]
Nov 28 11:19:38 user nova-compute[74994]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324, portal: 172.16.0.220,3260] successful.
Nov 28 11:19:38 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324 -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7744ad81-3068-4e38-9f58-72d2a5f673cc]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5049a2-882a-4b5b-9db8-7a3b7d15af0b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-1c5049a2-882a-4b5b-9db8-7a3b7d15af0b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5049a2-882a-4b5b-9db8-7a3b7d15af0b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] <== disconnect_volume: return (324ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:19:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c5049a2-882a-4b5b-9db8-7a3b7d15af0b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 11:19:39 user nova-compute[74994]: DEBUG nova.objects.instance [None req-1c5049a2-882a-4b5b-9db8-7a3b7d15af0b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lazy-loading 'flavor' on Instance uuid e6803632-6fc3-4b5d-abf4-cc2665a7a26a {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:19:39 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:19:39 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 11:19:39 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Rebuilding the list of instances to heal {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 11:19:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-1c5049a2-882a-4b5b-9db8-7a3b7d15af0b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "e6803632-6fc3-4b5d-abf4-cc2665a7a26a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.661s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:19:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bdcc878a-be0b-4b9d-bd01-7535d701b28b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "e6803632-6fc3-4b5d-abf4-cc2665a7a26a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.542s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:19:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bdcc878a-be0b-4b9d-bd01-7535d701b28b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Acquiring lock "e6803632-6fc3-4b5d-abf4-cc2665a7a26a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:19:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bdcc878a-be0b-4b9d-bd01-7535d701b28b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "e6803632-6fc3-4b5d-abf4-cc2665a7a26a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:19:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bdcc878a-be0b-4b9d-bd01-7535d701b28b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "e6803632-6fc3-4b5d-abf4-cc2665a7a26a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:19:39 user nova-compute[74994]: INFO nova.compute.manager [None req-bdcc878a-be0b-4b9d-bd01-7535d701b28b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Terminating instance
Nov 28 11:19:39 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Skipping network cache update for instance because it is being deleted. {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 28 11:19:39 user nova-compute[74994]: DEBUG nova.compute.manager [None req-bdcc878a-be0b-4b9d-bd01-7535d701b28b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 11:19:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "refresh_cache-58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:19:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquired lock "refresh_cache-58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:19:39 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Forcefully refreshing network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 11:19:39 user nova-compute[74994]: DEBUG nova.objects.instance [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lazy-loading 'info_cache' on Instance uuid 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:19:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:39 user nova-compute[74994]: DEBUG nova.compute.manager [req-f15d7671-4300-4c19-9b09-c4f27b0cb06e req-afc9fde5-9ceb-42cc-87ea-6615eb992644 service nova] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Received event network-vif-unplugged-f3314941-1e6a-4f3a-a608-0a6949c6f8f7 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:19:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f15d7671-4300-4c19-9b09-c4f27b0cb06e req-afc9fde5-9ceb-42cc-87ea-6615eb992644 service nova] Acquiring lock "e6803632-6fc3-4b5d-abf4-cc2665a7a26a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:19:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f15d7671-4300-4c19-9b09-c4f27b0cb06e req-afc9fde5-9ceb-42cc-87ea-6615eb992644 service nova] Lock "e6803632-6fc3-4b5d-abf4-cc2665a7a26a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:19:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f15d7671-4300-4c19-9b09-c4f27b0cb06e req-afc9fde5-9ceb-42cc-87ea-6615eb992644 service nova] Lock "e6803632-6fc3-4b5d-abf4-cc2665a7a26a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:19:39 user nova-compute[74994]: DEBUG nova.compute.manager [req-f15d7671-4300-4c19-9b09-c4f27b0cb06e req-afc9fde5-9ceb-42cc-87ea-6615eb992644 service nova] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] No waiting events found dispatching network-vif-unplugged-f3314941-1e6a-4f3a-a608-0a6949c6f8f7 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:19:39 user nova-compute[74994]: DEBUG nova.compute.manager [req-f15d7671-4300-4c19-9b09-c4f27b0cb06e req-afc9fde5-9ceb-42cc-87ea-6615eb992644 service nova] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Received event network-vif-unplugged-f3314941-1e6a-4f3a-a608-0a6949c6f8f7 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Updating instance_info_cache with network_info: [{"id": "f74e1103-305e-48c3-941a-df5a1dc39873", "address": "fa:16:3e:5e:26:7f", "network": {"id": "5adf74ed-a983-4b41-a530-3e79a364db73", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2074174508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6f53748392c4f07bcf976431a90ceb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74e1103-30", "ovs_interfaceid": "f74e1103-305e-48c3-941a-df5a1dc39873", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Releasing lock "refresh_cache-58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Updated the network info_cache for instance {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 11:19:40 user nova-compute[74994]: INFO nova.compute.manager [None req-6ad7db38-6bc7-4821-9516-f2ba9c0ed04f tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Unrescuing
Nov 28 11:19:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6ad7db38-6bc7-4821-9516-f2ba9c0ed04f tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Acquiring lock "refresh_cache-58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6ad7db38-6bc7-4821-9516-f2ba9c0ed04f tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Acquired lock "refresh_cache-58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG nova.network.neutron [None req-6ad7db38-6bc7-4821-9516-f2ba9c0ed04f tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:40 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Instance destroyed successfully.
Nov 28 11:19:40 user nova-compute[74994]: DEBUG nova.objects.instance [None req-bdcc878a-be0b-4b9d-bd01-7535d701b28b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lazy-loading 'resources' on Instance uuid e6803632-6fc3-4b5d-abf4-cc2665a7a26a {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-bdcc878a-be0b-4b9d-bd01-7535d701b28b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:16:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-836557515',display_name='tempest-VolumesSnapshotTestJSON-instance-836557515',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-836557515',id=43,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIghOlWB/ukamtDInEteS4pADIotKgIwiS2cPJsqoIP4TM3lbW8eAXX+HTj9k7f7e5WmcssOzLPd5W0aiyv4d6EhZLtjSn60KxaHY6tSl5W2voRjL5Ngxf3VYhd/wXD0Ug==',key_name='tempest-keypair-1862203321',keypairs=<?>,launch_index=0,launched_at=2023-11-28T11:17:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cc76d73b2a1142409262135e96f3cc82',ramdisk_id='',reservation_id='r-xr8vj762',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-496080761',owner_user_name='tempest-VolumesSnapshotTestJSON-496080761-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T11:17:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='879781a7540a448aac2e1c3a89f712bb',uuid=e6803632-6fc3-4b5d-abf4-cc2665a7a26a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3314941-1e6a-4f3a-a608-0a6949c6f8f7", "address": "fa:16:3e:54:c8:ad", "network": {"id": "45bc19c0-a3b5-478a-8289-a0f75228a260", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1070183224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc76d73b2a1142409262135e96f3cc82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3314941-1e", "ovs_interfaceid": "f3314941-1e6a-4f3a-a608-0a6949c6f8f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-bdcc878a-be0b-4b9d-bd01-7535d701b28b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Converting VIF {"id": "f3314941-1e6a-4f3a-a608-0a6949c6f8f7", "address": "fa:16:3e:54:c8:ad", "network": {"id": "45bc19c0-a3b5-478a-8289-a0f75228a260", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1070183224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc76d73b2a1142409262135e96f3cc82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3314941-1e", "ovs_interfaceid": "f3314941-1e6a-4f3a-a608-0a6949c6f8f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-bdcc878a-be0b-4b9d-bd01-7535d701b28b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:c8:ad,bridge_name='br-int',has_traffic_filtering=True,id=f3314941-1e6a-4f3a-a608-0a6949c6f8f7,network=Network(45bc19c0-a3b5-478a-8289-a0f75228a260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3314941-1e') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG os_vif [None req-bdcc878a-be0b-4b9d-bd01-7535d701b28b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:c8:ad,bridge_name='br-int',has_traffic_filtering=True,id=f3314941-1e6a-4f3a-a608-0a6949c6f8f7,network=Network(45bc19c0-a3b5-478a-8289-a0f75228a260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3314941-1e') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3314941-1e, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=493a717d-e0a2-4c22-850b-5ebd44354292) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:19:40 user nova-compute[74994]: INFO os_vif [None req-bdcc878a-be0b-4b9d-bd01-7535d701b28b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:c8:ad,bridge_name='br-int',has_traffic_filtering=True,id=f3314941-1e6a-4f3a-a608-0a6949c6f8f7,network=Network(45bc19c0-a3b5-478a-8289-a0f75228a260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3314941-1e')
Nov 28 11:19:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdcc878a-be0b-4b9d-bd01-7535d701b28b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcc878a-be0b-4b9d-bd01-7535d701b28b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pRuKdMhI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:19:40 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-bdcc878a-be0b-4b9d-bd01-7535d701b28b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:19:40 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-bdcc878a-be0b-4b9d-bd01-7535d701b28b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-bdcc878a-be0b-4b9d-bd01-7535d701b28b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1dbc21-7719-4718-b94f-f0cca11beae5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcc878a-be0b-4b9d-bd01-7535d701b28b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 11:19:40 user nova-compute[74994]: No targets found.
Nov 28 11:19:40 user nova-compute[74994]: iSNS:
Nov 28 11:19:40 user nova-compute[74994]: No targets found.
Nov 28 11:19:40 user nova-compute[74994]: STATIC:
Nov 28 11:19:40 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401
Nov 28 11:19:40 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:19:40 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:19:40 user nova-compute[74994]: FIRMWARE:
Nov 28 11:19:40 user nova-compute[74994]: No targets found.
Nov 28 11:19:40 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcc878a-be0b-4b9d-bd01-7535d701b28b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 11:19:40 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 11:19:40 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcc878a-be0b-4b9d-bd01-7535d701b28b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80e247b4-4e54-4b32-8709-14ad6a51f324', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a980d63-2a79-4ea2-b7d0-52c6e270529e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41e29bc-a050-4a23-9ddd-493519cdee9b]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcc878a-be0b-4b9d-bd01-7535d701b28b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 (non-flash)
Nov 28 11:19:40 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcc878a-be0b-4b9d-bd01-7535d701b28b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 (non-flash)
Nov 28 11:19:40 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcc878a-be0b-4b9d-bd01-7535d701b28b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9541c71c0>, {}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcc878a-be0b-4b9d-bd01-7535d701b28b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Disconnecting from: [] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-bdcc878a-be0b-4b9d-bd01-7535d701b28b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.067s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdcc878a-be0b-4b9d-bd01-7535d701b28b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] <== disconnect_volume: return (68ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdcc878a-be0b-4b9d-bd01-7535d701b28b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 11:19:40 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-bdcc878a-be0b-4b9d-bd01-7535d701b28b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Deleting instance files /opt/stack/data/nova/instances/e6803632-6fc3-4b5d-abf4-cc2665a7a26a_del
Nov 28 11:19:40 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-bdcc878a-be0b-4b9d-bd01-7535d701b28b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Deletion of /opt/stack/data/nova/instances/e6803632-6fc3-4b5d-abf4-cc2665a7a26a_del complete
Nov 28 11:19:40 user nova-compute[74994]: INFO nova.compute.manager [None req-bdcc878a-be0b-4b9d-bd01-7535d701b28b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 28 11:19:40 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-bdcc878a-be0b-4b9d-bd01-7535d701b28b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG nova.network.neutron [None req-6ad7db38-6bc7-4821-9516-f2ba9c0ed04f tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Updating instance_info_cache with network_info: [{"id": "f74e1103-305e-48c3-941a-df5a1dc39873", "address": "fa:16:3e:5e:26:7f", "network": {"id": "5adf74ed-a983-4b41-a530-3e79a364db73", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2074174508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6f53748392c4f07bcf976431a90ceb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74e1103-30", "ovs_interfaceid": "f74e1103-305e-48c3-941a-df5a1dc39873", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6ad7db38-6bc7-4821-9516-f2ba9c0ed04f tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Releasing lock "refresh_cache-58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG nova.objects.instance [None req-6ad7db38-6bc7-4821-9516-f2ba9c0ed04f tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Lazy-loading 'flavor' on Instance uuid 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:41 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:41 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:41 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:41 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:41 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:41 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:19:41 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:41 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Instance destroyed successfully.
Nov 28 11:19:41 user nova-compute[74994]: DEBUG nova.compute.manager [req-9a1e3c52-965d-43df-9e2d-fc8826e5bc0e req-0c2971a7-00e0-4194-8869-45a4cdd1383a service nova] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Received event network-vif-plugged-f3314941-1e6a-4f3a-a608-0a6949c6f8f7 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:19:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9a1e3c52-965d-43df-9e2d-fc8826e5bc0e req-0c2971a7-00e0-4194-8869-45a4cdd1383a service nova] Acquiring lock "e6803632-6fc3-4b5d-abf4-cc2665a7a26a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:19:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9a1e3c52-965d-43df-9e2d-fc8826e5bc0e req-0c2971a7-00e0-4194-8869-45a4cdd1383a service nova] Lock "e6803632-6fc3-4b5d-abf4-cc2665a7a26a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:19:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9a1e3c52-965d-43df-9e2d-fc8826e5bc0e req-0c2971a7-00e0-4194-8869-45a4cdd1383a service nova] Lock "e6803632-6fc3-4b5d-abf4-cc2665a7a26a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:19:41 user nova-compute[74994]: DEBUG nova.compute.manager [req-9a1e3c52-965d-43df-9e2d-fc8826e5bc0e req-0c2971a7-00e0-4194-8869-45a4cdd1383a service nova] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] No waiting events found dispatching network-vif-plugged-f3314941-1e6a-4f3a-a608-0a6949c6f8f7 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:19:41 user nova-compute[74994]: WARNING nova.compute.manager [req-9a1e3c52-965d-43df-9e2d-fc8826e5bc0e req-0c2971a7-00e0-4194-8869-45a4cdd1383a service nova] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Received unexpected event network-vif-plugged-f3314941-1e6a-4f3a-a608-0a6949c6f8f7 for instance with vm_state active and task_state deleting.
Nov 28 11:19:41 user nova-compute[74994]: DEBUG nova.compute.manager [req-9a1e3c52-965d-43df-9e2d-fc8826e5bc0e req-0c2971a7-00e0-4194-8869-45a4cdd1383a service nova] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Received event network-vif-plugged-f3314941-1e6a-4f3a-a608-0a6949c6f8f7 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:19:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9a1e3c52-965d-43df-9e2d-fc8826e5bc0e req-0c2971a7-00e0-4194-8869-45a4cdd1383a service nova] Acquiring lock "e6803632-6fc3-4b5d-abf4-cc2665a7a26a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:19:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9a1e3c52-965d-43df-9e2d-fc8826e5bc0e req-0c2971a7-00e0-4194-8869-45a4cdd1383a service nova] Lock "e6803632-6fc3-4b5d-abf4-cc2665a7a26a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:19:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9a1e3c52-965d-43df-9e2d-fc8826e5bc0e req-0c2971a7-00e0-4194-8869-45a4cdd1383a service nova] Lock "e6803632-6fc3-4b5d-abf4-cc2665a7a26a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:19:41 user nova-compute[74994]: DEBUG nova.compute.manager [req-9a1e3c52-965d-43df-9e2d-fc8826e5bc0e req-0c2971a7-00e0-4194-8869-45a4cdd1383a service nova] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] No waiting events found dispatching network-vif-plugged-f3314941-1e6a-4f3a-a608-0a6949c6f8f7 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:19:41 user nova-compute[74994]: WARNING nova.compute.manager [req-9a1e3c52-965d-43df-9e2d-fc8826e5bc0e req-0c2971a7-00e0-4194-8869-45a4cdd1383a service nova] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Received unexpected event network-vif-plugged-f3314941-1e6a-4f3a-a608-0a6949c6f8f7 for instance with vm_state active and task_state deleting.
Nov 28 11:19:41 user nova-compute[74994]: DEBUG nova.compute.manager [req-9a1e3c52-965d-43df-9e2d-fc8826e5bc0e req-0c2971a7-00e0-4194-8869-45a4cdd1383a service nova] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Received event network-vif-plugged-f3314941-1e6a-4f3a-a608-0a6949c6f8f7 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:19:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9a1e3c52-965d-43df-9e2d-fc8826e5bc0e req-0c2971a7-00e0-4194-8869-45a4cdd1383a service nova] Acquiring lock "e6803632-6fc3-4b5d-abf4-cc2665a7a26a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:19:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9a1e3c52-965d-43df-9e2d-fc8826e5bc0e req-0c2971a7-00e0-4194-8869-45a4cdd1383a service nova] Lock "e6803632-6fc3-4b5d-abf4-cc2665a7a26a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:19:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9a1e3c52-965d-43df-9e2d-fc8826e5bc0e req-0c2971a7-00e0-4194-8869-45a4cdd1383a service nova] Lock "e6803632-6fc3-4b5d-abf4-cc2665a7a26a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:19:41 user nova-compute[74994]: DEBUG nova.compute.manager [req-9a1e3c52-965d-43df-9e2d-fc8826e5bc0e req-0c2971a7-00e0-4194-8869-45a4cdd1383a service nova] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] No waiting events found dispatching network-vif-plugged-f3314941-1e6a-4f3a-a608-0a6949c6f8f7 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:19:41 user nova-compute[74994]: WARNING nova.compute.manager [req-9a1e3c52-965d-43df-9e2d-fc8826e5bc0e req-0c2971a7-00e0-4194-8869-45a4cdd1383a service nova] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Received unexpected event network-vif-plugged-f3314941-1e6a-4f3a-a608-0a6949c6f8f7 for instance with vm_state active and task_state deleting.
Nov 28 11:19:41 user nova-compute[74994]: DEBUG nova.compute.manager [req-9a1e3c52-965d-43df-9e2d-fc8826e5bc0e req-0c2971a7-00e0-4194-8869-45a4cdd1383a service nova] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Received event network-vif-unplugged-f3314941-1e6a-4f3a-a608-0a6949c6f8f7 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:19:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9a1e3c52-965d-43df-9e2d-fc8826e5bc0e req-0c2971a7-00e0-4194-8869-45a4cdd1383a service nova] Acquiring lock "e6803632-6fc3-4b5d-abf4-cc2665a7a26a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:19:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9a1e3c52-965d-43df-9e2d-fc8826e5bc0e req-0c2971a7-00e0-4194-8869-45a4cdd1383a service nova] Lock "e6803632-6fc3-4b5d-abf4-cc2665a7a26a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:19:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9a1e3c52-965d-43df-9e2d-fc8826e5bc0e req-0c2971a7-00e0-4194-8869-45a4cdd1383a service nova] Lock "e6803632-6fc3-4b5d-abf4-cc2665a7a26a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:19:41 user nova-compute[74994]: DEBUG nova.compute.manager [req-9a1e3c52-965d-43df-9e2d-fc8826e5bc0e req-0c2971a7-00e0-4194-8869-45a4cdd1383a service nova] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] No waiting events found dispatching network-vif-unplugged-f3314941-1e6a-4f3a-a608-0a6949c6f8f7 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:19:41 user nova-compute[74994]: DEBUG nova.compute.manager [req-9a1e3c52-965d-43df-9e2d-fc8826e5bc0e req-0c2971a7-00e0-4194-8869-45a4cdd1383a service nova] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Received event network-vif-unplugged-f3314941-1e6a-4f3a-a608-0a6949c6f8f7 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 11:19:41 user nova-compute[74994]: DEBUG nova.compute.manager [req-9a1e3c52-965d-43df-9e2d-fc8826e5bc0e req-0c2971a7-00e0-4194-8869-45a4cdd1383a service nova] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Received event network-vif-plugged-f3314941-1e6a-4f3a-a608-0a6949c6f8f7 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:19:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9a1e3c52-965d-43df-9e2d-fc8826e5bc0e req-0c2971a7-00e0-4194-8869-45a4cdd1383a service nova] Acquiring lock "e6803632-6fc3-4b5d-abf4-cc2665a7a26a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:19:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9a1e3c52-965d-43df-9e2d-fc8826e5bc0e req-0c2971a7-00e0-4194-8869-45a4cdd1383a service nova] Lock "e6803632-6fc3-4b5d-abf4-cc2665a7a26a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:19:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9a1e3c52-965d-43df-9e2d-fc8826e5bc0e req-0c2971a7-00e0-4194-8869-45a4cdd1383a service nova] Lock "e6803632-6fc3-4b5d-abf4-cc2665a7a26a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:19:41 user nova-compute[74994]: DEBUG nova.compute.manager [req-9a1e3c52-965d-43df-9e2d-fc8826e5bc0e req-0c2971a7-00e0-4194-8869-45a4cdd1383a service nova] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] No waiting events found dispatching network-vif-plugged-f3314941-1e6a-4f3a-a608-0a6949c6f8f7 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:19:41 user nova-compute[74994]: WARNING nova.compute.manager [req-9a1e3c52-965d-43df-9e2d-fc8826e5bc0e req-0c2971a7-00e0-4194-8869-45a4cdd1383a service nova] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Received unexpected event network-vif-plugged-f3314941-1e6a-4f3a-a608-0a6949c6f8f7 for instance with vm_state active and task_state deleting.
Nov 28 11:19:41 user nova-compute[74994]: DEBUG nova.compute.manager [req-9a1e3c52-965d-43df-9e2d-fc8826e5bc0e req-0c2971a7-00e0-4194-8869-45a4cdd1383a service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Received event network-vif-unplugged-f74e1103-305e-48c3-941a-df5a1dc39873 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:19:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9a1e3c52-965d-43df-9e2d-fc8826e5bc0e req-0c2971a7-00e0-4194-8869-45a4cdd1383a service nova] Acquiring lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:19:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9a1e3c52-965d-43df-9e2d-fc8826e5bc0e req-0c2971a7-00e0-4194-8869-45a4cdd1383a service nova] Lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:19:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9a1e3c52-965d-43df-9e2d-fc8826e5bc0e req-0c2971a7-00e0-4194-8869-45a4cdd1383a service nova] Lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:19:41 user nova-compute[74994]: DEBUG nova.compute.manager [req-9a1e3c52-965d-43df-9e2d-fc8826e5bc0e req-0c2971a7-00e0-4194-8869-45a4cdd1383a service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] No waiting events found dispatching network-vif-unplugged-f74e1103-305e-48c3-941a-df5a1dc39873 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:19:41 user nova-compute[74994]: WARNING nova.compute.manager [req-9a1e3c52-965d-43df-9e2d-fc8826e5bc0e req-0c2971a7-00e0-4194-8869-45a4cdd1383a service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Received unexpected event network-vif-unplugged-f74e1103-305e-48c3-941a-df5a1dc39873 for instance with vm_state rescued and task_state unrescuing.
Nov 28 11:19:41 user nova-compute[74994]: DEBUG nova.compute.manager [req-9a1e3c52-965d-43df-9e2d-fc8826e5bc0e req-0c2971a7-00e0-4194-8869-45a4cdd1383a service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Received event network-vif-plugged-f74e1103-305e-48c3-941a-df5a1dc39873 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:19:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9a1e3c52-965d-43df-9e2d-fc8826e5bc0e req-0c2971a7-00e0-4194-8869-45a4cdd1383a service nova] Acquiring lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:19:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9a1e3c52-965d-43df-9e2d-fc8826e5bc0e req-0c2971a7-00e0-4194-8869-45a4cdd1383a service nova] Lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:19:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9a1e3c52-965d-43df-9e2d-fc8826e5bc0e req-0c2971a7-00e0-4194-8869-45a4cdd1383a service nova] Lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:19:41 user nova-compute[74994]: DEBUG nova.compute.manager [req-9a1e3c52-965d-43df-9e2d-fc8826e5bc0e req-0c2971a7-00e0-4194-8869-45a4cdd1383a service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] No waiting events found dispatching network-vif-plugged-f74e1103-305e-48c3-941a-df5a1dc39873 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:19:41 user nova-compute[74994]: WARNING nova.compute.manager [req-9a1e3c52-965d-43df-9e2d-fc8826e5bc0e req-0c2971a7-00e0-4194-8869-45a4cdd1383a service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Received unexpected event network-vif-plugged-f74e1103-305e-48c3-941a-df5a1dc39873 for instance with vm_state rescued and task_state unrescuing.
Nov 28 11:19:42 user nova-compute[74994]: DEBUG nova.compute.manager [req-55c6d38b-6aa7-4ffe-905f-a16d67eb8ddd req-340066e1-3437-41c6-ad55-77c442da0bdc service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Received event network-changed-f74e1103-305e-48c3-941a-df5a1dc39873 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:19:42 user nova-compute[74994]: DEBUG nova.compute.manager [req-55c6d38b-6aa7-4ffe-905f-a16d67eb8ddd req-340066e1-3437-41c6-ad55-77c442da0bdc service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Refreshing instance network info cache due to event network-changed-f74e1103-305e-48c3-941a-df5a1dc39873. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:19:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-55c6d38b-6aa7-4ffe-905f-a16d67eb8ddd req-340066e1-3437-41c6-ad55-77c442da0bdc service nova] Acquiring lock "refresh_cache-58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:19:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-55c6d38b-6aa7-4ffe-905f-a16d67eb8ddd req-340066e1-3437-41c6-ad55-77c442da0bdc service nova] Acquired lock "refresh_cache-58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:19:42 user nova-compute[74994]: DEBUG nova.network.neutron [req-55c6d38b-6aa7-4ffe-905f-a16d67eb8ddd req-340066e1-3437-41c6-ad55-77c442da0bdc service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Refreshing network info cache for port f74e1103-305e-48c3-941a-df5a1dc39873 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:19:42 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:19:42 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Took 1.85 seconds to deallocate network for instance.
Nov 28 11:19:42 user nova-compute[74994]: WARNING nova.volume.cinder [None req-bdcc878a-be0b-4b9d-bd01-7535d701b28b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Attachment a67c93a1-3f1f-4825-a094-bc066f0953f2 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = a67c93a1-3f1f-4825-a094-bc066f0953f2. (HTTP 404) (Request-ID: req-b6466af7-cd3c-40e4-b307-36187d1cc360)
Nov 28 11:19:42 user nova-compute[74994]: INFO nova.compute.manager [None req-bdcc878a-be0b-4b9d-bd01-7535d701b28b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Took 0.02 seconds to detach 1 volumes for instance.
Nov 28 11:19:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bdcc878a-be0b-4b9d-bd01-7535d701b28b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:19:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bdcc878a-be0b-4b9d-bd01-7535d701b28b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:19:42 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:19:42 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-bdcc878a-be0b-4b9d-bd01-7535d701b28b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:19:42 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-bdcc878a-be0b-4b9d-bd01-7535d701b28b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:19:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bdcc878a-be0b-4b9d-bd01-7535d701b28b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.144s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:19:42 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-bdcc878a-be0b-4b9d-bd01-7535d701b28b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Deleted allocations for instance e6803632-6fc3-4b5d-abf4-cc2665a7a26a
Nov 28 11:19:42 user nova-compute[74994]: DEBUG nova.network.neutron [req-55c6d38b-6aa7-4ffe-905f-a16d67eb8ddd req-340066e1-3437-41c6-ad55-77c442da0bdc service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Updated VIF entry in instance network info cache for port f74e1103-305e-48c3-941a-df5a1dc39873. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:19:42 user nova-compute[74994]: DEBUG nova.network.neutron [req-55c6d38b-6aa7-4ffe-905f-a16d67eb8ddd req-340066e1-3437-41c6-ad55-77c442da0bdc service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Updating instance_info_cache with network_info: [{"id": "f74e1103-305e-48c3-941a-df5a1dc39873", "address": "fa:16:3e:5e:26:7f", "network": {"id": "5adf74ed-a983-4b41-a530-3e79a364db73", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2074174508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6f53748392c4f07bcf976431a90ceb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74e1103-30", "ovs_interfaceid": "f74e1103-305e-48c3-941a-df5a1dc39873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:19:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-55c6d38b-6aa7-4ffe-905f-a16d67eb8ddd req-340066e1-3437-41c6-ad55-77c442da0bdc service nova] Releasing lock "refresh_cache-58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:19:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-bdcc878a-be0b-4b9d-bd01-7535d701b28b tempest-VolumesSnapshotTestJSON-496080761 tempest-VolumesSnapshotTestJSON-496080761-project-member] Lock "e6803632-6fc3-4b5d-abf4-cc2665a7a26a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.182s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:19:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:43 user nova-compute[74994]: DEBUG nova.compute.manager [req-bc3b4be7-7e9b-403a-819e-0bef61ca6b61 req-f9bdefdf-49df-44c6-af13-c173965e9ed5 service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Received event network-vif-plugged-f74e1103-305e-48c3-941a-df5a1dc39873 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:19:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bc3b4be7-7e9b-403a-819e-0bef61ca6b61 req-f9bdefdf-49df-44c6-af13-c173965e9ed5 service nova] Acquiring lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:19:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bc3b4be7-7e9b-403a-819e-0bef61ca6b61 req-f9bdefdf-49df-44c6-af13-c173965e9ed5 service nova] Lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:19:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bc3b4be7-7e9b-403a-819e-0bef61ca6b61 req-f9bdefdf-49df-44c6-af13-c173965e9ed5 service nova] Lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:19:43 user nova-compute[74994]: DEBUG nova.compute.manager [req-bc3b4be7-7e9b-403a-819e-0bef61ca6b61 req-f9bdefdf-49df-44c6-af13-c173965e9ed5 service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] No waiting events found dispatching network-vif-plugged-f74e1103-305e-48c3-941a-df5a1dc39873 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:19:43 user nova-compute[74994]: WARNING nova.compute.manager [req-bc3b4be7-7e9b-403a-819e-0bef61ca6b61 req-f9bdefdf-49df-44c6-af13-c173965e9ed5 service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Received unexpected event network-vif-plugged-f74e1103-305e-48c3-941a-df5a1dc39873 for instance with vm_state rescued and task_state unrescuing.
Nov 28 11:19:43 user nova-compute[74994]: DEBUG nova.compute.manager [req-bc3b4be7-7e9b-403a-819e-0bef61ca6b61 req-f9bdefdf-49df-44c6-af13-c173965e9ed5 service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Received event network-vif-plugged-f74e1103-305e-48c3-941a-df5a1dc39873 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:19:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bc3b4be7-7e9b-403a-819e-0bef61ca6b61 req-f9bdefdf-49df-44c6-af13-c173965e9ed5 service nova] Acquiring lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:19:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bc3b4be7-7e9b-403a-819e-0bef61ca6b61 req-f9bdefdf-49df-44c6-af13-c173965e9ed5 service nova] Lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:19:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bc3b4be7-7e9b-403a-819e-0bef61ca6b61 req-f9bdefdf-49df-44c6-af13-c173965e9ed5 service nova] Lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:19:43 user nova-compute[74994]: DEBUG nova.compute.manager [req-bc3b4be7-7e9b-403a-819e-0bef61ca6b61 req-f9bdefdf-49df-44c6-af13-c173965e9ed5 service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] No waiting events found dispatching network-vif-plugged-f74e1103-305e-48c3-941a-df5a1dc39873 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:19:43 user nova-compute[74994]: WARNING nova.compute.manager [req-bc3b4be7-7e9b-403a-819e-0bef61ca6b61 req-f9bdefdf-49df-44c6-af13-c173965e9ed5 service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Received unexpected event network-vif-plugged-f74e1103-305e-48c3-941a-df5a1dc39873 for instance with vm_state rescued and task_state unrescuing.
Nov 28 11:19:44 user nova-compute[74994]: DEBUG nova.compute.manager [req-f672e914-d0f3-4a62-b0f3-b2d8052ad317 req-48d7b8f2-70d6-4dac-872e-0c40dacfef00 service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Received event network-changed-f74e1103-305e-48c3-941a-df5a1dc39873 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:19:44 user nova-compute[74994]: DEBUG nova.compute.manager [req-f672e914-d0f3-4a62-b0f3-b2d8052ad317 req-48d7b8f2-70d6-4dac-872e-0c40dacfef00 service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Refreshing instance network info cache due to event network-changed-f74e1103-305e-48c3-941a-df5a1dc39873. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:19:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f672e914-d0f3-4a62-b0f3-b2d8052ad317 req-48d7b8f2-70d6-4dac-872e-0c40dacfef00 service nova] Acquiring lock "refresh_cache-58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:19:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f672e914-d0f3-4a62-b0f3-b2d8052ad317 req-48d7b8f2-70d6-4dac-872e-0c40dacfef00 service nova] Acquired lock "refresh_cache-58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:19:44 user nova-compute[74994]: DEBUG nova.network.neutron [req-f672e914-d0f3-4a62-b0f3-b2d8052ad317 req-48d7b8f2-70d6-4dac-872e-0c40dacfef00 service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Refreshing network info cache for port f74e1103-305e-48c3-941a-df5a1dc39873 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:19:44 user nova-compute[74994]: DEBUG nova.network.neutron [req-f672e914-d0f3-4a62-b0f3-b2d8052ad317 req-48d7b8f2-70d6-4dac-872e-0c40dacfef00 service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Updated VIF entry in instance network info cache for port f74e1103-305e-48c3-941a-df5a1dc39873. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:19:44 user nova-compute[74994]: DEBUG nova.network.neutron [req-f672e914-d0f3-4a62-b0f3-b2d8052ad317 req-48d7b8f2-70d6-4dac-872e-0c40dacfef00 service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Updating instance_info_cache with network_info: [{"id": "f74e1103-305e-48c3-941a-df5a1dc39873", "address": "fa:16:3e:5e:26:7f", "network": {"id": "5adf74ed-a983-4b41-a530-3e79a364db73", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2074174508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6f53748392c4f07bcf976431a90ceb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74e1103-30", "ovs_interfaceid": "f74e1103-305e-48c3-941a-df5a1dc39873", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:19:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f672e914-d0f3-4a62-b0f3-b2d8052ad317 req-48d7b8f2-70d6-4dac-872e-0c40dacfef00 service nova] Releasing lock "refresh_cache-58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:19:44 user nova-compute[74994]: DEBUG nova.compute.manager [req-f672e914-d0f3-4a62-b0f3-b2d8052ad317 req-48d7b8f2-70d6-4dac-872e-0c40dacfef00 service nova] [instance: e6803632-6fc3-4b5d-abf4-cc2665a7a26a] Received event network-vif-deleted-f3314941-1e6a-4f3a-a608-0a6949c6f8f7 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:19:45 user nova-compute[74994]: DEBUG nova.compute.manager [None req-6ad7db38-6bc7-4821-9516-f2ba9c0ed04f tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 11:19:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:19:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:19:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:19:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:19:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:19:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:20:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:20:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:20:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:20:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:20:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:20:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:20:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-a2871797-8778-40f7-9418-d6a602ab505e tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Acquiring lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:20:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-a2871797-8778-40f7-9418-d6a602ab505e tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:20:14 user nova-compute[74994]: INFO nova.compute.manager [None req-a2871797-8778-40f7-9418-d6a602ab505e tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Detaching volume 8e996227-a705-4cd3-a100-a57c80861401
Nov 28 11:20:14 user nova-compute[74994]: INFO nova.virt.block_device [None req-a2871797-8778-40f7-9418-d6a602ab505e tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Attempting to driver detach volume 8e996227-a705-4cd3-a100-a57c80861401 from mountpoint /dev/vdb
Nov 28 11:20:14 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-a2871797-8778-40f7-9418-d6a602ab505e tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Attempting to detach device vdb from instance 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f from the persistent domain config. {{(pid=74994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 11:20:14 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-a2871797-8778-40f7-9418-d6a602ab505e tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 11:20:14 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:20:14 user nova-compute[74994]:   <source dev="/dev/sdb"/>
Nov 28 11:20:14 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:20:14 user nova-compute[74994]:   <serial>8e996227-a705-4cd3-a100-a57c80861401</serial>
Nov 28 11:20:14 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 11:20:14 user nova-compute[74994]: </disk>
Nov 28 11:20:14 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 11:20:14 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-a2871797-8778-40f7-9418-d6a602ab505e tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Successfully detached device vdb from instance 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f from the persistent domain config.
Nov 28 11:20:14 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-a2871797-8778-40f7-9418-d6a602ab505e tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f from the live domain config. {{(pid=74994) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 11:20:14 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-a2871797-8778-40f7-9418-d6a602ab505e tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 11:20:14 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:20:14 user nova-compute[74994]:   <source dev="/dev/sdb"/>
Nov 28 11:20:14 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:20:14 user nova-compute[74994]:   <serial>8e996227-a705-4cd3-a100-a57c80861401</serial>
Nov 28 11:20:14 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 11:20:14 user nova-compute[74994]: </disk>
Nov 28 11:20:14 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 11:20:14 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-a2871797-8778-40f7-9418-d6a602ab505e tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f {{(pid=74994) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 11:20:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:20:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:20:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:20:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:20:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:20:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:20:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:20:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:20:21 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:20:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:20:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:20:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:20:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:20:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:20:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:20:28 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:20:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:20:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:20:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:20:28 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 11:20:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:20:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:20:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:20:28 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:20:29 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:20:29 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:20:29 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=8952MB free_disk=24.973438262939453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 11:20:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:20:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:20:29 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:20:29 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 11:20:29 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 11:20:29 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Refreshing inventories for resource provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 11:20:29 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Updating ProviderTree inventory for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 11:20:29 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Updating inventory in ProviderTree for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 11:20:29 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Refreshing aggregate associations for resource provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a, aggregates: None {{(pid=74994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 11:20:29 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Refreshing trait associations for resource provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=74994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 11:20:29 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:20:29 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:20:29 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 11:20:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.537s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:20:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:20:30 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:20:30 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 11:20:32 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74994) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 11:20:34 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-a2871797-8778-40f7-9418-d6a602ab505e tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f is timed out.
Nov 28 11:20:34 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-a2871797-8778-40f7-9418-d6a602ab505e tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Successfully detached device vdb from instance 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f from the live domain config.
Nov 28 11:20:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2871797-8778-40f7-9418-d6a602ab505e tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2871797-8778-40f7-9418-d6a602ab505e tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TiDqrfAw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:20:34 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-a2871797-8778-40f7-9418-d6a602ab505e tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:20:34 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-a2871797-8778-40f7-9418-d6a602ab505e tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-a2871797-8778-40f7-9418-d6a602ab505e tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[243c80f5-b10b-4057-afee-385c5cf26e89]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2871797-8778-40f7-9418-d6a602ab505e tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 11:20:34 user nova-compute[74994]: No targets found.
Nov 28 11:20:34 user nova-compute[74994]: iSNS:
Nov 28 11:20:34 user nova-compute[74994]: No targets found.
Nov 28 11:20:34 user nova-compute[74994]: STATIC:
Nov 28 11:20:34 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401
Nov 28 11:20:34 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:20:34 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:20:34 user nova-compute[74994]: FIRMWARE:
Nov 28 11:20:34 user nova-compute[74994]: No targets found.
Nov 28 11:20:34 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2871797-8778-40f7-9418-d6a602ab505e tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 11:20:34 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 11:20:34 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2871797-8778-40f7-9418-d6a602ab505e tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[93caaf5a-d870-4cc3-b02a-5aa45e501605]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c693ec5-857e-48d0-a9fe-3ccd48ffadf4]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2871797-8778-40f7-9418-d6a602ab505e tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 (non-flash)
Nov 28 11:20:34 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2871797-8778-40f7-9418-d6a602ab505e tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 (non-flash)
Nov 28 11:20:34 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2871797-8778-40f7-9418-d6a602ab505e tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9206bbac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401'): ({'sdb'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-a2871797-8778-40f7-9418-d6a602ab505e tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Removing single pathed devices sdb {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5079c593-e08a-4e0c-98f3-352a244f2510]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[75baee9e-564c-467e-a625-9bbe177e050f]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-a2871797-8778-40f7-9418-d6a602ab505e tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Flushing IO for device /dev/sdb {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6896b5c-466d-47bd-8516-5d59fe86ffc4]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-a2871797-8778-40f7-9418-d6a602ab505e tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[063a8840-9237-4152-9b5a-f6e0e5c5e81d]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-a2871797-8778-40f7-9418-d6a602ab505e tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-a2871797-8778-40f7-9418-d6a602ab505e tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] SCSI volumes sdb have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2871797-8778-40f7-9418-d6a602ab505e tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf6bf2a-ccf1-4acc-8fc8-8cee3ebee78b]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2871797-8778-40f7-9418-d6a602ab505e tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 -p 172.16.0.220:3260 --logout" returned: 0 in 0.040s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c6e36a-4b06-4260-9ba6-55329cc5fdc0]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2871797-8778-40f7-9418-d6a602ab505e tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401, portal: 172.16.0.220,3260]
Nov 28 11:20:34 user nova-compute[74994]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401, portal: 172.16.0.220,3260] successful.
Nov 28 11:20:34 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e996227-a705-4cd3-a100-a57c80861401 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[af631ae2-0a77-4e53-8b36-049e6daf8320]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2871797-8778-40f7-9418-d6a602ab505e tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-a2871797-8778-40f7-9418-d6a602ab505e tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2871797-8778-40f7-9418-d6a602ab505e tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] <== disconnect_volume: return (266ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:20:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2871797-8778-40f7-9418-d6a602ab505e tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 11:20:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:20:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:20:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:20:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:20:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:20:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:20:35 user nova-compute[74994]: DEBUG nova.objects.instance [None req-a2871797-8778-40f7-9418-d6a602ab505e tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Lazy-loading 'flavor' on Instance uuid 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:20:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-a2871797-8778-40f7-9418-d6a602ab505e tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.708s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:20:37 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:20:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:20:39 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:20:39 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 11:20:39 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Rebuilding the list of instances to heal {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 11:20:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "refresh_cache-58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:20:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquired lock "refresh_cache-58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:20:39 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Forcefully refreshing network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 11:20:39 user nova-compute[74994]: DEBUG nova.objects.instance [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lazy-loading 'info_cache' on Instance uuid 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:20:40 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Updating instance_info_cache with network_info: [{"id": "f74e1103-305e-48c3-941a-df5a1dc39873", "address": "fa:16:3e:5e:26:7f", "network": {"id": "5adf74ed-a983-4b41-a530-3e79a364db73", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2074174508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6f53748392c4f07bcf976431a90ceb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74e1103-30", "ovs_interfaceid": "f74e1103-305e-48c3-941a-df5a1dc39873", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:20:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Releasing lock "refresh_cache-58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:20:40 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Updated the network info_cache for instance {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 11:20:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:20:40 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:20:41 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:20:42 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:20:42 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:20:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:20:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:20:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:20:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:20:47 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:20:47 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Cleaning up deleted instances {{(pid=74994) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 11:20:47 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] There are 0 instances to clean {{(pid=74994) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 11:20:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:20:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:20:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:20:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:20:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:20:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:20:56 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Acquiring lock "6b63060e-f38f-4dcd-b910-658cc37f3459" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:20:56 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Lock "6b63060e-f38f-4dcd-b910-658cc37f3459" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:20:56 user nova-compute[74994]: DEBUG nova.compute.manager [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 11:20:56 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:20:56 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:20:56 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 11:20:56 user nova-compute[74994]: INFO nova.compute.claims [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Claim successful on node user
Nov 28 11:20:56 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:20:57 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:20:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.249s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:20:57 user nova-compute[74994]: DEBUG nova.compute.manager [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 11:20:57 user nova-compute[74994]: DEBUG nova.compute.manager [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 11:20:57 user nova-compute[74994]: DEBUG nova.network.neutron [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 11:20:57 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 11:20:57 user nova-compute[74994]: DEBUG nova.compute.manager [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 11:20:57 user nova-compute[74994]: DEBUG nova.policy [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '511f425eb2a144338610e88e161fe857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899a40ec21f4580b01d0d8c4877055b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 11:20:57 user nova-compute[74994]: INFO nova.virt.block_device [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Booting with volume c46047e2-c89a-4e1a-9a8a-140a3b747e84 at /dev/vda
Nov 28 11:20:57 user nova-compute[74994]: DEBUG os_brick.utils [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:20:57 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:20:57 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:20:57 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3bacfd-36ec-4adc-94e1-e1ca22d8fea0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:20:57 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:20:57 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:20:57 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8307e304-c70b-44d4-90c8-636e1b87d965]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:20:57 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:20:57 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:20:57 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc1180c-13aa-4e95-a46a-30491f18232b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:20:57 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e2768a-ab0e-4b76-ae34-84805f1f853c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:20:57 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:20:57 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:20:57 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 11:20:57 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:20:57 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:20:57 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 11:20:57 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[71dc8de1-226c-4df0-a3b5-9b8269f4532f]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:20:57 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 11:20:57 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 11:20:57 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 11:20:57 user nova-compute[74994]: DEBUG os_brick.utils [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:20:57 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Updating existing volume attachment record: fb2f7858-d2dd-41f0-85b4-3b4168223a90 {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 11:20:57 user nova-compute[74994]: DEBUG nova.network.neutron [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Successfully created port: dfed3798-5f85-494b-a5e1-f7908962c509 {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 11:20:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:20:58 user nova-compute[74994]: DEBUG nova.network.neutron [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Successfully updated port: dfed3798-5f85-494b-a5e1-f7908962c509 {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 11:20:58 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Acquiring lock "refresh_cache-6b63060e-f38f-4dcd-b910-658cc37f3459" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:20:58 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Acquired lock "refresh_cache-6b63060e-f38f-4dcd-b910-658cc37f3459" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:20:58 user nova-compute[74994]: DEBUG nova.network.neutron [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 11:20:58 user nova-compute[74994]: DEBUG nova.compute.manager [req-6ee40885-326a-4df0-ac81-243bb48816f0 req-80a574c5-5f61-4334-9312-ba9af37822e5 service nova] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Received event network-changed-dfed3798-5f85-494b-a5e1-f7908962c509 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:20:58 user nova-compute[74994]: DEBUG nova.compute.manager [req-6ee40885-326a-4df0-ac81-243bb48816f0 req-80a574c5-5f61-4334-9312-ba9af37822e5 service nova] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Refreshing instance network info cache due to event network-changed-dfed3798-5f85-494b-a5e1-f7908962c509. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:20:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6ee40885-326a-4df0-ac81-243bb48816f0 req-80a574c5-5f61-4334-9312-ba9af37822e5 service nova] Acquiring lock "refresh_cache-6b63060e-f38f-4dcd-b910-658cc37f3459" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:20:59 user nova-compute[74994]: DEBUG nova.network.neutron [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 11:20:59 user nova-compute[74994]: DEBUG nova.network.neutron [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Updating instance_info_cache with network_info: [{"id": "dfed3798-5f85-494b-a5e1-f7908962c509", "address": "fa:16:3e:16:a7:ca", "network": {"id": "e60575fe-fd95-429e-ac43-9f2a9e6f80d8", "bridge": "br-int", "label": "tempest-TestShelveInstance-690233806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0899a40ec21f4580b01d0d8c4877055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfed3798-5f", "ovs_interfaceid": "dfed3798-5f85-494b-a5e1-f7908962c509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:20:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Releasing lock "refresh_cache-6b63060e-f38f-4dcd-b910-658cc37f3459" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:20:59 user nova-compute[74994]: DEBUG nova.compute.manager [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Instance network_info: |[{"id": "dfed3798-5f85-494b-a5e1-f7908962c509", "address": "fa:16:3e:16:a7:ca", "network": {"id": "e60575fe-fd95-429e-ac43-9f2a9e6f80d8", "bridge": "br-int", "label": "tempest-TestShelveInstance-690233806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0899a40ec21f4580b01d0d8c4877055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfed3798-5f", "ovs_interfaceid": "dfed3798-5f85-494b-a5e1-f7908962c509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 11:20:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6ee40885-326a-4df0-ac81-243bb48816f0 req-80a574c5-5f61-4334-9312-ba9af37822e5 service nova] Acquired lock "refresh_cache-6b63060e-f38f-4dcd-b910-658cc37f3459" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:20:59 user nova-compute[74994]: DEBUG nova.network.neutron [req-6ee40885-326a-4df0-ac81-243bb48816f0 req-80a574c5-5f61-4334-9312-ba9af37822e5 service nova] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Refreshing network info cache for port dfed3798-5f85-494b-a5e1-f7908962c509 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:20:59 user nova-compute[74994]: DEBUG nova.network.neutron [req-6ee40885-326a-4df0-ac81-243bb48816f0 req-80a574c5-5f61-4334-9312-ba9af37822e5 service nova] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Updated VIF entry in instance network info cache for port dfed3798-5f85-494b-a5e1-f7908962c509. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:20:59 user nova-compute[74994]: DEBUG nova.network.neutron [req-6ee40885-326a-4df0-ac81-243bb48816f0 req-80a574c5-5f61-4334-9312-ba9af37822e5 service nova] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Updating instance_info_cache with network_info: [{"id": "dfed3798-5f85-494b-a5e1-f7908962c509", "address": "fa:16:3e:16:a7:ca", "network": {"id": "e60575fe-fd95-429e-ac43-9f2a9e6f80d8", "bridge": "br-int", "label": "tempest-TestShelveInstance-690233806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0899a40ec21f4580b01d0d8c4877055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfed3798-5f", "ovs_interfaceid": "dfed3798-5f85-494b-a5e1-f7908962c509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:20:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6ee40885-326a-4df0-ac81-243bb48816f0 req-80a574c5-5f61-4334-9312-ba9af37822e5 service nova] Releasing lock "refresh_cache-6b63060e-f38f-4dcd-b910-658cc37f3459" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:21:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG nova.compute.manager [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 11:21:04 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Creating image(s)
Nov 28 11:21:04 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Did not create local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Ensure instance console log exists: /opt/stack/data/nova/instances/6b63060e-f38f-4dcd-b910-658cc37f3459/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Start _get_guest_xml network_info=[{"id": "dfed3798-5f85-494b-a5e1-f7908962c509", "address": "fa:16:3e:16:a7:ca", "network": {"id": "e60575fe-fd95-429e-ac43-9f2a9e6f80d8", "bridge": "br-int", "label": "tempest-TestShelveInstance-690233806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0899a40ec21f4580b01d0d8c4877055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfed3798-5f", "ovs_interfaceid": "dfed3798-5f85-494b-a5e1-f7908962c509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GnYqVsvC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6b63060e-f38f-4dcd-b910-658cc37f3459', 'attached_at': '', 'detached_at': '', 'volume_id': 'c46047e2-c89a-4e1a-9a8a-140a3b747e84', 'serial': 'c46047e2-c89a-4e1a-9a8a-140a3b747e84'}, 'attachment_id': 'fb2f7858-d2dd-41f0-85b4-3b4168223a90', 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 11:21:04 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:21:04 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:21:04 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-25c97113-1d0d-4f1b-a157-8f24c9009f88 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Acquiring lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-25c97113-1d0d-4f1b-a157-8f24c9009f88 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-25c97113-1d0d-4f1b-a157-8f24c9009f88 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Acquiring lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-25c97113-1d0d-4f1b-a157-8f24c9009f88 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-25c97113-1d0d-4f1b-a157-8f24c9009f88 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:21:04 user nova-compute[74994]: INFO nova.compute.manager [None req-25c97113-1d0d-4f1b-a157-8f24c9009f88 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Terminating instance
Nov 28 11:21:04 user nova-compute[74994]: DEBUG nova.compute.manager [None req-25c97113-1d0d-4f1b-a157-8f24c9009f88 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GnYqVsvC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:21:04 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:21:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:21:04 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:21:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:21:04 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 11:21:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f3a274-6d2f-4540-9d0f-3a1dc45b328a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 11:21:04 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a30bc4-cb3f-47d6-886a-78f89701bca7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84] added
Nov 28 11:21:04 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3894f608-b9ce-41ae-a442-29a0d3bb667b]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18b3c2d-f546-4466-96c7-47fca2a5b642]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GnYqVsvC {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GnYqVsvC" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[61afd60a-8222-4e9a-9f4a-2e6f89ebbab1]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GnYqVsvC'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[183e6fb3-72a6-4974-aeaa-6f5a11cf9f49]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dee8a56-e85d-4b7a-92db-6b2e18c473da]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 11:21:04 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 11:21:04 user nova-compute[74994]:  {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:21:04 user nova-compute[74994]: WARNING os_brick.initiator.connectors.iscsi [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 11:21:04 user nova-compute[74994]: 
Nov 28 11:21:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f439e1-4c9c-4cbc-81b3-900f2fb30b15]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84, portal: 172.16.0.220,3260]
Nov 28 11:21:04 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84, portal: 172.16.0.220,3260] successful.
Nov 28 11:21:04 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf89e9dc-2a88-42b8-8d17-be1754759dc0]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a253a2-6c41-4610-9876-831da6274bc4]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 (non-flash)
Nov 28 11:21:04 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 (non-flash)
Nov 28 11:21:04 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[360c5723-02c3-45a5-a43d-87a1b1be5e70]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:21:04 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: None {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 11:21:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:05 user nova-compute[74994]: DEBUG nova.compute.manager [req-bbea398b-4752-453b-877a-388ee7e22740 req-6d72f6d7-7f7b-4666-b0bc-3e4d43d2e6ea service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Received event network-vif-unplugged-f74e1103-305e-48c3-941a-df5a1dc39873 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:21:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bbea398b-4752-453b-877a-388ee7e22740 req-6d72f6d7-7f7b-4666-b0bc-3e4d43d2e6ea service nova] Acquiring lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:21:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bbea398b-4752-453b-877a-388ee7e22740 req-6d72f6d7-7f7b-4666-b0bc-3e4d43d2e6ea service nova] Lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:21:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bbea398b-4752-453b-877a-388ee7e22740 req-6d72f6d7-7f7b-4666-b0bc-3e4d43d2e6ea service nova] Lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:21:05 user nova-compute[74994]: DEBUG nova.compute.manager [req-bbea398b-4752-453b-877a-388ee7e22740 req-6d72f6d7-7f7b-4666-b0bc-3e4d43d2e6ea service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] No waiting events found dispatching network-vif-unplugged-f74e1103-305e-48c3-941a-df5a1dc39873 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:21:05 user nova-compute[74994]: DEBUG nova.compute.manager [req-bbea398b-4752-453b-877a-388ee7e22740 req-6d72f6d7-7f7b-4666-b0bc-3e4d43d2e6ea service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Received event network-vif-unplugged-f74e1103-305e-48c3-941a-df5a1dc39873 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 11:21:05 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Instance destroyed successfully.
Nov 28 11:21:05 user nova-compute[74994]: DEBUG nova.objects.instance [None req-25c97113-1d0d-4f1b-a157-8f24c9009f88 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Lazy-loading 'resources' on Instance uuid 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:21:05 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-25c97113-1d0d-4f1b-a157-8f24c9009f88 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:13:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1052735740',display_name='tempest-ServerStableDeviceRescueTest-server-1052735740',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1052735740',id=42,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvIMFBxCfGNOfXT7o2GQq2zAQvFOyOHwsqXQTy9EM88+ITJHWPj8RbVSw1m5OzDtto+mvTb2iAylNkJ25WSwMYGIsi1p2TfiDNsdNhJGcGABqRneTPc1XQ+A6T2HvtnvQ==',key_name='tempest-keypair-449219025',keypairs=<?>,launch_index=0,launched_at=2023-11-28T11:17:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6f53748392c4f07bcf976431a90ceb3',ramdisk_id='',reservation_id='r-ysh20ttk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1260621891',owner_user_name='tempest-ServerStableDeviceRescueTest-1260621891-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T11:19:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48a8f622cb634f478095ff72fde0b223',uuid=58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f74e1103-305e-48c3-941a-df5a1dc39873", "address": "fa:16:3e:5e:26:7f", "network": {"id": "5adf74ed-a983-4b41-a530-3e79a364db73", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2074174508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6f53748392c4f07bcf976431a90ceb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74e1103-30", "ovs_interfaceid": "f74e1103-305e-48c3-941a-df5a1dc39873", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 11:21:05 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-25c97113-1d0d-4f1b-a157-8f24c9009f88 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Converting VIF {"id": "f74e1103-305e-48c3-941a-df5a1dc39873", "address": "fa:16:3e:5e:26:7f", "network": {"id": "5adf74ed-a983-4b41-a530-3e79a364db73", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2074174508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6f53748392c4f07bcf976431a90ceb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74e1103-30", "ovs_interfaceid": "f74e1103-305e-48c3-941a-df5a1dc39873", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:21:05 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-25c97113-1d0d-4f1b-a157-8f24c9009f88 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:26:7f,bridge_name='br-int',has_traffic_filtering=True,id=f74e1103-305e-48c3-941a-df5a1dc39873,network=Network(5adf74ed-a983-4b41-a530-3e79a364db73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf74e1103-30') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:21:05 user nova-compute[74994]: DEBUG os_vif [None req-25c97113-1d0d-4f1b-a157-8f24c9009f88 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:26:7f,bridge_name='br-int',has_traffic_filtering=True,id=f74e1103-305e-48c3-941a-df5a1dc39873,network=Network(5adf74ed-a983-4b41-a530-3e79a364db73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf74e1103-30') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 11:21:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf74e1103-30, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:21:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:21:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e2f195f2-c513-4482-b6cb-fc781d74b0ed) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:21:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:21:05 user nova-compute[74994]: INFO os_vif [None req-25c97113-1d0d-4f1b-a157-8f24c9009f88 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:26:7f,bridge_name='br-int',has_traffic_filtering=True,id=f74e1103-305e-48c3-941a-df5a1dc39873,network=Network(5adf74ed-a983-4b41-a530-3e79a364db73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf74e1103-30')
Nov 28 11:21:05 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-25c97113-1d0d-4f1b-a157-8f24c9009f88 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Deleting instance files /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f_del
Nov 28 11:21:05 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-25c97113-1d0d-4f1b-a157-8f24c9009f88 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Deletion of /opt/stack/data/nova/instances/58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f_del complete
Nov 28 11:21:05 user nova-compute[74994]: INFO nova.compute.manager [None req-25c97113-1d0d-4f1b-a157-8f24c9009f88 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 28 11:21:05 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-25c97113-1d0d-4f1b-a157-8f24c9009f88 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 11:21:05 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 11:21:05 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 11:21:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:05 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 11:21:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GnYqVsvC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 11:21:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:21:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23035386531343431', 'path': '/dev/sdb'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:21:05 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035386531343431', 'path': '/dev/sdb'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 11:21:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:20:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1828007530',display_name='tempest-TestShelveInstance-server-1828007530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1828007530',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNF3fUpHEM9VeUq49aQapE8hfGQV0VLJSuoH3NotavqxAsyK1aFpgQcoCCirfFZKXWtvJIjbZcDU6F/Puy3MFxxr6NPdA3FHU53qC+0UMjSnIm5FnYd8bXwipVNVqJl98A==',key_name='tempest-TestShelveInstance-1222425401',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0899a40ec21f4580b01d0d8c4877055b',ramdisk_id='',reservation_id='r-fcuz0brj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-959893651',owner_user_name='tempest-TestShelveInstance-959893651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:20:57Z,user_data=None,user_id='511f425eb2a144338610e88e161fe857',uuid=6b63060e-f38f-4dcd-b910-658cc37f3459,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfed3798-5f85-494b-a5e1-f7908962c509", "address": "fa:16:3e:16:a7:ca", "network": {"id": "e60575fe-fd95-429e-ac43-9f2a9e6f80d8", "bridge": "br-int", "label": "tempest-TestShelveInstance-690233806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0899a40ec21f4580b01d0d8c4877055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfed3798-5f", "ovs_interfaceid": "dfed3798-5f85-494b-a5e1-f7908962c509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 11:21:06 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Converting VIF {"id": "dfed3798-5f85-494b-a5e1-f7908962c509", "address": "fa:16:3e:16:a7:ca", "network": {"id": "e60575fe-fd95-429e-ac43-9f2a9e6f80d8", "bridge": "br-int", "label": "tempest-TestShelveInstance-690233806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0899a40ec21f4580b01d0d8c4877055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfed3798-5f", "ovs_interfaceid": "dfed3798-5f85-494b-a5e1-f7908962c509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:21:06 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:a7:ca,bridge_name='br-int',has_traffic_filtering=True,id=dfed3798-5f85-494b-a5e1-f7908962c509,network=Network(e60575fe-fd95-429e-ac43-9f2a9e6f80d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfed3798-5f') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:21:06 user nova-compute[74994]: DEBUG nova.objects.instance [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Lazy-loading 'pci_devices' on Instance uuid 6b63060e-f38f-4dcd-b910-658cc37f3459 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:21:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] End _get_guest_xml xml=<domain type="kvm">
Nov 28 11:21:06 user nova-compute[74994]:   <uuid>6b63060e-f38f-4dcd-b910-658cc37f3459</uuid>
Nov 28 11:21:06 user nova-compute[74994]:   <name>instance-0000002d</name>
Nov 28 11:21:06 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 11:21:06 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 11:21:06 user nova-compute[74994]:   <metadata>
Nov 28 11:21:06 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 11:21:06 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 11:21:06 user nova-compute[74994]:       <nova:name>tempest-TestShelveInstance-server-1828007530</nova:name>
Nov 28 11:21:06 user nova-compute[74994]:       <nova:creationTime>2023-11-28 11:21:04</nova:creationTime>
Nov 28 11:21:06 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 11:21:06 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 11:21:06 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 11:21:06 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 11:21:06 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 11:21:06 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 11:21:06 user nova-compute[74994]:       </nova:flavor>
Nov 28 11:21:06 user nova-compute[74994]:       <nova:owner>
Nov 28 11:21:06 user nova-compute[74994]:         <nova:user uuid="511f425eb2a144338610e88e161fe857">tempest-TestShelveInstance-959893651-project-member</nova:user>
Nov 28 11:21:06 user nova-compute[74994]:         <nova:project uuid="0899a40ec21f4580b01d0d8c4877055b">tempest-TestShelveInstance-959893651</nova:project>
Nov 28 11:21:06 user nova-compute[74994]:       </nova:owner>
Nov 28 11:21:06 user nova-compute[74994]:       <nova:ports>
Nov 28 11:21:06 user nova-compute[74994]:         <nova:port uuid="dfed3798-5f85-494b-a5e1-f7908962c509">
Nov 28 11:21:06 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 28 11:21:06 user nova-compute[74994]:         </nova:port>
Nov 28 11:21:06 user nova-compute[74994]:       </nova:ports>
Nov 28 11:21:06 user nova-compute[74994]:     </nova:instance>
Nov 28 11:21:06 user nova-compute[74994]:   </metadata>
Nov 28 11:21:06 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 11:21:06 user nova-compute[74994]:     <system>
Nov 28 11:21:06 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 11:21:06 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 11:21:06 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 11:21:06 user nova-compute[74994]:       <entry name="serial">6b63060e-f38f-4dcd-b910-658cc37f3459</entry>
Nov 28 11:21:06 user nova-compute[74994]:       <entry name="uuid">6b63060e-f38f-4dcd-b910-658cc37f3459</entry>
Nov 28 11:21:06 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 11:21:06 user nova-compute[74994]:     </system>
Nov 28 11:21:06 user nova-compute[74994]:   </sysinfo>
Nov 28 11:21:06 user nova-compute[74994]:   <os>
Nov 28 11:21:06 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 11:21:06 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 11:21:06 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 11:21:06 user nova-compute[74994]:   </os>
Nov 28 11:21:06 user nova-compute[74994]:   <features>
Nov 28 11:21:06 user nova-compute[74994]:     <acpi/>
Nov 28 11:21:06 user nova-compute[74994]:     <apic/>
Nov 28 11:21:06 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 11:21:06 user nova-compute[74994]:   </features>
Nov 28 11:21:06 user nova-compute[74994]:   <clock offset="utc">
Nov 28 11:21:06 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 11:21:06 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 11:21:06 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 11:21:06 user nova-compute[74994]:   </clock>
Nov 28 11:21:06 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 11:21:06 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 11:21:06 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 11:21:06 user nova-compute[74994]:   </cpu>
Nov 28 11:21:06 user nova-compute[74994]:   <devices>
Nov 28 11:21:06 user nova-compute[74994]:     <disk type="block" device="disk">
Nov 28 11:21:06 user nova-compute[74994]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:21:06 user nova-compute[74994]:       <source dev="/dev/sdb"/>
Nov 28 11:21:06 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 11:21:06 user nova-compute[74994]:       <serial>c46047e2-c89a-4e1a-9a8a-140a3b747e84</serial>
Nov 28 11:21:06 user nova-compute[74994]:     </disk>
Nov 28 11:21:06 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 11:21:06 user nova-compute[74994]:       <mac address="fa:16:3e:16:a7:ca"/>
Nov 28 11:21:06 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:21:06 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 11:21:06 user nova-compute[74994]:       <target dev="tapdfed3798-5f"/>
Nov 28 11:21:06 user nova-compute[74994]:     </interface>
Nov 28 11:21:06 user nova-compute[74994]:     <serial type="pty">
Nov 28 11:21:06 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/6b63060e-f38f-4dcd-b910-658cc37f3459/console.log" append="off"/>
Nov 28 11:21:06 user nova-compute[74994]:     </serial>
Nov 28 11:21:06 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 11:21:06 user nova-compute[74994]:     <video>
Nov 28 11:21:06 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:21:06 user nova-compute[74994]:     </video>
Nov 28 11:21:06 user nova-compute[74994]:     <rng model="virtio">
Nov 28 11:21:06 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 11:21:06 user nova-compute[74994]:     </rng>
Nov 28 11:21:06 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 11:21:06 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 11:21:06 user nova-compute[74994]:       <stats period="10"/>
Nov 28 11:21:06 user nova-compute[74994]:     </memballoon>
Nov 28 11:21:06 user nova-compute[74994]:   </devices>
Nov 28 11:21:06 user nova-compute[74994]: </domain>
Nov 28 11:21:06 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 11:21:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:20:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1828007530',display_name='tempest-TestShelveInstance-server-1828007530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1828007530',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNF3fUpHEM9VeUq49aQapE8hfGQV0VLJSuoH3NotavqxAsyK1aFpgQcoCCirfFZKXWtvJIjbZcDU6F/Puy3MFxxr6NPdA3FHU53qC+0UMjSnIm5FnYd8bXwipVNVqJl98A==',key_name='tempest-TestShelveInstance-1222425401',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0899a40ec21f4580b01d0d8c4877055b',ramdisk_id='',reservation_id='r-fcuz0brj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-959893651',owner_user_name='tempest-TestShelveInstance-959893651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:20:57Z,user_data=None,user_id='511f425eb2a144338610e88e161fe857',uuid=6b63060e-f38f-4dcd-b910-658cc37f3459,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfed3798-5f85-494b-a5e1-f7908962c509", "address": "fa:16:3e:16:a7:ca", "network": {"id": "e60575fe-fd95-429e-ac43-9f2a9e6f80d8", "bridge": "br-int", "label": "tempest-TestShelveInstance-690233806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0899a40ec21f4580b01d0d8c4877055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfed3798-5f", "ovs_interfaceid": "dfed3798-5f85-494b-a5e1-f7908962c509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 11:21:06 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Converting VIF {"id": "dfed3798-5f85-494b-a5e1-f7908962c509", "address": "fa:16:3e:16:a7:ca", "network": {"id": "e60575fe-fd95-429e-ac43-9f2a9e6f80d8", "bridge": "br-int", "label": "tempest-TestShelveInstance-690233806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0899a40ec21f4580b01d0d8c4877055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfed3798-5f", "ovs_interfaceid": "dfed3798-5f85-494b-a5e1-f7908962c509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:21:06 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:a7:ca,bridge_name='br-int',has_traffic_filtering=True,id=dfed3798-5f85-494b-a5e1-f7908962c509,network=Network(e60575fe-fd95-429e-ac43-9f2a9e6f80d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfed3798-5f') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:21:06 user nova-compute[74994]: DEBUG os_vif [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:a7:ca,bridge_name='br-int',has_traffic_filtering=True,id=dfed3798-5f85-494b-a5e1-f7908962c509,network=Network(e60575fe-fd95-429e-ac43-9f2a9e6f80d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfed3798-5f') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 11:21:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:21:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 11:21:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ec1569ab-7f5a-51ef-bc72-ab1c4bf1200e', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:21:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:21:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdfed3798-5f, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:21:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdfed3798-5f, col_values=(('qos', UUID('949dce6a-de82-4e4a-93b8-90f937f95fdb')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:21:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdfed3798-5f, col_values=(('external_ids', {'iface-id': 'dfed3798-5f85-494b-a5e1-f7908962c509', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:a7:ca', 'vm-uuid': '6b63060e-f38f-4dcd-b910-658cc37f3459'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:21:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:21:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:06 user nova-compute[74994]: INFO os_vif [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:a7:ca,bridge_name='br-int',has_traffic_filtering=True,id=dfed3798-5f85-494b-a5e1-f7908962c509,network=Network(e60575fe-fd95-429e-ac43-9f2a9e6f80d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfed3798-5f')
Nov 28 11:21:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:21:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] No VIF found with MAC fa:16:3e:16:a7:ca, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:21:06 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:21:06 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Took 0.70 seconds to deallocate network for instance.
Nov 28 11:21:06 user nova-compute[74994]: DEBUG nova.compute.manager [req-0a5c86f9-25ed-4cb6-97e9-860c42d9a6d4 req-8ded36cb-a39e-43db-b049-b623e779badd service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Received event network-vif-deleted-f74e1103-305e-48c3-941a-df5a1dc39873 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:21:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-25c97113-1d0d-4f1b-a157-8f24c9009f88 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:21:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-25c97113-1d0d-4f1b-a157-8f24c9009f88 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:21:06 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-25c97113-1d0d-4f1b-a157-8f24c9009f88 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:21:06 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-25c97113-1d0d-4f1b-a157-8f24c9009f88 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:21:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-25c97113-1d0d-4f1b-a157-8f24c9009f88 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.164s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:21:06 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-25c97113-1d0d-4f1b-a157-8f24c9009f88 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Deleted allocations for instance 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f
Nov 28 11:21:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-25c97113-1d0d-4f1b-a157-8f24c9009f88 tempest-ServerStableDeviceRescueTest-1260621891 tempest-ServerStableDeviceRescueTest-1260621891-project-member] Lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.978s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:21:07 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:07 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:07 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:07 user nova-compute[74994]: DEBUG nova.compute.manager [req-b7291a29-a845-48e9-991f-420c00e7687a req-10572e9c-18c7-465a-a2a0-8924bd930e27 service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Received event network-vif-plugged-f74e1103-305e-48c3-941a-df5a1dc39873 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:21:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-b7291a29-a845-48e9-991f-420c00e7687a req-10572e9c-18c7-465a-a2a0-8924bd930e27 service nova] Acquiring lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:21:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-b7291a29-a845-48e9-991f-420c00e7687a req-10572e9c-18c7-465a-a2a0-8924bd930e27 service nova] Lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:21:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-b7291a29-a845-48e9-991f-420c00e7687a req-10572e9c-18c7-465a-a2a0-8924bd930e27 service nova] Lock "58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:21:07 user nova-compute[74994]: DEBUG nova.compute.manager [req-b7291a29-a845-48e9-991f-420c00e7687a req-10572e9c-18c7-465a-a2a0-8924bd930e27 service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] No waiting events found dispatching network-vif-plugged-f74e1103-305e-48c3-941a-df5a1dc39873 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:21:07 user nova-compute[74994]: WARNING nova.compute.manager [req-b7291a29-a845-48e9-991f-420c00e7687a req-10572e9c-18c7-465a-a2a0-8924bd930e27 service nova] [instance: 58f2c6bb-2e01-45b8-bfd6-2f6946e2b48f] Received unexpected event network-vif-plugged-f74e1103-305e-48c3-941a-df5a1dc39873 for instance with vm_state deleted and task_state None.
Nov 28 11:21:07 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:07 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:09 user nova-compute[74994]: DEBUG nova.compute.manager [req-8e1a372a-8f74-453f-a34f-8010de97ab3c req-6d870c7d-ecfd-4fab-a493-09e15a92f2be service nova] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Received event network-vif-plugged-dfed3798-5f85-494b-a5e1-f7908962c509 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:21:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8e1a372a-8f74-453f-a34f-8010de97ab3c req-6d870c7d-ecfd-4fab-a493-09e15a92f2be service nova] Acquiring lock "6b63060e-f38f-4dcd-b910-658cc37f3459-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:21:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8e1a372a-8f74-453f-a34f-8010de97ab3c req-6d870c7d-ecfd-4fab-a493-09e15a92f2be service nova] Lock "6b63060e-f38f-4dcd-b910-658cc37f3459-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:21:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8e1a372a-8f74-453f-a34f-8010de97ab3c req-6d870c7d-ecfd-4fab-a493-09e15a92f2be service nova] Lock "6b63060e-f38f-4dcd-b910-658cc37f3459-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:21:09 user nova-compute[74994]: DEBUG nova.compute.manager [req-8e1a372a-8f74-453f-a34f-8010de97ab3c req-6d870c7d-ecfd-4fab-a493-09e15a92f2be service nova] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] No waiting events found dispatching network-vif-plugged-dfed3798-5f85-494b-a5e1-f7908962c509 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:21:09 user nova-compute[74994]: WARNING nova.compute.manager [req-8e1a372a-8f74-453f-a34f-8010de97ab3c req-6d870c7d-ecfd-4fab-a493-09e15a92f2be service nova] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Received unexpected event network-vif-plugged-dfed3798-5f85-494b-a5e1-f7908962c509 for instance with vm_state building and task_state spawning.
Nov 28 11:21:09 user nova-compute[74994]: DEBUG nova.compute.manager [req-8e1a372a-8f74-453f-a34f-8010de97ab3c req-6d870c7d-ecfd-4fab-a493-09e15a92f2be service nova] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Received event network-vif-plugged-dfed3798-5f85-494b-a5e1-f7908962c509 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:21:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8e1a372a-8f74-453f-a34f-8010de97ab3c req-6d870c7d-ecfd-4fab-a493-09e15a92f2be service nova] Acquiring lock "6b63060e-f38f-4dcd-b910-658cc37f3459-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:21:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8e1a372a-8f74-453f-a34f-8010de97ab3c req-6d870c7d-ecfd-4fab-a493-09e15a92f2be service nova] Lock "6b63060e-f38f-4dcd-b910-658cc37f3459-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:21:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8e1a372a-8f74-453f-a34f-8010de97ab3c req-6d870c7d-ecfd-4fab-a493-09e15a92f2be service nova] Lock "6b63060e-f38f-4dcd-b910-658cc37f3459-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:21:09 user nova-compute[74994]: DEBUG nova.compute.manager [req-8e1a372a-8f74-453f-a34f-8010de97ab3c req-6d870c7d-ecfd-4fab-a493-09e15a92f2be service nova] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] No waiting events found dispatching network-vif-plugged-dfed3798-5f85-494b-a5e1-f7908962c509 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:21:09 user nova-compute[74994]: WARNING nova.compute.manager [req-8e1a372a-8f74-453f-a34f-8010de97ab3c req-6d870c7d-ecfd-4fab-a493-09e15a92f2be service nova] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Received unexpected event network-vif-plugged-dfed3798-5f85-494b-a5e1-f7908962c509 for instance with vm_state building and task_state spawning.
Nov 28 11:21:09 user nova-compute[74994]: DEBUG nova.compute.manager [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 11:21:09 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 11:21:09 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Instance spawned successfully.
Nov 28 11:21:09 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 11:21:09 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:21:09 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:21:09 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:21:09 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:21:09 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:21:09 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:21:09 user nova-compute[74994]: INFO nova.compute.manager [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Took 5.04 seconds to spawn the instance on the hypervisor.
Nov 28 11:21:09 user nova-compute[74994]: DEBUG nova.compute.manager [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 11:21:09 user nova-compute[74994]: INFO nova.compute.manager [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Took 12.94 seconds to build instance.
Nov 28 11:21:09 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6ea96e5a-2f50-4898-a6c1-f9a2dc528380 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Lock "6b63060e-f38f-4dcd-b910-658cc37f3459" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.047s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:21:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "d27176da-6eaf-4af6-9dc2-b0e9c558d465" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:21:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "d27176da-6eaf-4af6-9dc2-b0e9c558d465" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:21:17 user nova-compute[74994]: DEBUG nova.compute.manager [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 11:21:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:21:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:21:17 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 11:21:17 user nova-compute[74994]: INFO nova.compute.claims [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Claim successful on node user
Nov 28 11:21:17 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:21:17 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:21:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.197s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:21:17 user nova-compute[74994]: DEBUG nova.compute.manager [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 11:21:17 user nova-compute[74994]: DEBUG nova.compute.manager [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 11:21:17 user nova-compute[74994]: DEBUG nova.network.neutron [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 11:21:18 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 11:21:18 user nova-compute[74994]: DEBUG nova.compute.manager [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 11:21:18 user nova-compute[74994]: INFO nova.virt.block_device [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Booting with volume snapshot d4f46b60-8823-4d1e-a27e-fc1edaca87b8 at /dev/vda
Nov 28 11:21:18 user nova-compute[74994]: DEBUG nova.policy [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e1ebcd41891545f990e285b43c9eac90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb427b7927364726907d9e90ef9a578f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 11:21:18 user nova-compute[74994]: DEBUG nova.network.neutron [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Successfully created port: ab4e1d53-9f9a-4500-a81f-a1c2192606cf {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 11:21:19 user nova-compute[74994]: DEBUG nova.network.neutron [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Successfully updated port: ab4e1d53-9f9a-4500-a81f-a1c2192606cf {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 11:21:19 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "refresh_cache-d27176da-6eaf-4af6-9dc2-b0e9c558d465" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:21:19 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquired lock "refresh_cache-d27176da-6eaf-4af6-9dc2-b0e9c558d465" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:21:19 user nova-compute[74994]: DEBUG nova.network.neutron [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 11:21:19 user nova-compute[74994]: DEBUG nova.network.neutron [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 11:21:19 user nova-compute[74994]: DEBUG nova.compute.manager [req-a3737730-efcc-4aa4-a742-1291129e9a0f req-e83eb73d-79d3-44bf-876e-952be1304d87 service nova] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Received event network-changed-ab4e1d53-9f9a-4500-a81f-a1c2192606cf {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:21:19 user nova-compute[74994]: DEBUG nova.compute.manager [req-a3737730-efcc-4aa4-a742-1291129e9a0f req-e83eb73d-79d3-44bf-876e-952be1304d87 service nova] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Refreshing instance network info cache due to event network-changed-ab4e1d53-9f9a-4500-a81f-a1c2192606cf. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:21:19 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a3737730-efcc-4aa4-a742-1291129e9a0f req-e83eb73d-79d3-44bf-876e-952be1304d87 service nova] Acquiring lock "refresh_cache-d27176da-6eaf-4af6-9dc2-b0e9c558d465" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:21:19 user nova-compute[74994]: DEBUG nova.network.neutron [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Updating instance_info_cache with network_info: [{"id": "ab4e1d53-9f9a-4500-a81f-a1c2192606cf", "address": "fa:16:3e:2e:01:06", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab4e1d53-9f", "ovs_interfaceid": "ab4e1d53-9f9a-4500-a81f-a1c2192606cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:21:19 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Releasing lock "refresh_cache-d27176da-6eaf-4af6-9dc2-b0e9c558d465" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:21:19 user nova-compute[74994]: DEBUG nova.compute.manager [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Instance network_info: |[{"id": "ab4e1d53-9f9a-4500-a81f-a1c2192606cf", "address": "fa:16:3e:2e:01:06", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab4e1d53-9f", "ovs_interfaceid": "ab4e1d53-9f9a-4500-a81f-a1c2192606cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 11:21:19 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a3737730-efcc-4aa4-a742-1291129e9a0f req-e83eb73d-79d3-44bf-876e-952be1304d87 service nova] Acquired lock "refresh_cache-d27176da-6eaf-4af6-9dc2-b0e9c558d465" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:21:19 user nova-compute[74994]: DEBUG nova.network.neutron [req-a3737730-efcc-4aa4-a742-1291129e9a0f req-e83eb73d-79d3-44bf-876e-952be1304d87 service nova] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Refreshing network info cache for port ab4e1d53-9f9a-4500-a81f-a1c2192606cf {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:21:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:20 user nova-compute[74994]: DEBUG nova.network.neutron [req-a3737730-efcc-4aa4-a742-1291129e9a0f req-e83eb73d-79d3-44bf-876e-952be1304d87 service nova] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Updated VIF entry in instance network info cache for port ab4e1d53-9f9a-4500-a81f-a1c2192606cf. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:21:20 user nova-compute[74994]: DEBUG nova.network.neutron [req-a3737730-efcc-4aa4-a742-1291129e9a0f req-e83eb73d-79d3-44bf-876e-952be1304d87 service nova] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Updating instance_info_cache with network_info: [{"id": "ab4e1d53-9f9a-4500-a81f-a1c2192606cf", "address": "fa:16:3e:2e:01:06", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab4e1d53-9f", "ovs_interfaceid": "ab4e1d53-9f9a-4500-a81f-a1c2192606cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:21:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a3737730-efcc-4aa4-a742-1291129e9a0f req-e83eb73d-79d3-44bf-876e-952be1304d87 service nova] Releasing lock "refresh_cache-d27176da-6eaf-4af6-9dc2-b0e9c558d465" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:21:21 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:23 user nova-compute[74994]: DEBUG os_brick.utils [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:21:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:21:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:21:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[36497cf7-807f-40e9-b936-cb8e8459c38b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:21:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:21:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:21:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a548ca38-cae3-4d3f-8498-e4eaaaa7119c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:21:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:21:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:21:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e31b6a-8ca3-4870-8eb7-0c8e6850ffa2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:21:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[71cd1479-ac42-479a-ba53-b3a49e231b9c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:21:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:21:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:21:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 11:21:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:21:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:21:23 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 11:21:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10cfc6e-1eb4-4917-9e33-3e3e0bebd42b]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:21:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 11:21:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 11:21:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 11:21:23 user nova-compute[74994]: DEBUG os_brick.utils [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:21:23 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Updating existing volume attachment record: 783daa1e-b8a7-4cee-80a6-3ec70d249310 {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 11:21:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:29 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:21:29 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 11:21:29 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:21:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:21:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:21:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:21:29 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 11:21:29 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:21:29 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:21:29 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:21:29 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=8860MB free_disk=25.085540771484375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 11:21:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:21:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:21:30 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 6b63060e-f38f-4dcd-b910-658cc37f3459 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:21:30 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance d27176da-6eaf-4af6-9dc2-b0e9c558d465 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:21:30 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 11:21:30 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 11:21:30 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:21:30 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:21:30 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 11:21:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.303s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:21:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:30 user nova-compute[74994]: DEBUG nova.compute.manager [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 11:21:30 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 11:21:30 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Creating image(s)
Nov 28 11:21:30 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Did not create local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 11:21:30 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Ensure instance console log exists: /opt/stack/data/nova/instances/d27176da-6eaf-4af6-9dc2-b0e9c558d465/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 11:21:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:21:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:21:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:21:30 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Start _get_guest_xml network_info=[{"id": "ab4e1d53-9f9a-4500-a81f-a1c2192606cf", "address": "fa:16:3e:2e:01:06", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab4e1d53-9f", "ovs_interfaceid": "ab4e1d53-9f9a-4500-a81f-a1c2192606cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SdPgbBtk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd27176da-6eaf-4af6-9dc2-b0e9c558d465', 'attached_at': '', 'detached_at': '', 'volume_id': '0d320365-1b92-4e76-a126-8a0f6f9f6c8e', 'serial': '0d320365-1b92-4e76-a126-8a0f6f9f6c8e'}, 'attachment_id': '783daa1e-b8a7-4cee-80a6-3ec70d249310', 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 11:21:30 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:21:30 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:21:30 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 11:21:30 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 11:21:30 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 11:21:30 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 11:21:30 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 11:21:30 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 11:21:30 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 11:21:30 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 11:21:30 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 11:21:30 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 11:21:30 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 11:21:30 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 11:21:30 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 11:21:30 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 11:21:30 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 11:21:30 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 11:21:30 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 11:21:30 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SdPgbBtk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:21:30 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:21:30 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:21:30 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:21:30 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:21:30 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:21:30 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:21:30 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 11:21:30 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:21:30 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:21:30 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9624cee-f229-4b2c-9302-2d27d2e45294]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:21:30 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 11:21:30 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:21:30 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:21:30 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.036s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:21:30 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f9305f-1ce2-4fb8-8dc5-458a4dc87d6c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:21:30 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e] added
Nov 28 11:21:30 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:21:30 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:21:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:21:31 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce1fc0a-e1ea-40a6-a1ad-5483521f58ac]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:21:31 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:21:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:21:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:21:31 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37008d2-da7b-4405-87f7-9fb587b0c176]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:21:31 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:21:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SdPgbBtk {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:21:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SdPgbBtk" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:21:31 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa67b33-ee1f-4f84-91ed-2cbf39bdeaf6]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:21:31 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SdPgbBtk'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:21:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:21:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:21:31 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85cd044-e37c-4311-a155-eb6a55538e06]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:21:31 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:21:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:21:31 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:21:31 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8f5576-5833-4697-973e-b5e59a711ed3]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:21:31 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 (non-flash)
Nov 28 11:21:31 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:21:31 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 (non-flash)
Nov 28 11:21:31 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:21:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:21:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:21:31 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57330ca-4a33-4ff2-b3a8-7bf0965b36e9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:21:31 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e, portal: 172.16.0.220,3260]
Nov 28 11:21:31 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e, portal: 172.16.0.220,3260] successful.
Nov 28 11:21:31 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:21:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:21:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.064s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:21:31 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e684a9f-c9d2-48c8-a6e7-f792cd92f236]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:21:31 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:21:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:21:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:21:31 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba3247f-6559-4fab-b49f-e07a83abaf20]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:21:31 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 (non-flash)
Nov 28 11:21:31 user nova-compute[74994]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e (non-flash)
Nov 28 11:21:31 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:21:31 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 (non-flash)
Nov 28 11:21:31 user nova-compute[74994]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e (non-flash)
Nov 28 11:21:31 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:21:31 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:21:31 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 11:21:31 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 11:21:31 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 11:21:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:21:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:21:31 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9178a656-4e02-438f-a9c4-5d6184acff9c]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:21:31 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 11:21:31 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SdPgbBtk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 11:21:32 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.388s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:21:32 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '23130353632643534', 'path': '/dev/sdc'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:21:32 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130353632643534', 'path': '/dev/sdc'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 11:21:32 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:21:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2072403257',display_name='tempest-TestVolumeBootPattern-server-2072403257',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2072403257',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb427b7927364726907d9e90ef9a578f',ramdisk_id='',reservation_id='r-vobolo67',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-169069415',owner_user_name='tempest-TestVolumeBootPattern-169069415-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:21:18Z,user_data=None,user_id='e1ebcd41891545f990e285b43c9eac90',uuid=d27176da-6eaf-4af6-9dc2-b0e9c558d465,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab4e1d53-9f9a-4500-a81f-a1c2192606cf", "address": "fa:16:3e:2e:01:06", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab4e1d53-9f", "ovs_interfaceid": "ab4e1d53-9f9a-4500-a81f-a1c2192606cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 11:21:32 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Converting VIF {"id": "ab4e1d53-9f9a-4500-a81f-a1c2192606cf", "address": "fa:16:3e:2e:01:06", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab4e1d53-9f", "ovs_interfaceid": "ab4e1d53-9f9a-4500-a81f-a1c2192606cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:21:32 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:01:06,bridge_name='br-int',has_traffic_filtering=True,id=ab4e1d53-9f9a-4500-a81f-a1c2192606cf,network=Network(2dad67e8-a656-4aa2-a2ed-f2875ee5e48a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab4e1d53-9f') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:21:32 user nova-compute[74994]: DEBUG nova.objects.instance [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lazy-loading 'pci_devices' on Instance uuid d27176da-6eaf-4af6-9dc2-b0e9c558d465 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:21:32 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] End _get_guest_xml xml=<domain type="kvm">
Nov 28 11:21:32 user nova-compute[74994]:   <uuid>d27176da-6eaf-4af6-9dc2-b0e9c558d465</uuid>
Nov 28 11:21:32 user nova-compute[74994]:   <name>instance-0000002e</name>
Nov 28 11:21:32 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 11:21:32 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 11:21:32 user nova-compute[74994]:   <metadata>
Nov 28 11:21:32 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 11:21:32 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 11:21:32 user nova-compute[74994]:       <nova:name>tempest-TestVolumeBootPattern-server-2072403257</nova:name>
Nov 28 11:21:32 user nova-compute[74994]:       <nova:creationTime>2023-11-28 11:21:30</nova:creationTime>
Nov 28 11:21:32 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 11:21:32 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 11:21:32 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 11:21:32 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 11:21:32 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 11:21:32 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 11:21:32 user nova-compute[74994]:       </nova:flavor>
Nov 28 11:21:32 user nova-compute[74994]:       <nova:owner>
Nov 28 11:21:32 user nova-compute[74994]:         <nova:user uuid="e1ebcd41891545f990e285b43c9eac90">tempest-TestVolumeBootPattern-169069415-project-member</nova:user>
Nov 28 11:21:32 user nova-compute[74994]:         <nova:project uuid="cb427b7927364726907d9e90ef9a578f">tempest-TestVolumeBootPattern-169069415</nova:project>
Nov 28 11:21:32 user nova-compute[74994]:       </nova:owner>
Nov 28 11:21:32 user nova-compute[74994]:       <nova:ports>
Nov 28 11:21:32 user nova-compute[74994]:         <nova:port uuid="ab4e1d53-9f9a-4500-a81f-a1c2192606cf">
Nov 28 11:21:32 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 28 11:21:32 user nova-compute[74994]:         </nova:port>
Nov 28 11:21:32 user nova-compute[74994]:       </nova:ports>
Nov 28 11:21:32 user nova-compute[74994]:     </nova:instance>
Nov 28 11:21:32 user nova-compute[74994]:   </metadata>
Nov 28 11:21:32 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 11:21:32 user nova-compute[74994]:     <system>
Nov 28 11:21:32 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 11:21:32 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 11:21:32 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 11:21:32 user nova-compute[74994]:       <entry name="serial">d27176da-6eaf-4af6-9dc2-b0e9c558d465</entry>
Nov 28 11:21:32 user nova-compute[74994]:       <entry name="uuid">d27176da-6eaf-4af6-9dc2-b0e9c558d465</entry>
Nov 28 11:21:32 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 11:21:32 user nova-compute[74994]:     </system>
Nov 28 11:21:32 user nova-compute[74994]:   </sysinfo>
Nov 28 11:21:32 user nova-compute[74994]:   <os>
Nov 28 11:21:32 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 11:21:32 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 11:21:32 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 11:21:32 user nova-compute[74994]:   </os>
Nov 28 11:21:32 user nova-compute[74994]:   <features>
Nov 28 11:21:32 user nova-compute[74994]:     <acpi/>
Nov 28 11:21:32 user nova-compute[74994]:     <apic/>
Nov 28 11:21:32 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 11:21:32 user nova-compute[74994]:   </features>
Nov 28 11:21:32 user nova-compute[74994]:   <clock offset="utc">
Nov 28 11:21:32 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 11:21:32 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 11:21:32 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 11:21:32 user nova-compute[74994]:   </clock>
Nov 28 11:21:32 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 11:21:32 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 11:21:32 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 11:21:32 user nova-compute[74994]:   </cpu>
Nov 28 11:21:32 user nova-compute[74994]:   <devices>
Nov 28 11:21:32 user nova-compute[74994]:     <disk type="block" device="disk">
Nov 28 11:21:32 user nova-compute[74994]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:21:32 user nova-compute[74994]:       <source dev="/dev/sdc"/>
Nov 28 11:21:32 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 11:21:32 user nova-compute[74994]:       <serial>0d320365-1b92-4e76-a126-8a0f6f9f6c8e</serial>
Nov 28 11:21:32 user nova-compute[74994]:     </disk>
Nov 28 11:21:32 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 11:21:32 user nova-compute[74994]:       <mac address="fa:16:3e:2e:01:06"/>
Nov 28 11:21:32 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:21:32 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 11:21:32 user nova-compute[74994]:       <target dev="tapab4e1d53-9f"/>
Nov 28 11:21:32 user nova-compute[74994]:     </interface>
Nov 28 11:21:32 user nova-compute[74994]:     <serial type="pty">
Nov 28 11:21:32 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/d27176da-6eaf-4af6-9dc2-b0e9c558d465/console.log" append="off"/>
Nov 28 11:21:32 user nova-compute[74994]:     </serial>
Nov 28 11:21:32 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 11:21:32 user nova-compute[74994]:     <video>
Nov 28 11:21:32 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:21:32 user nova-compute[74994]:     </video>
Nov 28 11:21:32 user nova-compute[74994]:     <rng model="virtio">
Nov 28 11:21:32 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 11:21:32 user nova-compute[74994]:     </rng>
Nov 28 11:21:32 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 11:21:32 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 11:21:32 user nova-compute[74994]:       <stats period="10"/>
Nov 28 11:21:32 user nova-compute[74994]:     </memballoon>
Nov 28 11:21:32 user nova-compute[74994]:   </devices>
Nov 28 11:21:32 user nova-compute[74994]: </domain>
Nov 28 11:21:32 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 11:21:32 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:21:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2072403257',display_name='tempest-TestVolumeBootPattern-server-2072403257',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2072403257',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb427b7927364726907d9e90ef9a578f',ramdisk_id='',reservation_id='r-vobolo67',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-169069415',owner_user_name='tempest-TestVolumeBootPattern-169069415-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:21:18Z,user_data=None,user_id='e1ebcd41891545f990e285b43c9eac90',uuid=d27176da-6eaf-4af6-9dc2-b0e9c558d465,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab4e1d53-9f9a-4500-a81f-a1c2192606cf", "address": "fa:16:3e:2e:01:06", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab4e1d53-9f", "ovs_interfaceid": "ab4e1d53-9f9a-4500-a81f-a1c2192606cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 11:21:32 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Converting VIF {"id": "ab4e1d53-9f9a-4500-a81f-a1c2192606cf", "address": "fa:16:3e:2e:01:06", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab4e1d53-9f", "ovs_interfaceid": "ab4e1d53-9f9a-4500-a81f-a1c2192606cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:21:32 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:01:06,bridge_name='br-int',has_traffic_filtering=True,id=ab4e1d53-9f9a-4500-a81f-a1c2192606cf,network=Network(2dad67e8-a656-4aa2-a2ed-f2875ee5e48a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab4e1d53-9f') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:21:32 user nova-compute[74994]: DEBUG os_vif [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:01:06,bridge_name='br-int',has_traffic_filtering=True,id=ab4e1d53-9f9a-4500-a81f-a1c2192606cf,network=Network(2dad67e8-a656-4aa2-a2ed-f2875ee5e48a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab4e1d53-9f') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 11:21:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:21:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 11:21:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '98e08c97-054b-5c64-a06f-41d0c533b0a1', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:21:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:21:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapab4e1d53-9f, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:21:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapab4e1d53-9f, col_values=(('qos', UUID('2c60bb3c-da7e-47b8-a208-44065b37e29d')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:21:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapab4e1d53-9f, col_values=(('external_ids', {'iface-id': 'ab4e1d53-9f9a-4500-a81f-a1c2192606cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:01:06', 'vm-uuid': 'd27176da-6eaf-4af6-9dc2-b0e9c558d465'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:21:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:21:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:32 user nova-compute[74994]: INFO os_vif [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:01:06,bridge_name='br-int',has_traffic_filtering=True,id=ab4e1d53-9f9a-4500-a81f-a1c2192606cf,network=Network(2dad67e8-a656-4aa2-a2ed-f2875ee5e48a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab4e1d53-9f')
Nov 28 11:21:32 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:21:32 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] No VIF found with MAC fa:16:3e:2e:01:06, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:21:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:33 user nova-compute[74994]: DEBUG nova.compute.manager [req-687f199e-bdf8-413f-b80b-39f12c963855 req-d7b16554-5e8c-49f6-b37a-df64506b69af service nova] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Received event network-vif-plugged-ab4e1d53-9f9a-4500-a81f-a1c2192606cf {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:21:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-687f199e-bdf8-413f-b80b-39f12c963855 req-d7b16554-5e8c-49f6-b37a-df64506b69af service nova] Acquiring lock "d27176da-6eaf-4af6-9dc2-b0e9c558d465-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:21:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-687f199e-bdf8-413f-b80b-39f12c963855 req-d7b16554-5e8c-49f6-b37a-df64506b69af service nova] Lock "d27176da-6eaf-4af6-9dc2-b0e9c558d465-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:21:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-687f199e-bdf8-413f-b80b-39f12c963855 req-d7b16554-5e8c-49f6-b37a-df64506b69af service nova] Lock "d27176da-6eaf-4af6-9dc2-b0e9c558d465-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:21:33 user nova-compute[74994]: DEBUG nova.compute.manager [req-687f199e-bdf8-413f-b80b-39f12c963855 req-d7b16554-5e8c-49f6-b37a-df64506b69af service nova] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] No waiting events found dispatching network-vif-plugged-ab4e1d53-9f9a-4500-a81f-a1c2192606cf {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:21:33 user nova-compute[74994]: WARNING nova.compute.manager [req-687f199e-bdf8-413f-b80b-39f12c963855 req-d7b16554-5e8c-49f6-b37a-df64506b69af service nova] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Received unexpected event network-vif-plugged-ab4e1d53-9f9a-4500-a81f-a1c2192606cf for instance with vm_state building and task_state spawning.
Nov 28 11:21:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:35 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:21:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:35 user nova-compute[74994]: DEBUG nova.compute.manager [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 11:21:35 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 11:21:35 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Instance spawned successfully.
Nov 28 11:21:35 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 11:21:35 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:21:35 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:21:35 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:21:35 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:21:35 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:21:35 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:21:35 user nova-compute[74994]: INFO nova.compute.manager [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Took 4.93 seconds to spawn the instance on the hypervisor.
Nov 28 11:21:35 user nova-compute[74994]: DEBUG nova.compute.manager [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 11:21:35 user nova-compute[74994]: INFO nova.compute.manager [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Took 18.20 seconds to build instance.
Nov 28 11:21:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-31728c08-458a-4a0e-a517-cfc39702b946 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "d27176da-6eaf-4af6-9dc2-b0e9c558d465" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.286s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:21:35 user nova-compute[74994]: DEBUG nova.compute.manager [req-32758c1b-3ecb-4829-98da-bd574f1e0cbe req-e79516b1-a35d-4d2e-8691-13919f6bda5e service nova] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Received event network-vif-plugged-ab4e1d53-9f9a-4500-a81f-a1c2192606cf {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:21:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-32758c1b-3ecb-4829-98da-bd574f1e0cbe req-e79516b1-a35d-4d2e-8691-13919f6bda5e service nova] Acquiring lock "d27176da-6eaf-4af6-9dc2-b0e9c558d465-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:21:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-32758c1b-3ecb-4829-98da-bd574f1e0cbe req-e79516b1-a35d-4d2e-8691-13919f6bda5e service nova] Lock "d27176da-6eaf-4af6-9dc2-b0e9c558d465-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:21:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-32758c1b-3ecb-4829-98da-bd574f1e0cbe req-e79516b1-a35d-4d2e-8691-13919f6bda5e service nova] Lock "d27176da-6eaf-4af6-9dc2-b0e9c558d465-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:21:35 user nova-compute[74994]: DEBUG nova.compute.manager [req-32758c1b-3ecb-4829-98da-bd574f1e0cbe req-e79516b1-a35d-4d2e-8691-13919f6bda5e service nova] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] No waiting events found dispatching network-vif-plugged-ab4e1d53-9f9a-4500-a81f-a1c2192606cf {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:21:35 user nova-compute[74994]: WARNING nova.compute.manager [req-32758c1b-3ecb-4829-98da-bd574f1e0cbe req-e79516b1-a35d-4d2e-8691-13919f6bda5e service nova] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Received unexpected event network-vif-plugged-ab4e1d53-9f9a-4500-a81f-a1c2192606cf for instance with vm_state active and task_state None.
Nov 28 11:21:36 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:21:37 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:38 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:21:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:41 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:21:41 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 11:21:41 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Rebuilding the list of instances to heal {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 11:21:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "refresh_cache-6b63060e-f38f-4dcd-b910-658cc37f3459" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:21:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquired lock "refresh_cache-6b63060e-f38f-4dcd-b910-658cc37f3459" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:21:41 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Forcefully refreshing network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 11:21:41 user nova-compute[74994]: DEBUG nova.objects.instance [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lazy-loading 'info_cache' on Instance uuid 6b63060e-f38f-4dcd-b910-658cc37f3459 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:21:41 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Updating instance_info_cache with network_info: [{"id": "dfed3798-5f85-494b-a5e1-f7908962c509", "address": "fa:16:3e:16:a7:ca", "network": {"id": "e60575fe-fd95-429e-ac43-9f2a9e6f80d8", "bridge": "br-int", "label": "tempest-TestShelveInstance-690233806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0899a40ec21f4580b01d0d8c4877055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfed3798-5f", "ovs_interfaceid": "dfed3798-5f85-494b-a5e1-f7908962c509", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:21:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Releasing lock "refresh_cache-6b63060e-f38f-4dcd-b910-658cc37f3459" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:21:41 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Updated the network info_cache for instance {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 11:21:41 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:21:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:42 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:21:44 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:21:45 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:21:47 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:21:57 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:22:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:22:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:22:02 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:22:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:22:07 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:22:12 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:22:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:22:22 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:22:27 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:22:30 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:22:30 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 11:22:30 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:22:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:22:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:22:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:22:30 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 11:22:30 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:22:30 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:22:30 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:22:30 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:22:30 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=8834MB free_disk=25.08233642578125GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 11:22:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:22:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:22:31 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 6b63060e-f38f-4dcd-b910-658cc37f3459 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:22:31 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance d27176da-6eaf-4af6-9dc2-b0e9c558d465 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:22:31 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 11:22:31 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 11:22:31 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:22:31 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:22:31 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 11:22:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.221s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:22:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:22:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:22:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:22:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:22:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:22:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:22:36 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:22:36 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:22:37 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:22:39 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:22:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:22:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:22:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:22:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:22:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:22:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:22:42 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:22:42 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 11:22:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "refresh_cache-d27176da-6eaf-4af6-9dc2-b0e9c558d465" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:22:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquired lock "refresh_cache-d27176da-6eaf-4af6-9dc2-b0e9c558d465" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:22:42 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Forcefully refreshing network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 11:22:42 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Updating instance_info_cache with network_info: [{"id": "ab4e1d53-9f9a-4500-a81f-a1c2192606cf", "address": "fa:16:3e:2e:01:06", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab4e1d53-9f", "ovs_interfaceid": "ab4e1d53-9f9a-4500-a81f-a1c2192606cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:22:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Releasing lock "refresh_cache-d27176da-6eaf-4af6-9dc2-b0e9c558d465" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:22:42 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Updated the network info_cache for instance {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 11:22:42 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:22:44 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:22:46 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:22:47 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:22:48 user nova-compute[74994]: DEBUG nova.compute.manager [req-4119c2cc-8aaa-48fa-af6b-15351331578f req-dfd0076d-2c20-44ed-a13b-4884a7a344b0 service nova] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Received event network-changed-dfed3798-5f85-494b-a5e1-f7908962c509 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:22:48 user nova-compute[74994]: DEBUG nova.compute.manager [req-4119c2cc-8aaa-48fa-af6b-15351331578f req-dfd0076d-2c20-44ed-a13b-4884a7a344b0 service nova] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Refreshing instance network info cache due to event network-changed-dfed3798-5f85-494b-a5e1-f7908962c509. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:22:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4119c2cc-8aaa-48fa-af6b-15351331578f req-dfd0076d-2c20-44ed-a13b-4884a7a344b0 service nova] Acquiring lock "refresh_cache-6b63060e-f38f-4dcd-b910-658cc37f3459" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:22:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4119c2cc-8aaa-48fa-af6b-15351331578f req-dfd0076d-2c20-44ed-a13b-4884a7a344b0 service nova] Acquired lock "refresh_cache-6b63060e-f38f-4dcd-b910-658cc37f3459" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:22:48 user nova-compute[74994]: DEBUG nova.network.neutron [req-4119c2cc-8aaa-48fa-af6b-15351331578f req-dfd0076d-2c20-44ed-a13b-4884a7a344b0 service nova] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Refreshing network info cache for port dfed3798-5f85-494b-a5e1-f7908962c509 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:22:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-35b17999-22dd-46ae-8ada-8eac7a7af8a8 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Acquiring lock "6b63060e-f38f-4dcd-b910-658cc37f3459" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:22:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-35b17999-22dd-46ae-8ada-8eac7a7af8a8 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Lock "6b63060e-f38f-4dcd-b910-658cc37f3459" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:22:49 user nova-compute[74994]: INFO nova.compute.manager [None req-35b17999-22dd-46ae-8ada-8eac7a7af8a8 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Shelve offloading
Nov 28 11:22:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:22:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:22:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:22:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:22:49 user nova-compute[74994]: DEBUG nova.compute.manager [req-9dbef9d4-8301-4608-97b3-eb6391edf96c req-571439e2-91ee-4cb2-8cc0-3e6337d80841 service nova] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Received event network-vif-unplugged-dfed3798-5f85-494b-a5e1-f7908962c509 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:22:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9dbef9d4-8301-4608-97b3-eb6391edf96c req-571439e2-91ee-4cb2-8cc0-3e6337d80841 service nova] Acquiring lock "6b63060e-f38f-4dcd-b910-658cc37f3459-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:22:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9dbef9d4-8301-4608-97b3-eb6391edf96c req-571439e2-91ee-4cb2-8cc0-3e6337d80841 service nova] Lock "6b63060e-f38f-4dcd-b910-658cc37f3459-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:22:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-9dbef9d4-8301-4608-97b3-eb6391edf96c req-571439e2-91ee-4cb2-8cc0-3e6337d80841 service nova] Lock "6b63060e-f38f-4dcd-b910-658cc37f3459-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:22:49 user nova-compute[74994]: DEBUG nova.compute.manager [req-9dbef9d4-8301-4608-97b3-eb6391edf96c req-571439e2-91ee-4cb2-8cc0-3e6337d80841 service nova] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] No waiting events found dispatching network-vif-unplugged-dfed3798-5f85-494b-a5e1-f7908962c509 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:22:49 user nova-compute[74994]: WARNING nova.compute.manager [req-9dbef9d4-8301-4608-97b3-eb6391edf96c req-571439e2-91ee-4cb2-8cc0-3e6337d80841 service nova] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Received unexpected event network-vif-unplugged-dfed3798-5f85-494b-a5e1-f7908962c509 for instance with vm_state active and task_state shelving.
Nov 28 11:22:50 user nova-compute[74994]: DEBUG nova.network.neutron [req-4119c2cc-8aaa-48fa-af6b-15351331578f req-dfd0076d-2c20-44ed-a13b-4884a7a344b0 service nova] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Updated VIF entry in instance network info cache for port dfed3798-5f85-494b-a5e1-f7908962c509. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:22:50 user nova-compute[74994]: DEBUG nova.network.neutron [req-4119c2cc-8aaa-48fa-af6b-15351331578f req-dfd0076d-2c20-44ed-a13b-4884a7a344b0 service nova] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Updating instance_info_cache with network_info: [{"id": "dfed3798-5f85-494b-a5e1-f7908962c509", "address": "fa:16:3e:16:a7:ca", "network": {"id": "e60575fe-fd95-429e-ac43-9f2a9e6f80d8", "bridge": "br-int", "label": "tempest-TestShelveInstance-690233806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0899a40ec21f4580b01d0d8c4877055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfed3798-5f", "ovs_interfaceid": "dfed3798-5f85-494b-a5e1-f7908962c509", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:22:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4119c2cc-8aaa-48fa-af6b-15351331578f req-dfd0076d-2c20-44ed-a13b-4884a7a344b0 service nova] Releasing lock "refresh_cache-6b63060e-f38f-4dcd-b910-658cc37f3459" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:22:50 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Instance destroyed successfully.
Nov 28 11:22:50 user nova-compute[74994]: DEBUG nova.compute.manager [None req-35b17999-22dd-46ae-8ada-8eac7a7af8a8 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 11:22:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-35b17999-22dd-46ae-8ada-8eac7a7af8a8 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Acquiring lock "refresh_cache-6b63060e-f38f-4dcd-b910-658cc37f3459" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:22:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-35b17999-22dd-46ae-8ada-8eac7a7af8a8 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Acquired lock "refresh_cache-6b63060e-f38f-4dcd-b910-658cc37f3459" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:22:50 user nova-compute[74994]: DEBUG nova.network.neutron [None req-35b17999-22dd-46ae-8ada-8eac7a7af8a8 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 11:22:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:22:50 user nova-compute[74994]: DEBUG nova.network.neutron [None req-35b17999-22dd-46ae-8ada-8eac7a7af8a8 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Updating instance_info_cache with network_info: [{"id": "dfed3798-5f85-494b-a5e1-f7908962c509", "address": "fa:16:3e:16:a7:ca", "network": {"id": "e60575fe-fd95-429e-ac43-9f2a9e6f80d8", "bridge": "br-int", "label": "tempest-TestShelveInstance-690233806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0899a40ec21f4580b01d0d8c4877055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfed3798-5f", "ovs_interfaceid": "dfed3798-5f85-494b-a5e1-f7908962c509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:22:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-35b17999-22dd-46ae-8ada-8eac7a7af8a8 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Releasing lock "refresh_cache-6b63060e-f38f-4dcd-b910-658cc37f3459" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:22:51 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Instance destroyed successfully.
Nov 28 11:22:51 user nova-compute[74994]: DEBUG nova.objects.instance [None req-35b17999-22dd-46ae-8ada-8eac7a7af8a8 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Lazy-loading 'resources' on Instance uuid 6b63060e-f38f-4dcd-b910-658cc37f3459 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-35b17999-22dd-46ae-8ada-8eac7a7af8a8 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:20:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1828007530',display_name='tempest-TestShelveInstance-server-1828007530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1828007530',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNF3fUpHEM9VeUq49aQapE8hfGQV0VLJSuoH3NotavqxAsyK1aFpgQcoCCirfFZKXWtvJIjbZcDU6F/Puy3MFxxr6NPdA3FHU53qC+0UMjSnIm5FnYd8bXwipVNVqJl98A==',key_name='tempest-TestShelveInstance-1222425401',keypairs=<?>,launch_index=0,launched_at=2023-11-28T11:21:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0899a40ec21f4580b01d0d8c4877055b',ramdisk_id='',reservation_id='r-fcuz0brj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-959893651',owner_user_name='tempest-TestShelveInstance-959893651-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T11:21:10Z,user_data=None,user_id='511f425eb2a144338610e88e161fe857',uuid=6b63060e-f38f-4dcd-b910-658cc37f3459,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfed3798-5f85-494b-a5e1-f7908962c509", "address": "fa:16:3e:16:a7:ca", "network": {"id": "e60575fe-fd95-429e-ac43-9f2a9e6f80d8", "bridge": "br-int", "label": "tempest-TestShelveInstance-690233806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0899a40ec21f4580b01d0d8c4877055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfed3798-5f", "ovs_interfaceid": "dfed3798-5f85-494b-a5e1-f7908962c509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-35b17999-22dd-46ae-8ada-8eac7a7af8a8 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Converting VIF {"id": "dfed3798-5f85-494b-a5e1-f7908962c509", "address": "fa:16:3e:16:a7:ca", "network": {"id": "e60575fe-fd95-429e-ac43-9f2a9e6f80d8", "bridge": "br-int", "label": "tempest-TestShelveInstance-690233806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0899a40ec21f4580b01d0d8c4877055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfed3798-5f", "ovs_interfaceid": "dfed3798-5f85-494b-a5e1-f7908962c509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-35b17999-22dd-46ae-8ada-8eac7a7af8a8 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:a7:ca,bridge_name='br-int',has_traffic_filtering=True,id=dfed3798-5f85-494b-a5e1-f7908962c509,network=Network(e60575fe-fd95-429e-ac43-9f2a9e6f80d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfed3798-5f') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG os_vif [None req-35b17999-22dd-46ae-8ada-8eac7a7af8a8 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:a7:ca,bridge_name='br-int',has_traffic_filtering=True,id=dfed3798-5f85-494b-a5e1-f7908962c509,network=Network(e60575fe-fd95-429e-ac43-9f2a9e6f80d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfed3798-5f') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdfed3798-5f, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=949dce6a-de82-4e4a-93b8-90f937f95fdb) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG nova.compute.manager [req-fab36192-fbec-4f2f-8320-153feae76efc req-20b92eb2-e556-4ab3-91bb-e2a0df0ed962 service nova] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Received event network-changed-dfed3798-5f85-494b-a5e1-f7908962c509 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG nova.compute.manager [req-fab36192-fbec-4f2f-8320-153feae76efc req-20b92eb2-e556-4ab3-91bb-e2a0df0ed962 service nova] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Refreshing instance network info cache due to event network-changed-dfed3798-5f85-494b-a5e1-f7908962c509. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-fab36192-fbec-4f2f-8320-153feae76efc req-20b92eb2-e556-4ab3-91bb-e2a0df0ed962 service nova] Acquiring lock "refresh_cache-6b63060e-f38f-4dcd-b910-658cc37f3459" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-fab36192-fbec-4f2f-8320-153feae76efc req-20b92eb2-e556-4ab3-91bb-e2a0df0ed962 service nova] Acquired lock "refresh_cache-6b63060e-f38f-4dcd-b910-658cc37f3459" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG nova.network.neutron [req-fab36192-fbec-4f2f-8320-153feae76efc req-20b92eb2-e556-4ab3-91bb-e2a0df0ed962 service nova] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Refreshing network info cache for port dfed3798-5f85-494b-a5e1-f7908962c509 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:22:51 user nova-compute[74994]: INFO os_vif [None req-35b17999-22dd-46ae-8ada-8eac7a7af8a8 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:a7:ca,bridge_name='br-int',has_traffic_filtering=True,id=dfed3798-5f85-494b-a5e1-f7908962c509,network=Network(e60575fe-fd95-429e-ac43-9f2a9e6f80d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfed3798-5f')
Nov 28 11:22:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35b17999-22dd-46ae-8ada-8eac7a7af8a8 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b17999-22dd-46ae-8ada-8eac7a7af8a8 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GnYqVsvC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:22:51 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-35b17999-22dd-46ae-8ada-8eac7a7af8a8 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:22:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-35b17999-22dd-46ae-8ada-8eac7a7af8a8 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-35b17999-22dd-46ae-8ada-8eac7a7af8a8 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f82125b-1e1c-4ea3-b48b-eba16d7b7a8f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b17999-22dd-46ae-8ada-8eac7a7af8a8 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 11:22:51 user nova-compute[74994]: No targets found.
Nov 28 11:22:51 user nova-compute[74994]: iSNS:
Nov 28 11:22:51 user nova-compute[74994]: No targets found.
Nov 28 11:22:51 user nova-compute[74994]: STATIC:
Nov 28 11:22:51 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e
Nov 28 11:22:51 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:22:51 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:22:51 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84
Nov 28 11:22:51 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:22:51 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:22:51 user nova-compute[74994]: FIRMWARE:
Nov 28 11:22:51 user nova-compute[74994]: No targets found.
Nov 28 11:22:51 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b17999-22dd-46ae-8ada-8eac7a7af8a8 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 11:22:51 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 11:22:51 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b17999-22dd-46ae-8ada-8eac7a7af8a8 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a942d90-37cd-4482-b7d5-ec6c9a3e86fe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5d3263-6ab3-4e9f-965a-a3b73d339f38]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b17999-22dd-46ae-8ada-8eac7a7af8a8 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 (non-flash)
Nov 28 11:22:51 user nova-compute[74994]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e (non-flash)
Nov 28 11:22:51 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b17999-22dd-46ae-8ada-8eac7a7af8a8 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 (non-flash)
Nov 28 11:22:51 user nova-compute[74994]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e (non-flash)
Nov 28 11:22:51 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b17999-22dd-46ae-8ada-8eac7a7af8a8 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb920572950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84'): ({'sdb'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-35b17999-22dd-46ae-8ada-8eac7a7af8a8 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Removing single pathed devices sdb {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db0d88a-09e2-412a-a95b-d5fcf28e9dd6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[229b1d73-6e0b-4a8d-a288-69f05315b799]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-35b17999-22dd-46ae-8ada-8eac7a7af8a8 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Flushing IO for device /dev/sdb {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bfe4bb-2259-4ffa-b4c5-83c3d1bad39b]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-35b17999-22dd-46ae-8ada-8eac7a7af8a8 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7816485-ef02-4f0a-b5b6-a74a61cfc790]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-35b17999-22dd-46ae-8ada-8eac7a7af8a8 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-35b17999-22dd-46ae-8ada-8eac7a7af8a8 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] SCSI volumes sdb have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b17999-22dd-46ae-8ada-8eac7a7af8a8 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[10de6dff-1883-41f7-9030-3d9a40391efb]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b17999-22dd-46ae-8ada-8eac7a7af8a8 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[672f47e4-0fd2-4fa7-a0c7-b3abec6c6604]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b17999-22dd-46ae-8ada-8eac7a7af8a8 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84, portal: 172.16.0.220,3260]
Nov 28 11:22:51 user nova-compute[74994]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84, portal: 172.16.0.220,3260] successful.
Nov 28 11:22:51 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a427e4a1-4ad7-4dfe-90e6-23a8152a87b1]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b17999-22dd-46ae-8ada-8eac7a7af8a8 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-35b17999-22dd-46ae-8ada-8eac7a7af8a8 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b17999-22dd-46ae-8ada-8eac7a7af8a8 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] <== disconnect_volume: return (317ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35b17999-22dd-46ae-8ada-8eac7a7af8a8 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 11:22:51 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-35b17999-22dd-46ae-8ada-8eac7a7af8a8 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Deleting instance files /opt/stack/data/nova/instances/6b63060e-f38f-4dcd-b910-658cc37f3459_del
Nov 28 11:22:51 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-35b17999-22dd-46ae-8ada-8eac7a7af8a8 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Deletion of /opt/stack/data/nova/instances/6b63060e-f38f-4dcd-b910-658cc37f3459_del complete
Nov 28 11:22:51 user nova-compute[74994]: DEBUG nova.network.neutron [req-fab36192-fbec-4f2f-8320-153feae76efc req-20b92eb2-e556-4ab3-91bb-e2a0df0ed962 service nova] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Updated VIF entry in instance network info cache for port dfed3798-5f85-494b-a5e1-f7908962c509. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG nova.network.neutron [req-fab36192-fbec-4f2f-8320-153feae76efc req-20b92eb2-e556-4ab3-91bb-e2a0df0ed962 service nova] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Updating instance_info_cache with network_info: [{"id": "dfed3798-5f85-494b-a5e1-f7908962c509", "address": "fa:16:3e:16:a7:ca", "network": {"id": "e60575fe-fd95-429e-ac43-9f2a9e6f80d8", "bridge": null, "label": "tempest-TestShelveInstance-690233806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0899a40ec21f4580b01d0d8c4877055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapdfed3798-5f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-fab36192-fbec-4f2f-8320-153feae76efc req-20b92eb2-e556-4ab3-91bb-e2a0df0ed962 service nova] Releasing lock "refresh_cache-6b63060e-f38f-4dcd-b910-658cc37f3459" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG nova.compute.manager [req-231d3608-078a-4670-88cd-ff5f6ff3622a req-ecdd8f10-bc38-4705-83f7-39a165082ecd service nova] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Received event network-vif-plugged-dfed3798-5f85-494b-a5e1-f7908962c509 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-231d3608-078a-4670-88cd-ff5f6ff3622a req-ecdd8f10-bc38-4705-83f7-39a165082ecd service nova] Acquiring lock "6b63060e-f38f-4dcd-b910-658cc37f3459-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-231d3608-078a-4670-88cd-ff5f6ff3622a req-ecdd8f10-bc38-4705-83f7-39a165082ecd service nova] Lock "6b63060e-f38f-4dcd-b910-658cc37f3459-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-231d3608-078a-4670-88cd-ff5f6ff3622a req-ecdd8f10-bc38-4705-83f7-39a165082ecd service nova] Lock "6b63060e-f38f-4dcd-b910-658cc37f3459-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:22:51 user nova-compute[74994]: DEBUG nova.compute.manager [req-231d3608-078a-4670-88cd-ff5f6ff3622a req-ecdd8f10-bc38-4705-83f7-39a165082ecd service nova] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] No waiting events found dispatching network-vif-plugged-dfed3798-5f85-494b-a5e1-f7908962c509 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:22:51 user nova-compute[74994]: WARNING nova.compute.manager [req-231d3608-078a-4670-88cd-ff5f6ff3622a req-ecdd8f10-bc38-4705-83f7-39a165082ecd service nova] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Received unexpected event network-vif-plugged-dfed3798-5f85-494b-a5e1-f7908962c509 for instance with vm_state active and task_state shelving.
Nov 28 11:22:52 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-35b17999-22dd-46ae-8ada-8eac7a7af8a8 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Deleted allocations for instance 6b63060e-f38f-4dcd-b910-658cc37f3459
Nov 28 11:22:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-35b17999-22dd-46ae-8ada-8eac7a7af8a8 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:22:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-35b17999-22dd-46ae-8ada-8eac7a7af8a8 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:22:52 user nova-compute[74994]: DEBUG nova.objects.instance [None req-35b17999-22dd-46ae-8ada-8eac7a7af8a8 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Lazy-loading 'numa_topology' on Instance uuid 6b63060e-f38f-4dcd-b910-658cc37f3459 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:22:52 user nova-compute[74994]: DEBUG nova.objects.base [None req-35b17999-22dd-46ae-8ada-8eac7a7af8a8 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Object Instance<6b63060e-f38f-4dcd-b910-658cc37f3459> lazy-loaded attributes: resources,numa_topology {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 11:22:52 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-35b17999-22dd-46ae-8ada-8eac7a7af8a8 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:22:52 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-35b17999-22dd-46ae-8ada-8eac7a7af8a8 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:22:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-35b17999-22dd-46ae-8ada-8eac7a7af8a8 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.136s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:22:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-35b17999-22dd-46ae-8ada-8eac7a7af8a8 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Lock "6b63060e-f38f-4dcd-b910-658cc37f3459" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.420s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:22:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:22:56 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:23:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:23:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:23:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:23:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:23:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-160dfd93-a52b-4ee9-86b3-6a498ed08664 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "d27176da-6eaf-4af6-9dc2-b0e9c558d465" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:23:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-160dfd93-a52b-4ee9-86b3-6a498ed08664 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "d27176da-6eaf-4af6-9dc2-b0e9c558d465" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:23:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-160dfd93-a52b-4ee9-86b3-6a498ed08664 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "d27176da-6eaf-4af6-9dc2-b0e9c558d465-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:23:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-160dfd93-a52b-4ee9-86b3-6a498ed08664 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "d27176da-6eaf-4af6-9dc2-b0e9c558d465-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:23:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-160dfd93-a52b-4ee9-86b3-6a498ed08664 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "d27176da-6eaf-4af6-9dc2-b0e9c558d465-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:23:08 user nova-compute[74994]: INFO nova.compute.manager [None req-160dfd93-a52b-4ee9-86b3-6a498ed08664 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Terminating instance
Nov 28 11:23:08 user nova-compute[74994]: DEBUG nova.compute.manager [None req-160dfd93-a52b-4ee9-86b3-6a498ed08664 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 11:23:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:23:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:23:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:23:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:23:08 user nova-compute[74994]: DEBUG nova.compute.manager [req-91af232e-82e8-4f3e-ab27-3bf705c22ebd req-4abe5a1f-6500-4fdb-a05e-89b112f6c852 service nova] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Received event network-vif-unplugged-ab4e1d53-9f9a-4500-a81f-a1c2192606cf {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:23:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-91af232e-82e8-4f3e-ab27-3bf705c22ebd req-4abe5a1f-6500-4fdb-a05e-89b112f6c852 service nova] Acquiring lock "d27176da-6eaf-4af6-9dc2-b0e9c558d465-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:23:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-91af232e-82e8-4f3e-ab27-3bf705c22ebd req-4abe5a1f-6500-4fdb-a05e-89b112f6c852 service nova] Lock "d27176da-6eaf-4af6-9dc2-b0e9c558d465-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:23:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-91af232e-82e8-4f3e-ab27-3bf705c22ebd req-4abe5a1f-6500-4fdb-a05e-89b112f6c852 service nova] Lock "d27176da-6eaf-4af6-9dc2-b0e9c558d465-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:23:08 user nova-compute[74994]: DEBUG nova.compute.manager [req-91af232e-82e8-4f3e-ab27-3bf705c22ebd req-4abe5a1f-6500-4fdb-a05e-89b112f6c852 service nova] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] No waiting events found dispatching network-vif-unplugged-ab4e1d53-9f9a-4500-a81f-a1c2192606cf {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:23:08 user nova-compute[74994]: DEBUG nova.compute.manager [req-91af232e-82e8-4f3e-ab27-3bf705c22ebd req-4abe5a1f-6500-4fdb-a05e-89b112f6c852 service nova] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Received event network-vif-unplugged-ab4e1d53-9f9a-4500-a81f-a1c2192606cf for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 11:23:09 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Instance destroyed successfully.
Nov 28 11:23:09 user nova-compute[74994]: DEBUG nova.objects.instance [None req-160dfd93-a52b-4ee9-86b3-6a498ed08664 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lazy-loading 'resources' on Instance uuid d27176da-6eaf-4af6-9dc2-b0e9c558d465 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-160dfd93-a52b-4ee9-86b3-6a498ed08664 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:21:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2072403257',display_name='tempest-TestVolumeBootPattern-server-2072403257',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2072403257',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T11:21:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb427b7927364726907d9e90ef9a578f',ramdisk_id='',reservation_id='r-vobolo67',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-169069415',owner_user_name='tempest-TestVolumeBootPattern-169069415-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T11:21:36Z,user_data=None,user_id='e1ebcd41891545f990e285b43c9eac90',uuid=d27176da-6eaf-4af6-9dc2-b0e9c558d465,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab4e1d53-9f9a-4500-a81f-a1c2192606cf", "address": "fa:16:3e:2e:01:06", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab4e1d53-9f", "ovs_interfaceid": "ab4e1d53-9f9a-4500-a81f-a1c2192606cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-160dfd93-a52b-4ee9-86b3-6a498ed08664 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Converting VIF {"id": "ab4e1d53-9f9a-4500-a81f-a1c2192606cf", "address": "fa:16:3e:2e:01:06", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab4e1d53-9f", "ovs_interfaceid": "ab4e1d53-9f9a-4500-a81f-a1c2192606cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-160dfd93-a52b-4ee9-86b3-6a498ed08664 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:01:06,bridge_name='br-int',has_traffic_filtering=True,id=ab4e1d53-9f9a-4500-a81f-a1c2192606cf,network=Network(2dad67e8-a656-4aa2-a2ed-f2875ee5e48a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab4e1d53-9f') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG os_vif [None req-160dfd93-a52b-4ee9-86b3-6a498ed08664 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:01:06,bridge_name='br-int',has_traffic_filtering=True,id=ab4e1d53-9f9a-4500-a81f-a1c2192606cf,network=Network(2dad67e8-a656-4aa2-a2ed-f2875ee5e48a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab4e1d53-9f') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab4e1d53-9f, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2c60bb3c-da7e-47b8-a208-44065b37e29d) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:23:09 user nova-compute[74994]: INFO os_vif [None req-160dfd93-a52b-4ee9-86b3-6a498ed08664 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:01:06,bridge_name='br-int',has_traffic_filtering=True,id=ab4e1d53-9f9a-4500-a81f-a1c2192606cf,network=Network(2dad67e8-a656-4aa2-a2ed-f2875ee5e48a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab4e1d53-9f')
Nov 28 11:23:09 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-160dfd93-a52b-4ee9-86b3-6a498ed08664 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-160dfd93-a52b-4ee9-86b3-6a498ed08664 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SdPgbBtk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:23:09 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-160dfd93-a52b-4ee9-86b3-6a498ed08664 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:23:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-160dfd93-a52b-4ee9-86b3-6a498ed08664 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-160dfd93-a52b-4ee9-86b3-6a498ed08664 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[485230c3-edc2-43da-b65f-ba255af62a5d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-160dfd93-a52b-4ee9-86b3-6a498ed08664 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 11:23:09 user nova-compute[74994]: No targets found.
Nov 28 11:23:09 user nova-compute[74994]: iSNS:
Nov 28 11:23:09 user nova-compute[74994]: No targets found.
Nov 28 11:23:09 user nova-compute[74994]: STATIC:
Nov 28 11:23:09 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e
Nov 28 11:23:09 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:23:09 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:23:09 user nova-compute[74994]: FIRMWARE:
Nov 28 11:23:09 user nova-compute[74994]: No targets found.
Nov 28 11:23:09 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-160dfd93-a52b-4ee9-86b3-6a498ed08664 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 11:23:09 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 11:23:09 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-160dfd93-a52b-4ee9-86b3-6a498ed08664 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[297c6613-1970-4682-9846-23bb042247bc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ef9d7d-f71a-4445-bad3-71b2d9d36b7a]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-160dfd93-a52b-4ee9-86b3-6a498ed08664 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e (non-flash)
Nov 28 11:23:09 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-160dfd93-a52b-4ee9-86b3-6a498ed08664 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e (non-flash)
Nov 28 11:23:09 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-160dfd93-a52b-4ee9-86b3-6a498ed08664 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb920571000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e'): ({'sdc'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-160dfd93-a52b-4ee9-86b3-6a498ed08664 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Removing single pathed devices sdc {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b47b44-4b62-4ab0-9dbb-62f14024e89f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddeaed2-d7e3-4102-b338-7d1ea739316d]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-160dfd93-a52b-4ee9-86b3-6a498ed08664 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Flushing IO for device /dev/sdc {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e90c1d3-5fd4-49d2-87e0-884da550f346]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-160dfd93-a52b-4ee9-86b3-6a498ed08664 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a6cfa0-17c2-4536-823a-1ea10489896e]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-160dfd93-a52b-4ee9-86b3-6a498ed08664 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-160dfd93-a52b-4ee9-86b3-6a498ed08664 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] SCSI volumes sdc have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23130353632643534', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_50233b1c', '/dev/disk/by-id/scsi-1SCST_BIO50233b1c-10562d54ed3a32f9') {{(pid=86494) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 11:23:09 user nova-compute[74994]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23130353632643534
Nov 28 11:23:09 user nova-compute[74994]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_50233b1c
Nov 28 11:23:09 user nova-compute[74994]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO50233b1c-10562d54ed3a32f9
Nov 28 11:23:09 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0526da-8324-4f7c-bd06-86653c8db71b]: (4, None) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-160dfd93-a52b-4ee9-86b3-6a498ed08664 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5ff64a-84d3-4e2d-8271-90f43865b02c]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-160dfd93-a52b-4ee9-86b3-6a498ed08664 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e24317b-1300-4baa-9350-37d01fa6508f]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-160dfd93-a52b-4ee9-86b3-6a498ed08664 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e, portal: 172.16.0.220,3260]
Nov 28 11:23:09 user nova-compute[74994]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e, portal: 172.16.0.220,3260] successful.
Nov 28 11:23:09 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d320365-1b92-4e76-a126-8a0f6f9f6c8e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ea9430-94ce-4550-88e3-da7548707e4b]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-160dfd93-a52b-4ee9-86b3-6a498ed08664 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-160dfd93-a52b-4ee9-86b3-6a498ed08664 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-160dfd93-a52b-4ee9-86b3-6a498ed08664 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] <== disconnect_volume: return (330ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-160dfd93-a52b-4ee9-86b3-6a498ed08664 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 11:23:09 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-160dfd93-a52b-4ee9-86b3-6a498ed08664 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Deleting instance files /opt/stack/data/nova/instances/d27176da-6eaf-4af6-9dc2-b0e9c558d465_del
Nov 28 11:23:09 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-160dfd93-a52b-4ee9-86b3-6a498ed08664 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Deletion of /opt/stack/data/nova/instances/d27176da-6eaf-4af6-9dc2-b0e9c558d465_del complete
Nov 28 11:23:09 user nova-compute[74994]: INFO nova.compute.manager [None req-160dfd93-a52b-4ee9-86b3-6a498ed08664 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 28 11:23:09 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-160dfd93-a52b-4ee9-86b3-6a498ed08664 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:23:09 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:23:09 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Took 0.42 seconds to deallocate network for instance.
Nov 28 11:23:10 user nova-compute[74994]: DEBUG nova.compute.manager [req-4c5fa469-782c-44ce-92a1-07726ff83bb3 req-6b0ff719-fdb4-42da-b7c8-3c8c465d1d02 service nova] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Received event network-vif-plugged-ab4e1d53-9f9a-4500-a81f-a1c2192606cf {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:23:10 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4c5fa469-782c-44ce-92a1-07726ff83bb3 req-6b0ff719-fdb4-42da-b7c8-3c8c465d1d02 service nova] Acquiring lock "d27176da-6eaf-4af6-9dc2-b0e9c558d465-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:23:10 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4c5fa469-782c-44ce-92a1-07726ff83bb3 req-6b0ff719-fdb4-42da-b7c8-3c8c465d1d02 service nova] Lock "d27176da-6eaf-4af6-9dc2-b0e9c558d465-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:23:10 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4c5fa469-782c-44ce-92a1-07726ff83bb3 req-6b0ff719-fdb4-42da-b7c8-3c8c465d1d02 service nova] Lock "d27176da-6eaf-4af6-9dc2-b0e9c558d465-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:23:10 user nova-compute[74994]: DEBUG nova.compute.manager [req-4c5fa469-782c-44ce-92a1-07726ff83bb3 req-6b0ff719-fdb4-42da-b7c8-3c8c465d1d02 service nova] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] No waiting events found dispatching network-vif-plugged-ab4e1d53-9f9a-4500-a81f-a1c2192606cf {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:23:10 user nova-compute[74994]: WARNING nova.compute.manager [req-4c5fa469-782c-44ce-92a1-07726ff83bb3 req-6b0ff719-fdb4-42da-b7c8-3c8c465d1d02 service nova] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Received unexpected event network-vif-plugged-ab4e1d53-9f9a-4500-a81f-a1c2192606cf for instance with vm_state active and task_state deleting.
Nov 28 11:23:10 user nova-compute[74994]: DEBUG nova.compute.manager [req-4c5fa469-782c-44ce-92a1-07726ff83bb3 req-6b0ff719-fdb4-42da-b7c8-3c8c465d1d02 service nova] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Received event network-vif-deleted-ab4e1d53-9f9a-4500-a81f-a1c2192606cf {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:23:10 user nova-compute[74994]: INFO nova.compute.manager [None req-160dfd93-a52b-4ee9-86b3-6a498ed08664 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Took 0.78 seconds to detach 1 volumes for instance.
Nov 28 11:23:10 user nova-compute[74994]: DEBUG nova.compute.manager [None req-160dfd93-a52b-4ee9-86b3-6a498ed08664 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: d27176da-6eaf-4af6-9dc2-b0e9c558d465] Deleting volume: 0d320365-1b92-4e76-a126-8a0f6f9f6c8e {{(pid=74994) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 11:23:10 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-160dfd93-a52b-4ee9-86b3-6a498ed08664 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:23:10 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-160dfd93-a52b-4ee9-86b3-6a498ed08664 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:23:10 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-160dfd93-a52b-4ee9-86b3-6a498ed08664 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:23:10 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-160dfd93-a52b-4ee9-86b3-6a498ed08664 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:23:11 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-160dfd93-a52b-4ee9-86b3-6a498ed08664 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.174s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:23:11 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-160dfd93-a52b-4ee9-86b3-6a498ed08664 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Deleted allocations for instance d27176da-6eaf-4af6-9dc2-b0e9c558d465
Nov 28 11:23:11 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-160dfd93-a52b-4ee9-86b3-6a498ed08664 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "d27176da-6eaf-4af6-9dc2-b0e9c558d465" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.858s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:23:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:23:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:23:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:23:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:23:19 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:23:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:23:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:23:21 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:23:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:23:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:23:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Acquiring lock "c1d04dff-d786-4b78-9819-0f42437139a8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:23:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "c1d04dff-d786-4b78-9819-0f42437139a8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:23:26 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 11:23:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:23:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:23:26 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 11:23:26 user nova-compute[74994]: INFO nova.compute.claims [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Claim successful on node user
Nov 28 11:23:26 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:23:26 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:23:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.195s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:23:26 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 11:23:26 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 11:23:26 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 11:23:26 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 11:23:26 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 11:23:26 user nova-compute[74994]: DEBUG nova.policy [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad943d7c01a542fa82d9857bdb467069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd607facd2295407fa0d40510d8f1fae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 11:23:26 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 11:23:26 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 11:23:26 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Creating image(s)
Nov 28 11:23:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Acquiring lock "/opt/stack/data/nova/instances/c1d04dff-d786-4b78-9819-0f42437139a8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:23:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "/opt/stack/data/nova/instances/c1d04dff-d786-4b78-9819-0f42437139a8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:23:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "/opt/stack/data/nova/instances/c1d04dff-d786-4b78-9819-0f42437139a8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:23:26 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:23:26 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.177s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:23:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Acquiring lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:23:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:23:26 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:23:26 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.186s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:23:26 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/c1d04dff-d786-4b78-9819-0f42437139a8/disk 1073741824 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:23:26 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/c1d04dff-d786-4b78-9819-0f42437139a8/disk 1073741824" returned: 0 in 0.066s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:23:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:23:26 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:23:27 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Successfully created port: 5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 11:23:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.180s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:23:27 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c1d04dff-d786-4b78-9819-0f42437139a8/disk. size=1073741824 {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 11:23:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d04dff-d786-4b78-9819-0f42437139a8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:23:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d04dff-d786-4b78-9819-0f42437139a8/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:23:27 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Cannot resize image /opt/stack/data/nova/instances/c1d04dff-d786-4b78-9819-0f42437139a8/disk to a smaller size. {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 11:23:27 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Created local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 11:23:27 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Ensure instance console log exists: /opt/stack/data/nova/instances/c1d04dff-d786-4b78-9819-0f42437139a8/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 11:23:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:23:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:23:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:23:27 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Successfully updated port: 5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 11:23:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Acquiring lock "refresh_cache-c1d04dff-d786-4b78-9819-0f42437139a8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:23:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Acquired lock "refresh_cache-c1d04dff-d786-4b78-9819-0f42437139a8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:23:27 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 11:23:27 user nova-compute[74994]: DEBUG nova.compute.manager [req-47b23f21-69ba-4cfb-9cf5-94e07474d5f3 req-725adb10-ea9f-421f-9a7f-41cb1aa41167 service nova] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Received event network-changed-5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:23:27 user nova-compute[74994]: DEBUG nova.compute.manager [req-47b23f21-69ba-4cfb-9cf5-94e07474d5f3 req-725adb10-ea9f-421f-9a7f-41cb1aa41167 service nova] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Refreshing instance network info cache due to event network-changed-5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:23:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-47b23f21-69ba-4cfb-9cf5-94e07474d5f3 req-725adb10-ea9f-421f-9a7f-41cb1aa41167 service nova] Acquiring lock "refresh_cache-c1d04dff-d786-4b78-9819-0f42437139a8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:23:27 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 11:23:28 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Updating instance_info_cache with network_info: [{"id": "5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf", "address": "fa:16:3e:f8:72:17", "network": {"id": "5eb85013-4afd-42c4-888a-a3f1dd6d8798", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1182556685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d607facd2295407fa0d40510d8f1fae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc9dcd-ca", "ovs_interfaceid": "5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:23:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Releasing lock "refresh_cache-c1d04dff-d786-4b78-9819-0f42437139a8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:23:28 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Instance network_info: |[{"id": "5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf", "address": "fa:16:3e:f8:72:17", "network": {"id": "5eb85013-4afd-42c4-888a-a3f1dd6d8798", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1182556685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d607facd2295407fa0d40510d8f1fae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc9dcd-ca", "ovs_interfaceid": "5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 11:23:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-47b23f21-69ba-4cfb-9cf5-94e07474d5f3 req-725adb10-ea9f-421f-9a7f-41cb1aa41167 service nova] Acquired lock "refresh_cache-c1d04dff-d786-4b78-9819-0f42437139a8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:23:28 user nova-compute[74994]: DEBUG nova.network.neutron [req-47b23f21-69ba-4cfb-9cf5-94e07474d5f3 req-725adb10-ea9f-421f-9a7f-41cb1aa41167 service nova] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Refreshing network info cache for port 5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:23:28 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Start _get_guest_xml network_info=[{"id": "5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf", "address": "fa:16:3e:f8:72:17", "network": {"id": "5eb85013-4afd-42c4-888a-a3f1dd6d8798", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1182556685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d607facd2295407fa0d40510d8f1fae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc9dcd-ca", "ovs_interfaceid": "5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'aa939d1b-b8a6-4391-935b-0191bf5ccd0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 11:23:28 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:23:28 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:23:28 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 11:23:28 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 11:23:28 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 11:23:28 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 11:23:28 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 11:23:28 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 11:23:28 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 11:23:28 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 11:23:28 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 11:23:28 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 11:23:28 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 11:23:28 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 11:23:28 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 11:23:28 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 11:23:28 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 11:23:28 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 11:23:28 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:23:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-455108384',display_name='tempest-SnapshotDataIntegrityTests-server-455108384',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-455108384',id=47,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgLAQG0zJXXqz1Gd9d8gQTNQSpgaR6lu4v5qTYyzAFZgKtdZiv4LiE30qaclhjyLL5xyi9xEdNLFq9xTR7GTtMk5EoRmDQi+RfxbLjI9UbGb0ksuXGarikLWUpE9fzFhQ==',key_name='tempest-keypair-1190323180',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d607facd2295407fa0d40510d8f1fae4',ramdisk_id='',reservation_id='r-o2br9q7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-493673382',owner_user_name='tempest-SnapshotDataIntegrityTests-493673382-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:23:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad943d7c01a542fa82d9857bdb467069',uuid=c1d04dff-d786-4b78-9819-0f42437139a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf", "address": "fa:16:3e:f8:72:17", "network": {"id": "5eb85013-4afd-42c4-888a-a3f1dd6d8798", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1182556685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d607facd2295407fa0d40510d8f1fae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc9dcd-ca", "ovs_interfaceid": "5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 11:23:28 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Converting VIF {"id": "5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf", "address": "fa:16:3e:f8:72:17", "network": {"id": "5eb85013-4afd-42c4-888a-a3f1dd6d8798", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1182556685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d607facd2295407fa0d40510d8f1fae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc9dcd-ca", "ovs_interfaceid": "5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:23:28 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:72:17,bridge_name='br-int',has_traffic_filtering=True,id=5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf,network=Network(5eb85013-4afd-42c4-888a-a3f1dd6d8798),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bfc9dcd-ca') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:23:28 user nova-compute[74994]: DEBUG nova.objects.instance [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lazy-loading 'pci_devices' on Instance uuid c1d04dff-d786-4b78-9819-0f42437139a8 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:23:28 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] End _get_guest_xml xml=<domain type="kvm">
Nov 28 11:23:28 user nova-compute[74994]:   <uuid>c1d04dff-d786-4b78-9819-0f42437139a8</uuid>
Nov 28 11:23:28 user nova-compute[74994]:   <name>instance-0000002f</name>
Nov 28 11:23:28 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 11:23:28 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 11:23:28 user nova-compute[74994]:   <metadata>
Nov 28 11:23:28 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 11:23:28 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 11:23:28 user nova-compute[74994]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-455108384</nova:name>
Nov 28 11:23:28 user nova-compute[74994]:       <nova:creationTime>2023-11-28 11:23:28</nova:creationTime>
Nov 28 11:23:28 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 11:23:28 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 11:23:28 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 11:23:28 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 11:23:28 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 11:23:28 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 11:23:28 user nova-compute[74994]:       </nova:flavor>
Nov 28 11:23:28 user nova-compute[74994]:       <nova:owner>
Nov 28 11:23:28 user nova-compute[74994]:         <nova:user uuid="ad943d7c01a542fa82d9857bdb467069">tempest-SnapshotDataIntegrityTests-493673382-project-member</nova:user>
Nov 28 11:23:28 user nova-compute[74994]:         <nova:project uuid="d607facd2295407fa0d40510d8f1fae4">tempest-SnapshotDataIntegrityTests-493673382</nova:project>
Nov 28 11:23:28 user nova-compute[74994]:       </nova:owner>
Nov 28 11:23:28 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 11:23:28 user nova-compute[74994]:       <nova:ports>
Nov 28 11:23:28 user nova-compute[74994]:         <nova:port uuid="5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf">
Nov 28 11:23:28 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 11:23:28 user nova-compute[74994]:         </nova:port>
Nov 28 11:23:28 user nova-compute[74994]:       </nova:ports>
Nov 28 11:23:28 user nova-compute[74994]:     </nova:instance>
Nov 28 11:23:28 user nova-compute[74994]:   </metadata>
Nov 28 11:23:28 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 11:23:28 user nova-compute[74994]:     <system>
Nov 28 11:23:28 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 11:23:28 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 11:23:28 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 11:23:28 user nova-compute[74994]:       <entry name="serial">c1d04dff-d786-4b78-9819-0f42437139a8</entry>
Nov 28 11:23:28 user nova-compute[74994]:       <entry name="uuid">c1d04dff-d786-4b78-9819-0f42437139a8</entry>
Nov 28 11:23:28 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 11:23:28 user nova-compute[74994]:     </system>
Nov 28 11:23:28 user nova-compute[74994]:   </sysinfo>
Nov 28 11:23:28 user nova-compute[74994]:   <os>
Nov 28 11:23:28 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 11:23:28 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 11:23:28 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 11:23:28 user nova-compute[74994]:   </os>
Nov 28 11:23:28 user nova-compute[74994]:   <features>
Nov 28 11:23:28 user nova-compute[74994]:     <acpi/>
Nov 28 11:23:28 user nova-compute[74994]:     <apic/>
Nov 28 11:23:28 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 11:23:28 user nova-compute[74994]:   </features>
Nov 28 11:23:28 user nova-compute[74994]:   <clock offset="utc">
Nov 28 11:23:28 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 11:23:28 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 11:23:28 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 11:23:28 user nova-compute[74994]:   </clock>
Nov 28 11:23:28 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 11:23:28 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 11:23:28 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 11:23:28 user nova-compute[74994]:   </cpu>
Nov 28 11:23:28 user nova-compute[74994]:   <devices>
Nov 28 11:23:28 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 11:23:28 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 11:23:28 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/c1d04dff-d786-4b78-9819-0f42437139a8/disk"/>
Nov 28 11:23:28 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 11:23:28 user nova-compute[74994]:     </disk>
Nov 28 11:23:28 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 11:23:28 user nova-compute[74994]:       <mac address="fa:16:3e:f8:72:17"/>
Nov 28 11:23:28 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:23:28 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 11:23:28 user nova-compute[74994]:       <target dev="tap5bfc9dcd-ca"/>
Nov 28 11:23:28 user nova-compute[74994]:     </interface>
Nov 28 11:23:28 user nova-compute[74994]:     <serial type="pty">
Nov 28 11:23:28 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/c1d04dff-d786-4b78-9819-0f42437139a8/console.log" append="off"/>
Nov 28 11:23:28 user nova-compute[74994]:     </serial>
Nov 28 11:23:28 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 11:23:28 user nova-compute[74994]:     <video>
Nov 28 11:23:28 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:23:28 user nova-compute[74994]:     </video>
Nov 28 11:23:28 user nova-compute[74994]:     <rng model="virtio">
Nov 28 11:23:28 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 11:23:28 user nova-compute[74994]:     </rng>
Nov 28 11:23:28 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 11:23:28 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 11:23:28 user nova-compute[74994]:       <stats period="10"/>
Nov 28 11:23:28 user nova-compute[74994]:     </memballoon>
Nov 28 11:23:28 user nova-compute[74994]:   </devices>
Nov 28 11:23:28 user nova-compute[74994]: </domain>
Nov 28 11:23:28 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 11:23:28 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:23:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-455108384',display_name='tempest-SnapshotDataIntegrityTests-server-455108384',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-455108384',id=47,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgLAQG0zJXXqz1Gd9d8gQTNQSpgaR6lu4v5qTYyzAFZgKtdZiv4LiE30qaclhjyLL5xyi9xEdNLFq9xTR7GTtMk5EoRmDQi+RfxbLjI9UbGb0ksuXGarikLWUpE9fzFhQ==',key_name='tempest-keypair-1190323180',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d607facd2295407fa0d40510d8f1fae4',ramdisk_id='',reservation_id='r-o2br9q7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-493673382',owner_user_name='tempest-SnapshotDataIntegrityTests-493673382-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:23:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad943d7c01a542fa82d9857bdb467069',uuid=c1d04dff-d786-4b78-9819-0f42437139a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf", "address": "fa:16:3e:f8:72:17", "network": {"id": "5eb85013-4afd-42c4-888a-a3f1dd6d8798", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1182556685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d607facd2295407fa0d40510d8f1fae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc9dcd-ca", "ovs_interfaceid": "5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 11:23:28 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Converting VIF {"id": "5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf", "address": "fa:16:3e:f8:72:17", "network": {"id": "5eb85013-4afd-42c4-888a-a3f1dd6d8798", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1182556685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d607facd2295407fa0d40510d8f1fae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc9dcd-ca", "ovs_interfaceid": "5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:23:28 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:72:17,bridge_name='br-int',has_traffic_filtering=True,id=5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf,network=Network(5eb85013-4afd-42c4-888a-a3f1dd6d8798),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bfc9dcd-ca') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:23:28 user nova-compute[74994]: DEBUG os_vif [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:72:17,bridge_name='br-int',has_traffic_filtering=True,id=5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf,network=Network(5eb85013-4afd-42c4-888a-a3f1dd6d8798),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bfc9dcd-ca') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 11:23:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:23:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:23:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 11:23:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:23:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8c97027e-c404-5d56-ba92-7489088794e9', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:23:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:23:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:23:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:23:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5bfc9dcd-ca, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:23:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5bfc9dcd-ca, col_values=(('qos', UUID('add42d8a-83f8-4c88-b606-57d9d751a292')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:23:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5bfc9dcd-ca, col_values=(('external_ids', {'iface-id': '5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:72:17', 'vm-uuid': 'c1d04dff-d786-4b78-9819-0f42437139a8'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:23:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:23:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:23:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:23:28 user nova-compute[74994]: INFO os_vif [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:72:17,bridge_name='br-int',has_traffic_filtering=True,id=5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf,network=Network(5eb85013-4afd-42c4-888a-a3f1dd6d8798),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bfc9dcd-ca')
Nov 28 11:23:28 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:23:28 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] No VIF found with MAC fa:16:3e:f8:72:17, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:23:28 user nova-compute[74994]: DEBUG nova.network.neutron [req-47b23f21-69ba-4cfb-9cf5-94e07474d5f3 req-725adb10-ea9f-421f-9a7f-41cb1aa41167 service nova] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Updated VIF entry in instance network info cache for port 5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:23:28 user nova-compute[74994]: DEBUG nova.network.neutron [req-47b23f21-69ba-4cfb-9cf5-94e07474d5f3 req-725adb10-ea9f-421f-9a7f-41cb1aa41167 service nova] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Updating instance_info_cache with network_info: [{"id": "5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf", "address": "fa:16:3e:f8:72:17", "network": {"id": "5eb85013-4afd-42c4-888a-a3f1dd6d8798", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1182556685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d607facd2295407fa0d40510d8f1fae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc9dcd-ca", "ovs_interfaceid": "5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:23:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-47b23f21-69ba-4cfb-9cf5-94e07474d5f3 req-725adb10-ea9f-421f-9a7f-41cb1aa41167 service nova] Releasing lock "refresh_cache-c1d04dff-d786-4b78-9819-0f42437139a8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:23:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:23:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:23:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:23:29 user nova-compute[74994]: DEBUG nova.compute.manager [req-dae067e0-733f-49f6-922a-f6bb7402997b req-04efd910-7f6d-4153-96d2-137fc5bc7782 service nova] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Received event network-vif-plugged-5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:23:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-dae067e0-733f-49f6-922a-f6bb7402997b req-04efd910-7f6d-4153-96d2-137fc5bc7782 service nova] Acquiring lock "c1d04dff-d786-4b78-9819-0f42437139a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:23:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-dae067e0-733f-49f6-922a-f6bb7402997b req-04efd910-7f6d-4153-96d2-137fc5bc7782 service nova] Lock "c1d04dff-d786-4b78-9819-0f42437139a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:23:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-dae067e0-733f-49f6-922a-f6bb7402997b req-04efd910-7f6d-4153-96d2-137fc5bc7782 service nova] Lock "c1d04dff-d786-4b78-9819-0f42437139a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:23:29 user nova-compute[74994]: DEBUG nova.compute.manager [req-dae067e0-733f-49f6-922a-f6bb7402997b req-04efd910-7f6d-4153-96d2-137fc5bc7782 service nova] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] No waiting events found dispatching network-vif-plugged-5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:23:29 user nova-compute[74994]: WARNING nova.compute.manager [req-dae067e0-733f-49f6-922a-f6bb7402997b req-04efd910-7f6d-4153-96d2-137fc5bc7782 service nova] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Received unexpected event network-vif-plugged-5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf for instance with vm_state building and task_state spawning.
Nov 28 11:23:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:23:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:23:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:23:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:23:31 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:23:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:23:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:23:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:23:31 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 11:23:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d04dff-d786-4b78-9819-0f42437139a8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:23:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d04dff-d786-4b78-9819-0f42437139a8/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:23:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d04dff-d786-4b78-9819-0f42437139a8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:23:31 user nova-compute[74994]: DEBUG nova.compute.manager [req-0e0ef983-94a1-4b84-b5a4-ee581f8a97ac req-9e42a140-b510-413b-a2be-5761d760e66b service nova] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Received event network-vif-plugged-5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:23:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-0e0ef983-94a1-4b84-b5a4-ee581f8a97ac req-9e42a140-b510-413b-a2be-5761d760e66b service nova] Acquiring lock "c1d04dff-d786-4b78-9819-0f42437139a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:23:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-0e0ef983-94a1-4b84-b5a4-ee581f8a97ac req-9e42a140-b510-413b-a2be-5761d760e66b service nova] Lock "c1d04dff-d786-4b78-9819-0f42437139a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:23:31 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-0e0ef983-94a1-4b84-b5a4-ee581f8a97ac req-9e42a140-b510-413b-a2be-5761d760e66b service nova] Lock "c1d04dff-d786-4b78-9819-0f42437139a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:23:31 user nova-compute[74994]: DEBUG nova.compute.manager [req-0e0ef983-94a1-4b84-b5a4-ee581f8a97ac req-9e42a140-b510-413b-a2be-5761d760e66b service nova] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] No waiting events found dispatching network-vif-plugged-5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:23:31 user nova-compute[74994]: WARNING nova.compute.manager [req-0e0ef983-94a1-4b84-b5a4-ee581f8a97ac req-9e42a140-b510-413b-a2be-5761d760e66b service nova] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Received unexpected event network-vif-plugged-5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf for instance with vm_state building and task_state spawning.
Nov 28 11:23:31 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d04dff-d786-4b78-9819-0f42437139a8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:23:32 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 11:23:32 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 11:23:32 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:23:32 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:23:32 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=8996MB free_disk=25.070510864257812GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 11:23:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:23:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:23:32 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Instance spawned successfully.
Nov 28 11:23:32 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 11:23:32 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:23:32 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:23:32 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:23:32 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:23:32 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:23:32 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:23:32 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance c1d04dff-d786-4b78-9819-0f42437139a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:23:32 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 11:23:32 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 11:23:32 user nova-compute[74994]: INFO nova.compute.manager [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Took 5.90 seconds to spawn the instance on the hypervisor.
Nov 28 11:23:32 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 11:23:32 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:23:32 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:23:32 user nova-compute[74994]: INFO nova.compute.manager [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Took 6.43 seconds to build instance.
Nov 28 11:23:32 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 11:23:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.228s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:23:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8d6d4017-ee6f-44c6-ad32-380d4807e901 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "c1d04dff-d786-4b78-9819-0f42437139a8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.521s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:23:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:23:33 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:23:33 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 11:23:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:23:35 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:23:37 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:23:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:23:41 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:23:42 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:23:42 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 11:23:42 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Rebuilding the list of instances to heal {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 11:23:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "refresh_cache-c1d04dff-d786-4b78-9819-0f42437139a8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:23:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquired lock "refresh_cache-c1d04dff-d786-4b78-9819-0f42437139a8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:23:42 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Forcefully refreshing network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 11:23:42 user nova-compute[74994]: DEBUG nova.objects.instance [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lazy-loading 'info_cache' on Instance uuid c1d04dff-d786-4b78-9819-0f42437139a8 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:23:42 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Updating instance_info_cache with network_info: [{"id": "5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf", "address": "fa:16:3e:f8:72:17", "network": {"id": "5eb85013-4afd-42c4-888a-a3f1dd6d8798", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1182556685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d607facd2295407fa0d40510d8f1fae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc9dcd-ca", "ovs_interfaceid": "5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:23:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Releasing lock "refresh_cache-c1d04dff-d786-4b78-9819-0f42437139a8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:23:42 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Updated the network info_cache for instance {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 11:23:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:23:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:23:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:23:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:23:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:23:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:23:44 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:23:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:23:46 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:23:46 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:23:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:23:48 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:23:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:23:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:23:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:23:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:24:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:24:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:24:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:24:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:24:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:24:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:24:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:24:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:24:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:24:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "02d70aec-41a6-41bd-a826-1f7d31e1f78e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:24:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "02d70aec-41a6-41bd-a826-1f7d31e1f78e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:24:12 user nova-compute[74994]: DEBUG nova.compute.manager [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 11:24:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:24:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:24:12 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 11:24:12 user nova-compute[74994]: INFO nova.compute.claims [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Claim successful on node user
Nov 28 11:24:12 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:24:12 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:24:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.199s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:24:12 user nova-compute[74994]: DEBUG nova.compute.manager [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 11:24:12 user nova-compute[74994]: DEBUG nova.compute.manager [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 11:24:12 user nova-compute[74994]: DEBUG nova.network.neutron [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 11:24:12 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 11:24:12 user nova-compute[74994]: DEBUG nova.compute.manager [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 11:24:12 user nova-compute[74994]: DEBUG nova.policy [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e1ebcd41891545f990e285b43c9eac90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb427b7927364726907d9e90ef9a578f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 11:24:13 user nova-compute[74994]: INFO nova.virt.block_device [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Booting with volume 6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 at /dev/vda
Nov 28 11:24:13 user nova-compute[74994]: DEBUG os_brick.utils [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:24:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:24:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:24:13 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[88bc6ebc-d10e-42b9-bce7-bd36a5f5ed03]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:24:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:24:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:24:13 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c4276e-35dd-49eb-acdc-49475e11822b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:24:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:24:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:24:13 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85f8ba6-7e97-42c6-aff8-0d8723c6a3ec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:24:13 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a00de5f-e55f-474d-a3b3-8e3402dd95c5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:24:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:24:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:24:13 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 11:24:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:24:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:24:13 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 11:24:13 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7cbcfc8-2fae-4820-9e67-85879f86e9ed]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:24:13 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 11:24:13 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 11:24:13 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 11:24:13 user nova-compute[74994]: DEBUG os_brick.utils [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:24:13 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Updating existing volume attachment record: ecc66eda-db8d-4d98-8846-2a03054ee9b1 {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 11:24:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:24:13 user nova-compute[74994]: DEBUG nova.network.neutron [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Successfully created port: e2f8c784-e29d-4072-817e-6b741b90188c {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 11:24:14 user nova-compute[74994]: DEBUG nova.network.neutron [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Successfully updated port: e2f8c784-e29d-4072-817e-6b741b90188c {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 11:24:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "refresh_cache-02d70aec-41a6-41bd-a826-1f7d31e1f78e" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:24:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquired lock "refresh_cache-02d70aec-41a6-41bd-a826-1f7d31e1f78e" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:24:14 user nova-compute[74994]: DEBUG nova.network.neutron [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 11:24:14 user nova-compute[74994]: DEBUG nova.compute.manager [req-b76349f9-5e00-4aca-bc8c-295bfb335782 req-54fdf17e-ce68-4aff-9920-4c2e0e901412 service nova] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Received event network-changed-e2f8c784-e29d-4072-817e-6b741b90188c {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:24:14 user nova-compute[74994]: DEBUG nova.compute.manager [req-b76349f9-5e00-4aca-bc8c-295bfb335782 req-54fdf17e-ce68-4aff-9920-4c2e0e901412 service nova] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Refreshing instance network info cache due to event network-changed-e2f8c784-e29d-4072-817e-6b741b90188c. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:24:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-b76349f9-5e00-4aca-bc8c-295bfb335782 req-54fdf17e-ce68-4aff-9920-4c2e0e901412 service nova] Acquiring lock "refresh_cache-02d70aec-41a6-41bd-a826-1f7d31e1f78e" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:24:14 user nova-compute[74994]: DEBUG nova.network.neutron [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 11:24:14 user nova-compute[74994]: DEBUG nova.network.neutron [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Updating instance_info_cache with network_info: [{"id": "e2f8c784-e29d-4072-817e-6b741b90188c", "address": "fa:16:3e:54:9b:ac", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f8c784-e2", "ovs_interfaceid": "e2f8c784-e29d-4072-817e-6b741b90188c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:24:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Releasing lock "refresh_cache-02d70aec-41a6-41bd-a826-1f7d31e1f78e" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:24:14 user nova-compute[74994]: DEBUG nova.compute.manager [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Instance network_info: |[{"id": "e2f8c784-e29d-4072-817e-6b741b90188c", "address": "fa:16:3e:54:9b:ac", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f8c784-e2", "ovs_interfaceid": "e2f8c784-e29d-4072-817e-6b741b90188c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 11:24:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-b76349f9-5e00-4aca-bc8c-295bfb335782 req-54fdf17e-ce68-4aff-9920-4c2e0e901412 service nova] Acquired lock "refresh_cache-02d70aec-41a6-41bd-a826-1f7d31e1f78e" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:24:14 user nova-compute[74994]: DEBUG nova.network.neutron [req-b76349f9-5e00-4aca-bc8c-295bfb335782 req-54fdf17e-ce68-4aff-9920-4c2e0e901412 service nova] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Refreshing network info cache for port e2f8c784-e29d-4072-817e-6b741b90188c {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:24:15 user nova-compute[74994]: DEBUG nova.network.neutron [req-b76349f9-5e00-4aca-bc8c-295bfb335782 req-54fdf17e-ce68-4aff-9920-4c2e0e901412 service nova] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Updated VIF entry in instance network info cache for port e2f8c784-e29d-4072-817e-6b741b90188c. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:24:15 user nova-compute[74994]: DEBUG nova.network.neutron [req-b76349f9-5e00-4aca-bc8c-295bfb335782 req-54fdf17e-ce68-4aff-9920-4c2e0e901412 service nova] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Updating instance_info_cache with network_info: [{"id": "e2f8c784-e29d-4072-817e-6b741b90188c", "address": "fa:16:3e:54:9b:ac", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f8c784-e2", "ovs_interfaceid": "e2f8c784-e29d-4072-817e-6b741b90188c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:24:15 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-b76349f9-5e00-4aca-bc8c-295bfb335782 req-54fdf17e-ce68-4aff-9920-4c2e0e901412 service nova] Releasing lock "refresh_cache-02d70aec-41a6-41bd-a826-1f7d31e1f78e" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:24:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG nova.compute.manager [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 11:24:19 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Creating image(s)
Nov 28 11:24:19 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Did not create local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Ensure instance console log exists: /opt/stack/data/nova/instances/02d70aec-41a6-41bd-a826-1f7d31e1f78e/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Start _get_guest_xml network_info=[{"id": "e2f8c784-e29d-4072-817e-6b741b90188c", "address": "fa:16:3e:54:9b:ac", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f8c784-e2", "ovs_interfaceid": "e2f8c784-e29d-4072-817e-6b741b90188c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eRZbDukr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '02d70aec-41a6-41bd-a826-1f7d31e1f78e', 'attached_at': '', 'detached_at': '', 'volume_id': '6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5', 'serial': '6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5'}, 'attachment_id': 'ecc66eda-db8d-4d98-8846-2a03054ee9b1', 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 11:24:19 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:24:19 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:24:19 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eRZbDukr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:24:19 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:24:19 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:24:19 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:24:19 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:24:19 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 11:24:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd71c63-ce7c-491f-92e3-7924b0de23e3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 11:24:19 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[178dd172-faf2-42dc-885e-2420a5b41c36]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5] added
Nov 28 11:24:19 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a1c658-8705-4a12-bee2-fd6ba451818d]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[398da101-d971-4a2c-8a88-9afe0d070530]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eRZbDukr {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eRZbDukr" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd05d67-969e-4aa6-afd5-03389bf65ab1]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eRZbDukr'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b939b678-c134-4ad8-8959-2047b85b59f6]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6825e1-0f66-4a36-a3f1-8d91abea59b0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 11:24:19 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:24:19 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 11:24:19 user nova-compute[74994]:  {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:24:19 user nova-compute[74994]: WARNING os_brick.initiator.connectors.iscsi [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 11:24:19 user nova-compute[74994]: 
Nov 28 11:24:19 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:24:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:24:20 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[21be9d4c-b703-4ca9-a1bc-30b72a3b01f2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:24:20 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5, portal: 172.16.0.220,3260]
Nov 28 11:24:20 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5, portal: 172.16.0.220,3260] successful.
Nov 28 11:24:20 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:24:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:24:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:24:20 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d30545-abc7-4378-9241-a063d104e489]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:24:20 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:24:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:24:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:24:20 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d95c13-fd31-4e02-a3f5-0fb97f16c62f]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:24:20 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)
Nov 28 11:24:20 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:24:20 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)
Nov 28 11:24:20 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:24:20 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:24:20 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 11:24:20 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 11:24:20 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 11:24:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:24:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:24:20 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf632a7-30f6-46de-b70a-5c590c4314b0]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:24:20 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 11:24:20 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eRZbDukr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 11:24:21 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:24:21 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23835323765333865', 'path': '/dev/sdb'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:24:21 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835323765333865', 'path': '/dev/sdb'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 11:24:21 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:24:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-18128353',display_name='tempest-TestVolumeBootPattern-volume-backed-server-18128353',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-18128353',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTvbS+30IeAsvJmiTSMQ5tdHukOz2oPzRihG02M73B2wMzzjiivpAFNHC8a+YZFHJWALAMADi2LEjP4BQYZOwgNv1+qviqjkPHI6Uym2cGFlI9tqZMtIROxVOVkn+yujg==',key_name='tempest-keypair-97708266',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb427b7927364726907d9e90ef9a578f',ramdisk_id='',reservation_id='r-1nmm03xu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-169069415',owner_user_name='tempest-TestVolumeBootPattern-169069415-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:24:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1ebcd41891545f990e285b43c9eac90',uuid=02d70aec-41a6-41bd-a826-1f7d31e1f78e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2f8c784-e29d-4072-817e-6b741b90188c", "address": "fa:16:3e:54:9b:ac", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f8c784-e2", "ovs_interfaceid": "e2f8c784-e29d-4072-817e-6b741b90188c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 11:24:21 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Converting VIF {"id": "e2f8c784-e29d-4072-817e-6b741b90188c", "address": "fa:16:3e:54:9b:ac", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f8c784-e2", "ovs_interfaceid": "e2f8c784-e29d-4072-817e-6b741b90188c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:24:21 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:9b:ac,bridge_name='br-int',has_traffic_filtering=True,id=e2f8c784-e29d-4072-817e-6b741b90188c,network=Network(2dad67e8-a656-4aa2-a2ed-f2875ee5e48a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2f8c784-e2') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:24:21 user nova-compute[74994]: DEBUG nova.objects.instance [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lazy-loading 'pci_devices' on Instance uuid 02d70aec-41a6-41bd-a826-1f7d31e1f78e {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:24:21 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] End _get_guest_xml xml=<domain type="kvm">
Nov 28 11:24:21 user nova-compute[74994]:   <uuid>02d70aec-41a6-41bd-a826-1f7d31e1f78e</uuid>
Nov 28 11:24:21 user nova-compute[74994]:   <name>instance-00000030</name>
Nov 28 11:24:21 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 11:24:21 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 11:24:21 user nova-compute[74994]:   <metadata>
Nov 28 11:24:21 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 11:24:21 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 11:24:21 user nova-compute[74994]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-18128353</nova:name>
Nov 28 11:24:21 user nova-compute[74994]:       <nova:creationTime>2023-11-28 11:24:19</nova:creationTime>
Nov 28 11:24:21 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 11:24:21 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 11:24:21 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 11:24:21 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 11:24:21 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 11:24:21 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 11:24:21 user nova-compute[74994]:       </nova:flavor>
Nov 28 11:24:21 user nova-compute[74994]:       <nova:owner>
Nov 28 11:24:21 user nova-compute[74994]:         <nova:user uuid="e1ebcd41891545f990e285b43c9eac90">tempest-TestVolumeBootPattern-169069415-project-member</nova:user>
Nov 28 11:24:21 user nova-compute[74994]:         <nova:project uuid="cb427b7927364726907d9e90ef9a578f">tempest-TestVolumeBootPattern-169069415</nova:project>
Nov 28 11:24:21 user nova-compute[74994]:       </nova:owner>
Nov 28 11:24:21 user nova-compute[74994]:       <nova:ports>
Nov 28 11:24:21 user nova-compute[74994]:         <nova:port uuid="e2f8c784-e29d-4072-817e-6b741b90188c">
Nov 28 11:24:21 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 28 11:24:21 user nova-compute[74994]:         </nova:port>
Nov 28 11:24:21 user nova-compute[74994]:       </nova:ports>
Nov 28 11:24:21 user nova-compute[74994]:     </nova:instance>
Nov 28 11:24:21 user nova-compute[74994]:   </metadata>
Nov 28 11:24:21 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 11:24:21 user nova-compute[74994]:     <system>
Nov 28 11:24:21 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 11:24:21 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 11:24:21 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 11:24:21 user nova-compute[74994]:       <entry name="serial">02d70aec-41a6-41bd-a826-1f7d31e1f78e</entry>
Nov 28 11:24:21 user nova-compute[74994]:       <entry name="uuid">02d70aec-41a6-41bd-a826-1f7d31e1f78e</entry>
Nov 28 11:24:21 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 11:24:21 user nova-compute[74994]:     </system>
Nov 28 11:24:21 user nova-compute[74994]:   </sysinfo>
Nov 28 11:24:21 user nova-compute[74994]:   <os>
Nov 28 11:24:21 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 11:24:21 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 11:24:21 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 11:24:21 user nova-compute[74994]:   </os>
Nov 28 11:24:21 user nova-compute[74994]:   <features>
Nov 28 11:24:21 user nova-compute[74994]:     <acpi/>
Nov 28 11:24:21 user nova-compute[74994]:     <apic/>
Nov 28 11:24:21 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 11:24:21 user nova-compute[74994]:   </features>
Nov 28 11:24:21 user nova-compute[74994]:   <clock offset="utc">
Nov 28 11:24:21 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 11:24:21 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 11:24:21 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 11:24:21 user nova-compute[74994]:   </clock>
Nov 28 11:24:21 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 11:24:21 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 11:24:21 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 11:24:21 user nova-compute[74994]:   </cpu>
Nov 28 11:24:21 user nova-compute[74994]:   <devices>
Nov 28 11:24:21 user nova-compute[74994]:     <disk type="block" device="disk">
Nov 28 11:24:21 user nova-compute[74994]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:24:21 user nova-compute[74994]:       <source dev="/dev/sdb"/>
Nov 28 11:24:21 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 11:24:21 user nova-compute[74994]:       <serial>6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5</serial>
Nov 28 11:24:21 user nova-compute[74994]:     </disk>
Nov 28 11:24:21 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 11:24:21 user nova-compute[74994]:       <mac address="fa:16:3e:54:9b:ac"/>
Nov 28 11:24:21 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:24:21 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 11:24:21 user nova-compute[74994]:       <target dev="tape2f8c784-e2"/>
Nov 28 11:24:21 user nova-compute[74994]:     </interface>
Nov 28 11:24:21 user nova-compute[74994]:     <serial type="pty">
Nov 28 11:24:21 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/02d70aec-41a6-41bd-a826-1f7d31e1f78e/console.log" append="off"/>
Nov 28 11:24:21 user nova-compute[74994]:     </serial>
Nov 28 11:24:21 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 11:24:21 user nova-compute[74994]:     <video>
Nov 28 11:24:21 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:24:21 user nova-compute[74994]:     </video>
Nov 28 11:24:21 user nova-compute[74994]:     <rng model="virtio">
Nov 28 11:24:21 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 11:24:21 user nova-compute[74994]:     </rng>
Nov 28 11:24:21 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 11:24:21 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 11:24:21 user nova-compute[74994]:       <stats period="10"/>
Nov 28 11:24:21 user nova-compute[74994]:     </memballoon>
Nov 28 11:24:21 user nova-compute[74994]:   </devices>
Nov 28 11:24:21 user nova-compute[74994]: </domain>
Nov 28 11:24:21 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 11:24:21 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:24:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-18128353',display_name='tempest-TestVolumeBootPattern-volume-backed-server-18128353',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-18128353',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTvbS+30IeAsvJmiTSMQ5tdHukOz2oPzRihG02M73B2wMzzjiivpAFNHC8a+YZFHJWALAMADi2LEjP4BQYZOwgNv1+qviqjkPHI6Uym2cGFlI9tqZMtIROxVOVkn+yujg==',key_name='tempest-keypair-97708266',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb427b7927364726907d9e90ef9a578f',ramdisk_id='',reservation_id='r-1nmm03xu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-169069415',owner_user_name='tempest-TestVolumeBootPattern-169069415-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:24:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1ebcd41891545f990e285b43c9eac90',uuid=02d70aec-41a6-41bd-a826-1f7d31e1f78e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2f8c784-e29d-4072-817e-6b741b90188c", "address": "fa:16:3e:54:9b:ac", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f8c784-e2", "ovs_interfaceid": "e2f8c784-e29d-4072-817e-6b741b90188c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 11:24:21 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Converting VIF {"id": "e2f8c784-e29d-4072-817e-6b741b90188c", "address": "fa:16:3e:54:9b:ac", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f8c784-e2", "ovs_interfaceid": "e2f8c784-e29d-4072-817e-6b741b90188c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:24:21 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:9b:ac,bridge_name='br-int',has_traffic_filtering=True,id=e2f8c784-e29d-4072-817e-6b741b90188c,network=Network(2dad67e8-a656-4aa2-a2ed-f2875ee5e48a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2f8c784-e2') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:24:21 user nova-compute[74994]: DEBUG os_vif [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:9b:ac,bridge_name='br-int',has_traffic_filtering=True,id=e2f8c784-e29d-4072-817e-6b741b90188c,network=Network(2dad67e8-a656-4aa2-a2ed-f2875ee5e48a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2f8c784-e2') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 11:24:21 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:24:21 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:24:21 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 11:24:21 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:24:21 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '751f4065-0ba9-52d0-8ace-68bfb9104265', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:24:21 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:24:21 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:24:21 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape2f8c784-e2, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:24:21 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape2f8c784-e2, col_values=(('qos', UUID('47e46757-9539-4596-9df9-356350737e13')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:24:21 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape2f8c784-e2, col_values=(('external_ids', {'iface-id': 'e2f8c784-e29d-4072-817e-6b741b90188c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:9b:ac', 'vm-uuid': '02d70aec-41a6-41bd-a826-1f7d31e1f78e'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:24:21 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:24:21 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:24:21 user nova-compute[74994]: INFO os_vif [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:9b:ac,bridge_name='br-int',has_traffic_filtering=True,id=e2f8c784-e29d-4072-817e-6b741b90188c,network=Network(2dad67e8-a656-4aa2-a2ed-f2875ee5e48a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2f8c784-e2')
Nov 28 11:24:21 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:24:21 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] No VIF found with MAC fa:16:3e:54:9b:ac, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:24:22 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:24:22 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:24:22 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:24:22 user nova-compute[74994]: DEBUG nova.compute.manager [req-44a57d2f-9538-4f49-9614-8921c96908f5 req-f5bde99d-1575-4e47-b3e1-fe84909537d9 service nova] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Received event network-vif-plugged-e2f8c784-e29d-4072-817e-6b741b90188c {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:24:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-44a57d2f-9538-4f49-9614-8921c96908f5 req-f5bde99d-1575-4e47-b3e1-fe84909537d9 service nova] Acquiring lock "02d70aec-41a6-41bd-a826-1f7d31e1f78e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:24:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-44a57d2f-9538-4f49-9614-8921c96908f5 req-f5bde99d-1575-4e47-b3e1-fe84909537d9 service nova] Lock "02d70aec-41a6-41bd-a826-1f7d31e1f78e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:24:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-44a57d2f-9538-4f49-9614-8921c96908f5 req-f5bde99d-1575-4e47-b3e1-fe84909537d9 service nova] Lock "02d70aec-41a6-41bd-a826-1f7d31e1f78e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:24:22 user nova-compute[74994]: DEBUG nova.compute.manager [req-44a57d2f-9538-4f49-9614-8921c96908f5 req-f5bde99d-1575-4e47-b3e1-fe84909537d9 service nova] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] No waiting events found dispatching network-vif-plugged-e2f8c784-e29d-4072-817e-6b741b90188c {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:24:22 user nova-compute[74994]: WARNING nova.compute.manager [req-44a57d2f-9538-4f49-9614-8921c96908f5 req-f5bde99d-1575-4e47-b3e1-fe84909537d9 service nova] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Received unexpected event network-vif-plugged-e2f8c784-e29d-4072-817e-6b741b90188c for instance with vm_state building and task_state spawning.
Nov 28 11:24:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:24:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:24:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:24:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:24:24 user nova-compute[74994]: DEBUG nova.compute.manager [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 11:24:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 11:24:24 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Instance spawned successfully.
Nov 28 11:24:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 11:24:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:24:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:24:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:24:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:24:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:24:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:24:24 user nova-compute[74994]: INFO nova.compute.manager [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Took 4.84 seconds to spawn the instance on the hypervisor.
Nov 28 11:24:24 user nova-compute[74994]: DEBUG nova.compute.manager [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 11:24:24 user nova-compute[74994]: DEBUG nova.compute.manager [req-27eae506-c60a-4b5c-9a02-9040c32b60aa req-eb5178c5-45e0-41d7-9b77-93a55f3274a3 service nova] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Received event network-vif-plugged-e2f8c784-e29d-4072-817e-6b741b90188c {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:24:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-27eae506-c60a-4b5c-9a02-9040c32b60aa req-eb5178c5-45e0-41d7-9b77-93a55f3274a3 service nova] Acquiring lock "02d70aec-41a6-41bd-a826-1f7d31e1f78e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:24:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-27eae506-c60a-4b5c-9a02-9040c32b60aa req-eb5178c5-45e0-41d7-9b77-93a55f3274a3 service nova] Lock "02d70aec-41a6-41bd-a826-1f7d31e1f78e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:24:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-27eae506-c60a-4b5c-9a02-9040c32b60aa req-eb5178c5-45e0-41d7-9b77-93a55f3274a3 service nova] Lock "02d70aec-41a6-41bd-a826-1f7d31e1f78e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:24:24 user nova-compute[74994]: DEBUG nova.compute.manager [req-27eae506-c60a-4b5c-9a02-9040c32b60aa req-eb5178c5-45e0-41d7-9b77-93a55f3274a3 service nova] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] No waiting events found dispatching network-vif-plugged-e2f8c784-e29d-4072-817e-6b741b90188c {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:24:24 user nova-compute[74994]: WARNING nova.compute.manager [req-27eae506-c60a-4b5c-9a02-9040c32b60aa req-eb5178c5-45e0-41d7-9b77-93a55f3274a3 service nova] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Received unexpected event network-vif-plugged-e2f8c784-e29d-4072-817e-6b741b90188c for instance with vm_state active and task_state None.
Nov 28 11:24:24 user nova-compute[74994]: INFO nova.compute.manager [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Took 12.11 seconds to build instance.
Nov 28 11:24:24 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-95a0c067-0e6d-422e-afa9-4ddd24476f4b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "02d70aec-41a6-41bd-a826-1f7d31e1f78e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.199s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:24:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:24:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:24:31 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:24:32 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:24:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:24:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:24:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:24:32 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 11:24:32 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:24:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d04dff-d786-4b78-9819-0f42437139a8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:24:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d04dff-d786-4b78-9819-0f42437139a8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:24:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d04dff-d786-4b78-9819-0f42437139a8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:24:32 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d04dff-d786-4b78-9819-0f42437139a8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:24:33 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:24:33 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:24:33 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=8752MB free_disk=25.04045867919922GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 11:24:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:24:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:24:33 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance c1d04dff-d786-4b78-9819-0f42437139a8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:24:33 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 02d70aec-41a6-41bd-a826-1f7d31e1f78e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:24:33 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 11:24:33 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 11:24:33 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:24:33 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:24:33 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 11:24:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.219s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:24:34 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:24:34 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 11:24:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:24:37 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:24:39 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:24:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:24:41 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:24:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Acquiring lock "6b63060e-f38f-4dcd-b910-658cc37f3459" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:24:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Lock "6b63060e-f38f-4dcd-b910-658cc37f3459" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:24:41 user nova-compute[74994]: INFO nova.compute.manager [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Unshelving
Nov 28 11:24:41 user nova-compute[74994]: INFO nova.virt.block_device [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Booting with volume c46047e2-c89a-4e1a-9a8a-140a3b747e84 at /dev/vda
Nov 28 11:24:41 user nova-compute[74994]: DEBUG os_brick.utils [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:24:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:24:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:24:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0cb3bc3-8abb-4365-b09a-a30070e5a81a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:24:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:24:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:24:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c701923-10a0-4b3f-829c-23a46dce15fd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:24:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:24:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:24:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3ae724-43cf-42fe-a4e4-19545358a130]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:24:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db2e3b2-2aa1-4dd6-88f1-4f7235450f64]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:24:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:24:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:24:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 11:24:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:24:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:24:41 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 11:24:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[15fe9267-2284-43d5-b725-451af7fdff71]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:24:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 11:24:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 11:24:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 11:24:41 user nova-compute[74994]: DEBUG os_brick.utils [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:24:41 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Updating existing volume attachment record: c393b05f-55e1-493f-9100-eebef5656466 {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 11:24:42 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:24:42 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 11:24:42 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Rebuilding the list of instances to heal {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 11:24:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "refresh_cache-c1d04dff-d786-4b78-9819-0f42437139a8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:24:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquired lock "refresh_cache-c1d04dff-d786-4b78-9819-0f42437139a8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:24:42 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Forcefully refreshing network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 11:24:42 user nova-compute[74994]: DEBUG nova.objects.instance [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lazy-loading 'info_cache' on Instance uuid c1d04dff-d786-4b78-9819-0f42437139a8 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:24:42 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Updating instance_info_cache with network_info: [{"id": "5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf", "address": "fa:16:3e:f8:72:17", "network": {"id": "5eb85013-4afd-42c4-888a-a3f1dd6d8798", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1182556685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d607facd2295407fa0d40510d8f1fae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc9dcd-ca", "ovs_interfaceid": "5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:24:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Releasing lock "refresh_cache-c1d04dff-d786-4b78-9819-0f42437139a8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:24:42 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Updated the network info_cache for instance {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 11:24:43 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:24:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:24:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:24:46 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:24:47 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:24:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:24:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:24:48 user nova-compute[74994]: DEBUG nova.objects.instance [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Lazy-loading 'pci_requests' on Instance uuid 6b63060e-f38f-4dcd-b910-658cc37f3459 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:24:48 user nova-compute[74994]: DEBUG nova.objects.instance [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Lazy-loading 'numa_topology' on Instance uuid 6b63060e-f38f-4dcd-b910-658cc37f3459 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:24:48 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 11:24:48 user nova-compute[74994]: INFO nova.compute.claims [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Claim successful on node user
Nov 28 11:24:48 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:24:48 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:24:48 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:24:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.261s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:24:48 user nova-compute[74994]: INFO nova.network.neutron [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Updating port dfed3798-5f85-494b-a5e1-f7908962c509 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 28 11:24:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Acquiring lock "refresh_cache-6b63060e-f38f-4dcd-b910-658cc37f3459" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:24:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Acquired lock "refresh_cache-6b63060e-f38f-4dcd-b910-658cc37f3459" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:24:49 user nova-compute[74994]: DEBUG nova.network.neutron [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 11:24:49 user nova-compute[74994]: DEBUG nova.compute.manager [req-7506fdae-8e04-4d94-a3c0-9f3e5e3289b4 req-8fe06435-142d-4122-bf50-1a6ef32ac4ec service nova] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Received event network-changed-dfed3798-5f85-494b-a5e1-f7908962c509 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:24:49 user nova-compute[74994]: DEBUG nova.compute.manager [req-7506fdae-8e04-4d94-a3c0-9f3e5e3289b4 req-8fe06435-142d-4122-bf50-1a6ef32ac4ec service nova] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Refreshing instance network info cache due to event network-changed-dfed3798-5f85-494b-a5e1-f7908962c509. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:24:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-7506fdae-8e04-4d94-a3c0-9f3e5e3289b4 req-8fe06435-142d-4122-bf50-1a6ef32ac4ec service nova] Acquiring lock "refresh_cache-6b63060e-f38f-4dcd-b910-658cc37f3459" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:24:49 user nova-compute[74994]: DEBUG nova.network.neutron [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Updating instance_info_cache with network_info: [{"id": "dfed3798-5f85-494b-a5e1-f7908962c509", "address": "fa:16:3e:16:a7:ca", "network": {"id": "e60575fe-fd95-429e-ac43-9f2a9e6f80d8", "bridge": "br-int", "label": "tempest-TestShelveInstance-690233806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0899a40ec21f4580b01d0d8c4877055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfed3798-5f", "ovs_interfaceid": "dfed3798-5f85-494b-a5e1-f7908962c509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:24:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Releasing lock "refresh_cache-6b63060e-f38f-4dcd-b910-658cc37f3459" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:24:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 11:24:49 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Creating image(s)
Nov 28 11:24:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Did not create local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 11:24:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Ensure instance console log exists: /opt/stack/data/nova/instances/6b63060e-f38f-4dcd-b910-658cc37f3459/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 11:24:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:24:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:24:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:24:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Start _get_guest_xml network_info=[{"id": "dfed3798-5f85-494b-a5e1-f7908962c509", "address": "fa:16:3e:16:a7:ca", "network": {"id": "e60575fe-fd95-429e-ac43-9f2a9e6f80d8", "bridge": "br-int", "label": "tempest-TestShelveInstance-690233806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0899a40ec21f4580b01d0d8c4877055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfed3798-5f", "ovs_interfaceid": "dfed3798-5f85-494b-a5e1-f7908962c509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GnYqVsvC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6b63060e-f38f-4dcd-b910-658cc37f3459', 'attached_at': '', 'detached_at': '', 'volume_id': 'c46047e2-c89a-4e1a-9a8a-140a3b747e84', 'serial': 'c46047e2-c89a-4e1a-9a8a-140a3b747e84'}, 'attachment_id': 'c393b05f-55e1-493f-9100-eebef5656466', 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 11:24:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-7506fdae-8e04-4d94-a3c0-9f3e5e3289b4 req-8fe06435-142d-4122-bf50-1a6ef32ac4ec service nova] Acquired lock "refresh_cache-6b63060e-f38f-4dcd-b910-658cc37f3459" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:24:49 user nova-compute[74994]: DEBUG nova.network.neutron [req-7506fdae-8e04-4d94-a3c0-9f3e5e3289b4 req-8fe06435-142d-4122-bf50-1a6ef32ac4ec service nova] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Refreshing network info cache for port dfed3798-5f85-494b-a5e1-f7908962c509 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:24:49 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:24:49 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:24:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 11:24:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 11:24:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 11:24:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 11:24:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 11:24:49 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 11:24:49 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 11:24:49 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 11:24:49 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 11:24:49 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 11:24:49 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 11:24:49 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 11:24:49 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 11:24:49 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 11:24:49 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 11:24:49 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 11:24:49 user nova-compute[74994]: DEBUG nova.objects.instance [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6b63060e-f38f-4dcd-b910-658cc37f3459 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:24:49 user nova-compute[74994]: DEBUG nova.objects.base [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Object Instance<6b63060e-f38f-4dcd-b910-658cc37f3459> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 11:24:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 11:24:49 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GnYqVsvC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:24:49 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:24:49 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:24:49 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:24:49 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:24:49 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:24:49 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:24:49 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 11:24:49 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:24:49 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:24:49 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[15da179d-e225-49a3-9cb8-4dbd7c0209dc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:24:49 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 11:24:49 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:24:49 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:24:49 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:24:49 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7652e6-2d37-4ece-b65d-91093afc3e40]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:24:49 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84] added
Nov 28 11:24:49 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:24:49 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:24:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:24:50 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9c4a92-3a41-4b1a-be82-5790f1a149b3]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:24:50 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:24:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:24:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:24:50 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c59331-9e94-47b0-afdb-8597112a6cf7]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:24:50 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:24:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GnYqVsvC {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:24:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GnYqVsvC" returned: 0 in 0.040s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:24:50 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e78681c-4620-4aaa-9478-f380e36d08c8]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:24:50 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GnYqVsvC'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:24:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:24:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:24:50 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5686d3bf-36f8-4706-b2c7-8190961f4260]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:24:50 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:24:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:24:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:24:50 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca70521f-3a78-4855-8229-2ea1e5d96b58]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:24:50 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)
Nov 28 11:24:50 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:24:50 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)
Nov 28 11:24:50 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:24:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:24:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:24:50 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5eb039-4111-4739-9722-009c438a2ace]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:24:50 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84, portal: 172.16.0.220,3260]
Nov 28 11:24:50 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84, portal: 172.16.0.220,3260] successful.
Nov 28 11:24:50 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:24:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:24:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:24:50 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3fd5ee-0597-4ce0-a1b5-2c686564a59d]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:24:50 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:24:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:24:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:24:50 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4faa9f55-8479-4d85-9387-4ff3df7fd8f1]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:24:50 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)
Nov 28 11:24:50 user nova-compute[74994]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 (non-flash)
Nov 28 11:24:50 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:24:50 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)
Nov 28 11:24:50 user nova-compute[74994]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 (non-flash)
Nov 28 11:24:50 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:24:50 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:24:50 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 11:24:50 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 11:24:50 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 11:24:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:24:50 user nova-compute[74994]: DEBUG nova.network.neutron [req-7506fdae-8e04-4d94-a3c0-9f3e5e3289b4 req-8fe06435-142d-4122-bf50-1a6ef32ac4ec service nova] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Updated VIF entry in instance network info cache for port dfed3798-5f85-494b-a5e1-f7908962c509. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:24:50 user nova-compute[74994]: DEBUG nova.network.neutron [req-7506fdae-8e04-4d94-a3c0-9f3e5e3289b4 req-8fe06435-142d-4122-bf50-1a6ef32ac4ec service nova] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Updating instance_info_cache with network_info: [{"id": "dfed3798-5f85-494b-a5e1-f7908962c509", "address": "fa:16:3e:16:a7:ca", "network": {"id": "e60575fe-fd95-429e-ac43-9f2a9e6f80d8", "bridge": "br-int", "label": "tempest-TestShelveInstance-690233806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0899a40ec21f4580b01d0d8c4877055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfed3798-5f", "ovs_interfaceid": "dfed3798-5f85-494b-a5e1-f7908962c509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:24:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:24:50 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[86935119-31e6-42cb-b13a-dd03782dced1]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:24:50 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: None {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 11:24:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-7506fdae-8e04-4d94-a3c0-9f3e5e3289b4 req-8fe06435-142d-4122-bf50-1a6ef32ac4ec service nova] Releasing lock "refresh_cache-6b63060e-f38f-4dcd-b910-658cc37f3459" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:24:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:24:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:24:51 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 11:24:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GnYqVsvC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 11:24:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:24:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23035386531343431', 'path': '/dev/sdc'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:24:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035386531343431', 'path': '/dev/sdc'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 11:24:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T11:20:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1828007530',display_name='tempest-TestShelveInstance-server-1828007530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1828007530',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1222425401',keypairs=<?>,launch_index=0,launched_at=2023-11-28T11:21:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0899a40ec21f4580b01d0d8c4877055b',ramdisk_id='',reservation_id='r-fcuz0brj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-959893651',owner_user_name='tempest-TestShelveInstance-959893651-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T11:24:41Z,user_data=None,user_id='511f425eb2a144338610e88e161fe857',uuid=6b63060e-f38f-4dcd-b910-658cc37f3459,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "dfed3798-5f85-494b-a5e1-f7908962c509", "address": "fa:16:3e:16:a7:ca", "network": {"id": "e60575fe-fd95-429e-ac43-9f2a9e6f80d8", "bridge": "br-int", "label": "tempest-TestShelveInstance-690233806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0899a40ec21f4580b01d0d8c4877055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfed3798-5f", "ovs_interfaceid": "dfed3798-5f85-494b-a5e1-f7908962c509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 11:24:51 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Converting VIF {"id": "dfed3798-5f85-494b-a5e1-f7908962c509", "address": "fa:16:3e:16:a7:ca", "network": {"id": "e60575fe-fd95-429e-ac43-9f2a9e6f80d8", "bridge": "br-int", "label": "tempest-TestShelveInstance-690233806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0899a40ec21f4580b01d0d8c4877055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfed3798-5f", "ovs_interfaceid": "dfed3798-5f85-494b-a5e1-f7908962c509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:24:51 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:a7:ca,bridge_name='br-int',has_traffic_filtering=True,id=dfed3798-5f85-494b-a5e1-f7908962c509,network=Network(e60575fe-fd95-429e-ac43-9f2a9e6f80d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfed3798-5f') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:24:51 user nova-compute[74994]: DEBUG nova.objects.instance [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Lazy-loading 'pci_devices' on Instance uuid 6b63060e-f38f-4dcd-b910-658cc37f3459 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:24:51 user nova-compute[74994]: DEBUG nova.objects.base [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Object Instance<6b63060e-f38f-4dcd-b910-658cc37f3459> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74994) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 11:24:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] End _get_guest_xml xml=<domain type="kvm">
Nov 28 11:24:51 user nova-compute[74994]:   <uuid>6b63060e-f38f-4dcd-b910-658cc37f3459</uuid>
Nov 28 11:24:51 user nova-compute[74994]:   <name>instance-0000002d</name>
Nov 28 11:24:51 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 11:24:51 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 11:24:51 user nova-compute[74994]:   <metadata>
Nov 28 11:24:51 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 11:24:51 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 11:24:51 user nova-compute[74994]:       <nova:name>tempest-TestShelveInstance-server-1828007530</nova:name>
Nov 28 11:24:51 user nova-compute[74994]:       <nova:creationTime>2023-11-28 11:24:49</nova:creationTime>
Nov 28 11:24:51 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 11:24:51 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 11:24:51 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 11:24:51 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 11:24:51 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 11:24:51 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 11:24:51 user nova-compute[74994]:       </nova:flavor>
Nov 28 11:24:51 user nova-compute[74994]:       <nova:owner>
Nov 28 11:24:51 user nova-compute[74994]:         <nova:user uuid="511f425eb2a144338610e88e161fe857">tempest-TestShelveInstance-959893651-project-member</nova:user>
Nov 28 11:24:51 user nova-compute[74994]:         <nova:project uuid="0899a40ec21f4580b01d0d8c4877055b">tempest-TestShelveInstance-959893651</nova:project>
Nov 28 11:24:51 user nova-compute[74994]:       </nova:owner>
Nov 28 11:24:51 user nova-compute[74994]:       <nova:ports>
Nov 28 11:24:51 user nova-compute[74994]:         <nova:port uuid="dfed3798-5f85-494b-a5e1-f7908962c509">
Nov 28 11:24:51 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 28 11:24:51 user nova-compute[74994]:         </nova:port>
Nov 28 11:24:51 user nova-compute[74994]:       </nova:ports>
Nov 28 11:24:51 user nova-compute[74994]:     </nova:instance>
Nov 28 11:24:51 user nova-compute[74994]:   </metadata>
Nov 28 11:24:51 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 11:24:51 user nova-compute[74994]:     <system>
Nov 28 11:24:51 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 11:24:51 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 11:24:51 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 11:24:51 user nova-compute[74994]:       <entry name="serial">6b63060e-f38f-4dcd-b910-658cc37f3459</entry>
Nov 28 11:24:51 user nova-compute[74994]:       <entry name="uuid">6b63060e-f38f-4dcd-b910-658cc37f3459</entry>
Nov 28 11:24:51 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 11:24:51 user nova-compute[74994]:     </system>
Nov 28 11:24:51 user nova-compute[74994]:   </sysinfo>
Nov 28 11:24:51 user nova-compute[74994]:   <os>
Nov 28 11:24:51 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 11:24:51 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 11:24:51 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 11:24:51 user nova-compute[74994]:   </os>
Nov 28 11:24:51 user nova-compute[74994]:   <features>
Nov 28 11:24:51 user nova-compute[74994]:     <acpi/>
Nov 28 11:24:51 user nova-compute[74994]:     <apic/>
Nov 28 11:24:51 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 11:24:51 user nova-compute[74994]:   </features>
Nov 28 11:24:51 user nova-compute[74994]:   <clock offset="utc">
Nov 28 11:24:51 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 11:24:51 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 11:24:51 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 11:24:51 user nova-compute[74994]:   </clock>
Nov 28 11:24:51 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 11:24:51 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 11:24:51 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 11:24:51 user nova-compute[74994]:   </cpu>
Nov 28 11:24:51 user nova-compute[74994]:   <devices>
Nov 28 11:24:51 user nova-compute[74994]:     <disk type="block" device="disk">
Nov 28 11:24:51 user nova-compute[74994]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:24:51 user nova-compute[74994]:       <source dev="/dev/sdc"/>
Nov 28 11:24:51 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 11:24:51 user nova-compute[74994]:       <serial>c46047e2-c89a-4e1a-9a8a-140a3b747e84</serial>
Nov 28 11:24:51 user nova-compute[74994]:     </disk>
Nov 28 11:24:51 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 11:24:51 user nova-compute[74994]:       <mac address="fa:16:3e:16:a7:ca"/>
Nov 28 11:24:51 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:24:51 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 11:24:51 user nova-compute[74994]:       <target dev="tapdfed3798-5f"/>
Nov 28 11:24:51 user nova-compute[74994]:     </interface>
Nov 28 11:24:51 user nova-compute[74994]:     <serial type="pty">
Nov 28 11:24:51 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/6b63060e-f38f-4dcd-b910-658cc37f3459/console.log" append="off"/>
Nov 28 11:24:51 user nova-compute[74994]:     </serial>
Nov 28 11:24:51 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 11:24:51 user nova-compute[74994]:     <video>
Nov 28 11:24:51 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:24:51 user nova-compute[74994]:     </video>
Nov 28 11:24:51 user nova-compute[74994]:     <rng model="virtio">
Nov 28 11:24:51 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 11:24:51 user nova-compute[74994]:     </rng>
Nov 28 11:24:51 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 11:24:51 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 11:24:51 user nova-compute[74994]:       <stats period="10"/>
Nov 28 11:24:51 user nova-compute[74994]:     </memballoon>
Nov 28 11:24:51 user nova-compute[74994]:   </devices>
Nov 28 11:24:51 user nova-compute[74994]: </domain>
Nov 28 11:24:51 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 11:24:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T11:20:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1828007530',display_name='tempest-TestShelveInstance-server-1828007530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1828007530',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1222425401',keypairs=<?>,launch_index=0,launched_at=2023-11-28T11:21:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0899a40ec21f4580b01d0d8c4877055b',ramdisk_id='',reservation_id='r-fcuz0brj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-959893651',owner_user_name='tempest-TestShelveInstance-959893651-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T11:24:41Z,user_data=None,user_id='511f425eb2a144338610e88e161fe857',uuid=6b63060e-f38f-4dcd-b910-658cc37f3459,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "dfed3798-5f85-494b-a5e1-f7908962c509", "address": "fa:16:3e:16:a7:ca", "network": {"id": "e60575fe-fd95-429e-ac43-9f2a9e6f80d8", "bridge": "br-int", "label": "tempest-TestShelveInstance-690233806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0899a40ec21f4580b01d0d8c4877055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfed3798-5f", "ovs_interfaceid": "dfed3798-5f85-494b-a5e1-f7908962c509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 11:24:51 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Converting VIF {"id": "dfed3798-5f85-494b-a5e1-f7908962c509", "address": "fa:16:3e:16:a7:ca", "network": {"id": "e60575fe-fd95-429e-ac43-9f2a9e6f80d8", "bridge": "br-int", "label": "tempest-TestShelveInstance-690233806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0899a40ec21f4580b01d0d8c4877055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfed3798-5f", "ovs_interfaceid": "dfed3798-5f85-494b-a5e1-f7908962c509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:24:51 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:a7:ca,bridge_name='br-int',has_traffic_filtering=True,id=dfed3798-5f85-494b-a5e1-f7908962c509,network=Network(e60575fe-fd95-429e-ac43-9f2a9e6f80d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfed3798-5f') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:24:51 user nova-compute[74994]: DEBUG os_vif [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:a7:ca,bridge_name='br-int',has_traffic_filtering=True,id=dfed3798-5f85-494b-a5e1-f7908962c509,network=Network(e60575fe-fd95-429e-ac43-9f2a9e6f80d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfed3798-5f') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 11:24:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:24:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:24:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 11:24:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:24:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ec1569ab-7f5a-51ef-bc72-ab1c4bf1200e', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:24:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:24:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:24:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdfed3798-5f, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:24:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdfed3798-5f, col_values=(('qos', UUID('5b3e0fab-31fe-47f2-ab7a-19827d87945d')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:24:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdfed3798-5f, col_values=(('external_ids', {'iface-id': 'dfed3798-5f85-494b-a5e1-f7908962c509', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:a7:ca', 'vm-uuid': '6b63060e-f38f-4dcd-b910-658cc37f3459'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:24:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:24:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:24:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:24:51 user nova-compute[74994]: INFO os_vif [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:a7:ca,bridge_name='br-int',has_traffic_filtering=True,id=dfed3798-5f85-494b-a5e1-f7908962c509,network=Network(e60575fe-fd95-429e-ac43-9f2a9e6f80d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfed3798-5f')
Nov 28 11:24:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:24:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] No VIF found with MAC fa:16:3e:16:a7:ca, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:24:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:24:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:24:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:24:53 user nova-compute[74994]: DEBUG nova.compute.manager [req-93cd6f8f-5868-4ec3-afb1-25bc38e88822 req-3af5f76e-2b3b-4933-8e88-7f0d09de8a7e service nova] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Received event network-vif-plugged-dfed3798-5f85-494b-a5e1-f7908962c509 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:24:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-93cd6f8f-5868-4ec3-afb1-25bc38e88822 req-3af5f76e-2b3b-4933-8e88-7f0d09de8a7e service nova] Acquiring lock "6b63060e-f38f-4dcd-b910-658cc37f3459-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:24:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-93cd6f8f-5868-4ec3-afb1-25bc38e88822 req-3af5f76e-2b3b-4933-8e88-7f0d09de8a7e service nova] Lock "6b63060e-f38f-4dcd-b910-658cc37f3459-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:24:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-93cd6f8f-5868-4ec3-afb1-25bc38e88822 req-3af5f76e-2b3b-4933-8e88-7f0d09de8a7e service nova] Lock "6b63060e-f38f-4dcd-b910-658cc37f3459-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:24:53 user nova-compute[74994]: DEBUG nova.compute.manager [req-93cd6f8f-5868-4ec3-afb1-25bc38e88822 req-3af5f76e-2b3b-4933-8e88-7f0d09de8a7e service nova] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] No waiting events found dispatching network-vif-plugged-dfed3798-5f85-494b-a5e1-f7908962c509 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:24:53 user nova-compute[74994]: WARNING nova.compute.manager [req-93cd6f8f-5868-4ec3-afb1-25bc38e88822 req-3af5f76e-2b3b-4933-8e88-7f0d09de8a7e service nova] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Received unexpected event network-vif-plugged-dfed3798-5f85-494b-a5e1-f7908962c509 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 28 11:24:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:24:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:24:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:24:54 user nova-compute[74994]: DEBUG nova.compute.manager [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 11:24:54 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 11:24:54 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Instance spawned successfully.
Nov 28 11:24:54 user nova-compute[74994]: DEBUG nova.compute.manager [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 11:24:54 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-b2ba6e8f-d0cd-48f1-ad49-784b85507ecb tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Lock "6b63060e-f38f-4dcd-b910-658cc37f3459" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 13.403s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:24:55 user nova-compute[74994]: DEBUG nova.compute.manager [req-ae1ccb92-fe43-4168-9990-d54ca9275fa9 req-201f3044-4b85-4281-9a63-9bebf83c552e service nova] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Received event network-vif-plugged-dfed3798-5f85-494b-a5e1-f7908962c509 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:24:55 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ae1ccb92-fe43-4168-9990-d54ca9275fa9 req-201f3044-4b85-4281-9a63-9bebf83c552e service nova] Acquiring lock "6b63060e-f38f-4dcd-b910-658cc37f3459-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:24:55 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ae1ccb92-fe43-4168-9990-d54ca9275fa9 req-201f3044-4b85-4281-9a63-9bebf83c552e service nova] Lock "6b63060e-f38f-4dcd-b910-658cc37f3459-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:24:55 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-ae1ccb92-fe43-4168-9990-d54ca9275fa9 req-201f3044-4b85-4281-9a63-9bebf83c552e service nova] Lock "6b63060e-f38f-4dcd-b910-658cc37f3459-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:24:55 user nova-compute[74994]: DEBUG nova.compute.manager [req-ae1ccb92-fe43-4168-9990-d54ca9275fa9 req-201f3044-4b85-4281-9a63-9bebf83c552e service nova] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] No waiting events found dispatching network-vif-plugged-dfed3798-5f85-494b-a5e1-f7908962c509 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:24:55 user nova-compute[74994]: WARNING nova.compute.manager [req-ae1ccb92-fe43-4168-9990-d54ca9275fa9 req-201f3044-4b85-4281-9a63-9bebf83c552e service nova] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Received unexpected event network-vif-plugged-dfed3798-5f85-494b-a5e1-f7908962c509 for instance with vm_state active and task_state None.
Nov 28 11:24:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:24:56 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:24:58 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:24:58 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:24:58 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:24:58 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:24:58 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:24:58 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:24:58 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:24:58 user nova-compute[74994]: DEBUG nova.virt.libvirt.imagecache [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Verify base images {{(pid=74994) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 28 11:24:58 user nova-compute[74994]: DEBUG nova.virt.libvirt.imagecache [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74994) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 28 11:24:58 user nova-compute[74994]: DEBUG nova.virt.libvirt.imagecache [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Image id aa939d1b-b8a6-4391-935b-0191bf5ccd0a yields fingerprint fcc7b97cf95477e9f0e51c56d710b3067ade2188 {{(pid=74994) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 28 11:24:58 user nova-compute[74994]: INFO nova.virt.libvirt.imagecache [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] image aa939d1b-b8a6-4391-935b-0191bf5ccd0a at (/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188): checking
Nov 28 11:24:58 user nova-compute[74994]: DEBUG nova.virt.libvirt.imagecache [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] image aa939d1b-b8a6-4391-935b-0191bf5ccd0a at (/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188): image is in use {{(pid=74994) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 28 11:24:58 user nova-compute[74994]: DEBUG nova.virt.libvirt.imagecache [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] c1d04dff-d786-4b78-9819-0f42437139a8 is a valid instance name {{(pid=74994) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 28 11:24:58 user nova-compute[74994]: DEBUG nova.virt.libvirt.imagecache [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] c1d04dff-d786-4b78-9819-0f42437139a8 has a disk file {{(pid=74994) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 28 11:24:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d04dff-d786-4b78-9819-0f42437139a8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:24:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d04dff-d786-4b78-9819-0f42437139a8/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:24:58 user nova-compute[74994]: DEBUG nova.virt.libvirt.imagecache [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance c1d04dff-d786-4b78-9819-0f42437139a8 is backed by fcc7b97cf95477e9f0e51c56d710b3067ade2188 {{(pid=74994) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 28 11:24:58 user nova-compute[74994]: DEBUG nova.virt.libvirt.imagecache [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] 02d70aec-41a6-41bd-a826-1f7d31e1f78e is a valid instance name {{(pid=74994) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 28 11:24:58 user nova-compute[74994]: DEBUG nova.virt.libvirt.imagecache [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] 6b63060e-f38f-4dcd-b910-658cc37f3459 is a valid instance name {{(pid=74994) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 28 11:24:58 user nova-compute[74994]: WARNING nova.virt.libvirt.imagecache [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Unknown base file: /opt/stack/data/nova/instances/_base/90726bcf004a6699817d06d6d5f3a981dee9e56d
Nov 28 11:24:58 user nova-compute[74994]: WARNING nova.virt.libvirt.imagecache [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Unknown base file: /opt/stack/data/nova/instances/_base/1305c9a31cb42b02e8c3b001610fd7605fbf07b7
Nov 28 11:24:58 user nova-compute[74994]: WARNING nova.virt.libvirt.imagecache [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Unknown base file: /opt/stack/data/nova/instances/_base/3d87999ed529ac500c57b9759f9e222d260301b8
Nov 28 11:24:58 user nova-compute[74994]: WARNING nova.virt.libvirt.imagecache [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c2724c25d66ad36d084e74acd2605267affa62a9
Nov 28 11:24:58 user nova-compute[74994]: WARNING nova.virt.libvirt.imagecache [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Unknown base file: /opt/stack/data/nova/instances/_base/03384d4bafba67c2645866d5a788a018f007d884
Nov 28 11:24:58 user nova-compute[74994]: WARNING nova.virt.libvirt.imagecache [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b7a97c095b68db6f6ac2e0065f45f5df1eb8abba
Nov 28 11:24:58 user nova-compute[74994]: WARNING nova.virt.libvirt.imagecache [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c51527eb498019fd71fa61da518af1eb3108284b
Nov 28 11:24:58 user nova-compute[74994]: WARNING nova.virt.libvirt.imagecache [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Unknown base file: /opt/stack/data/nova/instances/_base/33a2f7b22edd69dfc429c2b7a2481070f6fc69aa
Nov 28 11:24:58 user nova-compute[74994]: WARNING nova.virt.libvirt.imagecache [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Unknown base file: /opt/stack/data/nova/instances/_base/1fa91fbd8c27e3441a4523e04020c2c6709d43a5
Nov 28 11:24:58 user nova-compute[74994]: INFO nova.virt.libvirt.imagecache [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Active base files: /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188
Nov 28 11:24:58 user nova-compute[74994]: INFO nova.virt.libvirt.imagecache [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Removable base files: /opt/stack/data/nova/instances/_base/90726bcf004a6699817d06d6d5f3a981dee9e56d /opt/stack/data/nova/instances/_base/1305c9a31cb42b02e8c3b001610fd7605fbf07b7 /opt/stack/data/nova/instances/_base/3d87999ed529ac500c57b9759f9e222d260301b8 /opt/stack/data/nova/instances/_base/c2724c25d66ad36d084e74acd2605267affa62a9 /opt/stack/data/nova/instances/_base/03384d4bafba67c2645866d5a788a018f007d884 /opt/stack/data/nova/instances/_base/b7a97c095b68db6f6ac2e0065f45f5df1eb8abba /opt/stack/data/nova/instances/_base/c51527eb498019fd71fa61da518af1eb3108284b /opt/stack/data/nova/instances/_base/33a2f7b22edd69dfc429c2b7a2481070f6fc69aa /opt/stack/data/nova/instances/_base/1fa91fbd8c27e3441a4523e04020c2c6709d43a5
Nov 28 11:24:58 user nova-compute[74994]: INFO nova.virt.libvirt.imagecache [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/90726bcf004a6699817d06d6d5f3a981dee9e56d
Nov 28 11:24:58 user nova-compute[74994]: INFO nova.virt.libvirt.imagecache [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1305c9a31cb42b02e8c3b001610fd7605fbf07b7
Nov 28 11:24:58 user nova-compute[74994]: INFO nova.virt.libvirt.imagecache [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3d87999ed529ac500c57b9759f9e222d260301b8
Nov 28 11:24:58 user nova-compute[74994]: INFO nova.virt.libvirt.imagecache [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c2724c25d66ad36d084e74acd2605267affa62a9
Nov 28 11:24:58 user nova-compute[74994]: INFO nova.virt.libvirt.imagecache [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/03384d4bafba67c2645866d5a788a018f007d884
Nov 28 11:24:58 user nova-compute[74994]: INFO nova.virt.libvirt.imagecache [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b7a97c095b68db6f6ac2e0065f45f5df1eb8abba
Nov 28 11:24:58 user nova-compute[74994]: INFO nova.virt.libvirt.imagecache [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c51527eb498019fd71fa61da518af1eb3108284b
Nov 28 11:24:58 user nova-compute[74994]: INFO nova.virt.libvirt.imagecache [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/33a2f7b22edd69dfc429c2b7a2481070f6fc69aa
Nov 28 11:24:58 user nova-compute[74994]: INFO nova.virt.libvirt.imagecache [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1fa91fbd8c27e3441a4523e04020c2c6709d43a5
Nov 28 11:24:58 user nova-compute[74994]: DEBUG nova.virt.libvirt.imagecache [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Verification complete {{(pid=74994) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 28 11:24:58 user nova-compute[74994]: DEBUG nova.virt.libvirt.imagecache [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Verify swap images {{(pid=74994) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 28 11:24:58 user nova-compute[74994]: DEBUG nova.virt.libvirt.imagecache [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Verify ephemeral images {{(pid=74994) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 28 11:25:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:25:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:25:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:25:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:25:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:25:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:25:16 user nova-compute[74994]: DEBUG nova.compute.manager [req-3d3024e5-aaf3-4e3c-8c60-805e644f35ff req-8244999e-1501-482e-a3e1-0f75e990cb3c service nova] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Received event network-changed-5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:25:16 user nova-compute[74994]: DEBUG nova.compute.manager [req-3d3024e5-aaf3-4e3c-8c60-805e644f35ff req-8244999e-1501-482e-a3e1-0f75e990cb3c service nova] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Refreshing instance network info cache due to event network-changed-5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:25:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-3d3024e5-aaf3-4e3c-8c60-805e644f35ff req-8244999e-1501-482e-a3e1-0f75e990cb3c service nova] Acquiring lock "refresh_cache-c1d04dff-d786-4b78-9819-0f42437139a8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:25:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-3d3024e5-aaf3-4e3c-8c60-805e644f35ff req-8244999e-1501-482e-a3e1-0f75e990cb3c service nova] Acquired lock "refresh_cache-c1d04dff-d786-4b78-9819-0f42437139a8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:25:16 user nova-compute[74994]: DEBUG nova.network.neutron [req-3d3024e5-aaf3-4e3c-8c60-805e644f35ff req-8244999e-1501-482e-a3e1-0f75e990cb3c service nova] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Refreshing network info cache for port 5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:25:17 user nova-compute[74994]: DEBUG nova.network.neutron [req-3d3024e5-aaf3-4e3c-8c60-805e644f35ff req-8244999e-1501-482e-a3e1-0f75e990cb3c service nova] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Updated VIF entry in instance network info cache for port 5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:25:17 user nova-compute[74994]: DEBUG nova.network.neutron [req-3d3024e5-aaf3-4e3c-8c60-805e644f35ff req-8244999e-1501-482e-a3e1-0f75e990cb3c service nova] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Updating instance_info_cache with network_info: [{"id": "5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf", "address": "fa:16:3e:f8:72:17", "network": {"id": "5eb85013-4afd-42c4-888a-a3f1dd6d8798", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1182556685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d607facd2295407fa0d40510d8f1fae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc9dcd-ca", "ovs_interfaceid": "5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:25:17 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-3d3024e5-aaf3-4e3c-8c60-805e644f35ff req-8244999e-1501-482e-a3e1-0f75e990cb3c service nova] Releasing lock "refresh_cache-c1d04dff-d786-4b78-9819-0f42437139a8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:25:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Acquiring lock "c1d04dff-d786-4b78-9819-0f42437139a8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:25:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "c1d04dff-d786-4b78-9819-0f42437139a8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:25:20 user nova-compute[74994]: DEBUG nova.objects.instance [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lazy-loading 'flavor' on Instance uuid c1d04dff-d786-4b78-9819-0f42437139a8 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:25:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "c1d04dff-d786-4b78-9819-0f42437139a8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:25:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:25:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Acquiring lock "c1d04dff-d786-4b78-9819-0f42437139a8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:25:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "c1d04dff-d786-4b78-9819-0f42437139a8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:25:20 user nova-compute[74994]: INFO nova.compute.manager [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Attaching volume a4ece64e-026e-4cbd-8049-08355fe6afb7 to /dev/vdb
Nov 28 11:25:20 user nova-compute[74994]: DEBUG os_brick.utils [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:25:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:25:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:25:20 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36def5e-5d91-4e01-be4d-7f9446ec15c9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:25:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:25:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:25:20 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9802023e-1bb7-44f8-812e-85965befa6cb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:25:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:25:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:25:20 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da99e16-0e47-4734-95eb-624103065266]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:25:20 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e8b4bc-a551-4d87-8008-9afaf2e9102d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:25:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:25:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:25:20 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 11:25:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:25:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:25:20 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 11:25:20 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[88dfc628-1e5b-440d-9980-bd7563ee1dd3]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:25:20 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 11:25:20 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 11:25:20 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 11:25:20 user nova-compute[74994]: DEBUG os_brick.utils [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:25:20 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Updating existing volume attachment record: 6f461c67-b936-4aa2-96ac-a6e7c5067ff2 {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 11:25:21 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:25:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:25:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a4ece64e-026e-4cbd-8049-08355fe6afb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kMqYHVUF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:25:27 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:25:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:25:27 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:25:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4ece64e-026e-4cbd-8049-08355fe6afb7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4ece64e-026e-4cbd-8049-08355fe6afb7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:25:27 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 11:25:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4ece64e-026e-4cbd-8049-08355fe6afb7 -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4ece64e-026e-4cbd-8049-08355fe6afb7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0526b70-818e-4ffe-a254-e153a22fb128]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 11:25:27 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4ece64e-026e-4cbd-8049-08355fe6afb7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4ece64e-026e-4cbd-8049-08355fe6afb7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[13177b50-642d-4067-a33f-38848470a161]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4ece64e-026e-4cbd-8049-08355fe6afb7] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4ece64e-026e-4cbd-8049-08355fe6afb7] added
Nov 28 11:25:27 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4ece64e-026e-4cbd-8049-08355fe6afb7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4ece64e-026e-4cbd-8049-08355fe6afb7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd5f190-61e9-4aab-bf69-d3497179481e]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4ece64e-026e-4cbd-8049-08355fe6afb7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4ece64e-026e-4cbd-8049-08355fe6afb7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d07094-2d10-476d-a8bf-544b7e14a0ab]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4ece64e-026e-4cbd-8049-08355fe6afb7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kMqYHVUF {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4ece64e-026e-4cbd-8049-08355fe6afb7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kMqYHVUF" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe25cc7e-aa28-4e44-9184-5832a1173e12]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kMqYHVUF'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4ece64e-026e-4cbd-8049-08355fe6afb7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4ece64e-026e-4cbd-8049-08355fe6afb7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad80057a-9d65-47dc-8f25-fdbfc00ec4a9]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[17afdb0f-f8be-4543-9429-518c60c0abb8]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)
Nov 28 11:25:27 user nova-compute[74994]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 (non-flash)
Nov 28 11:25:27 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)
Nov 28 11:25:27 user nova-compute[74994]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 (non-flash)
Nov 28 11:25:27 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4ece64e-026e-4cbd-8049-08355fe6afb7 -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4ece64e-026e-4cbd-8049-08355fe6afb7 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c5a912-63c6-4574-a4b5-2b08fa045b55]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4ece64e-026e-4cbd-8049-08355fe6afb7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a4ece64e-026e-4cbd-8049-08355fe6afb7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4ece64e-026e-4cbd-8049-08355fe6afb7, portal: 172.16.0.220,3260]
Nov 28 11:25:27 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:a4ece64e-026e-4cbd-8049-08355fe6afb7, portal: 172.16.0.220,3260] successful.
Nov 28 11:25:27 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4ece64e-026e-4cbd-8049-08355fe6afb7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4ece64e-026e-4cbd-8049-08355fe6afb7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5536a8a2-fed7-4729-98e7-289b0c6e7358]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4c777f-1236-4db5-9111-1bbc954d2564]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ece64e-026e-4cbd-8049-08355fe6afb7 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)
Nov 28 11:25:27 user nova-compute[74994]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 (non-flash)
Nov 28 11:25:27 user nova-compute[74994]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ece64e-026e-4cbd-8049-08355fe6afb7 (non-flash)
Nov 28 11:25:27 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)
Nov 28 11:25:27 user nova-compute[74994]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 (non-flash)
Nov 28 11:25:27 user nova-compute[74994]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ece64e-026e-4cbd-8049-08355fe6afb7 (non-flash)
Nov 28 11:25:27 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4ece64e-026e-4cbd-8049-08355fe6afb7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] HCTL ('35', '-', '-', 0) found on session 55 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf88de2-15fd-4ddb-85a2-9bcb04930ba2]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Searching for a device in session 55 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 11:25:27 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a4ece64e-026e-4cbd-8049-08355fe6afb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kMqYHVUF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 11:25:28 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:25:28 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '26164646236663339', 'path': '/dev/sdd'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:25:28 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164646236663339', 'path': '/dev/sdd'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 11:25:28 user nova-compute[74994]: DEBUG nova.objects.instance [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lazy-loading 'flavor' on Instance uuid c1d04dff-d786-4b78-9819-0f42437139a8 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:25:28 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 11:25:28 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:25:28 user nova-compute[74994]:   <source dev="/dev/sdd"/>
Nov 28 11:25:28 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:25:28 user nova-compute[74994]:   <serial>a4ece64e-026e-4cbd-8049-08355fe6afb7</serial>
Nov 28 11:25:28 user nova-compute[74994]: </disk>
Nov 28 11:25:28 user nova-compute[74994]:  {{(pid=74994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 11:25:28 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:25:28 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:25:28 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] No VIF found with MAC fa:16:3e:f8:72:17, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:25:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-01efe2f9-b85d-4e05-9cfa-3cda7820450c tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "c1d04dff-d786-4b78-9819-0f42437139a8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.750s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:25:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:25:31 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:25:33 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:25:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:25:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:25:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:25:33 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 11:25:33 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:25:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d04dff-d786-4b78-9819-0f42437139a8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:25:34 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d04dff-d786-4b78-9819-0f42437139a8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:25:34 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d04dff-d786-4b78-9819-0f42437139a8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:25:34 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d04dff-d786-4b78-9819-0f42437139a8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:25:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:25:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:25:34 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:25:34 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:25:34 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=8683MB free_disk=25.038246154785156GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 11:25:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:25:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:25:34 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance c1d04dff-d786-4b78-9819-0f42437139a8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:25:34 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 02d70aec-41a6-41bd-a826-1f7d31e1f78e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:25:34 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 6b63060e-f38f-4dcd-b910-658cc37f3459 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:25:34 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 11:25:34 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 11:25:34 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Refreshing inventories for resource provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 11:25:34 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Updating ProviderTree inventory for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 11:25:34 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Updating inventory in ProviderTree for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 11:25:34 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Refreshing aggregate associations for resource provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a, aggregates: None {{(pid=74994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 11:25:34 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Refreshing trait associations for resource provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=74994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 11:25:35 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:25:35 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:25:35 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 11:25:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.485s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:25:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:25:35 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:25:35 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 11:25:35 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:25:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:25:37 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:25:37 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74994) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 11:25:38 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:25:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:25:41 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:25:41 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:25:42 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:25:42 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 11:25:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "refresh_cache-02d70aec-41a6-41bd-a826-1f7d31e1f78e" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:25:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquired lock "refresh_cache-02d70aec-41a6-41bd-a826-1f7d31e1f78e" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:25:42 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Forcefully refreshing network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 11:25:42 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Updating instance_info_cache with network_info: [{"id": "e2f8c784-e29d-4072-817e-6b741b90188c", "address": "fa:16:3e:54:9b:ac", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f8c784-e2", "ovs_interfaceid": "e2f8c784-e29d-4072-817e-6b741b90188c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:25:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Releasing lock "refresh_cache-02d70aec-41a6-41bd-a826-1f7d31e1f78e" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:25:42 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Updated the network info_cache for instance {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 11:25:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5dc76fb6-9b50-44f2-a559-5fea2631f116 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Acquiring lock "c1d04dff-d786-4b78-9819-0f42437139a8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:25:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5dc76fb6-9b50-44f2-a559-5fea2631f116 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "c1d04dff-d786-4b78-9819-0f42437139a8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:25:43 user nova-compute[74994]: INFO nova.compute.manager [None req-5dc76fb6-9b50-44f2-a559-5fea2631f116 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Detaching volume a4ece64e-026e-4cbd-8049-08355fe6afb7
Nov 28 11:25:43 user nova-compute[74994]: INFO nova.virt.block_device [None req-5dc76fb6-9b50-44f2-a559-5fea2631f116 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Attempting to driver detach volume a4ece64e-026e-4cbd-8049-08355fe6afb7 from mountpoint /dev/vdb
Nov 28 11:25:43 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-5dc76fb6-9b50-44f2-a559-5fea2631f116 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Attempting to detach device vdb from instance c1d04dff-d786-4b78-9819-0f42437139a8 from the persistent domain config. {{(pid=74994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 11:25:43 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-5dc76fb6-9b50-44f2-a559-5fea2631f116 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 11:25:43 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:25:43 user nova-compute[74994]:   <source dev="/dev/sdd"/>
Nov 28 11:25:43 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:25:43 user nova-compute[74994]:   <serial>a4ece64e-026e-4cbd-8049-08355fe6afb7</serial>
Nov 28 11:25:43 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 11:25:43 user nova-compute[74994]: </disk>
Nov 28 11:25:43 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 11:25:43 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-5dc76fb6-9b50-44f2-a559-5fea2631f116 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Successfully detached device vdb from instance c1d04dff-d786-4b78-9819-0f42437139a8 from the persistent domain config.
Nov 28 11:25:43 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-5dc76fb6-9b50-44f2-a559-5fea2631f116 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c1d04dff-d786-4b78-9819-0f42437139a8 from the live domain config. {{(pid=74994) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 11:25:43 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-5dc76fb6-9b50-44f2-a559-5fea2631f116 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 11:25:43 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:25:43 user nova-compute[74994]:   <source dev="/dev/sdd"/>
Nov 28 11:25:43 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:25:43 user nova-compute[74994]:   <serial>a4ece64e-026e-4cbd-8049-08355fe6afb7</serial>
Nov 28 11:25:43 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 11:25:43 user nova-compute[74994]: </disk>
Nov 28 11:25:43 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 11:25:44 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-5dc76fb6-9b50-44f2-a559-5fea2631f116 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c1d04dff-d786-4b78-9819-0f42437139a8 {{(pid=74994) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 11:25:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:25:45 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:25:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:25:48 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:25:48 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:25:48 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:25:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:25:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:25:51 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:25:54 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:25:54 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Cleaning up deleted instances {{(pid=74994) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 11:25:54 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] There are 0 instances to clean {{(pid=74994) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 11:25:56 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:26:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:26:03 user nova-compute[74994]: DEBUG nova.compute.manager [req-465d0b62-851f-4374-ada6-c22e6651205c req-73debe3b-6590-47fc-aa20-0236b99ea480 service nova] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Received event network-changed-e2f8c784-e29d-4072-817e-6b741b90188c {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:26:03 user nova-compute[74994]: DEBUG nova.compute.manager [req-465d0b62-851f-4374-ada6-c22e6651205c req-73debe3b-6590-47fc-aa20-0236b99ea480 service nova] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Refreshing instance network info cache due to event network-changed-e2f8c784-e29d-4072-817e-6b741b90188c. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:26:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-465d0b62-851f-4374-ada6-c22e6651205c req-73debe3b-6590-47fc-aa20-0236b99ea480 service nova] Acquiring lock "refresh_cache-02d70aec-41a6-41bd-a826-1f7d31e1f78e" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:26:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-465d0b62-851f-4374-ada6-c22e6651205c req-73debe3b-6590-47fc-aa20-0236b99ea480 service nova] Acquired lock "refresh_cache-02d70aec-41a6-41bd-a826-1f7d31e1f78e" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:26:03 user nova-compute[74994]: DEBUG nova.network.neutron [req-465d0b62-851f-4374-ada6-c22e6651205c req-73debe3b-6590-47fc-aa20-0236b99ea480 service nova] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Refreshing network info cache for port e2f8c784-e29d-4072-817e-6b741b90188c {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:26:03 user nova-compute[74994]: DEBUG nova.network.neutron [req-465d0b62-851f-4374-ada6-c22e6651205c req-73debe3b-6590-47fc-aa20-0236b99ea480 service nova] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Updated VIF entry in instance network info cache for port e2f8c784-e29d-4072-817e-6b741b90188c. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:26:03 user nova-compute[74994]: DEBUG nova.network.neutron [req-465d0b62-851f-4374-ada6-c22e6651205c req-73debe3b-6590-47fc-aa20-0236b99ea480 service nova] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Updating instance_info_cache with network_info: [{"id": "e2f8c784-e29d-4072-817e-6b741b90188c", "address": "fa:16:3e:54:9b:ac", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f8c784-e2", "ovs_interfaceid": "e2f8c784-e29d-4072-817e-6b741b90188c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:26:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-465d0b62-851f-4374-ada6-c22e6651205c req-73debe3b-6590-47fc-aa20-0236b99ea480 service nova] Releasing lock "refresh_cache-02d70aec-41a6-41bd-a826-1f7d31e1f78e" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:26:04 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-5dc76fb6-9b50-44f2-a559-5fea2631f116 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c1d04dff-d786-4b78-9819-0f42437139a8 is timed out.
Nov 28 11:26:04 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-5dc76fb6-9b50-44f2-a559-5fea2631f116 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Successfully detached device vdb from instance c1d04dff-d786-4b78-9819-0f42437139a8 from the live domain config.
Nov 28 11:26:04 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5dc76fb6-9b50-44f2-a559-5fea2631f116 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 11:26:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc76fb6-9b50-44f2-a559-5fea2631f116 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:a4ece64e-026e-4cbd-8049-08355fe6afb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kMqYHVUF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:26:04 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-5dc76fb6-9b50-44f2-a559-5fea2631f116 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:26:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-5dc76fb6-9b50-44f2-a559-5fea2631f116 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:26:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-5dc76fb6-9b50-44f2-a559-5fea2631f116 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:26:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:26:04 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c3837a-a67c-4398-96db-b9875e4be2d4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a4ece64e-026e-4cbd-8049-08355fe6afb7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc76fb6-9b50-44f2-a559-5fea2631f116 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 11:26:04 user nova-compute[74994]: No targets found.
Nov 28 11:26:04 user nova-compute[74994]: iSNS:
Nov 28 11:26:04 user nova-compute[74994]: No targets found.
Nov 28 11:26:04 user nova-compute[74994]: STATIC:
Nov 28 11:26:04 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:a4ece64e-026e-4cbd-8049-08355fe6afb7
Nov 28 11:26:04 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:26:04 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:26:04 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84
Nov 28 11:26:04 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:26:04 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:26:04 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5
Nov 28 11:26:04 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:26:04 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:26:04 user nova-compute[74994]: FIRMWARE:
Nov 28 11:26:04 user nova-compute[74994]: No targets found.
Nov 28 11:26:04 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:26:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc76fb6-9b50-44f2-a559-5fea2631f116 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 11:26:04 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 11:26:04 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 11:26:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc76fb6-9b50-44f2-a559-5fea2631f116 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4ece64e-026e-4cbd-8049-08355fe6afb7', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 11:26:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:26:04 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99eb98b-ade8-477b-8507-e5ddd0faae54]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4ece64e-026e-4cbd-8049-08355fe6afb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:26:04 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44b82d0-7869-4ba2-bdcf-76376b52571a]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ece64e-026e-4cbd-8049-08355fe6afb7 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc76fb6-9b50-44f2-a559-5fea2631f116 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)
Nov 28 11:26:04 user nova-compute[74994]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 (non-flash)
Nov 28 11:26:04 user nova-compute[74994]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ece64e-026e-4cbd-8049-08355fe6afb7 (non-flash)
Nov 28 11:26:04 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:26:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc76fb6-9b50-44f2-a559-5fea2631f116 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)
Nov 28 11:26:04 user nova-compute[74994]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 (non-flash)
Nov 28 11:26:04 user nova-compute[74994]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ece64e-026e-4cbd-8049-08355fe6afb7 (non-flash)
Nov 28 11:26:04 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:26:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc76fb6-9b50-44f2-a559-5fea2631f116 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9445c29e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4ece64e-026e-4cbd-8049-08355fe6afb7'): ({'sdd'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 11:26:04 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-5dc76fb6-9b50-44f2-a559-5fea2631f116 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Removing single pathed devices sdd {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 11:26:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:26:04 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99c9798-0013-4eb1-80ae-b8dedae36ed7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:26:04 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c06b99-c0cf-4a82-8ae0-525629aed108]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:04 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-5dc76fb6-9b50-44f2-a559-5fea2631f116 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Flushing IO for device /dev/sdd {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 11:26:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:26:04 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f29224c-759c-4e9a-bfb6-9d3428bb445f]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:04 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-5dc76fb6-9b50-44f2-a559-5fea2631f116 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 11:26:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:26:04 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f544e53-e763-44f7-8e1d-9e151c4492b2]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:04 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-5dc76fb6-9b50-44f2-a559-5fea2631f116 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 11:26:04 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-5dc76fb6-9b50-44f2-a559-5fea2631f116 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] SCSI volumes sdd have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 11:26:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc76fb6-9b50-44f2-a559-5fea2631f116 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4ece64e-026e-4cbd-8049-08355fe6afb7')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 11:26:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4ece64e-026e-4cbd-8049-08355fe6afb7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4ece64e-026e-4cbd-8049-08355fe6afb7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:26:04 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[66dc0a29-54c0-42e7-adc6-7f5bcafed336]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc76fb6-9b50-44f2-a559-5fea2631f116 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:26:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4ece64e-026e-4cbd-8049-08355fe6afb7 -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4ece64e-026e-4cbd-8049-08355fe6afb7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:26:04 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1116ce99-b505-4dc7-9a19-edd167783452]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:a4ece64e-026e-4cbd-8049-08355fe6afb7, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:a4ece64e-026e-4cbd-8049-08355fe6afb7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc76fb6-9b50-44f2-a559-5fea2631f116 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:a4ece64e-026e-4cbd-8049-08355fe6afb7, portal: 172.16.0.220,3260]
Nov 28 11:26:04 user nova-compute[74994]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:a4ece64e-026e-4cbd-8049-08355fe6afb7, portal: 172.16.0.220,3260] successful.
Nov 28 11:26:04 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:26:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4ece64e-026e-4cbd-8049-08355fe6afb7 -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4ece64e-026e-4cbd-8049-08355fe6afb7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:26:04 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6431be19-0836-41b0-b6c8-1e36414ae327]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc76fb6-9b50-44f2-a559-5fea2631f116 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:26:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-5dc76fb6-9b50-44f2-a559-5fea2631f116 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:26:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc76fb6-9b50-44f2-a559-5fea2631f116 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] <== disconnect_volume: return (310ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:26:04 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5dc76fb6-9b50-44f2-a559-5fea2631f116 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 11:26:05 user nova-compute[74994]: DEBUG nova.objects.instance [None req-5dc76fb6-9b50-44f2-a559-5fea2631f116 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lazy-loading 'flavor' on Instance uuid c1d04dff-d786-4b78-9819-0f42437139a8 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:26:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5dc76fb6-9b50-44f2-a559-5fea2631f116 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "c1d04dff-d786-4b78-9819-0f42437139a8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.651s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:26:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:26:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:26:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:26:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:26:10 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "242ed28b-fd06-4696-85a0-9d8060fd7f95" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:26:10 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "242ed28b-fd06-4696-85a0-9d8060fd7f95" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:26:10 user nova-compute[74994]: DEBUG nova.compute.manager [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 11:26:10 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:26:10 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:26:10 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 11:26:10 user nova-compute[74994]: INFO nova.compute.claims [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Claim successful on node user
Nov 28 11:26:10 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:26:10 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:26:10 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.305s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:26:10 user nova-compute[74994]: DEBUG nova.compute.manager [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 11:26:10 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 11:26:10 user nova-compute[74994]: DEBUG nova.compute.manager [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 11:26:10 user nova-compute[74994]: DEBUG nova.network.neutron [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 11:26:10 user nova-compute[74994]: DEBUG nova.compute.manager [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 11:26:10 user nova-compute[74994]: INFO nova.virt.block_device [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Booting with volume snapshot f9b99bad-310e-4847-ab94-21535fcf9143 at /dev/vda
Nov 28 11:26:10 user nova-compute[74994]: DEBUG nova.policy [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e1ebcd41891545f990e285b43c9eac90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb427b7927364726907d9e90ef9a578f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 11:26:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:26:11 user nova-compute[74994]: DEBUG nova.network.neutron [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Successfully created port: f7c34a48-6c32-4215-add8-ee612ae7ebff {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 11:26:12 user nova-compute[74994]: DEBUG nova.network.neutron [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Successfully updated port: f7c34a48-6c32-4215-add8-ee612ae7ebff {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 11:26:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "refresh_cache-242ed28b-fd06-4696-85a0-9d8060fd7f95" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:26:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquired lock "refresh_cache-242ed28b-fd06-4696-85a0-9d8060fd7f95" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:26:12 user nova-compute[74994]: DEBUG nova.network.neutron [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 11:26:12 user nova-compute[74994]: DEBUG nova.compute.manager [req-50a1d9cd-0bdc-45fc-9047-14534b3d74f4 req-b2c3a8a8-98fc-4ff3-ac39-ae7073e885c2 service nova] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Received event network-changed-f7c34a48-6c32-4215-add8-ee612ae7ebff {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:26:12 user nova-compute[74994]: DEBUG nova.compute.manager [req-50a1d9cd-0bdc-45fc-9047-14534b3d74f4 req-b2c3a8a8-98fc-4ff3-ac39-ae7073e885c2 service nova] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Refreshing instance network info cache due to event network-changed-f7c34a48-6c32-4215-add8-ee612ae7ebff. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:26:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-50a1d9cd-0bdc-45fc-9047-14534b3d74f4 req-b2c3a8a8-98fc-4ff3-ac39-ae7073e885c2 service nova] Acquiring lock "refresh_cache-242ed28b-fd06-4696-85a0-9d8060fd7f95" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:26:12 user nova-compute[74994]: DEBUG nova.network.neutron [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 11:26:12 user nova-compute[74994]: DEBUG nova.network.neutron [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Updating instance_info_cache with network_info: [{"id": "f7c34a48-6c32-4215-add8-ee612ae7ebff", "address": "fa:16:3e:e6:36:40", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7c34a48-6c", "ovs_interfaceid": "f7c34a48-6c32-4215-add8-ee612ae7ebff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:26:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Releasing lock "refresh_cache-242ed28b-fd06-4696-85a0-9d8060fd7f95" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:26:12 user nova-compute[74994]: DEBUG nova.compute.manager [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Instance network_info: |[{"id": "f7c34a48-6c32-4215-add8-ee612ae7ebff", "address": "fa:16:3e:e6:36:40", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7c34a48-6c", "ovs_interfaceid": "f7c34a48-6c32-4215-add8-ee612ae7ebff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 11:26:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-50a1d9cd-0bdc-45fc-9047-14534b3d74f4 req-b2c3a8a8-98fc-4ff3-ac39-ae7073e885c2 service nova] Acquired lock "refresh_cache-242ed28b-fd06-4696-85a0-9d8060fd7f95" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:26:12 user nova-compute[74994]: DEBUG nova.network.neutron [req-50a1d9cd-0bdc-45fc-9047-14534b3d74f4 req-b2c3a8a8-98fc-4ff3-ac39-ae7073e885c2 service nova] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Refreshing network info cache for port f7c34a48-6c32-4215-add8-ee612ae7ebff {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:26:13 user nova-compute[74994]: DEBUG nova.network.neutron [req-50a1d9cd-0bdc-45fc-9047-14534b3d74f4 req-b2c3a8a8-98fc-4ff3-ac39-ae7073e885c2 service nova] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Updated VIF entry in instance network info cache for port f7c34a48-6c32-4215-add8-ee612ae7ebff. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:26:13 user nova-compute[74994]: DEBUG nova.network.neutron [req-50a1d9cd-0bdc-45fc-9047-14534b3d74f4 req-b2c3a8a8-98fc-4ff3-ac39-ae7073e885c2 service nova] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Updating instance_info_cache with network_info: [{"id": "f7c34a48-6c32-4215-add8-ee612ae7ebff", "address": "fa:16:3e:e6:36:40", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7c34a48-6c", "ovs_interfaceid": "f7c34a48-6c32-4215-add8-ee612ae7ebff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:26:13 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-50a1d9cd-0bdc-45fc-9047-14534b3d74f4 req-b2c3a8a8-98fc-4ff3-ac39-ae7073e885c2 service nova] Releasing lock "refresh_cache-242ed28b-fd06-4696-85a0-9d8060fd7f95" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:26:16 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:26:16 user nova-compute[74994]: WARNING nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] While synchronizing instance power states, found 4 instances in the database and 3 instances on the hypervisor.
Nov 28 11:26:16 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Triggering sync for uuid c1d04dff-d786-4b78-9819-0f42437139a8 {{(pid=74994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 11:26:16 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Triggering sync for uuid 02d70aec-41a6-41bd-a826-1f7d31e1f78e {{(pid=74994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 11:26:16 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Triggering sync for uuid 242ed28b-fd06-4696-85a0-9d8060fd7f95 {{(pid=74994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 11:26:16 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Triggering sync for uuid 6b63060e-f38f-4dcd-b910-658cc37f3459 {{(pid=74994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 11:26:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "c1d04dff-d786-4b78-9819-0f42437139a8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:26:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "c1d04dff-d786-4b78-9819-0f42437139a8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:26:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "02d70aec-41a6-41bd-a826-1f7d31e1f78e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:26:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "02d70aec-41a6-41bd-a826-1f7d31e1f78e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:26:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "242ed28b-fd06-4696-85a0-9d8060fd7f95" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:26:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "6b63060e-f38f-4dcd-b910-658cc37f3459" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:26:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "6b63060e-f38f-4dcd-b910-658cc37f3459" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:26:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "c1d04dff-d786-4b78-9819-0f42437139a8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:26:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "02d70aec-41a6-41bd-a826-1f7d31e1f78e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:26:16 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "6b63060e-f38f-4dcd-b910-658cc37f3459" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:26:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:26:16 user nova-compute[74994]: DEBUG os_brick.utils [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:26:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:26:16 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fb91b3-0ba1-4fe7-b202-3d47eec5429b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:26:16 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d21b701-0ad1-4b43-b316-f173de7aa5e9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:26:16 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0611c0-7bed-43f7-9206-fc09cabfc615]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:16 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3917a3-e17a-4079-859f-1c3c62077cbe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:26:16 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 11:26:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:16 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:26:16 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 11:26:16 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[769e5370-ba60-4d37-b2a9-707b159e3a25]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:16 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 11:26:16 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 11:26:16 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 11:26:16 user nova-compute[74994]: DEBUG os_brick.utils [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:26:16 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Updating existing volume attachment record: bf037503-3198-472f-9892-9ef0b44ed006 {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 11:26:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:26:21 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG nova.compute.manager [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 11:26:23 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Creating image(s)
Nov 28 11:26:23 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Did not create local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Ensure instance console log exists: /opt/stack/data/nova/instances/242ed28b-fd06-4696-85a0-9d8060fd7f95/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Start _get_guest_xml network_info=[{"id": "f7c34a48-6c32-4215-add8-ee612ae7ebff", "address": "fa:16:3e:e6:36:40", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7c34a48-6c", "ovs_interfaceid": "f7c34a48-6c32-4215-add8-ee612ae7ebff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-28T11:26:05Z,direct_url=<?>,disk_format='qcow2',id=9ae21bbc-a970-4f81-8310-ec78607871a5,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-797229867',owner='cb427b7927364726907d9e90ef9a578f',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-28T11:26:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SmqNEcXU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '242ed28b-fd06-4696-85a0-9d8060fd7f95', 'attached_at': '', 'detached_at': '', 'volume_id': '6d14e06d-167f-4757-bf2e-0b2b0186eb26', 'serial': '6d14e06d-167f-4757-bf2e-0b2b0186eb26'}, 'attachment_id': 'bf037503-3198-472f-9892-9ef0b44ed006', 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 11:26:23 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:26:23 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:26:23 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-28T11:26:05Z,direct_url=<?>,disk_format='qcow2',id=9ae21bbc-a970-4f81-8310-ec78607871a5,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-797229867',owner='cb427b7927364726907d9e90ef9a578f',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-28T11:26:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SmqNEcXU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:26:23 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:26:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:26:23 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:26:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:26:23 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 11:26:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26 -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a482e07-de1d-4daa-b820-e625c00749df]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 11:26:23 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26 -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72758db-0327-4b6c-8108-a1ed4202f24f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26] added
Nov 28 11:26:23 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[814c9bc0-2f51-4e55-87ac-83dab47345b5]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba353f7-c534-427f-a11b-cd477fd85618]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SmqNEcXU {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SmqNEcXU" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f09bb06-3937-4714-b8cd-5436dcfd7070]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SmqNEcXU'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f936b60-1a61-4dc1-886e-6877f90a6bbb]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ca6ad8-434d-4953-9da4-5a32a8011534]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)
Nov 28 11:26:23 user nova-compute[74994]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 (non-flash)
Nov 28 11:26:23 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)
Nov 28 11:26:23 user nova-compute[74994]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 (non-flash)
Nov 28 11:26:23 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26 -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79891cc-fdb6-4202-9f32-892645eb11d1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26, portal: 172.16.0.220,3260]
Nov 28 11:26:23 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26, portal: 172.16.0.220,3260] successful.
Nov 28 11:26:23 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.038s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89abb09-22fa-4272-a26c-caf660ceefe4]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[03bd9575-04ae-4fbd-a7be-52f98d3f6f82]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)
Nov 28 11:26:23 user nova-compute[74994]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 (non-flash)
Nov 28 11:26:23 user nova-compute[74994]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26 (non-flash)
Nov 28 11:26:23 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)
Nov 28 11:26:23 user nova-compute[74994]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 (non-flash)
Nov 28 11:26:23 user nova-compute[74994]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26 (non-flash)
Nov 28 11:26:23 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] HCTL ('35', '-', '-', 0) found on session 56 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a93841c-8f38-40cd-a5ce-c3d0d1723d1f]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:23 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Searching for a device in session 56 and hctl ['35', '*', '*', 0] yield: None {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 11:26:24 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Searching for a device in session 56 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 11:26:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SmqNEcXU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 11:26:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:26:24 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23035636235303433', 'path': '/dev/sdd'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:26:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035636235303433', 'path': '/dev/sdd'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 11:26:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:26:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-56461052',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-56461052',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-56461052',id=49,image_ref='9ae21bbc-a970-4f81-8310-ec78607871a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHT+hIhWTflqhY430mdIbirEwPvQ5PzjO1f0wP82pVClnxbcwgBmuOze7DWJM35CJcWjIu0NEK2EjOi3g961ZqpzEjqm4Bjh7NtAW6kCwGm+o/bGu0XTC+e7dfK32w/RZg==',key_name='tempest-keypair-411335736',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb427b7927364726907d9e90ef9a578f',ramdisk_id='',reservation_id='r-f2sh561g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-169069415',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-169069415-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-169069415',owner_user_name='tempest-TestVolumeBootPattern-169069415-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:26:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1ebcd41891545f990e285b43c9eac90',uuid=242ed28b-fd06-4696-85a0-9d8060fd7f95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7c34a48-6c32-4215-add8-ee612ae7ebff", "address": "fa:16:3e:e6:36:40", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7c34a48-6c", "ovs_interfaceid": "f7c34a48-6c32-4215-add8-ee612ae7ebff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 11:26:24 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Converting VIF {"id": "f7c34a48-6c32-4215-add8-ee612ae7ebff", "address": "fa:16:3e:e6:36:40", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7c34a48-6c", "ovs_interfaceid": "f7c34a48-6c32-4215-add8-ee612ae7ebff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:26:24 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:36:40,bridge_name='br-int',has_traffic_filtering=True,id=f7c34a48-6c32-4215-add8-ee612ae7ebff,network=Network(2dad67e8-a656-4aa2-a2ed-f2875ee5e48a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7c34a48-6c') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:26:24 user nova-compute[74994]: DEBUG nova.objects.instance [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lazy-loading 'pci_devices' on Instance uuid 242ed28b-fd06-4696-85a0-9d8060fd7f95 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:26:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] End _get_guest_xml xml=<domain type="kvm">
Nov 28 11:26:24 user nova-compute[74994]:   <uuid>242ed28b-fd06-4696-85a0-9d8060fd7f95</uuid>
Nov 28 11:26:24 user nova-compute[74994]:   <name>instance-00000031</name>
Nov 28 11:26:24 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 11:26:24 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 11:26:24 user nova-compute[74994]:   <metadata>
Nov 28 11:26:24 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 11:26:24 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 11:26:24 user nova-compute[74994]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-56461052</nova:name>
Nov 28 11:26:24 user nova-compute[74994]:       <nova:creationTime>2023-11-28 11:26:23</nova:creationTime>
Nov 28 11:26:24 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 11:26:24 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 11:26:24 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 11:26:24 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 11:26:24 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 11:26:24 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 11:26:24 user nova-compute[74994]:       </nova:flavor>
Nov 28 11:26:24 user nova-compute[74994]:       <nova:owner>
Nov 28 11:26:24 user nova-compute[74994]:         <nova:user uuid="e1ebcd41891545f990e285b43c9eac90">tempest-TestVolumeBootPattern-169069415-project-member</nova:user>
Nov 28 11:26:24 user nova-compute[74994]:         <nova:project uuid="cb427b7927364726907d9e90ef9a578f">tempest-TestVolumeBootPattern-169069415</nova:project>
Nov 28 11:26:24 user nova-compute[74994]:       </nova:owner>
Nov 28 11:26:24 user nova-compute[74994]:       <nova:root type="image" uuid="9ae21bbc-a970-4f81-8310-ec78607871a5"/>
Nov 28 11:26:24 user nova-compute[74994]:       <nova:ports>
Nov 28 11:26:24 user nova-compute[74994]:         <nova:port uuid="f7c34a48-6c32-4215-add8-ee612ae7ebff">
Nov 28 11:26:24 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 11:26:24 user nova-compute[74994]:         </nova:port>
Nov 28 11:26:24 user nova-compute[74994]:       </nova:ports>
Nov 28 11:26:24 user nova-compute[74994]:     </nova:instance>
Nov 28 11:26:24 user nova-compute[74994]:   </metadata>
Nov 28 11:26:24 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 11:26:24 user nova-compute[74994]:     <system>
Nov 28 11:26:24 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 11:26:24 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 11:26:24 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 11:26:24 user nova-compute[74994]:       <entry name="serial">242ed28b-fd06-4696-85a0-9d8060fd7f95</entry>
Nov 28 11:26:24 user nova-compute[74994]:       <entry name="uuid">242ed28b-fd06-4696-85a0-9d8060fd7f95</entry>
Nov 28 11:26:24 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 11:26:24 user nova-compute[74994]:     </system>
Nov 28 11:26:24 user nova-compute[74994]:   </sysinfo>
Nov 28 11:26:24 user nova-compute[74994]:   <os>
Nov 28 11:26:24 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 11:26:24 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 11:26:24 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 11:26:24 user nova-compute[74994]:   </os>
Nov 28 11:26:24 user nova-compute[74994]:   <features>
Nov 28 11:26:24 user nova-compute[74994]:     <acpi/>
Nov 28 11:26:24 user nova-compute[74994]:     <apic/>
Nov 28 11:26:24 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 11:26:24 user nova-compute[74994]:   </features>
Nov 28 11:26:24 user nova-compute[74994]:   <clock offset="utc">
Nov 28 11:26:24 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 11:26:24 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 11:26:24 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 11:26:24 user nova-compute[74994]:   </clock>
Nov 28 11:26:24 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 11:26:24 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 11:26:24 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 11:26:24 user nova-compute[74994]:   </cpu>
Nov 28 11:26:24 user nova-compute[74994]:   <devices>
Nov 28 11:26:24 user nova-compute[74994]:     <disk type="block" device="disk">
Nov 28 11:26:24 user nova-compute[74994]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:26:24 user nova-compute[74994]:       <source dev="/dev/sdd"/>
Nov 28 11:26:24 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 11:26:24 user nova-compute[74994]:       <serial>6d14e06d-167f-4757-bf2e-0b2b0186eb26</serial>
Nov 28 11:26:24 user nova-compute[74994]:     </disk>
Nov 28 11:26:24 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 11:26:24 user nova-compute[74994]:       <mac address="fa:16:3e:e6:36:40"/>
Nov 28 11:26:24 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:26:24 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 11:26:24 user nova-compute[74994]:       <target dev="tapf7c34a48-6c"/>
Nov 28 11:26:24 user nova-compute[74994]:     </interface>
Nov 28 11:26:24 user nova-compute[74994]:     <serial type="pty">
Nov 28 11:26:24 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/242ed28b-fd06-4696-85a0-9d8060fd7f95/console.log" append="off"/>
Nov 28 11:26:24 user nova-compute[74994]:     </serial>
Nov 28 11:26:24 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 11:26:24 user nova-compute[74994]:     <video>
Nov 28 11:26:24 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:26:24 user nova-compute[74994]:     </video>
Nov 28 11:26:24 user nova-compute[74994]:     <rng model="virtio">
Nov 28 11:26:24 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 11:26:24 user nova-compute[74994]:     </rng>
Nov 28 11:26:24 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 11:26:24 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 11:26:24 user nova-compute[74994]:       <stats period="10"/>
Nov 28 11:26:24 user nova-compute[74994]:     </memballoon>
Nov 28 11:26:24 user nova-compute[74994]:   </devices>
Nov 28 11:26:24 user nova-compute[74994]: </domain>
Nov 28 11:26:24 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 11:26:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:26:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-56461052',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-56461052',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-56461052',id=49,image_ref='9ae21bbc-a970-4f81-8310-ec78607871a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHT+hIhWTflqhY430mdIbirEwPvQ5PzjO1f0wP82pVClnxbcwgBmuOze7DWJM35CJcWjIu0NEK2EjOi3g961ZqpzEjqm4Bjh7NtAW6kCwGm+o/bGu0XTC+e7dfK32w/RZg==',key_name='tempest-keypair-411335736',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb427b7927364726907d9e90ef9a578f',ramdisk_id='',reservation_id='r-f2sh561g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-169069415',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-169069415-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-169069415',owner_user_name='tempest-TestVolumeBootPattern-169069415-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:26:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1ebcd41891545f990e285b43c9eac90',uuid=242ed28b-fd06-4696-85a0-9d8060fd7f95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7c34a48-6c32-4215-add8-ee612ae7ebff", "address": "fa:16:3e:e6:36:40", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7c34a48-6c", "ovs_interfaceid": "f7c34a48-6c32-4215-add8-ee612ae7ebff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 11:26:24 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Converting VIF {"id": "f7c34a48-6c32-4215-add8-ee612ae7ebff", "address": "fa:16:3e:e6:36:40", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7c34a48-6c", "ovs_interfaceid": "f7c34a48-6c32-4215-add8-ee612ae7ebff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:26:24 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:36:40,bridge_name='br-int',has_traffic_filtering=True,id=f7c34a48-6c32-4215-add8-ee612ae7ebff,network=Network(2dad67e8-a656-4aa2-a2ed-f2875ee5e48a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7c34a48-6c') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:26:24 user nova-compute[74994]: DEBUG os_vif [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:36:40,bridge_name='br-int',has_traffic_filtering=True,id=f7c34a48-6c32-4215-add8-ee612ae7ebff,network=Network(2dad67e8-a656-4aa2-a2ed-f2875ee5e48a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7c34a48-6c') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 11:26:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:26:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:26:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 11:26:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:26:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '05a261cb-e943-5925-b8bf-31ce8f1dc3db', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:26:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:26:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:26:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:26:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf7c34a48-6c, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:26:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf7c34a48-6c, col_values=(('qos', UUID('ff1ddc46-28f4-4679-830c-5cb5dc900d2b')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:26:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf7c34a48-6c, col_values=(('external_ids', {'iface-id': 'f7c34a48-6c32-4215-add8-ee612ae7ebff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:36:40', 'vm-uuid': '242ed28b-fd06-4696-85a0-9d8060fd7f95'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:26:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:26:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:26:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:26:24 user nova-compute[74994]: INFO os_vif [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:36:40,bridge_name='br-int',has_traffic_filtering=True,id=f7c34a48-6c32-4215-add8-ee612ae7ebff,network=Network(2dad67e8-a656-4aa2-a2ed-f2875ee5e48a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7c34a48-6c')
Nov 28 11:26:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:26:24 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] No VIF found with MAC fa:16:3e:e6:36:40, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:26:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:26:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:26:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:26:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:26:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:26:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:26:26 user nova-compute[74994]: DEBUG nova.compute.manager [req-6f78fd23-1c33-4894-b5bb-2b969d7e43b3 req-7d24642b-cfd8-452b-b6c0-1de419aba638 service nova] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Received event network-vif-plugged-f7c34a48-6c32-4215-add8-ee612ae7ebff {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:26:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6f78fd23-1c33-4894-b5bb-2b969d7e43b3 req-7d24642b-cfd8-452b-b6c0-1de419aba638 service nova] Acquiring lock "242ed28b-fd06-4696-85a0-9d8060fd7f95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:26:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6f78fd23-1c33-4894-b5bb-2b969d7e43b3 req-7d24642b-cfd8-452b-b6c0-1de419aba638 service nova] Lock "242ed28b-fd06-4696-85a0-9d8060fd7f95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:26:26 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6f78fd23-1c33-4894-b5bb-2b969d7e43b3 req-7d24642b-cfd8-452b-b6c0-1de419aba638 service nova] Lock "242ed28b-fd06-4696-85a0-9d8060fd7f95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:26:26 user nova-compute[74994]: DEBUG nova.compute.manager [req-6f78fd23-1c33-4894-b5bb-2b969d7e43b3 req-7d24642b-cfd8-452b-b6c0-1de419aba638 service nova] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] No waiting events found dispatching network-vif-plugged-f7c34a48-6c32-4215-add8-ee612ae7ebff {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:26:26 user nova-compute[74994]: WARNING nova.compute.manager [req-6f78fd23-1c33-4894-b5bb-2b969d7e43b3 req-7d24642b-cfd8-452b-b6c0-1de419aba638 service nova] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Received unexpected event network-vif-plugged-f7c34a48-6c32-4215-add8-ee612ae7ebff for instance with vm_state building and task_state spawning.
Nov 28 11:26:28 user nova-compute[74994]: DEBUG nova.compute.manager [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 11:26:28 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 11:26:28 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Instance spawned successfully.
Nov 28 11:26:28 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 11:26:28 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:26:28 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:26:28 user nova-compute[74994]: INFO nova.compute.manager [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Took 4.94 seconds to spawn the instance on the hypervisor.
Nov 28 11:26:28 user nova-compute[74994]: DEBUG nova.compute.manager [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 11:26:28 user nova-compute[74994]: INFO nova.compute.manager [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Took 17.98 seconds to build instance.
Nov 28 11:26:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-a0169393-8844-4cf3-99b4-7788e6ca5a6b tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "242ed28b-fd06-4696-85a0-9d8060fd7f95" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.071s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:26:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "242ed28b-fd06-4696-85a0-9d8060fd7f95" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 12.119s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:26:28 user nova-compute[74994]: INFO nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Nov 28 11:26:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "242ed28b-fd06-4696-85a0-9d8060fd7f95" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:26:28 user nova-compute[74994]: DEBUG nova.compute.manager [req-d2dbd8b3-875e-4d9f-bfc5-65cff371edd9 req-94544dbf-7c2e-4007-ab35-d55442893220 service nova] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Received event network-vif-plugged-f7c34a48-6c32-4215-add8-ee612ae7ebff {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:26:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d2dbd8b3-875e-4d9f-bfc5-65cff371edd9 req-94544dbf-7c2e-4007-ab35-d55442893220 service nova] Acquiring lock "242ed28b-fd06-4696-85a0-9d8060fd7f95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:26:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d2dbd8b3-875e-4d9f-bfc5-65cff371edd9 req-94544dbf-7c2e-4007-ab35-d55442893220 service nova] Lock "242ed28b-fd06-4696-85a0-9d8060fd7f95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:26:28 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d2dbd8b3-875e-4d9f-bfc5-65cff371edd9 req-94544dbf-7c2e-4007-ab35-d55442893220 service nova] Lock "242ed28b-fd06-4696-85a0-9d8060fd7f95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:26:28 user nova-compute[74994]: DEBUG nova.compute.manager [req-d2dbd8b3-875e-4d9f-bfc5-65cff371edd9 req-94544dbf-7c2e-4007-ab35-d55442893220 service nova] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] No waiting events found dispatching network-vif-plugged-f7c34a48-6c32-4215-add8-ee612ae7ebff {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:26:28 user nova-compute[74994]: WARNING nova.compute.manager [req-d2dbd8b3-875e-4d9f-bfc5-65cff371edd9 req-94544dbf-7c2e-4007-ab35-d55442893220 service nova] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Received unexpected event network-vif-plugged-f7c34a48-6c32-4215-add8-ee612ae7ebff for instance with vm_state active and task_state None.
Nov 28 11:26:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:26:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:26:32 user nova-compute[74994]: DEBUG nova.compute.manager [req-4371e3a5-6b03-40ca-9bc1-dd54f9c3e898 req-ba722276-b9fd-46e9-a6a9-e63071128089 service nova] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Received event network-changed-dfed3798-5f85-494b-a5e1-f7908962c509 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:26:32 user nova-compute[74994]: DEBUG nova.compute.manager [req-4371e3a5-6b03-40ca-9bc1-dd54f9c3e898 req-ba722276-b9fd-46e9-a6a9-e63071128089 service nova] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Refreshing instance network info cache due to event network-changed-dfed3798-5f85-494b-a5e1-f7908962c509. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:26:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4371e3a5-6b03-40ca-9bc1-dd54f9c3e898 req-ba722276-b9fd-46e9-a6a9-e63071128089 service nova] Acquiring lock "refresh_cache-6b63060e-f38f-4dcd-b910-658cc37f3459" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:26:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4371e3a5-6b03-40ca-9bc1-dd54f9c3e898 req-ba722276-b9fd-46e9-a6a9-e63071128089 service nova] Acquired lock "refresh_cache-6b63060e-f38f-4dcd-b910-658cc37f3459" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:26:32 user nova-compute[74994]: DEBUG nova.network.neutron [req-4371e3a5-6b03-40ca-9bc1-dd54f9c3e898 req-ba722276-b9fd-46e9-a6a9-e63071128089 service nova] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Refreshing network info cache for port dfed3798-5f85-494b-a5e1-f7908962c509 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:26:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9b6d275f-2c85-4816-b52e-1a3e4fe30f12 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Acquiring lock "6b63060e-f38f-4dcd-b910-658cc37f3459" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:26:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9b6d275f-2c85-4816-b52e-1a3e4fe30f12 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Lock "6b63060e-f38f-4dcd-b910-658cc37f3459" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:26:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9b6d275f-2c85-4816-b52e-1a3e4fe30f12 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Acquiring lock "6b63060e-f38f-4dcd-b910-658cc37f3459-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:26:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9b6d275f-2c85-4816-b52e-1a3e4fe30f12 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Lock "6b63060e-f38f-4dcd-b910-658cc37f3459-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:26:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9b6d275f-2c85-4816-b52e-1a3e4fe30f12 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Lock "6b63060e-f38f-4dcd-b910-658cc37f3459-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:26:32 user nova-compute[74994]: INFO nova.compute.manager [None req-9b6d275f-2c85-4816-b52e-1a3e4fe30f12 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Terminating instance
Nov 28 11:26:32 user nova-compute[74994]: DEBUG nova.compute.manager [None req-9b6d275f-2c85-4816-b52e-1a3e4fe30f12 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 11:26:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:26:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:26:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:26:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:26:32 user nova-compute[74994]: DEBUG nova.compute.manager [req-abf27a99-f1a4-4296-b789-1aa0fe57575f req-861b7d15-4045-45c6-ab6d-ca65dfd07fc4 service nova] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Received event network-vif-unplugged-dfed3798-5f85-494b-a5e1-f7908962c509 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:26:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-abf27a99-f1a4-4296-b789-1aa0fe57575f req-861b7d15-4045-45c6-ab6d-ca65dfd07fc4 service nova] Acquiring lock "6b63060e-f38f-4dcd-b910-658cc37f3459-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:26:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-abf27a99-f1a4-4296-b789-1aa0fe57575f req-861b7d15-4045-45c6-ab6d-ca65dfd07fc4 service nova] Lock "6b63060e-f38f-4dcd-b910-658cc37f3459-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:26:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-abf27a99-f1a4-4296-b789-1aa0fe57575f req-861b7d15-4045-45c6-ab6d-ca65dfd07fc4 service nova] Lock "6b63060e-f38f-4dcd-b910-658cc37f3459-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:26:32 user nova-compute[74994]: DEBUG nova.compute.manager [req-abf27a99-f1a4-4296-b789-1aa0fe57575f req-861b7d15-4045-45c6-ab6d-ca65dfd07fc4 service nova] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] No waiting events found dispatching network-vif-unplugged-dfed3798-5f85-494b-a5e1-f7908962c509 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:26:32 user nova-compute[74994]: DEBUG nova.compute.manager [req-abf27a99-f1a4-4296-b789-1aa0fe57575f req-861b7d15-4045-45c6-ab6d-ca65dfd07fc4 service nova] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Received event network-vif-unplugged-dfed3798-5f85-494b-a5e1-f7908962c509 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 11:26:32 user nova-compute[74994]: DEBUG nova.network.neutron [req-4371e3a5-6b03-40ca-9bc1-dd54f9c3e898 req-ba722276-b9fd-46e9-a6a9-e63071128089 service nova] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Updated VIF entry in instance network info cache for port dfed3798-5f85-494b-a5e1-f7908962c509. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:26:32 user nova-compute[74994]: DEBUG nova.network.neutron [req-4371e3a5-6b03-40ca-9bc1-dd54f9c3e898 req-ba722276-b9fd-46e9-a6a9-e63071128089 service nova] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Updating instance_info_cache with network_info: [{"id": "dfed3798-5f85-494b-a5e1-f7908962c509", "address": "fa:16:3e:16:a7:ca", "network": {"id": "e60575fe-fd95-429e-ac43-9f2a9e6f80d8", "bridge": "br-int", "label": "tempest-TestShelveInstance-690233806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0899a40ec21f4580b01d0d8c4877055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfed3798-5f", "ovs_interfaceid": "dfed3798-5f85-494b-a5e1-f7908962c509", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:26:32 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-4371e3a5-6b03-40ca-9bc1-dd54f9c3e898 req-ba722276-b9fd-46e9-a6a9-e63071128089 service nova] Releasing lock "refresh_cache-6b63060e-f38f-4dcd-b910-658cc37f3459" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:26:33 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Instance destroyed successfully.
Nov 28 11:26:33 user nova-compute[74994]: DEBUG nova.objects.instance [None req-9b6d275f-2c85-4816-b52e-1a3e4fe30f12 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Lazy-loading 'resources' on Instance uuid 6b63060e-f38f-4dcd-b910-658cc37f3459 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-9b6d275f-2c85-4816-b52e-1a3e4fe30f12 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T11:20:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1828007530',display_name='tempest-TestShelveInstance-server-1828007530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1828007530',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNF3fUpHEM9VeUq49aQapE8hfGQV0VLJSuoH3NotavqxAsyK1aFpgQcoCCirfFZKXWtvJIjbZcDU6F/Puy3MFxxr6NPdA3FHU53qC+0UMjSnIm5FnYd8bXwipVNVqJl98A==',key_name='tempest-TestShelveInstance-1222425401',keypairs=<?>,launch_index=0,launched_at=2023-11-28T11:24:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0899a40ec21f4580b01d0d8c4877055b',ramdisk_id='',reservation_id='r-fcuz0brj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-959893651',owner_user_name='tempest-TestShelveInstance-959893651-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T11:24:55Z,user_data=None,user_id='511f425eb2a144338610e88e161fe857',uuid=6b63060e-f38f-4dcd-b910-658cc37f3459,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfed3798-5f85-494b-a5e1-f7908962c509", "address": "fa:16:3e:16:a7:ca", "network": {"id": "e60575fe-fd95-429e-ac43-9f2a9e6f80d8", "bridge": "br-int", "label": "tempest-TestShelveInstance-690233806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0899a40ec21f4580b01d0d8c4877055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfed3798-5f", "ovs_interfaceid": "dfed3798-5f85-494b-a5e1-f7908962c509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-9b6d275f-2c85-4816-b52e-1a3e4fe30f12 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Converting VIF {"id": "dfed3798-5f85-494b-a5e1-f7908962c509", "address": "fa:16:3e:16:a7:ca", "network": {"id": "e60575fe-fd95-429e-ac43-9f2a9e6f80d8", "bridge": "br-int", "label": "tempest-TestShelveInstance-690233806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0899a40ec21f4580b01d0d8c4877055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfed3798-5f", "ovs_interfaceid": "dfed3798-5f85-494b-a5e1-f7908962c509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-9b6d275f-2c85-4816-b52e-1a3e4fe30f12 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:a7:ca,bridge_name='br-int',has_traffic_filtering=True,id=dfed3798-5f85-494b-a5e1-f7908962c509,network=Network(e60575fe-fd95-429e-ac43-9f2a9e6f80d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfed3798-5f') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG os_vif [None req-9b6d275f-2c85-4816-b52e-1a3e4fe30f12 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:a7:ca,bridge_name='br-int',has_traffic_filtering=True,id=dfed3798-5f85-494b-a5e1-f7908962c509,network=Network(e60575fe-fd95-429e-ac43-9f2a9e6f80d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfed3798-5f') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdfed3798-5f, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5b3e0fab-31fe-47f2-ab7a-19827d87945d) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:26:33 user nova-compute[74994]: INFO os_vif [None req-9b6d275f-2c85-4816-b52e-1a3e4fe30f12 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:a7:ca,bridge_name='br-int',has_traffic_filtering=True,id=dfed3798-5f85-494b-a5e1-f7908962c509,network=Network(e60575fe-fd95-429e-ac43-9f2a9e6f80d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfed3798-5f')
Nov 28 11:26:33 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b6d275f-2c85-4816-b52e-1a3e4fe30f12 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6d275f-2c85-4816-b52e-1a3e4fe30f12 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GnYqVsvC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:26:33 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-9b6d275f-2c85-4816-b52e-1a3e4fe30f12 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:26:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-9b6d275f-2c85-4816-b52e-1a3e4fe30f12 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-9b6d275f-2c85-4816-b52e-1a3e4fe30f12 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[59630f1d-023a-499a-b656-1116b21f85a9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6d275f-2c85-4816-b52e-1a3e4fe30f12 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 11:26:33 user nova-compute[74994]: No targets found.
Nov 28 11:26:33 user nova-compute[74994]: iSNS:
Nov 28 11:26:33 user nova-compute[74994]: No targets found.
Nov 28 11:26:33 user nova-compute[74994]: STATIC:
Nov 28 11:26:33 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26
Nov 28 11:26:33 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:26:33 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:26:33 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84
Nov 28 11:26:33 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:26:33 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:26:33 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5
Nov 28 11:26:33 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:26:33 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:26:33 user nova-compute[74994]: FIRMWARE:
Nov 28 11:26:33 user nova-compute[74994]: No targets found.
Nov 28 11:26:33 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6d275f-2c85-4816-b52e-1a3e4fe30f12 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 11:26:33 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 11:26:33 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6d275f-2c85-4816-b52e-1a3e4fe30f12 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[915414ef-00ea-45aa-8ee9-18226fde207d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[503b314d-713c-4aa5-9b91-32a621777607]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6d275f-2c85-4816-b52e-1a3e4fe30f12 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)
Nov 28 11:26:33 user nova-compute[74994]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 (non-flash)
Nov 28 11:26:33 user nova-compute[74994]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26 (non-flash)
Nov 28 11:26:33 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6d275f-2c85-4816-b52e-1a3e4fe30f12 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)
Nov 28 11:26:33 user nova-compute[74994]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 (non-flash)
Nov 28 11:26:33 user nova-compute[74994]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26 (non-flash)
Nov 28 11:26:33 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6d275f-2c85-4816-b52e-1a3e4fe30f12 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9206e1a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84'): ({'sdc'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-9b6d275f-2c85-4816-b52e-1a3e4fe30f12 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Removing single pathed devices sdc {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46810b0-9451-406f-b0d8-78b90f28f414]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dcd33a0-c70a-4a47-a443-3996d3a88779]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-9b6d275f-2c85-4816-b52e-1a3e4fe30f12 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Flushing IO for device /dev/sdc {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8af8903-afbc-4b44-8e22-fff3005ab7a2]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-9b6d275f-2c85-4816-b52e-1a3e4fe30f12 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.064s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e80805-38d5-45ec-8787-b17113a44a87]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-9b6d275f-2c85-4816-b52e-1a3e4fe30f12 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-9b6d275f-2c85-4816-b52e-1a3e4fe30f12 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] SCSI volumes sdc have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6d275f-2c85-4816-b52e-1a3e4fe30f12 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cad7b05-4fca-441f-b9a8-020a510cfcea]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6d275f-2c85-4816-b52e-1a3e4fe30f12 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d04dff-d786-4b78-9819-0f42437139a8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a98a458-94ec-46a2-8856-03484ee7cf70]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6d275f-2c85-4816-b52e-1a3e4fe30f12 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84, portal: 172.16.0.220,3260]
Nov 28 11:26:33 user nova-compute[74994]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84, portal: 172.16.0.220,3260] successful.
Nov 28 11:26:33 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c46047e2-c89a-4e1a-9a8a-140a3b747e84 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc88b5a-f877-4bc7-abdd-1ad649cfa28e]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6d275f-2c85-4816-b52e-1a3e4fe30f12 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-9b6d275f-2c85-4816-b52e-1a3e4fe30f12 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6d275f-2c85-4816-b52e-1a3e4fe30f12 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] <== disconnect_volume: return (389ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b6d275f-2c85-4816-b52e-1a3e4fe30f12 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 11:26:33 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-9b6d275f-2c85-4816-b52e-1a3e4fe30f12 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Deleting instance files /opt/stack/data/nova/instances/6b63060e-f38f-4dcd-b910-658cc37f3459_del
Nov 28 11:26:33 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-9b6d275f-2c85-4816-b52e-1a3e4fe30f12 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Deletion of /opt/stack/data/nova/instances/6b63060e-f38f-4dcd-b910-658cc37f3459_del complete
Nov 28 11:26:33 user nova-compute[74994]: INFO nova.compute.manager [None req-9b6d275f-2c85-4816-b52e-1a3e4fe30f12 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 28 11:26:33 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-9b6d275f-2c85-4816-b52e-1a3e4fe30f12 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d04dff-d786-4b78-9819-0f42437139a8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:26:33 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d04dff-d786-4b78-9819-0f42437139a8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:34 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d04dff-d786-4b78-9819-0f42437139a8/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:26:34 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Error from libvirt while getting description of instance-0000002d: [Error Code 42] Domain not found: no domain with matching uuid '6b63060e-f38f-4dcd-b910-658cc37f3459' (instance-0000002d): libvirt.libvirtError: Domain not found: no domain with matching uuid '6b63060e-f38f-4dcd-b910-658cc37f3459' (instance-0000002d)
Nov 28 11:26:34 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:26:34 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:26:34 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=8761MB free_disk=25.027976989746094GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 11:26:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:26:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:26:34 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:26:34 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Took 0.68 seconds to deallocate network for instance.
Nov 28 11:26:34 user nova-compute[74994]: DEBUG nova.compute.manager [req-7850ef6a-539e-4cfb-8bdb-6a72023abea1 req-f5457cd4-1700-42c7-a7ee-7e0136ace5f9 service nova] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Received event network-vif-deleted-dfed3798-5f85-494b-a5e1-f7908962c509 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:26:34 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance c1d04dff-d786-4b78-9819-0f42437139a8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:26:34 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 02d70aec-41a6-41bd-a826-1f7d31e1f78e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:26:34 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 6b63060e-f38f-4dcd-b910-658cc37f3459 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:26:34 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 242ed28b-fd06-4696-85a0-9d8060fd7f95 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:26:34 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 11:26:34 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 11:26:34 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:26:34 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:26:34 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 11:26:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.318s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:26:34 user nova-compute[74994]: DEBUG nova.compute.manager [req-6d338267-39ed-4ff6-852d-fb926af1c849 req-847e1ddf-1fd5-4ab6-9117-d56c4e614f79 service nova] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Received event network-vif-plugged-dfed3798-5f85-494b-a5e1-f7908962c509 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:26:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6d338267-39ed-4ff6-852d-fb926af1c849 req-847e1ddf-1fd5-4ab6-9117-d56c4e614f79 service nova] Acquiring lock "6b63060e-f38f-4dcd-b910-658cc37f3459-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:26:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6d338267-39ed-4ff6-852d-fb926af1c849 req-847e1ddf-1fd5-4ab6-9117-d56c4e614f79 service nova] Lock "6b63060e-f38f-4dcd-b910-658cc37f3459-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:26:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-6d338267-39ed-4ff6-852d-fb926af1c849 req-847e1ddf-1fd5-4ab6-9117-d56c4e614f79 service nova] Lock "6b63060e-f38f-4dcd-b910-658cc37f3459-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:26:34 user nova-compute[74994]: DEBUG nova.compute.manager [req-6d338267-39ed-4ff6-852d-fb926af1c849 req-847e1ddf-1fd5-4ab6-9117-d56c4e614f79 service nova] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] No waiting events found dispatching network-vif-plugged-dfed3798-5f85-494b-a5e1-f7908962c509 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:26:34 user nova-compute[74994]: WARNING nova.compute.manager [req-6d338267-39ed-4ff6-852d-fb926af1c849 req-847e1ddf-1fd5-4ab6-9117-d56c4e614f79 service nova] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Received unexpected event network-vif-plugged-dfed3798-5f85-494b-a5e1-f7908962c509 for instance with vm_state active and task_state deleting.
Nov 28 11:26:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:26:35 user nova-compute[74994]: INFO nova.compute.manager [None req-9b6d275f-2c85-4816-b52e-1a3e4fe30f12 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Took 0.95 seconds to detach 1 volumes for instance.
Nov 28 11:26:35 user nova-compute[74994]: DEBUG nova.compute.manager [None req-9b6d275f-2c85-4816-b52e-1a3e4fe30f12 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] [instance: 6b63060e-f38f-4dcd-b910-658cc37f3459] Deleting volume: c46047e2-c89a-4e1a-9a8a-140a3b747e84 {{(pid=74994) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 11:26:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9b6d275f-2c85-4816-b52e-1a3e4fe30f12 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:26:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9b6d275f-2c85-4816-b52e-1a3e4fe30f12 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:26:35 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-9b6d275f-2c85-4816-b52e-1a3e4fe30f12 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:26:35 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-9b6d275f-2c85-4816-b52e-1a3e4fe30f12 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:26:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9b6d275f-2c85-4816-b52e-1a3e4fe30f12 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.180s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:26:35 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-9b6d275f-2c85-4816-b52e-1a3e4fe30f12 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Deleted allocations for instance 6b63060e-f38f-4dcd-b910-658cc37f3459
Nov 28 11:26:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9b6d275f-2c85-4816-b52e-1a3e4fe30f12 tempest-TestShelveInstance-959893651 tempest-TestShelveInstance-959893651-project-member] Lock "6b63060e-f38f-4dcd-b910-658cc37f3459" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.319s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:26:36 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:26:36 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 11:26:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Acquiring lock "c1d04dff-d786-4b78-9819-0f42437139a8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:26:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "c1d04dff-d786-4b78-9819-0f42437139a8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:26:36 user nova-compute[74994]: DEBUG nova.objects.instance [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lazy-loading 'flavor' on Instance uuid c1d04dff-d786-4b78-9819-0f42437139a8 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:26:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "c1d04dff-d786-4b78-9819-0f42437139a8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:26:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Acquiring lock "c1d04dff-d786-4b78-9819-0f42437139a8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:26:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "c1d04dff-d786-4b78-9819-0f42437139a8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:26:37 user nova-compute[74994]: INFO nova.compute.manager [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Attaching volume f2539a06-e160-4ecb-9b7d-c4efa314190f to /dev/vdb
Nov 28 11:26:37 user nova-compute[74994]: DEBUG os_brick.utils [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:26:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:26:37 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5688373-88bd-4a73-b936-55c6e5de9460]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:26:37 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[18562068-9c99-4ec1-bef2-fa4e06712dec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:26:37 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6fb1f7d-4261-4ee9-81bf-c95612907617]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:37 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e825ef2d-c2f7-489c-ad8a-0d51ce0471b0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:26:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 11:26:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:26:37 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 11:26:37 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbc1453-0450-4659-9985-d69dcdb714dd]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 11:26:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 11:26:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 11:26:37 user nova-compute[74994]: DEBUG os_brick.utils [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:26:37 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Updating existing volume attachment record: 6b6b6509-4a9c-4226-8621-7a7106cf7e5f {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 11:26:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:26:38 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:26:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:26:41 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:26:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f2539a06-e160-4ecb-9b7d-c4efa314190f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iXtLKZyJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:26:44 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:26:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:26:44 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:26:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2539a06-e160-4ecb-9b7d-c4efa314190f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2539a06-e160-4ecb-9b7d-c4efa314190f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:26:44 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 11:26:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2539a06-e160-4ecb-9b7d-c4efa314190f -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2539a06-e160-4ecb-9b7d-c4efa314190f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4195bc5d-45cf-47ee-a532-39acd690b32b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 11:26:44 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2539a06-e160-4ecb-9b7d-c4efa314190f -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2539a06-e160-4ecb-9b7d-c4efa314190f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf652de-35c5-49b0-a7ea-da1393f3ac91]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2539a06-e160-4ecb-9b7d-c4efa314190f] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2539a06-e160-4ecb-9b7d-c4efa314190f] added
Nov 28 11:26:44 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2539a06-e160-4ecb-9b7d-c4efa314190f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2539a06-e160-4ecb-9b7d-c4efa314190f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1062f44b-1a33-4146-9b21-e970cd5030e4]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2539a06-e160-4ecb-9b7d-c4efa314190f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2539a06-e160-4ecb-9b7d-c4efa314190f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75e6bcf-732c-4ad7-9aac-0e64254dc7fc]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2539a06-e160-4ecb-9b7d-c4efa314190f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iXtLKZyJ {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2539a06-e160-4ecb-9b7d-c4efa314190f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iXtLKZyJ" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ccaa4ef-d308-4886-8eeb-ed557261783d]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iXtLKZyJ'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2539a06-e160-4ecb-9b7d-c4efa314190f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2539a06-e160-4ecb-9b7d-c4efa314190f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9fb1892-1b66-4c7a-8a2c-3f14d38929a1]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca213ceb-17ff-4a0e-b28a-7a3c08834a6a]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)
Nov 28 11:26:44 user nova-compute[74994]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26 (non-flash)
Nov 28 11:26:44 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)
Nov 28 11:26:44 user nova-compute[74994]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26 (non-flash)
Nov 28 11:26:44 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2539a06-e160-4ecb-9b7d-c4efa314190f -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2539a06-e160-4ecb-9b7d-c4efa314190f -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f053e4-9005-4ecd-983f-6298066b41fc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2539a06-e160-4ecb-9b7d-c4efa314190f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f2539a06-e160-4ecb-9b7d-c4efa314190f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2539a06-e160-4ecb-9b7d-c4efa314190f, portal: 172.16.0.220,3260]
Nov 28 11:26:44 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:f2539a06-e160-4ecb-9b7d-c4efa314190f, portal: 172.16.0.220,3260] successful.
Nov 28 11:26:44 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2539a06-e160-4ecb-9b7d-c4efa314190f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2539a06-e160-4ecb-9b7d-c4efa314190f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3dbe728-7278-4d91-9b70-23b21a63ad64]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e0cb71-5bfb-44b8-823d-b185027df2dc]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2539a06-e160-4ecb-9b7d-c4efa314190f (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Rebuilding the list of instances to heal {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)
Nov 28 11:26:44 user nova-compute[74994]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26 (non-flash)
Nov 28 11:26:44 user nova-compute[74994]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2539a06-e160-4ecb-9b7d-c4efa314190f (non-flash)
Nov 28 11:26:44 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)
Nov 28 11:26:44 user nova-compute[74994]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26 (non-flash)
Nov 28 11:26:44 user nova-compute[74994]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2539a06-e160-4ecb-9b7d-c4efa314190f (non-flash)
Nov 28 11:26:44 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2539a06-e160-4ecb-9b7d-c4efa314190f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fb129d-ea1d-4caa-bf2e-25aa63275836]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f2539a06-e160-4ecb-9b7d-c4efa314190f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iXtLKZyJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "refresh_cache-c1d04dff-d786-4b78-9819-0f42437139a8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquired lock "refresh_cache-c1d04dff-d786-4b78-9819-0f42437139a8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Forcefully refreshing network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG nova.objects.instance [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lazy-loading 'info_cache' on Instance uuid c1d04dff-d786-4b78-9819-0f42437139a8 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Updating instance_info_cache with network_info: [{"id": "5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf", "address": "fa:16:3e:f8:72:17", "network": {"id": "5eb85013-4afd-42c4-888a-a3f1dd6d8798", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1182556685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d607facd2295407fa0d40510d8f1fae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc9dcd-ca", "ovs_interfaceid": "5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Releasing lock "refresh_cache-c1d04dff-d786-4b78-9819-0f42437139a8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:26:44 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Updated the network info_cache for instance {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 11:26:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:26:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:26:45 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '26430303137396663', 'path': '/dev/sdc'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:26:45 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430303137396663', 'path': '/dev/sdc'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 11:26:45 user nova-compute[74994]: DEBUG nova.objects.instance [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lazy-loading 'flavor' on Instance uuid c1d04dff-d786-4b78-9819-0f42437139a8 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:26:45 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 11:26:45 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:26:45 user nova-compute[74994]:   <source dev="/dev/sdc"/>
Nov 28 11:26:45 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:26:45 user nova-compute[74994]:   <serial>f2539a06-e160-4ecb-9b7d-c4efa314190f</serial>
Nov 28 11:26:45 user nova-compute[74994]: </disk>
Nov 28 11:26:45 user nova-compute[74994]:  {{(pid=74994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 11:26:45 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:26:45 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:26:45 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:26:45 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] No VIF found with MAC fa:16:3e:f8:72:17, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:26:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-eccfb867-665b-4a95-8649-d6bbbecb84b5 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "c1d04dff-d786-4b78-9819-0f42437139a8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.022s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:26:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:26:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9b639412-a30f-401d-babd-48bc9565000e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Acquiring lock "c1d04dff-d786-4b78-9819-0f42437139a8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:26:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9b639412-a30f-401d-babd-48bc9565000e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "c1d04dff-d786-4b78-9819-0f42437139a8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:26:48 user nova-compute[74994]: INFO nova.compute.manager [None req-9b639412-a30f-401d-babd-48bc9565000e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Detaching volume f2539a06-e160-4ecb-9b7d-c4efa314190f
Nov 28 11:26:48 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:26:48 user nova-compute[74994]: INFO nova.virt.block_device [None req-9b639412-a30f-401d-babd-48bc9565000e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Attempting to driver detach volume f2539a06-e160-4ecb-9b7d-c4efa314190f from mountpoint /dev/vdb
Nov 28 11:26:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-9b639412-a30f-401d-babd-48bc9565000e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Attempting to detach device vdb from instance c1d04dff-d786-4b78-9819-0f42437139a8 from the persistent domain config. {{(pid=74994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 11:26:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-9b639412-a30f-401d-babd-48bc9565000e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 11:26:48 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:26:48 user nova-compute[74994]:   <source dev="/dev/sdc"/>
Nov 28 11:26:48 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:26:48 user nova-compute[74994]:   <serial>f2539a06-e160-4ecb-9b7d-c4efa314190f</serial>
Nov 28 11:26:48 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 11:26:48 user nova-compute[74994]: </disk>
Nov 28 11:26:48 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 11:26:48 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-9b639412-a30f-401d-babd-48bc9565000e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Successfully detached device vdb from instance c1d04dff-d786-4b78-9819-0f42437139a8 from the persistent domain config.
Nov 28 11:26:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-9b639412-a30f-401d-babd-48bc9565000e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c1d04dff-d786-4b78-9819-0f42437139a8 from the live domain config. {{(pid=74994) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 11:26:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-9b639412-a30f-401d-babd-48bc9565000e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 11:26:48 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:26:48 user nova-compute[74994]:   <source dev="/dev/sdc"/>
Nov 28 11:26:48 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:26:48 user nova-compute[74994]:   <serial>f2539a06-e160-4ecb-9b7d-c4efa314190f</serial>
Nov 28 11:26:48 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 11:26:48 user nova-compute[74994]: </disk>
Nov 28 11:26:48 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 11:26:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-9b639412-a30f-401d-babd-48bc9565000e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c1d04dff-d786-4b78-9819-0f42437139a8 {{(pid=74994) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 11:26:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:26:50 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:26:50 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:26:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:26:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:26:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:27:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:27:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:27:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:27:08 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-9b639412-a30f-401d-babd-48bc9565000e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c1d04dff-d786-4b78-9819-0f42437139a8 is timed out.
Nov 28 11:27:08 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-9b639412-a30f-401d-babd-48bc9565000e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Successfully detached device vdb from instance c1d04dff-d786-4b78-9819-0f42437139a8 from the live domain config.
Nov 28 11:27:08 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b639412-a30f-401d-babd-48bc9565000e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 11:27:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b639412-a30f-401d-babd-48bc9565000e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:f2539a06-e160-4ecb-9b7d-c4efa314190f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iXtLKZyJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:27:08 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-9b639412-a30f-401d-babd-48bc9565000e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:27:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-9b639412-a30f-401d-babd-48bc9565000e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:27:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-9b639412-a30f-401d-babd-48bc9565000e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:27:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:27:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:27:08 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea23dc1d-065c-4727-a002-ed2fee1e30f5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f2539a06-e160-4ecb-9b7d-c4efa314190f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:27:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b639412-a30f-401d-babd-48bc9565000e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 11:27:08 user nova-compute[74994]: No targets found.
Nov 28 11:27:08 user nova-compute[74994]: iSNS:
Nov 28 11:27:08 user nova-compute[74994]: No targets found.
Nov 28 11:27:08 user nova-compute[74994]: STATIC:
Nov 28 11:27:08 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:f2539a06-e160-4ecb-9b7d-c4efa314190f
Nov 28 11:27:08 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:27:08 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:27:08 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26
Nov 28 11:27:08 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:27:08 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:27:08 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5
Nov 28 11:27:08 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:27:08 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:27:08 user nova-compute[74994]: FIRMWARE:
Nov 28 11:27:08 user nova-compute[74994]: No targets found.
Nov 28 11:27:08 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:27:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b639412-a30f-401d-babd-48bc9565000e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 11:27:08 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 11:27:08 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 11:27:08 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b639412-a30f-401d-babd-48bc9565000e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2539a06-e160-4ecb-9b7d-c4efa314190f', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 11:27:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:27:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:27:08 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[756bf052-9955-40ef-a255-6493cb263f76]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2539a06-e160-4ecb-9b7d-c4efa314190f\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:27:08 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:27:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:27:09 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[683306c7-427f-4c13-bff9-5165482f2ad4]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2539a06-e160-4ecb-9b7d-c4efa314190f (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:27:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b639412-a30f-401d-babd-48bc9565000e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)
Nov 28 11:27:09 user nova-compute[74994]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26 (non-flash)
Nov 28 11:27:09 user nova-compute[74994]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2539a06-e160-4ecb-9b7d-c4efa314190f (non-flash)
Nov 28 11:27:09 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:27:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b639412-a30f-401d-babd-48bc9565000e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)
Nov 28 11:27:09 user nova-compute[74994]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26 (non-flash)
Nov 28 11:27:09 user nova-compute[74994]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2539a06-e160-4ecb-9b7d-c4efa314190f (non-flash)
Nov 28 11:27:09 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:27:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b639412-a30f-401d-babd-48bc9565000e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9206cdd80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2539a06-e160-4ecb-9b7d-c4efa314190f'): ({'sdc'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 11:27:09 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-9b639412-a30f-401d-babd-48bc9565000e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Removing single pathed devices sdc {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 11:27:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:27:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:27:09 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b094c6a6-0464-4489-bf2b-00baacfa9b91]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:27:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:27:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:27:09 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f98f7d-dfdc-4790-a505-a6b3d66c3868]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:27:09 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-9b639412-a30f-401d-babd-48bc9565000e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Flushing IO for device /dev/sdc {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 11:27:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:27:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:27:09 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2c87b4-9a10-4ee7-b844-0263bf273813]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:27:09 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-9b639412-a30f-401d-babd-48bc9565000e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 11:27:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:27:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.032s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:27:09 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[681e2be7-f076-4677-8221-5b93031e339f]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:27:09 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-9b639412-a30f-401d-babd-48bc9565000e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 11:27:09 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-9b639412-a30f-401d-babd-48bc9565000e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] SCSI volumes sdc have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 11:27:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b639412-a30f-401d-babd-48bc9565000e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2539a06-e160-4ecb-9b7d-c4efa314190f')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 11:27:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2539a06-e160-4ecb-9b7d-c4efa314190f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:27:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2539a06-e160-4ecb-9b7d-c4efa314190f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:27:09 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[290d14dc-780f-411b-8b43-7fa6b8faf5bb]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:27:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b639412-a30f-401d-babd-48bc9565000e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:27:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2539a06-e160-4ecb-9b7d-c4efa314190f -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:27:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2539a06-e160-4ecb-9b7d-c4efa314190f -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:27:09 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84519d6-afae-4099-b157-bf06ddffbaf2]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:f2539a06-e160-4ecb-9b7d-c4efa314190f, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:f2539a06-e160-4ecb-9b7d-c4efa314190f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:27:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b639412-a30f-401d-babd-48bc9565000e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:f2539a06-e160-4ecb-9b7d-c4efa314190f, portal: 172.16.0.220,3260]
Nov 28 11:27:09 user nova-compute[74994]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:f2539a06-e160-4ecb-9b7d-c4efa314190f, portal: 172.16.0.220,3260] successful.
Nov 28 11:27:09 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:27:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2539a06-e160-4ecb-9b7d-c4efa314190f -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:27:09 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2539a06-e160-4ecb-9b7d-c4efa314190f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:27:09 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d8bcef-4d92-4db3-a07b-689824b98275]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:27:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b639412-a30f-401d-babd-48bc9565000e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:27:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-9b639412-a30f-401d-babd-48bc9565000e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:27:09 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b639412-a30f-401d-babd-48bc9565000e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] <== disconnect_volume: return (311ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:27:09 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b639412-a30f-401d-babd-48bc9565000e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 11:27:10 user nova-compute[74994]: DEBUG nova.objects.instance [None req-9b639412-a30f-401d-babd-48bc9565000e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lazy-loading 'flavor' on Instance uuid c1d04dff-d786-4b78-9819-0f42437139a8 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:27:10 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9b639412-a30f-401d-babd-48bc9565000e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "c1d04dff-d786-4b78-9819-0f42437139a8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.700s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:27:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:27:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:27:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:27:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:27:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:27:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:27:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:27:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:27:34 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:27:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:27:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:27:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:27:34 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 11:27:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:27:34 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:27:34 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d04dff-d786-4b78-9819-0f42437139a8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:27:34 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d04dff-d786-4b78-9819-0f42437139a8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:27:34 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d04dff-d786-4b78-9819-0f42437139a8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:27:34 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d04dff-d786-4b78-9819-0f42437139a8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:27:35 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:27:35 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:27:35 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=8757MB free_disk=25.02615737915039GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 11:27:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:27:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:27:35 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance c1d04dff-d786-4b78-9819-0f42437139a8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:27:35 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 02d70aec-41a6-41bd-a826-1f7d31e1f78e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:27:35 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 242ed28b-fd06-4696-85a0-9d8060fd7f95 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:27:35 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 11:27:35 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 11:27:35 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:27:35 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:27:35 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 11:27:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.310s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:27:36 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:27:36 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 11:27:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:27:38 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:27:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Acquiring lock "c1d04dff-d786-4b78-9819-0f42437139a8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:27:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "c1d04dff-d786-4b78-9819-0f42437139a8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:27:41 user nova-compute[74994]: DEBUG nova.objects.instance [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lazy-loading 'flavor' on Instance uuid c1d04dff-d786-4b78-9819-0f42437139a8 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:27:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "c1d04dff-d786-4b78-9819-0f42437139a8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:27:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Acquiring lock "c1d04dff-d786-4b78-9819-0f42437139a8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:27:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "c1d04dff-d786-4b78-9819-0f42437139a8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:27:41 user nova-compute[74994]: INFO nova.compute.manager [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Attaching volume 29c5b539-88f1-4baa-b875-7b1b45805b8f to /dev/vdb
Nov 28 11:27:41 user nova-compute[74994]: DEBUG os_brick.utils [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:27:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:27:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:27:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0034893-a8ed-43cf-9992-0e6611c78f19]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:27:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:27:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:27:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8ee0a7-b240-4078-82dc-2eafe8458dd6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:27:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:27:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:27:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b1e7c8-6db7-482e-9ab9-79406deab5c4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:27:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a544f263-b564-497c-9ee3-1161583d8363]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:27:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:27:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:27:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 11:27:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:27:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:27:41 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 11:27:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff395d28-cd53-49be-b272-949b709ca52e]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:27:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 11:27:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 11:27:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 11:27:41 user nova-compute[74994]: DEBUG os_brick.utils [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:27:41 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Updating existing volume attachment record: e279260f-cfeb-4009-b5fc-e9d98061ebab {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 11:27:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:27:43 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:27:44 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:27:44 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 11:27:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "refresh_cache-02d70aec-41a6-41bd-a826-1f7d31e1f78e" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:27:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquired lock "refresh_cache-02d70aec-41a6-41bd-a826-1f7d31e1f78e" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:27:44 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Forcefully refreshing network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 11:27:44 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Updating instance_info_cache with network_info: [{"id": "e2f8c784-e29d-4072-817e-6b741b90188c", "address": "fa:16:3e:54:9b:ac", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f8c784-e2", "ovs_interfaceid": "e2f8c784-e29d-4072-817e-6b741b90188c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:27:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Releasing lock "refresh_cache-02d70aec-41a6-41bd-a826-1f7d31e1f78e" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:27:44 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Updated the network info_cache for instance {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 11:27:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:27:47 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RtuIljOM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:27:48 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:27:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:27:48 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:27:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:27:48 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 11:27:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ec8d4f-1a4e-4705-80a0-74bedc1f1e74]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 11:27:48 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[550fd2a5-3236-4846-af18-d3545cdbddcc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f] added
Nov 28 11:27:48 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7f60b2-31ea-4c88-96a5-6c85225ee3ab]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e389dc9-ff44-41a0-8dd2-8d9579e32db8]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RtuIljOM {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RtuIljOM" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e6dbad-65e6-4eaa-b958-a11d2b110afb]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RtuIljOM'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d32fbc4-3dc0-43c2-9ee5-c04b4ec1b3b1]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d80d5b1-025b-4764-b2a6-6566645de5ca]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51a5743-cef4-40fc-8d2a-245a6d110ec9 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)
Nov 28 11:27:48 user nova-compute[74994]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26 (non-flash)
Nov 28 11:27:48 user nova-compute[74994]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51a5743-cef4-40fc-8d2a-245a6d110ec9 (non-flash)
Nov 28 11:27:48 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)
Nov 28 11:27:48 user nova-compute[74994]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26 (non-flash)
Nov 28 11:27:48 user nova-compute[74994]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51a5743-cef4-40fc-8d2a-245a6d110ec9 (non-flash)
Nov 28 11:27:48 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f26e885-cf0d-4e0d-ac67-b0eff0c6e34c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f, portal: 172.16.0.220,3260]
Nov 28 11:27:48 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f, portal: 172.16.0.220,3260] successful.
Nov 28 11:27:48 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a0aa3a-8ed8-4db4-bb4e-5945795d9ddf]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85a36ca-b02b-4ddd-93cd-03acdc38480a]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51a5743-cef4-40fc-8d2a-245a6d110ec9 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)
Nov 28 11:27:48 user nova-compute[74994]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26 (non-flash)
Nov 28 11:27:48 user nova-compute[74994]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51a5743-cef4-40fc-8d2a-245a6d110ec9 (non-flash)
Nov 28 11:27:48 user nova-compute[74994]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f (non-flash)
Nov 28 11:27:48 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)
Nov 28 11:27:48 user nova-compute[74994]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26 (non-flash)
Nov 28 11:27:48 user nova-compute[74994]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51a5743-cef4-40fc-8d2a-245a6d110ec9 (non-flash)
Nov 28 11:27:48 user nova-compute[74994]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f (non-flash)
Nov 28 11:27:48 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] HCTL ('36', '-', '-', 0) found on session 59 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2945ae-7b0c-4750-a80e-b16ae8c1849c]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Searching for a device in session 59 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 11:27:48 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RtuIljOM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 11:27:49 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:27:49 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23536373435316436', 'path': '/dev/sde'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:27:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23536373435316436', 'path': '/dev/sde'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 11:27:49 user nova-compute[74994]: DEBUG nova.objects.instance [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lazy-loading 'flavor' on Instance uuid c1d04dff-d786-4b78-9819-0f42437139a8 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:27:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 11:27:49 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:27:49 user nova-compute[74994]:   <source dev="/dev/sde"/>
Nov 28 11:27:49 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:27:49 user nova-compute[74994]:   <serial>29c5b539-88f1-4baa-b875-7b1b45805b8f</serial>
Nov 28 11:27:49 user nova-compute[74994]: </disk>
Nov 28 11:27:49 user nova-compute[74994]:  {{(pid=74994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 11:27:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:27:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:27:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] No VIF found with MAC fa:16:3e:f8:72:17, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:27:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:27:50 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:27:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f3306983-30e1-417a-b5b0-09d4d6c5eb04 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "c1d04dff-d786-4b78-9819-0f42437139a8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.843s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:27:52 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:27:52 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:27:52 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:27:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-7ed3d8eb-c842-4225-a39c-c7f199c6a84a tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Acquiring lock "c1d04dff-d786-4b78-9819-0f42437139a8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:27:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-7ed3d8eb-c842-4225-a39c-c7f199c6a84a tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "c1d04dff-d786-4b78-9819-0f42437139a8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:27:52 user nova-compute[74994]: INFO nova.compute.manager [None req-7ed3d8eb-c842-4225-a39c-c7f199c6a84a tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Detaching volume 29c5b539-88f1-4baa-b875-7b1b45805b8f
Nov 28 11:27:53 user nova-compute[74994]: INFO nova.virt.block_device [None req-7ed3d8eb-c842-4225-a39c-c7f199c6a84a tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Attempting to driver detach volume 29c5b539-88f1-4baa-b875-7b1b45805b8f from mountpoint /dev/vdb
Nov 28 11:27:53 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-7ed3d8eb-c842-4225-a39c-c7f199c6a84a tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Attempting to detach device vdb from instance c1d04dff-d786-4b78-9819-0f42437139a8 from the persistent domain config. {{(pid=74994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 11:27:53 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-7ed3d8eb-c842-4225-a39c-c7f199c6a84a tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 11:27:53 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:27:53 user nova-compute[74994]:   <source dev="/dev/sde"/>
Nov 28 11:27:53 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:27:53 user nova-compute[74994]:   <serial>29c5b539-88f1-4baa-b875-7b1b45805b8f</serial>
Nov 28 11:27:53 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 11:27:53 user nova-compute[74994]: </disk>
Nov 28 11:27:53 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 11:27:53 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-7ed3d8eb-c842-4225-a39c-c7f199c6a84a tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Successfully detached device vdb from instance c1d04dff-d786-4b78-9819-0f42437139a8 from the persistent domain config.
Nov 28 11:27:53 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-7ed3d8eb-c842-4225-a39c-c7f199c6a84a tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c1d04dff-d786-4b78-9819-0f42437139a8 from the live domain config. {{(pid=74994) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 11:27:53 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-7ed3d8eb-c842-4225-a39c-c7f199c6a84a tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 11:27:53 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:27:53 user nova-compute[74994]:   <source dev="/dev/sde"/>
Nov 28 11:27:53 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:27:53 user nova-compute[74994]:   <serial>29c5b539-88f1-4baa-b875-7b1b45805b8f</serial>
Nov 28 11:27:53 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 11:27:53 user nova-compute[74994]: </disk>
Nov 28 11:27:53 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 11:27:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:27:53 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-7ed3d8eb-c842-4225-a39c-c7f199c6a84a tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c1d04dff-d786-4b78-9819-0f42437139a8 {{(pid=74994) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 11:27:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:27:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:28:01 user nova-compute[74994]: DEBUG nova.compute.manager [req-362dd31c-2d84-4c40-8d92-7c05757d15b6 req-de290144-e493-4a30-8e2e-1a92888e8e00 service nova] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Received event network-changed-f7c34a48-6c32-4215-add8-ee612ae7ebff {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:28:01 user nova-compute[74994]: DEBUG nova.compute.manager [req-362dd31c-2d84-4c40-8d92-7c05757d15b6 req-de290144-e493-4a30-8e2e-1a92888e8e00 service nova] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Refreshing instance network info cache due to event network-changed-f7c34a48-6c32-4215-add8-ee612ae7ebff. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:28:01 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-362dd31c-2d84-4c40-8d92-7c05757d15b6 req-de290144-e493-4a30-8e2e-1a92888e8e00 service nova] Acquiring lock "refresh_cache-242ed28b-fd06-4696-85a0-9d8060fd7f95" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:28:01 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-362dd31c-2d84-4c40-8d92-7c05757d15b6 req-de290144-e493-4a30-8e2e-1a92888e8e00 service nova] Acquired lock "refresh_cache-242ed28b-fd06-4696-85a0-9d8060fd7f95" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:28:01 user nova-compute[74994]: DEBUG nova.network.neutron [req-362dd31c-2d84-4c40-8d92-7c05757d15b6 req-de290144-e493-4a30-8e2e-1a92888e8e00 service nova] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Refreshing network info cache for port f7c34a48-6c32-4215-add8-ee612ae7ebff {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:28:02 user nova-compute[74994]: DEBUG nova.network.neutron [req-362dd31c-2d84-4c40-8d92-7c05757d15b6 req-de290144-e493-4a30-8e2e-1a92888e8e00 service nova] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Updated VIF entry in instance network info cache for port f7c34a48-6c32-4215-add8-ee612ae7ebff. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:28:02 user nova-compute[74994]: DEBUG nova.network.neutron [req-362dd31c-2d84-4c40-8d92-7c05757d15b6 req-de290144-e493-4a30-8e2e-1a92888e8e00 service nova] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Updating instance_info_cache with network_info: [{"id": "f7c34a48-6c32-4215-add8-ee612ae7ebff", "address": "fa:16:3e:e6:36:40", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7c34a48-6c", "ovs_interfaceid": "f7c34a48-6c32-4215-add8-ee612ae7ebff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:28:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-362dd31c-2d84-4c40-8d92-7c05757d15b6 req-de290144-e493-4a30-8e2e-1a92888e8e00 service nova] Releasing lock "refresh_cache-242ed28b-fd06-4696-85a0-9d8060fd7f95" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:28:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:28:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6200a67e-c7c6-4bd8-a65c-6cdb5ff41c1e tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "242ed28b-fd06-4696-85a0-9d8060fd7f95" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:28:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6200a67e-c7c6-4bd8-a65c-6cdb5ff41c1e tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "242ed28b-fd06-4696-85a0-9d8060fd7f95" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:28:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6200a67e-c7c6-4bd8-a65c-6cdb5ff41c1e tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "242ed28b-fd06-4696-85a0-9d8060fd7f95-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:28:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6200a67e-c7c6-4bd8-a65c-6cdb5ff41c1e tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "242ed28b-fd06-4696-85a0-9d8060fd7f95-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:28:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6200a67e-c7c6-4bd8-a65c-6cdb5ff41c1e tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "242ed28b-fd06-4696-85a0-9d8060fd7f95-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:28:03 user nova-compute[74994]: INFO nova.compute.manager [None req-6200a67e-c7c6-4bd8-a65c-6cdb5ff41c1e tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Terminating instance
Nov 28 11:28:03 user nova-compute[74994]: DEBUG nova.compute.manager [None req-6200a67e-c7c6-4bd8-a65c-6cdb5ff41c1e tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 11:28:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:28:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:28:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:28:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:28:03 user nova-compute[74994]: DEBUG nova.compute.manager [req-7c7db11d-435b-48eb-bb9d-51b3c0684d0e req-33466ac6-2a81-4509-b542-5ac4e72a1190 service nova] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Received event network-vif-unplugged-f7c34a48-6c32-4215-add8-ee612ae7ebff {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:28:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-7c7db11d-435b-48eb-bb9d-51b3c0684d0e req-33466ac6-2a81-4509-b542-5ac4e72a1190 service nova] Acquiring lock "242ed28b-fd06-4696-85a0-9d8060fd7f95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:28:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-7c7db11d-435b-48eb-bb9d-51b3c0684d0e req-33466ac6-2a81-4509-b542-5ac4e72a1190 service nova] Lock "242ed28b-fd06-4696-85a0-9d8060fd7f95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:28:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-7c7db11d-435b-48eb-bb9d-51b3c0684d0e req-33466ac6-2a81-4509-b542-5ac4e72a1190 service nova] Lock "242ed28b-fd06-4696-85a0-9d8060fd7f95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:28:03 user nova-compute[74994]: DEBUG nova.compute.manager [req-7c7db11d-435b-48eb-bb9d-51b3c0684d0e req-33466ac6-2a81-4509-b542-5ac4e72a1190 service nova] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] No waiting events found dispatching network-vif-unplugged-f7c34a48-6c32-4215-add8-ee612ae7ebff {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:28:03 user nova-compute[74994]: DEBUG nova.compute.manager [req-7c7db11d-435b-48eb-bb9d-51b3c0684d0e req-33466ac6-2a81-4509-b542-5ac4e72a1190 service nova] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Received event network-vif-unplugged-f7c34a48-6c32-4215-add8-ee612ae7ebff for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 11:28:04 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Instance destroyed successfully.
Nov 28 11:28:04 user nova-compute[74994]: DEBUG nova.objects.instance [None req-6200a67e-c7c6-4bd8-a65c-6cdb5ff41c1e tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lazy-loading 'resources' on Instance uuid 242ed28b-fd06-4696-85a0-9d8060fd7f95 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-6200a67e-c7c6-4bd8-a65c-6cdb5ff41c1e tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:26:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-56461052',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-56461052',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-56461052',id=49,image_ref='9ae21bbc-a970-4f81-8310-ec78607871a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHT+hIhWTflqhY430mdIbirEwPvQ5PzjO1f0wP82pVClnxbcwgBmuOze7DWJM35CJcWjIu0NEK2EjOi3g961ZqpzEjqm4Bjh7NtAW6kCwGm+o/bGu0XTC+e7dfK32w/RZg==',key_name='tempest-keypair-411335736',keypairs=<?>,launch_index=0,launched_at=2023-11-28T11:26:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb427b7927364726907d9e90ef9a578f',ramdisk_id='',reservation_id='r-f2sh561g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-169069415',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-169069415-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-169069415',owner_user_name='tempest-TestVolumeBootPattern-169069415-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T11:26:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1ebcd41891545f990e285b43c9eac90',uuid=242ed28b-fd06-4696-85a0-9d8060fd7f95,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f7c34a48-6c32-4215-add8-ee612ae7ebff", "address": "fa:16:3e:e6:36:40", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7c34a48-6c", "ovs_interfaceid": "f7c34a48-6c32-4215-add8-ee612ae7ebff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-6200a67e-c7c6-4bd8-a65c-6cdb5ff41c1e tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Converting VIF {"id": "f7c34a48-6c32-4215-add8-ee612ae7ebff", "address": "fa:16:3e:e6:36:40", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7c34a48-6c", "ovs_interfaceid": "f7c34a48-6c32-4215-add8-ee612ae7ebff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-6200a67e-c7c6-4bd8-a65c-6cdb5ff41c1e tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e6:36:40,bridge_name='br-int',has_traffic_filtering=True,id=f7c34a48-6c32-4215-add8-ee612ae7ebff,network=Network(2dad67e8-a656-4aa2-a2ed-f2875ee5e48a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7c34a48-6c') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG os_vif [None req-6200a67e-c7c6-4bd8-a65c-6cdb5ff41c1e tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:36:40,bridge_name='br-int',has_traffic_filtering=True,id=f7c34a48-6c32-4215-add8-ee612ae7ebff,network=Network(2dad67e8-a656-4aa2-a2ed-f2875ee5e48a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7c34a48-6c') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf7c34a48-6c, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ff1ddc46-28f4-4679-830c-5cb5dc900d2b) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:28:04 user nova-compute[74994]: INFO os_vif [None req-6200a67e-c7c6-4bd8-a65c-6cdb5ff41c1e tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:36:40,bridge_name='br-int',has_traffic_filtering=True,id=f7c34a48-6c32-4215-add8-ee612ae7ebff,network=Network(2dad67e8-a656-4aa2-a2ed-f2875ee5e48a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7c34a48-6c')
Nov 28 11:28:04 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6200a67e-c7c6-4bd8-a65c-6cdb5ff41c1e tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6200a67e-c7c6-4bd8-a65c-6cdb5ff41c1e tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SmqNEcXU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:28:04 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-6200a67e-c7c6-4bd8-a65c-6cdb5ff41c1e tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:28:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-6200a67e-c7c6-4bd8-a65c-6cdb5ff41c1e tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-6200a67e-c7c6-4bd8-a65c-6cdb5ff41c1e tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f0f34d-039a-4ae6-aa52-5b536ad426f6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6200a67e-c7c6-4bd8-a65c-6cdb5ff41c1e tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 11:28:04 user nova-compute[74994]: No targets found.
Nov 28 11:28:04 user nova-compute[74994]: iSNS:
Nov 28 11:28:04 user nova-compute[74994]: No targets found.
Nov 28 11:28:04 user nova-compute[74994]: STATIC:
Nov 28 11:28:04 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26
Nov 28 11:28:04 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:28:04 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:28:04 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f
Nov 28 11:28:04 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:28:04 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:28:04 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5
Nov 28 11:28:04 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:28:04 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:28:04 user nova-compute[74994]: FIRMWARE:
Nov 28 11:28:04 user nova-compute[74994]: No targets found.
Nov 28 11:28:04 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6200a67e-c7c6-4bd8-a65c-6cdb5ff41c1e tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 11:28:04 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 11:28:04 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6200a67e-c7c6-4bd8-a65c-6cdb5ff41c1e tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a5be52-eef2-406a-bd29-358787b9db67]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac52240-ae51-4c2e-88b7-1de393e9e583]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6200a67e-c7c6-4bd8-a65c-6cdb5ff41c1e tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)
Nov 28 11:28:04 user nova-compute[74994]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26 (non-flash)
Nov 28 11:28:04 user nova-compute[74994]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f (non-flash)
Nov 28 11:28:04 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6200a67e-c7c6-4bd8-a65c-6cdb5ff41c1e tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)
Nov 28 11:28:04 user nova-compute[74994]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26 (non-flash)
Nov 28 11:28:04 user nova-compute[74994]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f (non-flash)
Nov 28 11:28:04 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6200a67e-c7c6-4bd8-a65c-6cdb5ff41c1e tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb92035c040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26'): ({'sdd'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-6200a67e-c7c6-4bd8-a65c-6cdb5ff41c1e tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Removing single pathed devices sdd {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba8375d-b079-437d-bdcc-e716f2832290]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d36c19f-6aff-4c60-9c2d-d5ff418ff4f1]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-6200a67e-c7c6-4bd8-a65c-6cdb5ff41c1e tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Flushing IO for device /dev/sdd {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b8a92e-e06c-45b1-bd2a-c49e2d1d5af7]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-6200a67e-c7c6-4bd8-a65c-6cdb5ff41c1e tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9674f12e-9417-43a9-84c6-56e81f4a51d0]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-6200a67e-c7c6-4bd8-a65c-6cdb5ff41c1e tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-6200a67e-c7c6-4bd8-a65c-6cdb5ff41c1e tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] SCSI volumes sdd have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23035636235303433', '/dev/disk/by-id/scsi-1SCST_BIO2fb7677a-05cb504388f2a0cb', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_2fb7677a') {{(pid=86494) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[deaa4025-f71b-431b-8d3c-cc2f0c6813b3]: (4, None) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6200a67e-c7c6-4bd8-a65c-6cdb5ff41c1e tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa1a29e-c076-431b-96b7-d77adda9ecf1]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6200a67e-c7c6-4bd8-a65c-6cdb5ff41c1e tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26 -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[03278a33-fd43-4ceb-b8b1-4481a2fbf838]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6200a67e-c7c6-4bd8-a65c-6cdb5ff41c1e tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26, portal: 172.16.0.220,3260]
Nov 28 11:28:04 user nova-compute[74994]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26, portal: 172.16.0.220,3260] successful.
Nov 28 11:28:04 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26 -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d14e06d-167f-4757-bf2e-0b2b0186eb26 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe7d92c-e13f-4b1b-9d43-b62f8adf3229]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6200a67e-c7c6-4bd8-a65c-6cdb5ff41c1e tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-6200a67e-c7c6-4bd8-a65c-6cdb5ff41c1e tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6200a67e-c7c6-4bd8-a65c-6cdb5ff41c1e tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] <== disconnect_volume: return (305ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6200a67e-c7c6-4bd8-a65c-6cdb5ff41c1e tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 11:28:04 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-6200a67e-c7c6-4bd8-a65c-6cdb5ff41c1e tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Deleting instance files /opt/stack/data/nova/instances/242ed28b-fd06-4696-85a0-9d8060fd7f95_del
Nov 28 11:28:04 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-6200a67e-c7c6-4bd8-a65c-6cdb5ff41c1e tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Deletion of /opt/stack/data/nova/instances/242ed28b-fd06-4696-85a0-9d8060fd7f95_del complete
Nov 28 11:28:04 user nova-compute[74994]: INFO nova.compute.manager [None req-6200a67e-c7c6-4bd8-a65c-6cdb5ff41c1e tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 28 11:28:04 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-6200a67e-c7c6-4bd8-a65c-6cdb5ff41c1e tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 11:28:04 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 11:28:05 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:28:05 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Took 0.70 seconds to deallocate network for instance.
Nov 28 11:28:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:28:05 user nova-compute[74994]: DEBUG nova.compute.manager [req-b8051e99-1600-4bb9-9a42-4e68a4ef23ad req-48857c3a-53ea-4816-a9a9-4312eff8c30f service nova] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Received event network-vif-plugged-f7c34a48-6c32-4215-add8-ee612ae7ebff {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:28:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-b8051e99-1600-4bb9-9a42-4e68a4ef23ad req-48857c3a-53ea-4816-a9a9-4312eff8c30f service nova] Acquiring lock "242ed28b-fd06-4696-85a0-9d8060fd7f95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:28:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-b8051e99-1600-4bb9-9a42-4e68a4ef23ad req-48857c3a-53ea-4816-a9a9-4312eff8c30f service nova] Lock "242ed28b-fd06-4696-85a0-9d8060fd7f95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:28:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-b8051e99-1600-4bb9-9a42-4e68a4ef23ad req-48857c3a-53ea-4816-a9a9-4312eff8c30f service nova] Lock "242ed28b-fd06-4696-85a0-9d8060fd7f95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:28:05 user nova-compute[74994]: DEBUG nova.compute.manager [req-b8051e99-1600-4bb9-9a42-4e68a4ef23ad req-48857c3a-53ea-4816-a9a9-4312eff8c30f service nova] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] No waiting events found dispatching network-vif-plugged-f7c34a48-6c32-4215-add8-ee612ae7ebff {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:28:05 user nova-compute[74994]: WARNING nova.compute.manager [req-b8051e99-1600-4bb9-9a42-4e68a4ef23ad req-48857c3a-53ea-4816-a9a9-4312eff8c30f service nova] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Received unexpected event network-vif-plugged-f7c34a48-6c32-4215-add8-ee612ae7ebff for instance with vm_state active and task_state deleting.
Nov 28 11:28:05 user nova-compute[74994]: DEBUG nova.compute.manager [req-b8051e99-1600-4bb9-9a42-4e68a4ef23ad req-48857c3a-53ea-4816-a9a9-4312eff8c30f service nova] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Received event network-vif-deleted-f7c34a48-6c32-4215-add8-ee612ae7ebff {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:28:06 user nova-compute[74994]: INFO nova.compute.manager [None req-6200a67e-c7c6-4bd8-a65c-6cdb5ff41c1e tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Took 0.85 seconds to detach 1 volumes for instance.
Nov 28 11:28:06 user nova-compute[74994]: DEBUG nova.compute.manager [None req-6200a67e-c7c6-4bd8-a65c-6cdb5ff41c1e tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 242ed28b-fd06-4696-85a0-9d8060fd7f95] Deleting volume: 6d14e06d-167f-4757-bf2e-0b2b0186eb26 {{(pid=74994) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 11:28:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6200a67e-c7c6-4bd8-a65c-6cdb5ff41c1e tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:28:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6200a67e-c7c6-4bd8-a65c-6cdb5ff41c1e tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:28:06 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-6200a67e-c7c6-4bd8-a65c-6cdb5ff41c1e tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:28:06 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-6200a67e-c7c6-4bd8-a65c-6cdb5ff41c1e tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:28:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6200a67e-c7c6-4bd8-a65c-6cdb5ff41c1e tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.211s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:28:06 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-6200a67e-c7c6-4bd8-a65c-6cdb5ff41c1e tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Deleted allocations for instance 242ed28b-fd06-4696-85a0-9d8060fd7f95
Nov 28 11:28:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6200a67e-c7c6-4bd8-a65c-6cdb5ff41c1e tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "242ed28b-fd06-4696-85a0-9d8060fd7f95" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.158s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:28:09 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:28:13 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-7ed3d8eb-c842-4225-a39c-c7f199c6a84a tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c1d04dff-d786-4b78-9819-0f42437139a8 is timed out.
Nov 28 11:28:13 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-7ed3d8eb-c842-4225-a39c-c7f199c6a84a tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Successfully detached device vdb from instance c1d04dff-d786-4b78-9819-0f42437139a8 from the live domain config.
Nov 28 11:28:13 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ed3d8eb-c842-4225-a39c-c7f199c6a84a tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 11:28:13 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed3d8eb-c842-4225-a39c-c7f199c6a84a tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RtuIljOM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:28:13 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-7ed3d8eb-c842-4225-a39c-c7f199c6a84a tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:28:13 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-7ed3d8eb-c842-4225-a39c-c7f199c6a84a tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:28:13 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-7ed3d8eb-c842-4225-a39c-c7f199c6a84a tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:28:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:28:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:28:13 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b8830e-58a6-4489-83a3-0b71ed1cd50b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:28:13 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed3d8eb-c842-4225-a39c-c7f199c6a84a tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 11:28:13 user nova-compute[74994]: No targets found.
Nov 28 11:28:13 user nova-compute[74994]: iSNS:
Nov 28 11:28:13 user nova-compute[74994]: No targets found.
Nov 28 11:28:13 user nova-compute[74994]: STATIC:
Nov 28 11:28:13 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f
Nov 28 11:28:13 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:28:13 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:28:13 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5
Nov 28 11:28:13 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:28:13 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:28:13 user nova-compute[74994]: FIRMWARE:
Nov 28 11:28:13 user nova-compute[74994]: No targets found.
Nov 28 11:28:13 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:28:13 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed3d8eb-c842-4225-a39c-c7f199c6a84a tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 11:28:13 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 11:28:13 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 11:28:13 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed3d8eb-c842-4225-a39c-c7f199c6a84a tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 11:28:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:28:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:28:13 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64bf691-03d4-43e6-88ad-43d86d7dccd8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:28:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:28:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:28:13 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e50d25-58c9-4eb4-910d-de527f5e2f78]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:28:13 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed3d8eb-c842-4225-a39c-c7f199c6a84a tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)
Nov 28 11:28:13 user nova-compute[74994]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f (non-flash)
Nov 28 11:28:13 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:28:13 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed3d8eb-c842-4225-a39c-c7f199c6a84a tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)
Nov 28 11:28:13 user nova-compute[74994]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f (non-flash)
Nov 28 11:28:13 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:28:13 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed3d8eb-c842-4225-a39c-c7f199c6a84a tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9445c29e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f'): ({'sde'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 11:28:13 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-7ed3d8eb-c842-4225-a39c-c7f199c6a84a tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Removing single pathed devices sde {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 11:28:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:28:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:28:13 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f9a5de-6b81-4af3-b60d-90ba6cd80113]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:28:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:28:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:28:13 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b8f82e-bbec-4ca0-8af3-b1254bda976e]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:28:13 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-7ed3d8eb-c842-4225-a39c-c7f199c6a84a tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Flushing IO for device /dev/sde {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 11:28:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:28:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:28:13 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3196ff47-0591-48bd-8a52-e790fb98477f]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:28:13 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-7ed3d8eb-c842-4225-a39c-c7f199c6a84a tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 11:28:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:28:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.032s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:28:13 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e9b696-2c84-496e-afb6-89c9f874e46f]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:28:13 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-7ed3d8eb-c842-4225-a39c-c7f199c6a84a tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 11:28:13 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-7ed3d8eb-c842-4225-a39c-c7f199c6a84a tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] SCSI volumes sde have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 11:28:13 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed3d8eb-c842-4225-a39c-c7f199c6a84a tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 11:28:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:28:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:28:13 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[bacb7a58-656c-48dc-b177-f08b4029e64c]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:28:13 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed3d8eb-c842-4225-a39c-c7f199c6a84a tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:28:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:28:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:28:13 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d955330-00de-4765-bd15-bbafe597cb56]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:28:13 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed3d8eb-c842-4225-a39c-c7f199c6a84a tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f, portal: 172.16.0.220,3260]
Nov 28 11:28:13 user nova-compute[74994]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f, portal: 172.16.0.220,3260] successful.
Nov 28 11:28:13 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:28:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:28:13 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c5b539-88f1-4baa-b875-7b1b45805b8f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:28:13 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b058f678-9dc8-42f4-9df0-bd479fda0ead]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:28:13 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed3d8eb-c842-4225-a39c-c7f199c6a84a tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:28:13 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-7ed3d8eb-c842-4225-a39c-c7f199c6a84a tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:28:13 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed3d8eb-c842-4225-a39c-c7f199c6a84a tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] <== disconnect_volume: return (280ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:28:13 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ed3d8eb-c842-4225-a39c-c7f199c6a84a tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 11:28:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:28:14 user nova-compute[74994]: DEBUG nova.objects.instance [None req-7ed3d8eb-c842-4225-a39c-c7f199c6a84a tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lazy-loading 'flavor' on Instance uuid c1d04dff-d786-4b78-9819-0f42437139a8 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:28:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-7ed3d8eb-c842-4225-a39c-c7f199c6a84a tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "c1d04dff-d786-4b78-9819-0f42437139a8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.600s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:28:19 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:28:19 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:28:19 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:28:19 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:28:19 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:28:19 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:28:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:28:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:28:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:28:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:28:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:28:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:28:29 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:28:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:28:36 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:28:36 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 11:28:36 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:28:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:28:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:28:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:28:36 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 11:28:36 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:28:36 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d04dff-d786-4b78-9819-0f42437139a8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:28:36 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d04dff-d786-4b78-9819-0f42437139a8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:28:36 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d04dff-d786-4b78-9819-0f42437139a8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:28:36 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d04dff-d786-4b78-9819-0f42437139a8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:28:37 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:28:37 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:28:37 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=8879MB free_disk=25.024002075195312GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 11:28:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:28:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:28:37 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance c1d04dff-d786-4b78-9819-0f42437139a8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:28:37 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 02d70aec-41a6-41bd-a826-1f7d31e1f78e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:28:37 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 11:28:37 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 11:28:37 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:28:37 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:28:37 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 11:28:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.193s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:28:39 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:28:39 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:28:43 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:28:44 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:28:46 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:28:46 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 11:28:46 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Didn't find any instances for network info cache update. {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 11:28:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Acquiring lock "c1d04dff-d786-4b78-9819-0f42437139a8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:28:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "c1d04dff-d786-4b78-9819-0f42437139a8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:28:46 user nova-compute[74994]: DEBUG nova.objects.instance [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lazy-loading 'flavor' on Instance uuid c1d04dff-d786-4b78-9819-0f42437139a8 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:28:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "c1d04dff-d786-4b78-9819-0f42437139a8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:28:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Acquiring lock "c1d04dff-d786-4b78-9819-0f42437139a8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:28:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "c1d04dff-d786-4b78-9819-0f42437139a8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:28:46 user nova-compute[74994]: INFO nova.compute.manager [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Attaching volume 9a82486b-24f7-45f0-8cca-31b625c64e32 to /dev/vdb
Nov 28 11:28:46 user nova-compute[74994]: DEBUG os_brick.utils [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:28:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:28:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:28:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3727bfde-036d-4e31-b588-b264b903ce27]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:28:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:28:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:28:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbbf26b-afe6-4eda-8da8-5cd44c17006f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:28:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:28:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:28:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7436a36-bca2-4f46-a01a-f86fea9c64f4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:28:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[292b482c-ae1c-468c-9539-3003e728add5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:28:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:28:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:28:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 11:28:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:28:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:28:46 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 11:28:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb3da3d-298a-473c-b8e1-438b7e6c49d8]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:28:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 11:28:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 11:28:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 11:28:46 user nova-compute[74994]: DEBUG os_brick.utils [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:28:46 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Updating existing volume attachment record: b5bfda01-6210-4ae9-89ae-ab38049a58c5 {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 11:28:48 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:28:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:28:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:28:51 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:28:52 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oxszueDc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:28:53 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:28:53 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:28:53 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:28:53 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:28:53 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 11:28:53 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32 -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[df952ae5-2664-4436-a12d-8c66affa1ab6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 11:28:53 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32 -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e68d126-f6b5-491f-ba6b-14f900ae207a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32] added
Nov 28 11:28:53 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2ac69d-d8bc-44d5-8abf-440738ef648c]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9e3988-996e-43bd-8c83-3e70730ca3df]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oxszueDc {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oxszueDc" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc78dbe0-f31f-457e-a268-06bfaee884a2]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oxszueDc'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[293b9b8b-fa55-47c1-9beb-cf33dd346c19]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2d06d2-16ca-4ed7-942e-868829bf2ddc]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)
Nov 28 11:28:53 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)
Nov 28 11:28:53 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32 -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c16aa7-fca1-48fd-a0ad-061297041a51]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32, portal: 172.16.0.220,3260]
Nov 28 11:28:53 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32, portal: 172.16.0.220,3260] successful.
Nov 28 11:28:53 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f68e5b2-7ed3-4cec-8ffd-c043761fa9c1]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a17ec0-b343-423c-93f8-a8220a86457a]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)
Nov 28 11:28:53 user nova-compute[74994]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32 (non-flash)
Nov 28 11:28:53 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)
Nov 28 11:28:53 user nova-compute[74994]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32 (non-flash)
Nov 28 11:28:53 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e631ccd3-3cdf-4d9e-8548-34518d6a5483]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:28:53 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: None {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 11:28:54 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:28:54 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 11:28:54 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oxszueDc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 11:28:54 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:28:54 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23431636262316237', 'path': '/dev/sdc'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:28:54 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431636262316237', 'path': '/dev/sdc'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 11:28:54 user nova-compute[74994]: DEBUG nova.objects.instance [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lazy-loading 'flavor' on Instance uuid c1d04dff-d786-4b78-9819-0f42437139a8 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:28:54 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 11:28:54 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:28:54 user nova-compute[74994]:   <source dev="/dev/sdc"/>
Nov 28 11:28:54 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:28:54 user nova-compute[74994]:   <serial>9a82486b-24f7-45f0-8cca-31b625c64e32</serial>
Nov 28 11:28:54 user nova-compute[74994]: </disk>
Nov 28 11:28:54 user nova-compute[74994]:  {{(pid=74994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 11:28:55 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:28:55 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:28:55 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] No VIF found with MAC fa:16:3e:f8:72:17, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:28:55 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-5f789d77-436c-4d94-a932-9ea1f455487e tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "c1d04dff-d786-4b78-9819-0f42437139a8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.781s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:28:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-01789a3c-6960-4d07-9fbd-2b10ecc16355 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "02d70aec-41a6-41bd-a826-1f7d31e1f78e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:28:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-01789a3c-6960-4d07-9fbd-2b10ecc16355 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "02d70aec-41a6-41bd-a826-1f7d31e1f78e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:28:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-01789a3c-6960-4d07-9fbd-2b10ecc16355 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "02d70aec-41a6-41bd-a826-1f7d31e1f78e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:28:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-01789a3c-6960-4d07-9fbd-2b10ecc16355 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "02d70aec-41a6-41bd-a826-1f7d31e1f78e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:28:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-01789a3c-6960-4d07-9fbd-2b10ecc16355 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "02d70aec-41a6-41bd-a826-1f7d31e1f78e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:28:57 user nova-compute[74994]: INFO nova.compute.manager [None req-01789a3c-6960-4d07-9fbd-2b10ecc16355 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Terminating instance
Nov 28 11:28:57 user nova-compute[74994]: DEBUG nova.compute.manager [None req-01789a3c-6960-4d07-9fbd-2b10ecc16355 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 11:28:57 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:28:57 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:28:57 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:28:57 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:28:57 user nova-compute[74994]: DEBUG nova.compute.manager [req-1873143a-d07a-4460-8b31-669819953a1a req-dcf531d9-9fa8-41e1-9492-afaaf6fd9899 service nova] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Received event network-vif-unplugged-e2f8c784-e29d-4072-817e-6b741b90188c {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:28:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-1873143a-d07a-4460-8b31-669819953a1a req-dcf531d9-9fa8-41e1-9492-afaaf6fd9899 service nova] Acquiring lock "02d70aec-41a6-41bd-a826-1f7d31e1f78e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:28:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-1873143a-d07a-4460-8b31-669819953a1a req-dcf531d9-9fa8-41e1-9492-afaaf6fd9899 service nova] Lock "02d70aec-41a6-41bd-a826-1f7d31e1f78e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:28:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-1873143a-d07a-4460-8b31-669819953a1a req-dcf531d9-9fa8-41e1-9492-afaaf6fd9899 service nova] Lock "02d70aec-41a6-41bd-a826-1f7d31e1f78e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:28:57 user nova-compute[74994]: DEBUG nova.compute.manager [req-1873143a-d07a-4460-8b31-669819953a1a req-dcf531d9-9fa8-41e1-9492-afaaf6fd9899 service nova] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] No waiting events found dispatching network-vif-unplugged-e2f8c784-e29d-4072-817e-6b741b90188c {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:28:57 user nova-compute[74994]: DEBUG nova.compute.manager [req-1873143a-d07a-4460-8b31-669819953a1a req-dcf531d9-9fa8-41e1-9492-afaaf6fd9899 service nova] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Received event network-vif-unplugged-e2f8c784-e29d-4072-817e-6b741b90188c for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 11:28:57 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:28:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6ae1f01d-f4ed-46ef-a2a0-599125de33cf tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Acquiring lock "c1d04dff-d786-4b78-9819-0f42437139a8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:28:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6ae1f01d-f4ed-46ef-a2a0-599125de33cf tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "c1d04dff-d786-4b78-9819-0f42437139a8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:28:57 user nova-compute[74994]: INFO nova.compute.manager [None req-6ae1f01d-f4ed-46ef-a2a0-599125de33cf tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Detaching volume 9a82486b-24f7-45f0-8cca-31b625c64e32
Nov 28 11:28:58 user nova-compute[74994]: INFO nova.virt.block_device [None req-6ae1f01d-f4ed-46ef-a2a0-599125de33cf tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Attempting to driver detach volume 9a82486b-24f7-45f0-8cca-31b625c64e32 from mountpoint /dev/vdb
Nov 28 11:28:58 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Instance destroyed successfully.
Nov 28 11:28:58 user nova-compute[74994]: DEBUG nova.objects.instance [None req-01789a3c-6960-4d07-9fbd-2b10ecc16355 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lazy-loading 'resources' on Instance uuid 02d70aec-41a6-41bd-a826-1f7d31e1f78e {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-6ae1f01d-f4ed-46ef-a2a0-599125de33cf tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Attempting to detach device vdb from instance c1d04dff-d786-4b78-9819-0f42437139a8 from the persistent domain config. {{(pid=74994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-6ae1f01d-f4ed-46ef-a2a0-599125de33cf tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 11:28:58 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:28:58 user nova-compute[74994]:   <source dev="/dev/sdc"/>
Nov 28 11:28:58 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:28:58 user nova-compute[74994]:   <serial>9a82486b-24f7-45f0-8cca-31b625c64e32</serial>
Nov 28 11:28:58 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 11:28:58 user nova-compute[74994]: </disk>
Nov 28 11:28:58 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 11:28:58 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-6ae1f01d-f4ed-46ef-a2a0-599125de33cf tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Successfully detached device vdb from instance c1d04dff-d786-4b78-9819-0f42437139a8 from the persistent domain config.
Nov 28 11:28:58 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-6ae1f01d-f4ed-46ef-a2a0-599125de33cf tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c1d04dff-d786-4b78-9819-0f42437139a8 from the live domain config. {{(pid=74994) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-6ae1f01d-f4ed-46ef-a2a0-599125de33cf tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 11:28:58 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:28:58 user nova-compute[74994]:   <source dev="/dev/sdc"/>
Nov 28 11:28:58 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:28:58 user nova-compute[74994]:   <serial>9a82486b-24f7-45f0-8cca-31b625c64e32</serial>
Nov 28 11:28:58 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 11:28:58 user nova-compute[74994]: </disk>
Nov 28 11:28:58 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-01789a3c-6960-4d07-9fbd-2b10ecc16355 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:24:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-18128353',display_name='tempest-TestVolumeBootPattern-volume-backed-server-18128353',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-18128353',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTvbS+30IeAsvJmiTSMQ5tdHukOz2oPzRihG02M73B2wMzzjiivpAFNHC8a+YZFHJWALAMADi2LEjP4BQYZOwgNv1+qviqjkPHI6Uym2cGFlI9tqZMtIROxVOVkn+yujg==',key_name='tempest-keypair-97708266',keypairs=<?>,launch_index=0,launched_at=2023-11-28T11:24:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb427b7927364726907d9e90ef9a578f',ramdisk_id='',reservation_id='r-1nmm03xu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-169069415',owner_user_name='tempest-TestVolumeBootPattern-169069415-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T11:24:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1ebcd41891545f990e285b43c9eac90',uuid=02d70aec-41a6-41bd-a826-1f7d31e1f78e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2f8c784-e29d-4072-817e-6b741b90188c", "address": "fa:16:3e:54:9b:ac", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f8c784-e2", "ovs_interfaceid": "e2f8c784-e29d-4072-817e-6b741b90188c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-01789a3c-6960-4d07-9fbd-2b10ecc16355 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Converting VIF {"id": "e2f8c784-e29d-4072-817e-6b741b90188c", "address": "fa:16:3e:54:9b:ac", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f8c784-e2", "ovs_interfaceid": "e2f8c784-e29d-4072-817e-6b741b90188c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-01789a3c-6960-4d07-9fbd-2b10ecc16355 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:9b:ac,bridge_name='br-int',has_traffic_filtering=True,id=e2f8c784-e29d-4072-817e-6b741b90188c,network=Network(2dad67e8-a656-4aa2-a2ed-f2875ee5e48a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2f8c784-e2') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG os_vif [None req-01789a3c-6960-4d07-9fbd-2b10ecc16355 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:9b:ac,bridge_name='br-int',has_traffic_filtering=True,id=e2f8c784-e29d-4072-817e-6b741b90188c,network=Network(2dad67e8-a656-4aa2-a2ed-f2875ee5e48a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2f8c784-e2') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape2f8c784-e2, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=47e46757-9539-4596-9df9-356350737e13) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:28:58 user nova-compute[74994]: INFO os_vif [None req-01789a3c-6960-4d07-9fbd-2b10ecc16355 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:9b:ac,bridge_name='br-int',has_traffic_filtering=True,id=e2f8c784-e29d-4072-817e-6b741b90188c,network=Network(2dad67e8-a656-4aa2-a2ed-f2875ee5e48a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2f8c784-e2')
Nov 28 11:28:58 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01789a3c-6960-4d07-9fbd-2b10ecc16355 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-01789a3c-6960-4d07-9fbd-2b10ecc16355 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eRZbDukr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:28:58 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-01789a3c-6960-4d07-9fbd-2b10ecc16355 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:28:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-01789a3c-6960-4d07-9fbd-2b10ecc16355 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-01789a3c-6960-4d07-9fbd-2b10ecc16355 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ad4058-2b10-4728-ab7d-811bd26d7e14]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-01789a3c-6960-4d07-9fbd-2b10ecc16355 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 11:28:58 user nova-compute[74994]: No targets found.
Nov 28 11:28:58 user nova-compute[74994]: iSNS:
Nov 28 11:28:58 user nova-compute[74994]: No targets found.
Nov 28 11:28:58 user nova-compute[74994]: STATIC:
Nov 28 11:28:58 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32
Nov 28 11:28:58 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:28:58 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:28:58 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5
Nov 28 11:28:58 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:28:58 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:28:58 user nova-compute[74994]: FIRMWARE:
Nov 28 11:28:58 user nova-compute[74994]: No targets found.
Nov 28 11:28:58 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-01789a3c-6960-4d07-9fbd-2b10ecc16355 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 11:28:58 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 11:28:58 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-01789a3c-6960-4d07-9fbd-2b10ecc16355 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c3ddb2-d2d9-4f3d-a9f5-dd1edc306e87]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e944c2b-7c86-44f1-a2f4-181900c66cb7]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-01789a3c-6960-4d07-9fbd-2b10ecc16355 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)
Nov 28 11:28:58 user nova-compute[74994]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32 (non-flash)
Nov 28 11:28:58 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-01789a3c-6960-4d07-9fbd-2b10ecc16355 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 (non-flash)
Nov 28 11:28:58 user nova-compute[74994]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32 (non-flash)
Nov 28 11:28:58 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-01789a3c-6960-4d07-9fbd-2b10ecc16355 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb920322cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5'): ({'sdb'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-01789a3c-6960-4d07-9fbd-2b10ecc16355 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Removing single pathed devices sdb {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e235dc-d50f-4e3a-b9fe-0779714d30fc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69e8a1d-5824-47cb-aa3a-e171b24d6f4f]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-01789a3c-6960-4d07-9fbd-2b10ecc16355 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Flushing IO for device /dev/sdb {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e556ac74-dbc3-4ab2-897f-d70906909843]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-01789a3c-6960-4d07-9fbd-2b10ecc16355 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc6c782-f642-40b0-a381-d7ced0f1981f]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-01789a3c-6960-4d07-9fbd-2b10ecc16355 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-01789a3c-6960-4d07-9fbd-2b10ecc16355 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] SCSI volumes sdb have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-01789a3c-6960-4d07-9fbd-2b10ecc16355 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e090f71-5b0d-4163-9311-2a559602097f]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-01789a3c-6960-4d07-9fbd-2b10ecc16355 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[df58c729-6b0f-4ffc-9e89-088df31363ca]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-01789a3c-6960-4d07-9fbd-2b10ecc16355 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5, portal: 172.16.0.220,3260]
Nov 28 11:28:58 user nova-compute[74994]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5, portal: 172.16.0.220,3260] successful.
Nov 28 11:28:58 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4667b6ec-507b-4a2c-ac19-bad20b625434]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-01789a3c-6960-4d07-9fbd-2b10ecc16355 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-01789a3c-6960-4d07-9fbd-2b10ecc16355 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-01789a3c-6960-4d07-9fbd-2b10ecc16355 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] <== disconnect_volume: return (309ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01789a3c-6960-4d07-9fbd-2b10ecc16355 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 11:28:58 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-01789a3c-6960-4d07-9fbd-2b10ecc16355 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Deleting instance files /opt/stack/data/nova/instances/02d70aec-41a6-41bd-a826-1f7d31e1f78e_del
Nov 28 11:28:58 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-01789a3c-6960-4d07-9fbd-2b10ecc16355 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Deletion of /opt/stack/data/nova/instances/02d70aec-41a6-41bd-a826-1f7d31e1f78e_del complete
Nov 28 11:28:58 user nova-compute[74994]: INFO nova.compute.manager [None req-01789a3c-6960-4d07-9fbd-2b10ecc16355 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 28 11:28:58 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-01789a3c-6960-4d07-9fbd-2b10ecc16355 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 11:28:58 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-6ae1f01d-f4ed-46ef-a2a0-599125de33cf tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c1d04dff-d786-4b78-9819-0f42437139a8 {{(pid=74994) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 11:28:59 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:28:59 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Took 0.99 seconds to deallocate network for instance.
Nov 28 11:28:59 user nova-compute[74994]: DEBUG nova.compute.manager [req-c7c1e4da-2c40-4a66-a5f2-8e1ee6203485 req-1ed79ed9-27e5-4c72-81ad-ade71154e369 service nova] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Received event network-vif-deleted-e2f8c784-e29d-4072-817e-6b741b90188c {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:28:59 user nova-compute[74994]: INFO nova.compute.manager [req-c7c1e4da-2c40-4a66-a5f2-8e1ee6203485 req-1ed79ed9-27e5-4c72-81ad-ade71154e369 service nova] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Neutron deleted interface e2f8c784-e29d-4072-817e-6b741b90188c; detaching it from the instance and deleting it from the info cache
Nov 28 11:28:59 user nova-compute[74994]: DEBUG nova.network.neutron [req-c7c1e4da-2c40-4a66-a5f2-8e1ee6203485 req-1ed79ed9-27e5-4c72-81ad-ade71154e369 service nova] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:28:59 user nova-compute[74994]: DEBUG nova.compute.manager [req-c7c1e4da-2c40-4a66-a5f2-8e1ee6203485 req-1ed79ed9-27e5-4c72-81ad-ade71154e369 service nova] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Detach interface failed, port_id=e2f8c784-e29d-4072-817e-6b741b90188c, reason: Instance 02d70aec-41a6-41bd-a826-1f7d31e1f78e could not be found. {{(pid=74994) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 11:28:59 user nova-compute[74994]: DEBUG nova.compute.manager [req-730cfc14-4c5d-464e-97b1-c9420855402b req-e6ef4f92-33f5-4479-8907-2976e7df27d9 service nova] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Received event network-vif-plugged-e2f8c784-e29d-4072-817e-6b741b90188c {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:28:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-730cfc14-4c5d-464e-97b1-c9420855402b req-e6ef4f92-33f5-4479-8907-2976e7df27d9 service nova] Acquiring lock "02d70aec-41a6-41bd-a826-1f7d31e1f78e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:28:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-730cfc14-4c5d-464e-97b1-c9420855402b req-e6ef4f92-33f5-4479-8907-2976e7df27d9 service nova] Lock "02d70aec-41a6-41bd-a826-1f7d31e1f78e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:28:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-730cfc14-4c5d-464e-97b1-c9420855402b req-e6ef4f92-33f5-4479-8907-2976e7df27d9 service nova] Lock "02d70aec-41a6-41bd-a826-1f7d31e1f78e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:28:59 user nova-compute[74994]: DEBUG nova.compute.manager [req-730cfc14-4c5d-464e-97b1-c9420855402b req-e6ef4f92-33f5-4479-8907-2976e7df27d9 service nova] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] No waiting events found dispatching network-vif-plugged-e2f8c784-e29d-4072-817e-6b741b90188c {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:28:59 user nova-compute[74994]: WARNING nova.compute.manager [req-730cfc14-4c5d-464e-97b1-c9420855402b req-e6ef4f92-33f5-4479-8907-2976e7df27d9 service nova] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Received unexpected event network-vif-plugged-e2f8c784-e29d-4072-817e-6b741b90188c for instance with vm_state active and task_state deleting.
Nov 28 11:29:00 user nova-compute[74994]: INFO nova.compute.manager [None req-01789a3c-6960-4d07-9fbd-2b10ecc16355 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Took 0.72 seconds to detach 1 volumes for instance.
Nov 28 11:29:00 user nova-compute[74994]: DEBUG nova.compute.manager [None req-01789a3c-6960-4d07-9fbd-2b10ecc16355 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 02d70aec-41a6-41bd-a826-1f7d31e1f78e] Deleting volume: 6e2ba7fb-4cf7-4491-b48a-3d719d6c51a5 {{(pid=74994) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 11:29:00 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-01789a3c-6960-4d07-9fbd-2b10ecc16355 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:29:00 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-01789a3c-6960-4d07-9fbd-2b10ecc16355 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:29:00 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-01789a3c-6960-4d07-9fbd-2b10ecc16355 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:29:00 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-01789a3c-6960-4d07-9fbd-2b10ecc16355 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:29:00 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-01789a3c-6960-4d07-9fbd-2b10ecc16355 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.139s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:29:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:29:00 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-01789a3c-6960-4d07-9fbd-2b10ecc16355 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Deleted allocations for instance 02d70aec-41a6-41bd-a826-1f7d31e1f78e
Nov 28 11:29:00 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-01789a3c-6960-4d07-9fbd-2b10ecc16355 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "02d70aec-41a6-41bd-a826-1f7d31e1f78e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.269s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:29:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:29:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:29:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:29:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:29:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:29:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:29:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:29:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:29:18 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-6ae1f01d-f4ed-46ef-a2a0-599125de33cf tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c1d04dff-d786-4b78-9819-0f42437139a8 is timed out.
Nov 28 11:29:18 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-6ae1f01d-f4ed-46ef-a2a0-599125de33cf tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Successfully detached device vdb from instance c1d04dff-d786-4b78-9819-0f42437139a8 from the live domain config.
Nov 28 11:29:18 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ae1f01d-f4ed-46ef-a2a0-599125de33cf tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae1f01d-f4ed-46ef-a2a0-599125de33cf tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oxszueDc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:29:18 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-6ae1f01d-f4ed-46ef-a2a0-599125de33cf tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:29:18 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-6ae1f01d-f4ed-46ef-a2a0-599125de33cf tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-6ae1f01d-f4ed-46ef-a2a0-599125de33cf tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f1499e-3d02-49a3-b06a-cb952f2e8a9e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae1f01d-f4ed-46ef-a2a0-599125de33cf tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 11:29:18 user nova-compute[74994]: No targets found.
Nov 28 11:29:18 user nova-compute[74994]: iSNS:
Nov 28 11:29:18 user nova-compute[74994]: No targets found.
Nov 28 11:29:18 user nova-compute[74994]: STATIC:
Nov 28 11:29:18 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32
Nov 28 11:29:18 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:29:18 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:29:18 user nova-compute[74994]: FIRMWARE:
Nov 28 11:29:18 user nova-compute[74994]: No targets found.
Nov 28 11:29:18 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae1f01d-f4ed-46ef-a2a0-599125de33cf tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 11:29:18 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 11:29:18 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae1f01d-f4ed-46ef-a2a0-599125de33cf tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b59df70-987d-4f53-a4aa-b91812ef1547]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[febac7cf-6099-4bc8-b09d-be9e369cebca]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae1f01d-f4ed-46ef-a2a0-599125de33cf tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32 (non-flash)
Nov 28 11:29:18 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae1f01d-f4ed-46ef-a2a0-599125de33cf tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32 (non-flash)
Nov 28 11:29:18 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae1f01d-f4ed-46ef-a2a0-599125de33cf tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9444d4ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32'): ({'sdc'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-6ae1f01d-f4ed-46ef-a2a0-599125de33cf tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Removing single pathed devices sdc {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9686ccc5-b920-4129-aecf-68d44e8914be]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bab932-2e2a-45a9-bc43-cf07e4032335]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-6ae1f01d-f4ed-46ef-a2a0-599125de33cf tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Flushing IO for device /dev/sdc {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[487a285e-a5d9-47c5-9f1c-f87e5c6aedd0]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-6ae1f01d-f4ed-46ef-a2a0-599125de33cf tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[58532d5c-c8ff-4653-87a1-4592e8caede2]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-6ae1f01d-f4ed-46ef-a2a0-599125de33cf tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-6ae1f01d-f4ed-46ef-a2a0-599125de33cf tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] SCSI volumes sdc have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae1f01d-f4ed-46ef-a2a0-599125de33cf tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[26758146-74cb-4377-a530-c6d4b3437776]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae1f01d-f4ed-46ef-a2a0-599125de33cf tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32 -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a71430-826c-41e6-8440-bb5af191b655]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae1f01d-f4ed-46ef-a2a0-599125de33cf tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32, portal: 172.16.0.220,3260]
Nov 28 11:29:18 user nova-compute[74994]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32, portal: 172.16.0.220,3260] successful.
Nov 28 11:29:18 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32 -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a82486b-24f7-45f0-8cca-31b625c64e32 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6db1bf7-d6d9-4f1e-995c-26b98bafe590]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae1f01d-f4ed-46ef-a2a0-599125de33cf tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-6ae1f01d-f4ed-46ef-a2a0-599125de33cf tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae1f01d-f4ed-46ef-a2a0-599125de33cf tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] <== disconnect_volume: return (296ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:29:18 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ae1f01d-f4ed-46ef-a2a0-599125de33cf tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 11:29:19 user nova-compute[74994]: DEBUG nova.objects.instance [None req-6ae1f01d-f4ed-46ef-a2a0-599125de33cf tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lazy-loading 'flavor' on Instance uuid c1d04dff-d786-4b78-9819-0f42437139a8 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:29:19 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6ae1f01d-f4ed-46ef-a2a0-599125de33cf tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "c1d04dff-d786-4b78-9819-0f42437139a8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.636s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:29:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:29:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:29:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:29:36 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:29:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:29:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:29:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:29:36 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 11:29:36 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d04dff-d786-4b78-9819-0f42437139a8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:29:36 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d04dff-d786-4b78-9819-0f42437139a8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:29:36 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d04dff-d786-4b78-9819-0f42437139a8/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:29:36 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d04dff-d786-4b78-9819-0f42437139a8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:29:37 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:29:37 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:29:37 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=8950MB free_disk=25.014896392822266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 11:29:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:29:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:29:37 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance c1d04dff-d786-4b78-9819-0f42437139a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:29:37 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 11:29:37 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 11:29:37 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:29:37 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:29:37 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 11:29:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.193s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:29:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:29:38 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:29:38 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 11:29:40 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:29:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:29:45 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:29:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:29:48 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:29:48 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 11:29:48 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Rebuilding the list of instances to heal {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 11:29:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "refresh_cache-c1d04dff-d786-4b78-9819-0f42437139a8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:29:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquired lock "refresh_cache-c1d04dff-d786-4b78-9819-0f42437139a8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:29:48 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Forcefully refreshing network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 11:29:48 user nova-compute[74994]: DEBUG nova.objects.instance [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lazy-loading 'info_cache' on Instance uuid c1d04dff-d786-4b78-9819-0f42437139a8 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:29:49 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Updating instance_info_cache with network_info: [{"id": "5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf", "address": "fa:16:3e:f8:72:17", "network": {"id": "5eb85013-4afd-42c4-888a-a3f1dd6d8798", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1182556685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d607facd2295407fa0d40510d8f1fae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc9dcd-ca", "ovs_interfaceid": "5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:29:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Releasing lock "refresh_cache-c1d04dff-d786-4b78-9819-0f42437139a8" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:29:49 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Updated the network info_cache for instance {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 11:29:49 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:29:50 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:29:52 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:29:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:29:54 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:29:55 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:29:57 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:29:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "36a15405-aa6a-41a2-93fe-d1e894b1c539" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:29:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "36a15405-aa6a-41a2-93fe-d1e894b1c539" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:29:57 user nova-compute[74994]: DEBUG nova.compute.manager [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 11:29:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:29:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:29:57 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 11:29:57 user nova-compute[74994]: INFO nova.compute.claims [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Claim successful on node user
Nov 28 11:29:57 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:29:57 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:29:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:29:58 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.529s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:29:58 user nova-compute[74994]: DEBUG nova.compute.manager [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 11:29:58 user nova-compute[74994]: DEBUG nova.compute.manager [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 11:29:58 user nova-compute[74994]: DEBUG nova.network.neutron [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 11:29:58 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 11:29:58 user nova-compute[74994]: DEBUG nova.compute.manager [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 11:29:58 user nova-compute[74994]: DEBUG nova.policy [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e1ebcd41891545f990e285b43c9eac90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb427b7927364726907d9e90ef9a578f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 11:29:58 user nova-compute[74994]: INFO nova.virt.block_device [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Booting with volume c4ab3363-a862-49e9-879b-46e91b07ce82 at /dev/vda
Nov 28 11:29:58 user nova-compute[74994]: DEBUG os_brick.utils [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:29:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:29:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:29:58 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92a6a51-a275-4553-a261-2b166cb10428]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:29:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:29:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:29:58 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea984b00-cd16-4e10-8a97-78091d62c792]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:29:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:29:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:29:58 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[da533a77-9f49-4407-80ab-63b262fac311]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:29:58 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad90836-4192-4f09-93b5-a78c3923e2b3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:29:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:29:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:29:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 11:29:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:29:58 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:29:58 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 11:29:58 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe0c628-116f-4eb7-aeb5-92cd4effef04]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:29:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 11:29:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 11:29:58 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 11:29:58 user nova-compute[74994]: DEBUG os_brick.utils [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:29:58 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Updating existing volume attachment record: 586fcc75-2bb9-4438-beed-4e8047d13091 {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 11:29:58 user nova-compute[74994]: DEBUG nova.network.neutron [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Successfully created port: 35d86fef-8ddd-45db-9601-e99041a371ee {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 11:29:59 user nova-compute[74994]: DEBUG nova.network.neutron [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Successfully updated port: 35d86fef-8ddd-45db-9601-e99041a371ee {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 11:29:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "refresh_cache-36a15405-aa6a-41a2-93fe-d1e894b1c539" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:29:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquired lock "refresh_cache-36a15405-aa6a-41a2-93fe-d1e894b1c539" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:29:59 user nova-compute[74994]: DEBUG nova.network.neutron [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 11:29:59 user nova-compute[74994]: DEBUG nova.compute.manager [req-674304f7-2164-42e7-aee8-98c745269dbe req-775a331c-c914-4925-889c-c08bca65ed35 service nova] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Received event network-changed-35d86fef-8ddd-45db-9601-e99041a371ee {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:29:59 user nova-compute[74994]: DEBUG nova.compute.manager [req-674304f7-2164-42e7-aee8-98c745269dbe req-775a331c-c914-4925-889c-c08bca65ed35 service nova] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Refreshing instance network info cache due to event network-changed-35d86fef-8ddd-45db-9601-e99041a371ee. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:29:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-674304f7-2164-42e7-aee8-98c745269dbe req-775a331c-c914-4925-889c-c08bca65ed35 service nova] Acquiring lock "refresh_cache-36a15405-aa6a-41a2-93fe-d1e894b1c539" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:29:59 user nova-compute[74994]: DEBUG nova.network.neutron [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 11:29:59 user nova-compute[74994]: DEBUG nova.network.neutron [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Updating instance_info_cache with network_info: [{"id": "35d86fef-8ddd-45db-9601-e99041a371ee", "address": "fa:16:3e:9a:80:52", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d86fef-8d", "ovs_interfaceid": "35d86fef-8ddd-45db-9601-e99041a371ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:29:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Releasing lock "refresh_cache-36a15405-aa6a-41a2-93fe-d1e894b1c539" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:29:59 user nova-compute[74994]: DEBUG nova.compute.manager [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Instance network_info: |[{"id": "35d86fef-8ddd-45db-9601-e99041a371ee", "address": "fa:16:3e:9a:80:52", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d86fef-8d", "ovs_interfaceid": "35d86fef-8ddd-45db-9601-e99041a371ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 11:29:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-674304f7-2164-42e7-aee8-98c745269dbe req-775a331c-c914-4925-889c-c08bca65ed35 service nova] Acquired lock "refresh_cache-36a15405-aa6a-41a2-93fe-d1e894b1c539" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:29:59 user nova-compute[74994]: DEBUG nova.network.neutron [req-674304f7-2164-42e7-aee8-98c745269dbe req-775a331c-c914-4925-889c-c08bca65ed35 service nova] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Refreshing network info cache for port 35d86fef-8ddd-45db-9601-e99041a371ee {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:30:00 user nova-compute[74994]: DEBUG nova.network.neutron [req-674304f7-2164-42e7-aee8-98c745269dbe req-775a331c-c914-4925-889c-c08bca65ed35 service nova] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Updated VIF entry in instance network info cache for port 35d86fef-8ddd-45db-9601-e99041a371ee. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:30:00 user nova-compute[74994]: DEBUG nova.network.neutron [req-674304f7-2164-42e7-aee8-98c745269dbe req-775a331c-c914-4925-889c-c08bca65ed35 service nova] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Updating instance_info_cache with network_info: [{"id": "35d86fef-8ddd-45db-9601-e99041a371ee", "address": "fa:16:3e:9a:80:52", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d86fef-8d", "ovs_interfaceid": "35d86fef-8ddd-45db-9601-e99041a371ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:30:00 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-674304f7-2164-42e7-aee8-98c745269dbe req-775a331c-c914-4925-889c-c08bca65ed35 service nova] Releasing lock "refresh_cache-36a15405-aa6a-41a2-93fe-d1e894b1c539" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:30:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG nova.compute.manager [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 11:30:05 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Creating image(s)
Nov 28 11:30:05 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Did not create local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Ensure instance console log exists: /opt/stack/data/nova/instances/36a15405-aa6a-41a2-93fe-d1e894b1c539/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Start _get_guest_xml network_info=[{"id": "35d86fef-8ddd-45db-9601-e99041a371ee", "address": "fa:16:3e:9a:80:52", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d86fef-8d", "ovs_interfaceid": "35d86fef-8ddd-45db-9601-e99041a371ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'btnUjlSM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '36a15405-aa6a-41a2-93fe-d1e894b1c539', 'attached_at': '', 'detached_at': '', 'volume_id': 'c4ab3363-a862-49e9-879b-46e91b07ce82', 'serial': 'c4ab3363-a862-49e9-879b-46e91b07ce82'}, 'attachment_id': '586fcc75-2bb9-4438-beed-4e8047d13091', 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 11:30:05 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:30:05 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:30:05 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'btnUjlSM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:30:05 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:30:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:30:05 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:30:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:30:05 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 11:30:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fadb006-a509-4bcd-b3b9-8be215fe63e4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 11:30:05 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcec63f3-5710-4ea7-8987-1ae430bf39fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82] added
Nov 28 11:30:05 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f432ee14-d89e-4d1f-a0bd-8e8a1327a6a5]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed10c32-215d-43b7-9dad-0009b1300d97]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v btnUjlSM {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v btnUjlSM" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[155c7822-dee1-4f58-9df3-c5a8e1c3d5fa]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'btnUjlSM'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a273a935-2007-4d2c-a9e6-e77458b6a744]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab6cb21-1941-4700-b803-b74e27987c58]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 11:30:05 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 11:30:05 user nova-compute[74994]:  {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:30:05 user nova-compute[74994]: WARNING os_brick.initiator.connectors.iscsi [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 11:30:05 user nova-compute[74994]: 
Nov 28 11:30:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b5efbb-4bdc-4017-bd90-ef8353bda502]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82, portal: 172.16.0.220,3260]
Nov 28 11:30:05 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82, portal: 172.16.0.220,3260] successful.
Nov 28 11:30:05 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bd7d0f-cf5f-4183-9e16-b2ed43f387c9]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e9718b-ca8e-4cf9-881a-f756197e5130]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 (non-flash)
Nov 28 11:30:05 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 (non-flash)
Nov 28 11:30:05 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd8ffea-a6b9-43d1-9137-2ec9fc2ccfb9]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 11:30:05 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'btnUjlSM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 11:30:06 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:30:06 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '26637626466633864', 'path': '/dev/sdb'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:30:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637626466633864', 'path': '/dev/sdb'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 11:30:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:29:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1219331062',display_name='tempest-TestVolumeBootPattern-server-1219331062',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1219331062',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJskGb8o7sKkkJHXfIeXjUMFdWljc0ALZAd51Odn5QFpQ6//wKpup5hgiLYGjHgIIEMC9O9O/gz4Xaxr/KZsMrjOgAbnCWxIK2QuPGlez3xcOsg8TTQkkpxGQHDunVpPZQ==',key_name='tempest-TestVolumeBootPattern-1373923849',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb427b7927364726907d9e90ef9a578f',ramdisk_id='',reservation_id='r-ws0elhs1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-169069415',owner_user_name='tempest-TestVolumeBootPattern-169069415-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:29:58Z,user_data=None,user_id='e1ebcd41891545f990e285b43c9eac90',uuid=36a15405-aa6a-41a2-93fe-d1e894b1c539,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35d86fef-8ddd-45db-9601-e99041a371ee", "address": "fa:16:3e:9a:80:52", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d86fef-8d", "ovs_interfaceid": "35d86fef-8ddd-45db-9601-e99041a371ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 11:30:06 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Converting VIF {"id": "35d86fef-8ddd-45db-9601-e99041a371ee", "address": "fa:16:3e:9a:80:52", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d86fef-8d", "ovs_interfaceid": "35d86fef-8ddd-45db-9601-e99041a371ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:30:06 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:80:52,bridge_name='br-int',has_traffic_filtering=True,id=35d86fef-8ddd-45db-9601-e99041a371ee,network=Network(2dad67e8-a656-4aa2-a2ed-f2875ee5e48a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d86fef-8d') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:30:06 user nova-compute[74994]: DEBUG nova.objects.instance [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lazy-loading 'pci_devices' on Instance uuid 36a15405-aa6a-41a2-93fe-d1e894b1c539 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:30:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] End _get_guest_xml xml=<domain type="kvm">
Nov 28 11:30:06 user nova-compute[74994]:   <uuid>36a15405-aa6a-41a2-93fe-d1e894b1c539</uuid>
Nov 28 11:30:06 user nova-compute[74994]:   <name>instance-00000032</name>
Nov 28 11:30:06 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 11:30:06 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 11:30:06 user nova-compute[74994]:   <metadata>
Nov 28 11:30:06 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 11:30:06 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 11:30:06 user nova-compute[74994]:       <nova:name>tempest-TestVolumeBootPattern-server-1219331062</nova:name>
Nov 28 11:30:06 user nova-compute[74994]:       <nova:creationTime>2023-11-28 11:30:05</nova:creationTime>
Nov 28 11:30:06 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 11:30:06 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 11:30:06 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 11:30:06 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 11:30:06 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 11:30:06 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 11:30:06 user nova-compute[74994]:       </nova:flavor>
Nov 28 11:30:06 user nova-compute[74994]:       <nova:owner>
Nov 28 11:30:06 user nova-compute[74994]:         <nova:user uuid="e1ebcd41891545f990e285b43c9eac90">tempest-TestVolumeBootPattern-169069415-project-member</nova:user>
Nov 28 11:30:06 user nova-compute[74994]:         <nova:project uuid="cb427b7927364726907d9e90ef9a578f">tempest-TestVolumeBootPattern-169069415</nova:project>
Nov 28 11:30:06 user nova-compute[74994]:       </nova:owner>
Nov 28 11:30:06 user nova-compute[74994]:       <nova:ports>
Nov 28 11:30:06 user nova-compute[74994]:         <nova:port uuid="35d86fef-8ddd-45db-9601-e99041a371ee">
Nov 28 11:30:06 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 11:30:06 user nova-compute[74994]:         </nova:port>
Nov 28 11:30:06 user nova-compute[74994]:       </nova:ports>
Nov 28 11:30:06 user nova-compute[74994]:     </nova:instance>
Nov 28 11:30:06 user nova-compute[74994]:   </metadata>
Nov 28 11:30:06 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 11:30:06 user nova-compute[74994]:     <system>
Nov 28 11:30:06 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 11:30:06 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 11:30:06 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 11:30:06 user nova-compute[74994]:       <entry name="serial">36a15405-aa6a-41a2-93fe-d1e894b1c539</entry>
Nov 28 11:30:06 user nova-compute[74994]:       <entry name="uuid">36a15405-aa6a-41a2-93fe-d1e894b1c539</entry>
Nov 28 11:30:06 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 11:30:06 user nova-compute[74994]:     </system>
Nov 28 11:30:06 user nova-compute[74994]:   </sysinfo>
Nov 28 11:30:06 user nova-compute[74994]:   <os>
Nov 28 11:30:06 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 11:30:06 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 11:30:06 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 11:30:06 user nova-compute[74994]:   </os>
Nov 28 11:30:06 user nova-compute[74994]:   <features>
Nov 28 11:30:06 user nova-compute[74994]:     <acpi/>
Nov 28 11:30:06 user nova-compute[74994]:     <apic/>
Nov 28 11:30:06 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 11:30:06 user nova-compute[74994]:   </features>
Nov 28 11:30:06 user nova-compute[74994]:   <clock offset="utc">
Nov 28 11:30:06 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 11:30:06 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 11:30:06 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 11:30:06 user nova-compute[74994]:   </clock>
Nov 28 11:30:06 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 11:30:06 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 11:30:06 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 11:30:06 user nova-compute[74994]:   </cpu>
Nov 28 11:30:06 user nova-compute[74994]:   <devices>
Nov 28 11:30:06 user nova-compute[74994]:     <disk type="block" device="disk">
Nov 28 11:30:06 user nova-compute[74994]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:30:06 user nova-compute[74994]:       <source dev="/dev/sdb"/>
Nov 28 11:30:06 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 11:30:06 user nova-compute[74994]:       <serial>c4ab3363-a862-49e9-879b-46e91b07ce82</serial>
Nov 28 11:30:06 user nova-compute[74994]:     </disk>
Nov 28 11:30:06 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 11:30:06 user nova-compute[74994]:       <mac address="fa:16:3e:9a:80:52"/>
Nov 28 11:30:06 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:30:06 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 11:30:06 user nova-compute[74994]:       <target dev="tap35d86fef-8d"/>
Nov 28 11:30:06 user nova-compute[74994]:     </interface>
Nov 28 11:30:06 user nova-compute[74994]:     <serial type="pty">
Nov 28 11:30:06 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/36a15405-aa6a-41a2-93fe-d1e894b1c539/console.log" append="off"/>
Nov 28 11:30:06 user nova-compute[74994]:     </serial>
Nov 28 11:30:06 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 11:30:06 user nova-compute[74994]:     <video>
Nov 28 11:30:06 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:30:06 user nova-compute[74994]:     </video>
Nov 28 11:30:06 user nova-compute[74994]:     <rng model="virtio">
Nov 28 11:30:06 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 11:30:06 user nova-compute[74994]:     </rng>
Nov 28 11:30:06 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 11:30:06 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 11:30:06 user nova-compute[74994]:       <stats period="10"/>
Nov 28 11:30:06 user nova-compute[74994]:     </memballoon>
Nov 28 11:30:06 user nova-compute[74994]:   </devices>
Nov 28 11:30:06 user nova-compute[74994]: </domain>
Nov 28 11:30:06 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 11:30:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:29:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1219331062',display_name='tempest-TestVolumeBootPattern-server-1219331062',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1219331062',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJskGb8o7sKkkJHXfIeXjUMFdWljc0ALZAd51Odn5QFpQ6//wKpup5hgiLYGjHgIIEMC9O9O/gz4Xaxr/KZsMrjOgAbnCWxIK2QuPGlez3xcOsg8TTQkkpxGQHDunVpPZQ==',key_name='tempest-TestVolumeBootPattern-1373923849',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb427b7927364726907d9e90ef9a578f',ramdisk_id='',reservation_id='r-ws0elhs1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-169069415',owner_user_name='tempest-TestVolumeBootPattern-169069415-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:29:58Z,user_data=None,user_id='e1ebcd41891545f990e285b43c9eac90',uuid=36a15405-aa6a-41a2-93fe-d1e894b1c539,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35d86fef-8ddd-45db-9601-e99041a371ee", "address": "fa:16:3e:9a:80:52", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d86fef-8d", "ovs_interfaceid": "35d86fef-8ddd-45db-9601-e99041a371ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 11:30:06 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Converting VIF {"id": "35d86fef-8ddd-45db-9601-e99041a371ee", "address": "fa:16:3e:9a:80:52", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d86fef-8d", "ovs_interfaceid": "35d86fef-8ddd-45db-9601-e99041a371ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:30:06 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:80:52,bridge_name='br-int',has_traffic_filtering=True,id=35d86fef-8ddd-45db-9601-e99041a371ee,network=Network(2dad67e8-a656-4aa2-a2ed-f2875ee5e48a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d86fef-8d') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:30:06 user nova-compute[74994]: DEBUG os_vif [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:80:52,bridge_name='br-int',has_traffic_filtering=True,id=35d86fef-8ddd-45db-9601-e99041a371ee,network=Network(2dad67e8-a656-4aa2-a2ed-f2875ee5e48a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d86fef-8d') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 11:30:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:30:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:30:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 11:30:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:30:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b2aa5587-409e-5581-86b2-334a59383717', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:30:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:30:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:30:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:30:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap35d86fef-8d, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:30:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap35d86fef-8d, col_values=(('qos', UUID('2cd74a0b-2959-45e1-9ee6-ee221d6d7910')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:30:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap35d86fef-8d, col_values=(('external_ids', {'iface-id': '35d86fef-8ddd-45db-9601-e99041a371ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:80:52', 'vm-uuid': '36a15405-aa6a-41a2-93fe-d1e894b1c539'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:30:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:30:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:30:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:30:06 user nova-compute[74994]: INFO os_vif [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:80:52,bridge_name='br-int',has_traffic_filtering=True,id=35d86fef-8ddd-45db-9601-e99041a371ee,network=Network(2dad67e8-a656-4aa2-a2ed-f2875ee5e48a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d86fef-8d')
Nov 28 11:30:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:30:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] No VIF found with MAC fa:16:3e:9a:80:52, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:30:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:30:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:30:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:30:08 user nova-compute[74994]: DEBUG nova.compute.manager [req-20d01fba-1679-4d7f-b158-14c232300b64 req-3c3241c7-4335-47a8-b86d-c422bf7a6e9c service nova] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Received event network-vif-plugged-35d86fef-8ddd-45db-9601-e99041a371ee {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:30:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-20d01fba-1679-4d7f-b158-14c232300b64 req-3c3241c7-4335-47a8-b86d-c422bf7a6e9c service nova] Acquiring lock "36a15405-aa6a-41a2-93fe-d1e894b1c539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:30:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-20d01fba-1679-4d7f-b158-14c232300b64 req-3c3241c7-4335-47a8-b86d-c422bf7a6e9c service nova] Lock "36a15405-aa6a-41a2-93fe-d1e894b1c539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:30:08 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-20d01fba-1679-4d7f-b158-14c232300b64 req-3c3241c7-4335-47a8-b86d-c422bf7a6e9c service nova] Lock "36a15405-aa6a-41a2-93fe-d1e894b1c539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:30:08 user nova-compute[74994]: DEBUG nova.compute.manager [req-20d01fba-1679-4d7f-b158-14c232300b64 req-3c3241c7-4335-47a8-b86d-c422bf7a6e9c service nova] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] No waiting events found dispatching network-vif-plugged-35d86fef-8ddd-45db-9601-e99041a371ee {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:30:08 user nova-compute[74994]: WARNING nova.compute.manager [req-20d01fba-1679-4d7f-b158-14c232300b64 req-3c3241c7-4335-47a8-b86d-c422bf7a6e9c service nova] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Received unexpected event network-vif-plugged-35d86fef-8ddd-45db-9601-e99041a371ee for instance with vm_state building and task_state spawning.
Nov 28 11:30:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:30:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:30:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:30:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:30:10 user nova-compute[74994]: DEBUG nova.compute.manager [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 11:30:10 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 11:30:10 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Instance spawned successfully.
Nov 28 11:30:10 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 11:30:10 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:30:10 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:30:10 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:30:10 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:30:10 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:30:10 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:30:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:30:10 user nova-compute[74994]: INFO nova.compute.manager [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Took 4.96 seconds to spawn the instance on the hypervisor.
Nov 28 11:30:10 user nova-compute[74994]: DEBUG nova.compute.manager [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 11:30:10 user nova-compute[74994]: DEBUG nova.compute.manager [req-efa2767f-34bb-4dfe-b8a9-8913991cca26 req-2a9029d4-9703-4ee1-bef8-c93a5fa47dbc service nova] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Received event network-vif-plugged-35d86fef-8ddd-45db-9601-e99041a371ee {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:30:10 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-efa2767f-34bb-4dfe-b8a9-8913991cca26 req-2a9029d4-9703-4ee1-bef8-c93a5fa47dbc service nova] Acquiring lock "36a15405-aa6a-41a2-93fe-d1e894b1c539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:30:10 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-efa2767f-34bb-4dfe-b8a9-8913991cca26 req-2a9029d4-9703-4ee1-bef8-c93a5fa47dbc service nova] Lock "36a15405-aa6a-41a2-93fe-d1e894b1c539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:30:10 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-efa2767f-34bb-4dfe-b8a9-8913991cca26 req-2a9029d4-9703-4ee1-bef8-c93a5fa47dbc service nova] Lock "36a15405-aa6a-41a2-93fe-d1e894b1c539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:30:10 user nova-compute[74994]: DEBUG nova.compute.manager [req-efa2767f-34bb-4dfe-b8a9-8913991cca26 req-2a9029d4-9703-4ee1-bef8-c93a5fa47dbc service nova] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] No waiting events found dispatching network-vif-plugged-35d86fef-8ddd-45db-9601-e99041a371ee {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:30:10 user nova-compute[74994]: WARNING nova.compute.manager [req-efa2767f-34bb-4dfe-b8a9-8913991cca26 req-2a9029d4-9703-4ee1-bef8-c93a5fa47dbc service nova] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Received unexpected event network-vif-plugged-35d86fef-8ddd-45db-9601-e99041a371ee for instance with vm_state building and task_state spawning.
Nov 28 11:30:10 user nova-compute[74994]: INFO nova.compute.manager [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Took 12.86 seconds to build instance.
Nov 28 11:30:10 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-610a03b9-a3c6-4ae9-8914-4be5c5cb00da tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "36a15405-aa6a-41a2-93fe-d1e894b1c539" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.954s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:30:11 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e31a75c2-728f-4d35-8401-88b12190d905 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Acquiring lock "c1d04dff-d786-4b78-9819-0f42437139a8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:30:11 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e31a75c2-728f-4d35-8401-88b12190d905 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "c1d04dff-d786-4b78-9819-0f42437139a8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:30:11 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e31a75c2-728f-4d35-8401-88b12190d905 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Acquiring lock "c1d04dff-d786-4b78-9819-0f42437139a8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:30:11 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e31a75c2-728f-4d35-8401-88b12190d905 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "c1d04dff-d786-4b78-9819-0f42437139a8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:30:11 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e31a75c2-728f-4d35-8401-88b12190d905 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "c1d04dff-d786-4b78-9819-0f42437139a8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:30:11 user nova-compute[74994]: INFO nova.compute.manager [None req-e31a75c2-728f-4d35-8401-88b12190d905 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Terminating instance
Nov 28 11:30:11 user nova-compute[74994]: DEBUG nova.compute.manager [None req-e31a75c2-728f-4d35-8401-88b12190d905 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 11:30:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:30:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:30:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:30:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:30:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:30:11 user nova-compute[74994]: DEBUG nova.compute.manager [req-afba19e1-4803-4aae-8394-e1b1da5b958a req-8682eefe-862b-4150-be6c-fdf2087704c9 service nova] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Received event network-vif-unplugged-5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:30:11 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-afba19e1-4803-4aae-8394-e1b1da5b958a req-8682eefe-862b-4150-be6c-fdf2087704c9 service nova] Acquiring lock "c1d04dff-d786-4b78-9819-0f42437139a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:30:11 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-afba19e1-4803-4aae-8394-e1b1da5b958a req-8682eefe-862b-4150-be6c-fdf2087704c9 service nova] Lock "c1d04dff-d786-4b78-9819-0f42437139a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:30:11 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-afba19e1-4803-4aae-8394-e1b1da5b958a req-8682eefe-862b-4150-be6c-fdf2087704c9 service nova] Lock "c1d04dff-d786-4b78-9819-0f42437139a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:30:11 user nova-compute[74994]: DEBUG nova.compute.manager [req-afba19e1-4803-4aae-8394-e1b1da5b958a req-8682eefe-862b-4150-be6c-fdf2087704c9 service nova] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] No waiting events found dispatching network-vif-unplugged-5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:30:11 user nova-compute[74994]: DEBUG nova.compute.manager [req-afba19e1-4803-4aae-8394-e1b1da5b958a req-8682eefe-862b-4150-be6c-fdf2087704c9 service nova] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Received event network-vif-unplugged-5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 11:30:12 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Instance destroyed successfully.
Nov 28 11:30:12 user nova-compute[74994]: DEBUG nova.objects.instance [None req-e31a75c2-728f-4d35-8401-88b12190d905 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lazy-loading 'resources' on Instance uuid c1d04dff-d786-4b78-9819-0f42437139a8 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:30:12 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-e31a75c2-728f-4d35-8401-88b12190d905 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:23:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-455108384',display_name='tempest-SnapshotDataIntegrityTests-server-455108384',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-455108384',id=47,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgLAQG0zJXXqz1Gd9d8gQTNQSpgaR6lu4v5qTYyzAFZgKtdZiv4LiE30qaclhjyLL5xyi9xEdNLFq9xTR7GTtMk5EoRmDQi+RfxbLjI9UbGb0ksuXGarikLWUpE9fzFhQ==',key_name='tempest-keypair-1190323180',keypairs=<?>,launch_index=0,launched_at=2023-11-28T11:23:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d607facd2295407fa0d40510d8f1fae4',ramdisk_id='',reservation_id='r-o2br9q7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-493673382',owner_user_name='tempest-SnapshotDataIntegrityTests-493673382-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T11:23:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad943d7c01a542fa82d9857bdb467069',uuid=c1d04dff-d786-4b78-9819-0f42437139a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf", "address": "fa:16:3e:f8:72:17", "network": {"id": "5eb85013-4afd-42c4-888a-a3f1dd6d8798", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1182556685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d607facd2295407fa0d40510d8f1fae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc9dcd-ca", "ovs_interfaceid": "5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 11:30:12 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-e31a75c2-728f-4d35-8401-88b12190d905 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Converting VIF {"id": "5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf", "address": "fa:16:3e:f8:72:17", "network": {"id": "5eb85013-4afd-42c4-888a-a3f1dd6d8798", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1182556685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d607facd2295407fa0d40510d8f1fae4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfc9dcd-ca", "ovs_interfaceid": "5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:30:12 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-e31a75c2-728f-4d35-8401-88b12190d905 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:72:17,bridge_name='br-int',has_traffic_filtering=True,id=5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf,network=Network(5eb85013-4afd-42c4-888a-a3f1dd6d8798),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bfc9dcd-ca') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:30:12 user nova-compute[74994]: DEBUG os_vif [None req-e31a75c2-728f-4d35-8401-88b12190d905 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:72:17,bridge_name='br-int',has_traffic_filtering=True,id=5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf,network=Network(5eb85013-4afd-42c4-888a-a3f1dd6d8798),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bfc9dcd-ca') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 11:30:12 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:30:12 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5bfc9dcd-ca, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:30:12 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:30:12 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:30:12 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:30:12 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=add42d8a-83f8-4c88-b606-57d9d751a292) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:30:12 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:30:12 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:30:12 user nova-compute[74994]: INFO os_vif [None req-e31a75c2-728f-4d35-8401-88b12190d905 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:72:17,bridge_name='br-int',has_traffic_filtering=True,id=5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf,network=Network(5eb85013-4afd-42c4-888a-a3f1dd6d8798),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bfc9dcd-ca')
Nov 28 11:30:12 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-e31a75c2-728f-4d35-8401-88b12190d905 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Deleting instance files /opt/stack/data/nova/instances/c1d04dff-d786-4b78-9819-0f42437139a8_del
Nov 28 11:30:12 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-e31a75c2-728f-4d35-8401-88b12190d905 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Deletion of /opt/stack/data/nova/instances/c1d04dff-d786-4b78-9819-0f42437139a8_del complete
Nov 28 11:30:12 user nova-compute[74994]: INFO nova.compute.manager [None req-e31a75c2-728f-4d35-8401-88b12190d905 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 28 11:30:12 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-e31a75c2-728f-4d35-8401-88b12190d905 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 11:30:12 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 11:30:12 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 11:30:13 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:30:13 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Took 0.91 seconds to deallocate network for instance.
Nov 28 11:30:13 user nova-compute[74994]: DEBUG nova.compute.manager [req-1458ffc4-8ea1-49c2-bc18-e721b4d86375 req-dd590db6-49f4-4512-af5a-69125863d699 service nova] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Received event network-vif-deleted-5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:30:13 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e31a75c2-728f-4d35-8401-88b12190d905 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:30:13 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e31a75c2-728f-4d35-8401-88b12190d905 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:30:13 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-e31a75c2-728f-4d35-8401-88b12190d905 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:30:13 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-e31a75c2-728f-4d35-8401-88b12190d905 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:30:13 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e31a75c2-728f-4d35-8401-88b12190d905 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.174s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:30:13 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-e31a75c2-728f-4d35-8401-88b12190d905 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Deleted allocations for instance c1d04dff-d786-4b78-9819-0f42437139a8
Nov 28 11:30:13 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e31a75c2-728f-4d35-8401-88b12190d905 tempest-SnapshotDataIntegrityTests-493673382 tempest-SnapshotDataIntegrityTests-493673382-project-member] Lock "c1d04dff-d786-4b78-9819-0f42437139a8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.170s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:30:13 user nova-compute[74994]: DEBUG nova.compute.manager [req-8896dcc5-fbca-451f-b06f-86ce3efe65ef req-a4eb8d3f-743c-4066-8221-aaf5ba00e559 service nova] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Received event network-vif-plugged-5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:30:13 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8896dcc5-fbca-451f-b06f-86ce3efe65ef req-a4eb8d3f-743c-4066-8221-aaf5ba00e559 service nova] Acquiring lock "c1d04dff-d786-4b78-9819-0f42437139a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:30:13 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8896dcc5-fbca-451f-b06f-86ce3efe65ef req-a4eb8d3f-743c-4066-8221-aaf5ba00e559 service nova] Lock "c1d04dff-d786-4b78-9819-0f42437139a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:30:13 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8896dcc5-fbca-451f-b06f-86ce3efe65ef req-a4eb8d3f-743c-4066-8221-aaf5ba00e559 service nova] Lock "c1d04dff-d786-4b78-9819-0f42437139a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:30:13 user nova-compute[74994]: DEBUG nova.compute.manager [req-8896dcc5-fbca-451f-b06f-86ce3efe65ef req-a4eb8d3f-743c-4066-8221-aaf5ba00e559 service nova] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] No waiting events found dispatching network-vif-plugged-5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:30:13 user nova-compute[74994]: WARNING nova.compute.manager [req-8896dcc5-fbca-451f-b06f-86ce3efe65ef req-a4eb8d3f-743c-4066-8221-aaf5ba00e559 service nova] [instance: c1d04dff-d786-4b78-9819-0f42437139a8] Received unexpected event network-vif-plugged-5bfc9dcd-cac2-4685-bc7a-62cbc6c75acf for instance with vm_state deleted and task_state None.
Nov 28 11:30:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:30:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:30:22 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:30:27 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:30:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:30:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:30:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:30:36 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:30:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:30:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:30:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:30:36 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 11:30:36 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:30:36 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:30:36 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:30:36 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=8911MB free_disk=25.040325164794922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 11:30:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:30:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:30:37 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 36a15405-aa6a-41a2-93fe-d1e894b1c539 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:30:37 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 11:30:37 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 11:30:37 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Refreshing inventories for resource provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 11:30:37 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Updating ProviderTree inventory for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 11:30:37 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Updating inventory in ProviderTree for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 11:30:37 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Refreshing aggregate associations for resource provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a, aggregates: None {{(pid=74994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 11:30:37 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Refreshing trait associations for resource provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=74994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 11:30:37 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:30:37 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:30:37 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 11:30:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.355s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:30:37 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:30:39 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:30:39 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 11:30:39 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:30:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:30:40 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:30:40 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:30:40 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74994) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 11:30:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:30:46 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:30:47 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:30:47 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:30:47 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:30:47 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:30:47 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:30:47 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:30:49 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:30:49 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 11:30:49 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Rebuilding the list of instances to heal {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 11:30:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "refresh_cache-36a15405-aa6a-41a2-93fe-d1e894b1c539" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:30:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquired lock "refresh_cache-36a15405-aa6a-41a2-93fe-d1e894b1c539" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:30:49 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Forcefully refreshing network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 11:30:49 user nova-compute[74994]: DEBUG nova.objects.instance [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lazy-loading 'info_cache' on Instance uuid 36a15405-aa6a-41a2-93fe-d1e894b1c539 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:30:49 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Updating instance_info_cache with network_info: [{"id": "35d86fef-8ddd-45db-9601-e99041a371ee", "address": "fa:16:3e:9a:80:52", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d86fef-8d", "ovs_interfaceid": "35d86fef-8ddd-45db-9601-e99041a371ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:30:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Releasing lock "refresh_cache-36a15405-aa6a-41a2-93fe-d1e894b1c539" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:30:49 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Updated the network info_cache for instance {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 11:30:51 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:30:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:30:52 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:30:55 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:30:56 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:30:57 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:31:02 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:31:02 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:31:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:31:07 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:31:07 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:31:07 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Cleaning up deleted instances {{(pid=74994) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 11:31:07 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] There are 0 instances to clean {{(pid=74994) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 11:31:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:31:12 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:31:17 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:31:22 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:31:27 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:31:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:31:37 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:31:38 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:31:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:31:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:31:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:31:38 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 11:31:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:31:38 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:31:38 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:31:38 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=9032MB free_disk=25.039043426513672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 11:31:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:31:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:31:38 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 36a15405-aa6a-41a2-93fe-d1e894b1c539 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:31:38 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 11:31:38 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 11:31:39 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:31:39 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:31:39 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 11:31:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.152s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:31:42 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:31:42 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:31:42 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 11:31:42 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:31:47 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:31:47 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:31:47 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:31:47 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:31:47 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:31:47 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:31:48 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:31:50 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:31:50 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 11:31:50 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Rebuilding the list of instances to heal {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 11:31:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:31:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "refresh_cache-36a15405-aa6a-41a2-93fe-d1e894b1c539" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:31:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquired lock "refresh_cache-36a15405-aa6a-41a2-93fe-d1e894b1c539" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:31:50 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Forcefully refreshing network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 11:31:50 user nova-compute[74994]: DEBUG nova.objects.instance [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lazy-loading 'info_cache' on Instance uuid 36a15405-aa6a-41a2-93fe-d1e894b1c539 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:31:50 user nova-compute[74994]: DEBUG nova.compute.manager [req-567bb805-965c-40ca-a2e3-9e56fcd6b4ef req-22c6bbe2-c9c4-4210-aedc-a68cdee8d6b0 service nova] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Received event network-changed-35d86fef-8ddd-45db-9601-e99041a371ee {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:31:50 user nova-compute[74994]: DEBUG nova.compute.manager [req-567bb805-965c-40ca-a2e3-9e56fcd6b4ef req-22c6bbe2-c9c4-4210-aedc-a68cdee8d6b0 service nova] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Refreshing instance network info cache due to event network-changed-35d86fef-8ddd-45db-9601-e99041a371ee. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:31:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-567bb805-965c-40ca-a2e3-9e56fcd6b4ef req-22c6bbe2-c9c4-4210-aedc-a68cdee8d6b0 service nova] Acquiring lock "refresh_cache-36a15405-aa6a-41a2-93fe-d1e894b1c539" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:31:50 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Updating instance_info_cache with network_info: [{"id": "35d86fef-8ddd-45db-9601-e99041a371ee", "address": "fa:16:3e:9a:80:52", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d86fef-8d", "ovs_interfaceid": "35d86fef-8ddd-45db-9601-e99041a371ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Releasing lock "refresh_cache-36a15405-aa6a-41a2-93fe-d1e894b1c539" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Updated the network info_cache for instance {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-567bb805-965c-40ca-a2e3-9e56fcd6b4ef req-22c6bbe2-c9c4-4210-aedc-a68cdee8d6b0 service nova] Acquired lock "refresh_cache-36a15405-aa6a-41a2-93fe-d1e894b1c539" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG nova.network.neutron [req-567bb805-965c-40ca-a2e3-9e56fcd6b4ef req-22c6bbe2-c9c4-4210-aedc-a68cdee8d6b0 service nova] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Refreshing network info cache for port 35d86fef-8ddd-45db-9601-e99041a371ee {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-02558ea0-53f2-474e-bf81-9067b1aac01d tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "36a15405-aa6a-41a2-93fe-d1e894b1c539" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-02558ea0-53f2-474e-bf81-9067b1aac01d tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "36a15405-aa6a-41a2-93fe-d1e894b1c539" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-02558ea0-53f2-474e-bf81-9067b1aac01d tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "36a15405-aa6a-41a2-93fe-d1e894b1c539-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-02558ea0-53f2-474e-bf81-9067b1aac01d tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "36a15405-aa6a-41a2-93fe-d1e894b1c539-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-02558ea0-53f2-474e-bf81-9067b1aac01d tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "36a15405-aa6a-41a2-93fe-d1e894b1c539-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:31:51 user nova-compute[74994]: INFO nova.compute.manager [None req-02558ea0-53f2-474e-bf81-9067b1aac01d tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Terminating instance
Nov 28 11:31:51 user nova-compute[74994]: DEBUG nova.compute.manager [None req-02558ea0-53f2-474e-bf81-9067b1aac01d tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG nova.compute.manager [req-d120123d-c173-440c-839b-7fd37a18400f req-989260f1-9eb5-488d-a2fe-3f8526287593 service nova] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Received event network-vif-unplugged-35d86fef-8ddd-45db-9601-e99041a371ee {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d120123d-c173-440c-839b-7fd37a18400f req-989260f1-9eb5-488d-a2fe-3f8526287593 service nova] Acquiring lock "36a15405-aa6a-41a2-93fe-d1e894b1c539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d120123d-c173-440c-839b-7fd37a18400f req-989260f1-9eb5-488d-a2fe-3f8526287593 service nova] Lock "36a15405-aa6a-41a2-93fe-d1e894b1c539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-d120123d-c173-440c-839b-7fd37a18400f req-989260f1-9eb5-488d-a2fe-3f8526287593 service nova] Lock "36a15405-aa6a-41a2-93fe-d1e894b1c539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG nova.compute.manager [req-d120123d-c173-440c-839b-7fd37a18400f req-989260f1-9eb5-488d-a2fe-3f8526287593 service nova] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] No waiting events found dispatching network-vif-unplugged-35d86fef-8ddd-45db-9601-e99041a371ee {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG nova.compute.manager [req-d120123d-c173-440c-839b-7fd37a18400f req-989260f1-9eb5-488d-a2fe-3f8526287593 service nova] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Received event network-vif-unplugged-35d86fef-8ddd-45db-9601-e99041a371ee for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG nova.network.neutron [req-567bb805-965c-40ca-a2e3-9e56fcd6b4ef req-22c6bbe2-c9c4-4210-aedc-a68cdee8d6b0 service nova] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Updated VIF entry in instance network info cache for port 35d86fef-8ddd-45db-9601-e99041a371ee. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG nova.network.neutron [req-567bb805-965c-40ca-a2e3-9e56fcd6b4ef req-22c6bbe2-c9c4-4210-aedc-a68cdee8d6b0 service nova] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Updating instance_info_cache with network_info: [{"id": "35d86fef-8ddd-45db-9601-e99041a371ee", "address": "fa:16:3e:9a:80:52", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d86fef-8d", "ovs_interfaceid": "35d86fef-8ddd-45db-9601-e99041a371ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-567bb805-965c-40ca-a2e3-9e56fcd6b4ef req-22c6bbe2-c9c4-4210-aedc-a68cdee8d6b0 service nova] Releasing lock "refresh_cache-36a15405-aa6a-41a2-93fe-d1e894b1c539" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:31:51 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Instance destroyed successfully.
Nov 28 11:31:51 user nova-compute[74994]: DEBUG nova.objects.instance [None req-02558ea0-53f2-474e-bf81-9067b1aac01d tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lazy-loading 'resources' on Instance uuid 36a15405-aa6a-41a2-93fe-d1e894b1c539 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-02558ea0-53f2-474e-bf81-9067b1aac01d tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:29:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1219331062',display_name='tempest-TestVolumeBootPattern-server-1219331062',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1219331062',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJskGb8o7sKkkJHXfIeXjUMFdWljc0ALZAd51Odn5QFpQ6//wKpup5hgiLYGjHgIIEMC9O9O/gz4Xaxr/KZsMrjOgAbnCWxIK2QuPGlez3xcOsg8TTQkkpxGQHDunVpPZQ==',key_name='tempest-TestVolumeBootPattern-1373923849',keypairs=<?>,launch_index=0,launched_at=2023-11-28T11:30:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb427b7927364726907d9e90ef9a578f',ramdisk_id='',reservation_id='r-ws0elhs1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-169069415',owner_user_name='tempest-TestVolumeBootPattern-169069415-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T11:30:11Z,user_data=None,user_id='e1ebcd41891545f990e285b43c9eac90',uuid=36a15405-aa6a-41a2-93fe-d1e894b1c539,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35d86fef-8ddd-45db-9601-e99041a371ee", "address": "fa:16:3e:9a:80:52", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d86fef-8d", "ovs_interfaceid": "35d86fef-8ddd-45db-9601-e99041a371ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-02558ea0-53f2-474e-bf81-9067b1aac01d tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Converting VIF {"id": "35d86fef-8ddd-45db-9601-e99041a371ee", "address": "fa:16:3e:9a:80:52", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d86fef-8d", "ovs_interfaceid": "35d86fef-8ddd-45db-9601-e99041a371ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-02558ea0-53f2-474e-bf81-9067b1aac01d tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:80:52,bridge_name='br-int',has_traffic_filtering=True,id=35d86fef-8ddd-45db-9601-e99041a371ee,network=Network(2dad67e8-a656-4aa2-a2ed-f2875ee5e48a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d86fef-8d') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG os_vif [None req-02558ea0-53f2-474e-bf81-9067b1aac01d tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:80:52,bridge_name='br-int',has_traffic_filtering=True,id=35d86fef-8ddd-45db-9601-e99041a371ee,network=Network(2dad67e8-a656-4aa2-a2ed-f2875ee5e48a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d86fef-8d') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap35d86fef-8d, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2cd74a0b-2959-45e1-9ee6-ee221d6d7910) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:31:51 user nova-compute[74994]: INFO os_vif [None req-02558ea0-53f2-474e-bf81-9067b1aac01d tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:80:52,bridge_name='br-int',has_traffic_filtering=True,id=35d86fef-8ddd-45db-9601-e99041a371ee,network=Network(2dad67e8-a656-4aa2-a2ed-f2875ee5e48a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d86fef-8d')
Nov 28 11:31:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02558ea0-53f2-474e-bf81-9067b1aac01d tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-02558ea0-53f2-474e-bf81-9067b1aac01d tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'btnUjlSM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:31:51 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-02558ea0-53f2-474e-bf81-9067b1aac01d tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:31:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-02558ea0-53f2-474e-bf81-9067b1aac01d tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-02558ea0-53f2-474e-bf81-9067b1aac01d tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8ebd39-4463-4539-a3d9-1f05dd80a3d9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-02558ea0-53f2-474e-bf81-9067b1aac01d tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 11:31:51 user nova-compute[74994]: No targets found.
Nov 28 11:31:51 user nova-compute[74994]: iSNS:
Nov 28 11:31:51 user nova-compute[74994]: No targets found.
Nov 28 11:31:51 user nova-compute[74994]: STATIC:
Nov 28 11:31:51 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82
Nov 28 11:31:51 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:31:51 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:31:51 user nova-compute[74994]: FIRMWARE:
Nov 28 11:31:51 user nova-compute[74994]: No targets found.
Nov 28 11:31:51 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-02558ea0-53f2-474e-bf81-9067b1aac01d tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 11:31:51 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 11:31:51 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-02558ea0-53f2-474e-bf81-9067b1aac01d tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[88eebc12-89c4-41b6-a4a5-db8794081772]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e5b2c8-9cbd-4f06-8166-66e3f565ac41]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-02558ea0-53f2-474e-bf81-9067b1aac01d tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 (non-flash)
Nov 28 11:31:51 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-02558ea0-53f2-474e-bf81-9067b1aac01d tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 (non-flash)
Nov 28 11:31:51 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-02558ea0-53f2-474e-bf81-9067b1aac01d tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb944393400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82'): ({'sdb'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-02558ea0-53f2-474e-bf81-9067b1aac01d tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Removing single pathed devices sdb {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[50482833-00cb-41b4-9a63-d60fc72b9df5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba5e9a7-8d82-4162-a9bb-12a665bc4c68]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-02558ea0-53f2-474e-bf81-9067b1aac01d tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Flushing IO for device /dev/sdb {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[928707c6-c36c-4d03-8f26-a5437674df96]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-02558ea0-53f2-474e-bf81-9067b1aac01d tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 11:31:51 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:31:52 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:31:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.060s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:31:52 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4488c6-cab4-46dc-986f-bc764b542237]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:31:52 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-02558ea0-53f2-474e-bf81-9067b1aac01d tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 11:31:52 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-02558ea0-53f2-474e-bf81-9067b1aac01d tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] SCSI volumes sdb have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 11:31:52 user nova-compute[74994]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOe6cef6a2-f7bdfc8d9961898b', '/dev/disk/by-id/scsi-26637626466633864', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e6cef6a2') {{(pid=86494) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 11:31:52 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7852dec-6dc5-41e2-8913-953110e29fe6]: (4, None) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:31:52 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-02558ea0-53f2-474e-bf81-9067b1aac01d tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 11:31:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:31:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:31:52 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbcff86e-98d7-4d05-9fe4-a2d294fac69e]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:31:52 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-02558ea0-53f2-474e-bf81-9067b1aac01d tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:31:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:31:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:31:52 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[17029245-4851-4346-ab6a-aa99491bebb2]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:31:52 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-02558ea0-53f2-474e-bf81-9067b1aac01d tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82, portal: 172.16.0.220,3260]
Nov 28 11:31:52 user nova-compute[74994]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82, portal: 172.16.0.220,3260] successful.
Nov 28 11:31:52 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:31:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:31:52 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:31:52 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e3afe3-65df-424a-bd55-b66ce4a39d64]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:31:52 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-02558ea0-53f2-474e-bf81-9067b1aac01d tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:31:52 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-02558ea0-53f2-474e-bf81-9067b1aac01d tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:31:52 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-02558ea0-53f2-474e-bf81-9067b1aac01d tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] <== disconnect_volume: return (319ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:31:52 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02558ea0-53f2-474e-bf81-9067b1aac01d tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 11:31:52 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-02558ea0-53f2-474e-bf81-9067b1aac01d tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Deleting instance files /opt/stack/data/nova/instances/36a15405-aa6a-41a2-93fe-d1e894b1c539_del
Nov 28 11:31:52 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-02558ea0-53f2-474e-bf81-9067b1aac01d tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Deletion of /opt/stack/data/nova/instances/36a15405-aa6a-41a2-93fe-d1e894b1c539_del complete
Nov 28 11:31:52 user nova-compute[74994]: INFO nova.compute.manager [None req-02558ea0-53f2-474e-bf81-9067b1aac01d tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 28 11:31:52 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-02558ea0-53f2-474e-bf81-9067b1aac01d tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 11:31:52 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 11:31:52 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 11:31:53 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:31:53 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Took 0.88 seconds to deallocate network for instance.
Nov 28 11:31:53 user nova-compute[74994]: DEBUG nova.compute.manager [req-91e93700-1f31-43a8-9b3e-850d509fc4dd req-feaa910d-fbb7-457a-9553-f2f7ded6a0ab service nova] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Received event network-vif-deleted-35d86fef-8ddd-45db-9601-e99041a371ee {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:31:53 user nova-compute[74994]: DEBUG nova.compute.manager [req-7bad3b72-b8b5-4d64-9ecf-7df76ea719c8 req-c0524851-d980-4553-b94c-c63507600e0a service nova] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Received event network-vif-plugged-35d86fef-8ddd-45db-9601-e99041a371ee {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:31:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-7bad3b72-b8b5-4d64-9ecf-7df76ea719c8 req-c0524851-d980-4553-b94c-c63507600e0a service nova] Acquiring lock "36a15405-aa6a-41a2-93fe-d1e894b1c539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:31:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-7bad3b72-b8b5-4d64-9ecf-7df76ea719c8 req-c0524851-d980-4553-b94c-c63507600e0a service nova] Lock "36a15405-aa6a-41a2-93fe-d1e894b1c539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:31:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-7bad3b72-b8b5-4d64-9ecf-7df76ea719c8 req-c0524851-d980-4553-b94c-c63507600e0a service nova] Lock "36a15405-aa6a-41a2-93fe-d1e894b1c539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:31:53 user nova-compute[74994]: DEBUG nova.compute.manager [req-7bad3b72-b8b5-4d64-9ecf-7df76ea719c8 req-c0524851-d980-4553-b94c-c63507600e0a service nova] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] No waiting events found dispatching network-vif-plugged-35d86fef-8ddd-45db-9601-e99041a371ee {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:31:53 user nova-compute[74994]: WARNING nova.compute.manager [req-7bad3b72-b8b5-4d64-9ecf-7df76ea719c8 req-c0524851-d980-4553-b94c-c63507600e0a service nova] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Received unexpected event network-vif-plugged-35d86fef-8ddd-45db-9601-e99041a371ee for instance with vm_state active and task_state deleting.
Nov 28 11:31:53 user nova-compute[74994]: INFO nova.compute.manager [None req-02558ea0-53f2-474e-bf81-9067b1aac01d tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 36a15405-aa6a-41a2-93fe-d1e894b1c539] Took 0.80 seconds to detach 1 volumes for instance.
Nov 28 11:31:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-02558ea0-53f2-474e-bf81-9067b1aac01d tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:31:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-02558ea0-53f2-474e-bf81-9067b1aac01d tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:31:54 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-02558ea0-53f2-474e-bf81-9067b1aac01d tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:31:54 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-02558ea0-53f2-474e-bf81-9067b1aac01d tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:31:54 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-02558ea0-53f2-474e-bf81-9067b1aac01d tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.112s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:31:54 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-02558ea0-53f2-474e-bf81-9067b1aac01d tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Deleted allocations for instance 36a15405-aa6a-41a2-93fe-d1e894b1c539
Nov 28 11:31:54 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-02558ea0-53f2-474e-bf81-9067b1aac01d tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "36a15405-aa6a-41a2-93fe-d1e894b1c539" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.184s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:31:54 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:31:55 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:31:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:31:56 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:31:56 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:31:57 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:32:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:32:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:32:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:32:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:32:21 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:32:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:32:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:32:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:32:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:32:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:32:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:32:31 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:32:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:32:39 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:32:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:32:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:32:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:32:39 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 11:32:39 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:32:39 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:32:39 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=9171MB free_disk=25.03824234008789GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 11:32:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:32:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:32:39 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 11:32:39 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 11:32:39 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:32:39 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:32:40 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 11:32:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.136s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:32:41 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:32:42 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:32:42 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:32:42 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 11:32:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "de04088f-264e-48ef-83bf-3b25b9b76352" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:32:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "de04088f-264e-48ef-83bf-3b25b9b76352" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:32:42 user nova-compute[74994]: DEBUG nova.compute.manager [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 11:32:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:32:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:32:42 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 11:32:42 user nova-compute[74994]: INFO nova.compute.claims [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Claim successful on node user
Nov 28 11:32:42 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:32:42 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:32:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.223s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:32:43 user nova-compute[74994]: DEBUG nova.compute.manager [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 11:32:43 user nova-compute[74994]: DEBUG nova.compute.manager [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 11:32:43 user nova-compute[74994]: DEBUG nova.network.neutron [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 11:32:43 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 11:32:43 user nova-compute[74994]: DEBUG nova.compute.manager [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 11:32:43 user nova-compute[74994]: DEBUG nova.policy [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e1ebcd41891545f990e285b43c9eac90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb427b7927364726907d9e90ef9a578f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 11:32:43 user nova-compute[74994]: INFO nova.virt.block_device [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Booting with volume c4ab3363-a862-49e9-879b-46e91b07ce82 at /dev/vda
Nov 28 11:32:43 user nova-compute[74994]: DEBUG os_brick.utils [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:32:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:32:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:32:43 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff67fca-9152-4189-845f-ecd79de1994b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:32:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:32:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:32:43 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ecedf9-47f9-4796-ac94-ea362440dce2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:32:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:32:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:32:43 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb47251-f757-4f77-99d6-f3e3e61e7536]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:32:43 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[24da7626-1dca-41f0-9e2d-438c17195c0f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:32:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:32:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:32:43 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 11:32:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:32:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:32:43 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 11:32:43 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ce291a-7e59-40b9-a77a-44e5f59711c9]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:32:43 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 11:32:43 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 11:32:43 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 11:32:43 user nova-compute[74994]: DEBUG os_brick.utils [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:32:43 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Updating existing volume attachment record: a5033630-9fa6-4467-9844-ff7e253ee8ef {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 11:32:44 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:32:44 user nova-compute[74994]: DEBUG nova.network.neutron [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Successfully created port: 35fefd16-16bd-4dff-819c-ef13f7e84e94 {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 11:32:45 user nova-compute[74994]: DEBUG nova.network.neutron [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Successfully updated port: 35fefd16-16bd-4dff-819c-ef13f7e84e94 {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 11:32:45 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "refresh_cache-de04088f-264e-48ef-83bf-3b25b9b76352" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:32:45 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquired lock "refresh_cache-de04088f-264e-48ef-83bf-3b25b9b76352" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:32:45 user nova-compute[74994]: DEBUG nova.network.neutron [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 11:32:45 user nova-compute[74994]: DEBUG nova.compute.manager [req-b8892d41-54c3-491c-a572-5c716a2039c2 req-5b3d2d69-7abe-4d28-8865-a450f7f62e2d service nova] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Received event network-changed-35fefd16-16bd-4dff-819c-ef13f7e84e94 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:32:45 user nova-compute[74994]: DEBUG nova.compute.manager [req-b8892d41-54c3-491c-a572-5c716a2039c2 req-5b3d2d69-7abe-4d28-8865-a450f7f62e2d service nova] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Refreshing instance network info cache due to event network-changed-35fefd16-16bd-4dff-819c-ef13f7e84e94. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:32:45 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-b8892d41-54c3-491c-a572-5c716a2039c2 req-5b3d2d69-7abe-4d28-8865-a450f7f62e2d service nova] Acquiring lock "refresh_cache-de04088f-264e-48ef-83bf-3b25b9b76352" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:32:45 user nova-compute[74994]: DEBUG nova.network.neutron [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 11:32:45 user nova-compute[74994]: DEBUG nova.network.neutron [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Updating instance_info_cache with network_info: [{"id": "35fefd16-16bd-4dff-819c-ef13f7e84e94", "address": "fa:16:3e:f3:f2:3a", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35fefd16-16", "ovs_interfaceid": "35fefd16-16bd-4dff-819c-ef13f7e84e94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:32:45 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Releasing lock "refresh_cache-de04088f-264e-48ef-83bf-3b25b9b76352" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:32:45 user nova-compute[74994]: DEBUG nova.compute.manager [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Instance network_info: |[{"id": "35fefd16-16bd-4dff-819c-ef13f7e84e94", "address": "fa:16:3e:f3:f2:3a", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35fefd16-16", "ovs_interfaceid": "35fefd16-16bd-4dff-819c-ef13f7e84e94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 11:32:45 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-b8892d41-54c3-491c-a572-5c716a2039c2 req-5b3d2d69-7abe-4d28-8865-a450f7f62e2d service nova] Acquired lock "refresh_cache-de04088f-264e-48ef-83bf-3b25b9b76352" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:32:45 user nova-compute[74994]: DEBUG nova.network.neutron [req-b8892d41-54c3-491c-a572-5c716a2039c2 req-5b3d2d69-7abe-4d28-8865-a450f7f62e2d service nova] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Refreshing network info cache for port 35fefd16-16bd-4dff-819c-ef13f7e84e94 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:32:45 user nova-compute[74994]: DEBUG nova.network.neutron [req-b8892d41-54c3-491c-a572-5c716a2039c2 req-5b3d2d69-7abe-4d28-8865-a450f7f62e2d service nova] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Updated VIF entry in instance network info cache for port 35fefd16-16bd-4dff-819c-ef13f7e84e94. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:32:45 user nova-compute[74994]: DEBUG nova.network.neutron [req-b8892d41-54c3-491c-a572-5c716a2039c2 req-5b3d2d69-7abe-4d28-8865-a450f7f62e2d service nova] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Updating instance_info_cache with network_info: [{"id": "35fefd16-16bd-4dff-819c-ef13f7e84e94", "address": "fa:16:3e:f3:f2:3a", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35fefd16-16", "ovs_interfaceid": "35fefd16-16bd-4dff-819c-ef13f7e84e94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:32:45 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-b8892d41-54c3-491c-a572-5c716a2039c2 req-5b3d2d69-7abe-4d28-8865-a450f7f62e2d service nova] Releasing lock "refresh_cache-de04088f-264e-48ef-83bf-3b25b9b76352" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:32:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:32:49 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG nova.compute.manager [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 11:32:50 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Creating image(s)
Nov 28 11:32:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Did not create local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Ensure instance console log exists: /opt/stack/data/nova/instances/de04088f-264e-48ef-83bf-3b25b9b76352/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Start _get_guest_xml network_info=[{"id": "35fefd16-16bd-4dff-819c-ef13f7e84e94", "address": "fa:16:3e:f3:f2:3a", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35fefd16-16", "ovs_interfaceid": "35fefd16-16bd-4dff-819c-ef13f7e84e94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'btnUjlSM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'de04088f-264e-48ef-83bf-3b25b9b76352', 'attached_at': '', 'detached_at': '', 'volume_id': 'c4ab3363-a862-49e9-879b-46e91b07ce82', 'serial': 'c4ab3363-a862-49e9-879b-46e91b07ce82'}, 'attachment_id': 'a5033630-9fa6-4467-9844-ff7e253ee8ef', 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 11:32:50 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:32:50 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:32:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'btnUjlSM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:32:50 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:32:50 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:32:50 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:32:50 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:32:50 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 11:32:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb8c977-d8b5-4855-a394-63b78db4150c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 11:32:50 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Rebuilding the list of instances to heal {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c68b2d5-22af-44c5-97a1-e13ed9cc9259]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82] added
Nov 28 11:32:50 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Skipping network cache update for instance because it is Building. {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Didn't find any instances for network info cache update. {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5caa7e67-7e74-4c4d-9873-e6894959a1b2]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[953a0f0c-00b5-4a4f-8d59-06d3221ea8eb]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v btnUjlSM {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v btnUjlSM" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd7db64-ac7d-4da6-a18b-23da71065b34]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'btnUjlSM'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[482ae401-5eb8-4411-8a16-7f19dc9206c1]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2cf574b-1bf2-4ea1-85f3-81bbdfacf192]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 11:32:50 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 11:32:50 user nova-compute[74994]:  {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:32:50 user nova-compute[74994]: WARNING os_brick.initiator.connectors.iscsi [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 11:32:50 user nova-compute[74994]: 
Nov 28 11:32:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[37140f71-f6c5-43ff-8435-230a57b5aa4e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82, portal: 172.16.0.220,3260]
Nov 28 11:32:50 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82, portal: 172.16.0.220,3260] successful.
Nov 28 11:32:50 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6c5980-6252-40c4-8405-6a413dd235de]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6082c26-af12-4aa6-a456-e9f69ebfb0d7]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 (non-flash)
Nov 28 11:32:50 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 (non-flash)
Nov 28 11:32:50 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e86f5c-451c-4c95-b9d3-eec449af0141]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 11:32:50 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'btnUjlSM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 11:32:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:32:51 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '26637626466633864', 'path': '/dev/sdb'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:32:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637626466633864', 'path': '/dev/sdb'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 11:32:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-422785220',display_name='tempest-TestVolumeBootPattern-server-422785220',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-422785220',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJskGb8o7sKkkJHXfIeXjUMFdWljc0ALZAd51Odn5QFpQ6//wKpup5hgiLYGjHgIIEMC9O9O/gz4Xaxr/KZsMrjOgAbnCWxIK2QuPGlez3xcOsg8TTQkkpxGQHDunVpPZQ==',key_name='tempest-TestVolumeBootPattern-1373923849',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb427b7927364726907d9e90ef9a578f',ramdisk_id='',reservation_id='r-83ou7405',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-169069415',owner_user_name='tempest-TestVolumeBootPattern-169069415-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:32:43Z,user_data=None,user_id='e1ebcd41891545f990e285b43c9eac90',uuid=de04088f-264e-48ef-83bf-3b25b9b76352,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35fefd16-16bd-4dff-819c-ef13f7e84e94", "address": "fa:16:3e:f3:f2:3a", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35fefd16-16", "ovs_interfaceid": "35fefd16-16bd-4dff-819c-ef13f7e84e94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 11:32:51 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Converting VIF {"id": "35fefd16-16bd-4dff-819c-ef13f7e84e94", "address": "fa:16:3e:f3:f2:3a", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35fefd16-16", "ovs_interfaceid": "35fefd16-16bd-4dff-819c-ef13f7e84e94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:32:51 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:f2:3a,bridge_name='br-int',has_traffic_filtering=True,id=35fefd16-16bd-4dff-819c-ef13f7e84e94,network=Network(2dad67e8-a656-4aa2-a2ed-f2875ee5e48a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35fefd16-16') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:32:51 user nova-compute[74994]: DEBUG nova.objects.instance [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lazy-loading 'pci_devices' on Instance uuid de04088f-264e-48ef-83bf-3b25b9b76352 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:32:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] End _get_guest_xml xml=<domain type="kvm">
Nov 28 11:32:51 user nova-compute[74994]:   <uuid>de04088f-264e-48ef-83bf-3b25b9b76352</uuid>
Nov 28 11:32:51 user nova-compute[74994]:   <name>instance-00000033</name>
Nov 28 11:32:51 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 11:32:51 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 11:32:51 user nova-compute[74994]:   <metadata>
Nov 28 11:32:51 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 11:32:51 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 11:32:51 user nova-compute[74994]:       <nova:name>tempest-TestVolumeBootPattern-server-422785220</nova:name>
Nov 28 11:32:51 user nova-compute[74994]:       <nova:creationTime>2023-11-28 11:32:50</nova:creationTime>
Nov 28 11:32:51 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 11:32:51 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 11:32:51 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 11:32:51 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 11:32:51 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 11:32:51 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 11:32:51 user nova-compute[74994]:       </nova:flavor>
Nov 28 11:32:51 user nova-compute[74994]:       <nova:owner>
Nov 28 11:32:51 user nova-compute[74994]:         <nova:user uuid="e1ebcd41891545f990e285b43c9eac90">tempest-TestVolumeBootPattern-169069415-project-member</nova:user>
Nov 28 11:32:51 user nova-compute[74994]:         <nova:project uuid="cb427b7927364726907d9e90ef9a578f">tempest-TestVolumeBootPattern-169069415</nova:project>
Nov 28 11:32:51 user nova-compute[74994]:       </nova:owner>
Nov 28 11:32:51 user nova-compute[74994]:       <nova:ports>
Nov 28 11:32:51 user nova-compute[74994]:         <nova:port uuid="35fefd16-16bd-4dff-819c-ef13f7e84e94">
Nov 28 11:32:51 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 28 11:32:51 user nova-compute[74994]:         </nova:port>
Nov 28 11:32:51 user nova-compute[74994]:       </nova:ports>
Nov 28 11:32:51 user nova-compute[74994]:     </nova:instance>
Nov 28 11:32:51 user nova-compute[74994]:   </metadata>
Nov 28 11:32:51 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 11:32:51 user nova-compute[74994]:     <system>
Nov 28 11:32:51 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 11:32:51 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 11:32:51 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 11:32:51 user nova-compute[74994]:       <entry name="serial">de04088f-264e-48ef-83bf-3b25b9b76352</entry>
Nov 28 11:32:51 user nova-compute[74994]:       <entry name="uuid">de04088f-264e-48ef-83bf-3b25b9b76352</entry>
Nov 28 11:32:51 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 11:32:51 user nova-compute[74994]:     </system>
Nov 28 11:32:51 user nova-compute[74994]:   </sysinfo>
Nov 28 11:32:51 user nova-compute[74994]:   <os>
Nov 28 11:32:51 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 11:32:51 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 11:32:51 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 11:32:51 user nova-compute[74994]:   </os>
Nov 28 11:32:51 user nova-compute[74994]:   <features>
Nov 28 11:32:51 user nova-compute[74994]:     <acpi/>
Nov 28 11:32:51 user nova-compute[74994]:     <apic/>
Nov 28 11:32:51 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 11:32:51 user nova-compute[74994]:   </features>
Nov 28 11:32:51 user nova-compute[74994]:   <clock offset="utc">
Nov 28 11:32:51 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 11:32:51 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 11:32:51 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 11:32:51 user nova-compute[74994]:   </clock>
Nov 28 11:32:51 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 11:32:51 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 11:32:51 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 11:32:51 user nova-compute[74994]:   </cpu>
Nov 28 11:32:51 user nova-compute[74994]:   <devices>
Nov 28 11:32:51 user nova-compute[74994]:     <disk type="block" device="disk">
Nov 28 11:32:51 user nova-compute[74994]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:32:51 user nova-compute[74994]:       <source dev="/dev/sdb"/>
Nov 28 11:32:51 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 11:32:51 user nova-compute[74994]:       <serial>c4ab3363-a862-49e9-879b-46e91b07ce82</serial>
Nov 28 11:32:51 user nova-compute[74994]:     </disk>
Nov 28 11:32:51 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 11:32:51 user nova-compute[74994]:       <mac address="fa:16:3e:f3:f2:3a"/>
Nov 28 11:32:51 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:32:51 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 11:32:51 user nova-compute[74994]:       <target dev="tap35fefd16-16"/>
Nov 28 11:32:51 user nova-compute[74994]:     </interface>
Nov 28 11:32:51 user nova-compute[74994]:     <serial type="pty">
Nov 28 11:32:51 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/de04088f-264e-48ef-83bf-3b25b9b76352/console.log" append="off"/>
Nov 28 11:32:51 user nova-compute[74994]:     </serial>
Nov 28 11:32:51 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 11:32:51 user nova-compute[74994]:     <video>
Nov 28 11:32:51 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:32:51 user nova-compute[74994]:     </video>
Nov 28 11:32:51 user nova-compute[74994]:     <rng model="virtio">
Nov 28 11:32:51 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 11:32:51 user nova-compute[74994]:     </rng>
Nov 28 11:32:51 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 11:32:51 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 11:32:51 user nova-compute[74994]:       <stats period="10"/>
Nov 28 11:32:51 user nova-compute[74994]:     </memballoon>
Nov 28 11:32:51 user nova-compute[74994]:   </devices>
Nov 28 11:32:51 user nova-compute[74994]: </domain>
Nov 28 11:32:51 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 11:32:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-422785220',display_name='tempest-TestVolumeBootPattern-server-422785220',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-422785220',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJskGb8o7sKkkJHXfIeXjUMFdWljc0ALZAd51Odn5QFpQ6//wKpup5hgiLYGjHgIIEMC9O9O/gz4Xaxr/KZsMrjOgAbnCWxIK2QuPGlez3xcOsg8TTQkkpxGQHDunVpPZQ==',key_name='tempest-TestVolumeBootPattern-1373923849',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb427b7927364726907d9e90ef9a578f',ramdisk_id='',reservation_id='r-83ou7405',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-169069415',owner_user_name='tempest-TestVolumeBootPattern-169069415-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:32:43Z,user_data=None,user_id='e1ebcd41891545f990e285b43c9eac90',uuid=de04088f-264e-48ef-83bf-3b25b9b76352,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35fefd16-16bd-4dff-819c-ef13f7e84e94", "address": "fa:16:3e:f3:f2:3a", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35fefd16-16", "ovs_interfaceid": "35fefd16-16bd-4dff-819c-ef13f7e84e94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 11:32:51 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Converting VIF {"id": "35fefd16-16bd-4dff-819c-ef13f7e84e94", "address": "fa:16:3e:f3:f2:3a", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35fefd16-16", "ovs_interfaceid": "35fefd16-16bd-4dff-819c-ef13f7e84e94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:32:51 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:f2:3a,bridge_name='br-int',has_traffic_filtering=True,id=35fefd16-16bd-4dff-819c-ef13f7e84e94,network=Network(2dad67e8-a656-4aa2-a2ed-f2875ee5e48a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35fefd16-16') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:32:51 user nova-compute[74994]: DEBUG os_vif [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:f2:3a,bridge_name='br-int',has_traffic_filtering=True,id=35fefd16-16bd-4dff-819c-ef13f7e84e94,network=Network(2dad67e8-a656-4aa2-a2ed-f2875ee5e48a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35fefd16-16') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 11:32:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:32:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:32:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 11:32:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:32:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '10495f14-802e-5b50-98c3-6db8404a43ce', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:32:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:32:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:32:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:32:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap35fefd16-16, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:32:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap35fefd16-16, col_values=(('qos', UUID('142e9804-70a7-41fa-a202-832f63017936')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:32:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap35fefd16-16, col_values=(('external_ids', {'iface-id': '35fefd16-16bd-4dff-819c-ef13f7e84e94', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:f2:3a', 'vm-uuid': 'de04088f-264e-48ef-83bf-3b25b9b76352'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:32:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:32:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:32:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:32:51 user nova-compute[74994]: INFO os_vif [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:f2:3a,bridge_name='br-int',has_traffic_filtering=True,id=35fefd16-16bd-4dff-819c-ef13f7e84e94,network=Network(2dad67e8-a656-4aa2-a2ed-f2875ee5e48a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35fefd16-16')
Nov 28 11:32:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:32:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] No VIF found with MAC fa:16:3e:f3:f2:3a, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:32:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:32:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:32:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:32:53 user nova-compute[74994]: DEBUG nova.compute.manager [req-66a96b4f-ced9-42c6-bfd0-fdbd47655d0c req-7b7bf7f2-85bc-47d9-9066-32d4ab938f7c service nova] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Received event network-vif-plugged-35fefd16-16bd-4dff-819c-ef13f7e84e94 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:32:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-66a96b4f-ced9-42c6-bfd0-fdbd47655d0c req-7b7bf7f2-85bc-47d9-9066-32d4ab938f7c service nova] Acquiring lock "de04088f-264e-48ef-83bf-3b25b9b76352-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:32:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-66a96b4f-ced9-42c6-bfd0-fdbd47655d0c req-7b7bf7f2-85bc-47d9-9066-32d4ab938f7c service nova] Lock "de04088f-264e-48ef-83bf-3b25b9b76352-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:32:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-66a96b4f-ced9-42c6-bfd0-fdbd47655d0c req-7b7bf7f2-85bc-47d9-9066-32d4ab938f7c service nova] Lock "de04088f-264e-48ef-83bf-3b25b9b76352-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:32:53 user nova-compute[74994]: DEBUG nova.compute.manager [req-66a96b4f-ced9-42c6-bfd0-fdbd47655d0c req-7b7bf7f2-85bc-47d9-9066-32d4ab938f7c service nova] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] No waiting events found dispatching network-vif-plugged-35fefd16-16bd-4dff-819c-ef13f7e84e94 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:32:53 user nova-compute[74994]: WARNING nova.compute.manager [req-66a96b4f-ced9-42c6-bfd0-fdbd47655d0c req-7b7bf7f2-85bc-47d9-9066-32d4ab938f7c service nova] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Received unexpected event network-vif-plugged-35fefd16-16bd-4dff-819c-ef13f7e84e94 for instance with vm_state building and task_state spawning.
Nov 28 11:32:53 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:32:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:32:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:32:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:32:55 user nova-compute[74994]: DEBUG nova.compute.manager [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 11:32:55 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 11:32:55 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Instance spawned successfully.
Nov 28 11:32:55 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 11:32:55 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:32:55 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:32:55 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:32:55 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:32:55 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:32:55 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:32:55 user nova-compute[74994]: INFO nova.compute.manager [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Took 4.96 seconds to spawn the instance on the hypervisor.
Nov 28 11:32:55 user nova-compute[74994]: DEBUG nova.compute.manager [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 11:32:55 user nova-compute[74994]: DEBUG nova.compute.manager [req-a7cd350d-e15f-4378-9ad1-2de7900c3b26 req-38d5e5af-4915-4316-b0d8-5042f69c62e0 service nova] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Received event network-vif-plugged-35fefd16-16bd-4dff-819c-ef13f7e84e94 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:32:55 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a7cd350d-e15f-4378-9ad1-2de7900c3b26 req-38d5e5af-4915-4316-b0d8-5042f69c62e0 service nova] Acquiring lock "de04088f-264e-48ef-83bf-3b25b9b76352-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:32:55 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a7cd350d-e15f-4378-9ad1-2de7900c3b26 req-38d5e5af-4915-4316-b0d8-5042f69c62e0 service nova] Lock "de04088f-264e-48ef-83bf-3b25b9b76352-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:32:55 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-a7cd350d-e15f-4378-9ad1-2de7900c3b26 req-38d5e5af-4915-4316-b0d8-5042f69c62e0 service nova] Lock "de04088f-264e-48ef-83bf-3b25b9b76352-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:32:55 user nova-compute[74994]: DEBUG nova.compute.manager [req-a7cd350d-e15f-4378-9ad1-2de7900c3b26 req-38d5e5af-4915-4316-b0d8-5042f69c62e0 service nova] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] No waiting events found dispatching network-vif-plugged-35fefd16-16bd-4dff-819c-ef13f7e84e94 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:32:55 user nova-compute[74994]: WARNING nova.compute.manager [req-a7cd350d-e15f-4378-9ad1-2de7900c3b26 req-38d5e5af-4915-4316-b0d8-5042f69c62e0 service nova] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Received unexpected event network-vif-plugged-35fefd16-16bd-4dff-819c-ef13f7e84e94 for instance with vm_state building and task_state spawning.
Nov 28 11:32:55 user nova-compute[74994]: INFO nova.compute.manager [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Took 12.62 seconds to build instance.
Nov 28 11:32:55 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-402b4c34-78e5-40f9-8c5c-c91d769d82cf tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "de04088f-264e-48ef-83bf-3b25b9b76352" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.719s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:32:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:32:56 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:32:56 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:32:56 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:32:56 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:33:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:33:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:33:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:33:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:33:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:33:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:33:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:33:21 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:33:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:33:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:33:31 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:33:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:33:39 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:33:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:33:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:33:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:33:39 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 11:33:39 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:33:39 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:33:39 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:33:39 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=9024MB free_disk=25.036518096923828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 11:33:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:33:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:33:39 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance de04088f-264e-48ef-83bf-3b25b9b76352 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:33:39 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 11:33:39 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 11:33:40 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:33:40 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:33:40 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 11:33:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.202s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:33:41 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:33:43 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:33:43 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 11:33:43 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:33:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:33:50 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:33:51 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:33:52 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:33:52 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 11:33:52 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Rebuilding the list of instances to heal {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 11:33:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "refresh_cache-de04088f-264e-48ef-83bf-3b25b9b76352" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:33:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquired lock "refresh_cache-de04088f-264e-48ef-83bf-3b25b9b76352" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:33:52 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Forcefully refreshing network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 11:33:52 user nova-compute[74994]: DEBUG nova.objects.instance [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lazy-loading 'info_cache' on Instance uuid de04088f-264e-48ef-83bf-3b25b9b76352 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:33:52 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Updating instance_info_cache with network_info: [{"id": "35fefd16-16bd-4dff-819c-ef13f7e84e94", "address": "fa:16:3e:f3:f2:3a", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35fefd16-16", "ovs_interfaceid": "35fefd16-16bd-4dff-819c-ef13f7e84e94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:33:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Releasing lock "refresh_cache-de04088f-264e-48ef-83bf-3b25b9b76352" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:33:52 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Updated the network info_cache for instance {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 11:33:55 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:33:56 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:33:56 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:33:56 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:33:58 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:34:01 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:34:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:34:06 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:34:11 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:34:16 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:34:21 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:34:26 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:34:31 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:34:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:34:34 user nova-compute[74994]: DEBUG nova.compute.manager [req-b48200de-570a-4fb8-ae93-2be6d7632615 req-e2901f48-c630-48f2-a662-d98a73c324c3 service nova] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Received event network-changed-35fefd16-16bd-4dff-819c-ef13f7e84e94 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:34:34 user nova-compute[74994]: DEBUG nova.compute.manager [req-b48200de-570a-4fb8-ae93-2be6d7632615 req-e2901f48-c630-48f2-a662-d98a73c324c3 service nova] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Refreshing instance network info cache due to event network-changed-35fefd16-16bd-4dff-819c-ef13f7e84e94. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:34:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-b48200de-570a-4fb8-ae93-2be6d7632615 req-e2901f48-c630-48f2-a662-d98a73c324c3 service nova] Acquiring lock "refresh_cache-de04088f-264e-48ef-83bf-3b25b9b76352" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:34:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-b48200de-570a-4fb8-ae93-2be6d7632615 req-e2901f48-c630-48f2-a662-d98a73c324c3 service nova] Acquired lock "refresh_cache-de04088f-264e-48ef-83bf-3b25b9b76352" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:34:34 user nova-compute[74994]: DEBUG nova.network.neutron [req-b48200de-570a-4fb8-ae93-2be6d7632615 req-e2901f48-c630-48f2-a662-d98a73c324c3 service nova] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Refreshing network info cache for port 35fefd16-16bd-4dff-819c-ef13f7e84e94 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:34:35 user nova-compute[74994]: DEBUG nova.network.neutron [req-b48200de-570a-4fb8-ae93-2be6d7632615 req-e2901f48-c630-48f2-a662-d98a73c324c3 service nova] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Updated VIF entry in instance network info cache for port 35fefd16-16bd-4dff-819c-ef13f7e84e94. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:34:35 user nova-compute[74994]: DEBUG nova.network.neutron [req-b48200de-570a-4fb8-ae93-2be6d7632615 req-e2901f48-c630-48f2-a662-d98a73c324c3 service nova] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Updating instance_info_cache with network_info: [{"id": "35fefd16-16bd-4dff-819c-ef13f7e84e94", "address": "fa:16:3e:f3:f2:3a", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35fefd16-16", "ovs_interfaceid": "35fefd16-16bd-4dff-819c-ef13f7e84e94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:34:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-b48200de-570a-4fb8-ae93-2be6d7632615 req-e2901f48-c630-48f2-a662-d98a73c324c3 service nova] Releasing lock "refresh_cache-de04088f-264e-48ef-83bf-3b25b9b76352" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:34:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:34:36 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:34:39 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:34:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:34:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:34:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:34:39 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 11:34:39 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:34:39 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:34:39 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:34:39 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=9055MB free_disk=25.0357666015625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 11:34:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:34:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:34:39 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance de04088f-264e-48ef-83bf-3b25b9b76352 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:34:39 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 11:34:39 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 11:34:40 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:34:40 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:34:40 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 11:34:40 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.156s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:34:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:34:41 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:34:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "8cde59ae-f4d6-4200-a3a7-5ff54b004083" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:34:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "8cde59ae-f4d6-4200-a3a7-5ff54b004083" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:34:42 user nova-compute[74994]: DEBUG nova.compute.manager [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 11:34:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:34:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:34:42 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 11:34:42 user nova-compute[74994]: INFO nova.compute.claims [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Claim successful on node user
Nov 28 11:34:42 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:34:42 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:34:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.207s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:34:42 user nova-compute[74994]: DEBUG nova.compute.manager [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 11:34:42 user nova-compute[74994]: DEBUG nova.compute.manager [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 11:34:42 user nova-compute[74994]: DEBUG nova.network.neutron [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 11:34:42 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 11:34:42 user nova-compute[74994]: DEBUG nova.compute.manager [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 11:34:42 user nova-compute[74994]: DEBUG nova.policy [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e1ebcd41891545f990e285b43c9eac90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb427b7927364726907d9e90ef9a578f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 11:34:42 user nova-compute[74994]: INFO nova.virt.block_device [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Booting with volume 02b9e71d-034e-465f-80a0-d120af116330 at /dev/vda
Nov 28 11:34:42 user nova-compute[74994]: DEBUG os_brick.utils [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:34:42 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:34:42 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:34:42 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6129d286-3e4a-40e2-b359-76a051f62569]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:34:42 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:34:42 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:34:42 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[36334ce3-3367-4adb-927c-796603bec63e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:34:42 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:34:42 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:34:42 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fc540f-0c5e-4537-ae12-938ca773af8b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:34:42 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c304b2-f717-41f9-b807-8c87b70ecd5e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:34:42 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:34:42 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:34:42 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 11:34:42 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:34:42 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:34:42 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 11:34:42 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43a2b6e-9674-4206-84e0-33ea1c787cb1]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:34:42 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 11:34:42 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 11:34:42 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 11:34:42 user nova-compute[74994]: DEBUG os_brick.utils [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:34:42 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Updating existing volume attachment record: 459f56ac-f4e6-484c-98a3-5266c671e96b {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 11:34:43 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:34:43 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 11:34:43 user nova-compute[74994]: DEBUG nova.network.neutron [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Successfully created port: e4b1717f-2765-42ba-974a-3953f12c6b41 {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 11:34:44 user nova-compute[74994]: DEBUG nova.network.neutron [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Successfully updated port: e4b1717f-2765-42ba-974a-3953f12c6b41 {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 11:34:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "refresh_cache-8cde59ae-f4d6-4200-a3a7-5ff54b004083" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:34:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquired lock "refresh_cache-8cde59ae-f4d6-4200-a3a7-5ff54b004083" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:34:44 user nova-compute[74994]: DEBUG nova.network.neutron [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 11:34:44 user nova-compute[74994]: DEBUG nova.compute.manager [req-5b94f3e1-a307-4831-a83a-e172cc395b4f req-a04d6dfb-a676-4fd0-acd7-1295cbf9a5b0 service nova] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Received event network-changed-e4b1717f-2765-42ba-974a-3953f12c6b41 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:34:44 user nova-compute[74994]: DEBUG nova.compute.manager [req-5b94f3e1-a307-4831-a83a-e172cc395b4f req-a04d6dfb-a676-4fd0-acd7-1295cbf9a5b0 service nova] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Refreshing instance network info cache due to event network-changed-e4b1717f-2765-42ba-974a-3953f12c6b41. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:34:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-5b94f3e1-a307-4831-a83a-e172cc395b4f req-a04d6dfb-a676-4fd0-acd7-1295cbf9a5b0 service nova] Acquiring lock "refresh_cache-8cde59ae-f4d6-4200-a3a7-5ff54b004083" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:34:44 user nova-compute[74994]: DEBUG nova.network.neutron [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 11:34:44 user nova-compute[74994]: DEBUG nova.network.neutron [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Updating instance_info_cache with network_info: [{"id": "e4b1717f-2765-42ba-974a-3953f12c6b41", "address": "fa:16:3e:fa:00:a3", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b1717f-27", "ovs_interfaceid": "e4b1717f-2765-42ba-974a-3953f12c6b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:34:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Releasing lock "refresh_cache-8cde59ae-f4d6-4200-a3a7-5ff54b004083" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:34:44 user nova-compute[74994]: DEBUG nova.compute.manager [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Instance network_info: |[{"id": "e4b1717f-2765-42ba-974a-3953f12c6b41", "address": "fa:16:3e:fa:00:a3", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b1717f-27", "ovs_interfaceid": "e4b1717f-2765-42ba-974a-3953f12c6b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 11:34:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-5b94f3e1-a307-4831-a83a-e172cc395b4f req-a04d6dfb-a676-4fd0-acd7-1295cbf9a5b0 service nova] Acquired lock "refresh_cache-8cde59ae-f4d6-4200-a3a7-5ff54b004083" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:34:44 user nova-compute[74994]: DEBUG nova.network.neutron [req-5b94f3e1-a307-4831-a83a-e172cc395b4f req-a04d6dfb-a676-4fd0-acd7-1295cbf9a5b0 service nova] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Refreshing network info cache for port e4b1717f-2765-42ba-974a-3953f12c6b41 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:34:45 user nova-compute[74994]: DEBUG nova.network.neutron [req-5b94f3e1-a307-4831-a83a-e172cc395b4f req-a04d6dfb-a676-4fd0-acd7-1295cbf9a5b0 service nova] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Updated VIF entry in instance network info cache for port e4b1717f-2765-42ba-974a-3953f12c6b41. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:34:45 user nova-compute[74994]: DEBUG nova.network.neutron [req-5b94f3e1-a307-4831-a83a-e172cc395b4f req-a04d6dfb-a676-4fd0-acd7-1295cbf9a5b0 service nova] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Updating instance_info_cache with network_info: [{"id": "e4b1717f-2765-42ba-974a-3953f12c6b41", "address": "fa:16:3e:fa:00:a3", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b1717f-27", "ovs_interfaceid": "e4b1717f-2765-42ba-974a-3953f12c6b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:34:45 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-5b94f3e1-a307-4831-a83a-e172cc395b4f req-a04d6dfb-a676-4fd0-acd7-1295cbf9a5b0 service nova] Releasing lock "refresh_cache-8cde59ae-f4d6-4200-a3a7-5ff54b004083" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:34:45 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:34:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:34:46 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG nova.compute.manager [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 11:34:49 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Creating image(s)
Nov 28 11:34:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Did not create local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Ensure instance console log exists: /opt/stack/data/nova/instances/8cde59ae-f4d6-4200-a3a7-5ff54b004083/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Start _get_guest_xml network_info=[{"id": "e4b1717f-2765-42ba-974a-3953f12c6b41", "address": "fa:16:3e:fa:00:a3", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b1717f-27", "ovs_interfaceid": "e4b1717f-2765-42ba-974a-3953f12c6b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RmZkLOUG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8cde59ae-f4d6-4200-a3a7-5ff54b004083', 'attached_at': '', 'detached_at': '', 'volume_id': '02b9e71d-034e-465f-80a0-d120af116330', 'serial': '02b9e71d-034e-465f-80a0-d120af116330'}, 'attachment_id': '459f56ac-f4e6-484c-98a3-5266c671e96b', 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 11:34:49 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:34:49 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:34:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RmZkLOUG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:34:49 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:34:49 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:34:49 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:34:49 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:34:49 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 11:34:49 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330 -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[964a3103-4490-47ee-be0c-29f49e4763a4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 11:34:49 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330 -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9797e2a4-1fd5-4fc7-ae7a-79e3439d2dc7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330] added
Nov 28 11:34:49 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[160e11c1-94b0-4416-a39e-f2b06167971e]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f60bb6-8aca-4d1a-9bcc-98e661e489f2]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RmZkLOUG {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RmZkLOUG" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf17d48-2e67-4bb8-95f1-f20aa230a879]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RmZkLOUG'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[36939f7c-2189-42b3-83d6-83e17fa76f2d]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[90da8af4-4f4c-470d-adb4-8a2f153b43c1]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 (non-flash)
Nov 28 11:34:49 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 (non-flash)
Nov 28 11:34:49 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330 -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[67856520-9e16-4ac1-a923-9c619326c519]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330, portal: 172.16.0.220,3260]
Nov 28 11:34:49 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330, portal: 172.16.0.220,3260] successful.
Nov 28 11:34:49 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ebe810-0741-4970-a835-c240a10b8e18]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[929768b7-399c-4c19-ba78-a31a3cfdf0c6]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 (non-flash)
Nov 28 11:34:49 user nova-compute[74994]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330 (non-flash)
Nov 28 11:34:49 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 (non-flash)
Nov 28 11:34:49 user nova-compute[74994]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330 (non-flash)
Nov 28 11:34:49 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] HCTL ('34', '-', '-', 0) found on session 63 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2dfe17-574f-4df4-9c29-3dd1155efb28]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:34:49 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: None {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 11:34:50 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:34:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:34:50 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 11:34:50 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RmZkLOUG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 11:34:50 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:34:50 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23033633236373834', 'path': '/dev/sdc'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:34:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033633236373834', 'path': '/dev/sdc'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 11:34:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:34:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2084240881',display_name='tempest-TestVolumeBootPattern-server-2084240881',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2084240881',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJskGb8o7sKkkJHXfIeXjUMFdWljc0ALZAd51Odn5QFpQ6//wKpup5hgiLYGjHgIIEMC9O9O/gz4Xaxr/KZsMrjOgAbnCWxIK2QuPGlez3xcOsg8TTQkkpxGQHDunVpPZQ==',key_name='tempest-TestVolumeBootPattern-1373923849',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb427b7927364726907d9e90ef9a578f',ramdisk_id='',reservation_id='r-rh72kuzc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-169069415',owner_user_name='tempest-TestVolumeBootPattern-169069415-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:34:43Z,user_data=None,user_id='e1ebcd41891545f990e285b43c9eac90',uuid=8cde59ae-f4d6-4200-a3a7-5ff54b004083,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4b1717f-2765-42ba-974a-3953f12c6b41", "address": "fa:16:3e:fa:00:a3", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b1717f-27", "ovs_interfaceid": "e4b1717f-2765-42ba-974a-3953f12c6b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 11:34:50 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Converting VIF {"id": "e4b1717f-2765-42ba-974a-3953f12c6b41", "address": "fa:16:3e:fa:00:a3", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b1717f-27", "ovs_interfaceid": "e4b1717f-2765-42ba-974a-3953f12c6b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:34:50 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:00:a3,bridge_name='br-int',has_traffic_filtering=True,id=e4b1717f-2765-42ba-974a-3953f12c6b41,network=Network(2dad67e8-a656-4aa2-a2ed-f2875ee5e48a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b1717f-27') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:34:50 user nova-compute[74994]: DEBUG nova.objects.instance [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lazy-loading 'pci_devices' on Instance uuid 8cde59ae-f4d6-4200-a3a7-5ff54b004083 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:34:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] End _get_guest_xml xml=<domain type="kvm">
Nov 28 11:34:50 user nova-compute[74994]:   <uuid>8cde59ae-f4d6-4200-a3a7-5ff54b004083</uuid>
Nov 28 11:34:50 user nova-compute[74994]:   <name>instance-00000034</name>
Nov 28 11:34:50 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 11:34:50 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 11:34:50 user nova-compute[74994]:   <metadata>
Nov 28 11:34:50 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 11:34:50 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 11:34:50 user nova-compute[74994]:       <nova:name>tempest-TestVolumeBootPattern-server-2084240881</nova:name>
Nov 28 11:34:50 user nova-compute[74994]:       <nova:creationTime>2023-11-28 11:34:49</nova:creationTime>
Nov 28 11:34:50 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 11:34:50 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 11:34:50 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 11:34:50 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 11:34:50 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 11:34:50 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 11:34:50 user nova-compute[74994]:       </nova:flavor>
Nov 28 11:34:50 user nova-compute[74994]:       <nova:owner>
Nov 28 11:34:50 user nova-compute[74994]:         <nova:user uuid="e1ebcd41891545f990e285b43c9eac90">tempest-TestVolumeBootPattern-169069415-project-member</nova:user>
Nov 28 11:34:50 user nova-compute[74994]:         <nova:project uuid="cb427b7927364726907d9e90ef9a578f">tempest-TestVolumeBootPattern-169069415</nova:project>
Nov 28 11:34:50 user nova-compute[74994]:       </nova:owner>
Nov 28 11:34:50 user nova-compute[74994]:       <nova:ports>
Nov 28 11:34:50 user nova-compute[74994]:         <nova:port uuid="e4b1717f-2765-42ba-974a-3953f12c6b41">
Nov 28 11:34:50 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 11:34:50 user nova-compute[74994]:         </nova:port>
Nov 28 11:34:50 user nova-compute[74994]:       </nova:ports>
Nov 28 11:34:50 user nova-compute[74994]:     </nova:instance>
Nov 28 11:34:50 user nova-compute[74994]:   </metadata>
Nov 28 11:34:50 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 11:34:50 user nova-compute[74994]:     <system>
Nov 28 11:34:50 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 11:34:50 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 11:34:50 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 11:34:50 user nova-compute[74994]:       <entry name="serial">8cde59ae-f4d6-4200-a3a7-5ff54b004083</entry>
Nov 28 11:34:50 user nova-compute[74994]:       <entry name="uuid">8cde59ae-f4d6-4200-a3a7-5ff54b004083</entry>
Nov 28 11:34:50 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 11:34:50 user nova-compute[74994]:     </system>
Nov 28 11:34:50 user nova-compute[74994]:   </sysinfo>
Nov 28 11:34:50 user nova-compute[74994]:   <os>
Nov 28 11:34:50 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 11:34:50 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 11:34:50 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 11:34:50 user nova-compute[74994]:   </os>
Nov 28 11:34:50 user nova-compute[74994]:   <features>
Nov 28 11:34:50 user nova-compute[74994]:     <acpi/>
Nov 28 11:34:50 user nova-compute[74994]:     <apic/>
Nov 28 11:34:50 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 11:34:50 user nova-compute[74994]:   </features>
Nov 28 11:34:50 user nova-compute[74994]:   <clock offset="utc">
Nov 28 11:34:50 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 11:34:50 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 11:34:50 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 11:34:50 user nova-compute[74994]:   </clock>
Nov 28 11:34:50 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 11:34:50 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 11:34:50 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 11:34:50 user nova-compute[74994]:   </cpu>
Nov 28 11:34:50 user nova-compute[74994]:   <devices>
Nov 28 11:34:50 user nova-compute[74994]:     <disk type="block" device="disk">
Nov 28 11:34:50 user nova-compute[74994]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:34:50 user nova-compute[74994]:       <source dev="/dev/sdc"/>
Nov 28 11:34:50 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 11:34:50 user nova-compute[74994]:       <serial>02b9e71d-034e-465f-80a0-d120af116330</serial>
Nov 28 11:34:50 user nova-compute[74994]:     </disk>
Nov 28 11:34:50 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 11:34:50 user nova-compute[74994]:       <mac address="fa:16:3e:fa:00:a3"/>
Nov 28 11:34:50 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:34:50 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 11:34:50 user nova-compute[74994]:       <target dev="tape4b1717f-27"/>
Nov 28 11:34:50 user nova-compute[74994]:     </interface>
Nov 28 11:34:50 user nova-compute[74994]:     <serial type="pty">
Nov 28 11:34:50 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/8cde59ae-f4d6-4200-a3a7-5ff54b004083/console.log" append="off"/>
Nov 28 11:34:50 user nova-compute[74994]:     </serial>
Nov 28 11:34:50 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 11:34:50 user nova-compute[74994]:     <video>
Nov 28 11:34:50 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:34:50 user nova-compute[74994]:     </video>
Nov 28 11:34:50 user nova-compute[74994]:     <rng model="virtio">
Nov 28 11:34:50 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 11:34:50 user nova-compute[74994]:     </rng>
Nov 28 11:34:50 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 11:34:50 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 11:34:50 user nova-compute[74994]:       <stats period="10"/>
Nov 28 11:34:50 user nova-compute[74994]:     </memballoon>
Nov 28 11:34:50 user nova-compute[74994]:   </devices>
Nov 28 11:34:50 user nova-compute[74994]: </domain>
Nov 28 11:34:50 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 11:34:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:34:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2084240881',display_name='tempest-TestVolumeBootPattern-server-2084240881',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2084240881',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJskGb8o7sKkkJHXfIeXjUMFdWljc0ALZAd51Odn5QFpQ6//wKpup5hgiLYGjHgIIEMC9O9O/gz4Xaxr/KZsMrjOgAbnCWxIK2QuPGlez3xcOsg8TTQkkpxGQHDunVpPZQ==',key_name='tempest-TestVolumeBootPattern-1373923849',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb427b7927364726907d9e90ef9a578f',ramdisk_id='',reservation_id='r-rh72kuzc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-169069415',owner_user_name='tempest-TestVolumeBootPattern-169069415-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:34:43Z,user_data=None,user_id='e1ebcd41891545f990e285b43c9eac90',uuid=8cde59ae-f4d6-4200-a3a7-5ff54b004083,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4b1717f-2765-42ba-974a-3953f12c6b41", "address": "fa:16:3e:fa:00:a3", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b1717f-27", "ovs_interfaceid": "e4b1717f-2765-42ba-974a-3953f12c6b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 11:34:50 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Converting VIF {"id": "e4b1717f-2765-42ba-974a-3953f12c6b41", "address": "fa:16:3e:fa:00:a3", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b1717f-27", "ovs_interfaceid": "e4b1717f-2765-42ba-974a-3953f12c6b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:34:50 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:00:a3,bridge_name='br-int',has_traffic_filtering=True,id=e4b1717f-2765-42ba-974a-3953f12c6b41,network=Network(2dad67e8-a656-4aa2-a2ed-f2875ee5e48a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b1717f-27') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:34:50 user nova-compute[74994]: DEBUG os_vif [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:00:a3,bridge_name='br-int',has_traffic_filtering=True,id=e4b1717f-2765-42ba-974a-3953f12c6b41,network=Network(2dad67e8-a656-4aa2-a2ed-f2875ee5e48a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b1717f-27') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 11:34:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:34:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:34:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 11:34:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:34:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9f075f76-f10c-586c-bef7-a34ad4a2f711', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:34:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:34:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:34:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:34:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4b1717f-27, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:34:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape4b1717f-27, col_values=(('qos', UUID('ee7ac2f7-eab8-48c0-8a7b-a46a1a38d391')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:34:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape4b1717f-27, col_values=(('external_ids', {'iface-id': 'e4b1717f-2765-42ba-974a-3953f12c6b41', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:00:a3', 'vm-uuid': '8cde59ae-f4d6-4200-a3a7-5ff54b004083'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:34:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:34:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:34:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:34:50 user nova-compute[74994]: INFO os_vif [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:00:a3,bridge_name='br-int',has_traffic_filtering=True,id=e4b1717f-2765-42ba-974a-3953f12c6b41,network=Network(2dad67e8-a656-4aa2-a2ed-f2875ee5e48a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b1717f-27')
Nov 28 11:34:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:34:50 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] No VIF found with MAC fa:16:3e:fa:00:a3, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:34:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:34:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:34:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:34:52 user nova-compute[74994]: DEBUG nova.compute.manager [req-af8036ba-4a0a-424d-8425-25b65f63c46a req-0b9d6857-59a6-4b2c-a9d6-75cbf3185ccd service nova] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Received event network-vif-plugged-e4b1717f-2765-42ba-974a-3953f12c6b41 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:34:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-af8036ba-4a0a-424d-8425-25b65f63c46a req-0b9d6857-59a6-4b2c-a9d6-75cbf3185ccd service nova] Acquiring lock "8cde59ae-f4d6-4200-a3a7-5ff54b004083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:34:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-af8036ba-4a0a-424d-8425-25b65f63c46a req-0b9d6857-59a6-4b2c-a9d6-75cbf3185ccd service nova] Lock "8cde59ae-f4d6-4200-a3a7-5ff54b004083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:34:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-af8036ba-4a0a-424d-8425-25b65f63c46a req-0b9d6857-59a6-4b2c-a9d6-75cbf3185ccd service nova] Lock "8cde59ae-f4d6-4200-a3a7-5ff54b004083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:34:52 user nova-compute[74994]: DEBUG nova.compute.manager [req-af8036ba-4a0a-424d-8425-25b65f63c46a req-0b9d6857-59a6-4b2c-a9d6-75cbf3185ccd service nova] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] No waiting events found dispatching network-vif-plugged-e4b1717f-2765-42ba-974a-3953f12c6b41 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:34:52 user nova-compute[74994]: WARNING nova.compute.manager [req-af8036ba-4a0a-424d-8425-25b65f63c46a req-0b9d6857-59a6-4b2c-a9d6-75cbf3185ccd service nova] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Received unexpected event network-vif-plugged-e4b1717f-2765-42ba-974a-3953f12c6b41 for instance with vm_state building and task_state spawning.
Nov 28 11:34:52 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:34:52 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:34:52 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 11:34:52 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Rebuilding the list of instances to heal {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 11:34:52 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Skipping network cache update for instance because it is Building. {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 28 11:34:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "refresh_cache-de04088f-264e-48ef-83bf-3b25b9b76352" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:34:52 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquired lock "refresh_cache-de04088f-264e-48ef-83bf-3b25b9b76352" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:34:52 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Forcefully refreshing network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 11:34:52 user nova-compute[74994]: DEBUG nova.objects.instance [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lazy-loading 'info_cache' on Instance uuid de04088f-264e-48ef-83bf-3b25b9b76352 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:34:53 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Updating instance_info_cache with network_info: [{"id": "35fefd16-16bd-4dff-819c-ef13f7e84e94", "address": "fa:16:3e:f3:f2:3a", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35fefd16-16", "ovs_interfaceid": "35fefd16-16bd-4dff-819c-ef13f7e84e94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:34:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Releasing lock "refresh_cache-de04088f-264e-48ef-83bf-3b25b9b76352" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:34:53 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Updated the network info_cache for instance {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 11:34:54 user nova-compute[74994]: DEBUG nova.compute.manager [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 11:34:54 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 11:34:54 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Instance spawned successfully.
Nov 28 11:34:54 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 11:34:54 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:34:54 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:34:54 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:34:54 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:34:54 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:34:54 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:34:54 user nova-compute[74994]: INFO nova.compute.manager [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Took 4.89 seconds to spawn the instance on the hypervisor.
Nov 28 11:34:54 user nova-compute[74994]: DEBUG nova.compute.manager [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 11:34:54 user nova-compute[74994]: DEBUG nova.compute.manager [req-bfd6a34b-84e3-46da-8d2a-28d7fe7a023e req-9271620b-f407-413f-a15c-d45d9a2981e3 service nova] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Received event network-vif-plugged-e4b1717f-2765-42ba-974a-3953f12c6b41 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:34:54 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bfd6a34b-84e3-46da-8d2a-28d7fe7a023e req-9271620b-f407-413f-a15c-d45d9a2981e3 service nova] Acquiring lock "8cde59ae-f4d6-4200-a3a7-5ff54b004083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:34:54 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bfd6a34b-84e3-46da-8d2a-28d7fe7a023e req-9271620b-f407-413f-a15c-d45d9a2981e3 service nova] Lock "8cde59ae-f4d6-4200-a3a7-5ff54b004083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:34:54 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-bfd6a34b-84e3-46da-8d2a-28d7fe7a023e req-9271620b-f407-413f-a15c-d45d9a2981e3 service nova] Lock "8cde59ae-f4d6-4200-a3a7-5ff54b004083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:34:54 user nova-compute[74994]: DEBUG nova.compute.manager [req-bfd6a34b-84e3-46da-8d2a-28d7fe7a023e req-9271620b-f407-413f-a15c-d45d9a2981e3 service nova] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] No waiting events found dispatching network-vif-plugged-e4b1717f-2765-42ba-974a-3953f12c6b41 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:34:54 user nova-compute[74994]: WARNING nova.compute.manager [req-bfd6a34b-84e3-46da-8d2a-28d7fe7a023e req-9271620b-f407-413f-a15c-d45d9a2981e3 service nova] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Received unexpected event network-vif-plugged-e4b1717f-2765-42ba-974a-3953f12c6b41 for instance with vm_state building and task_state spawning.
Nov 28 11:34:54 user nova-compute[74994]: INFO nova.compute.manager [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Took 12.11 seconds to build instance.
Nov 28 11:34:54 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-6db10697-396a-4734-b93f-3d3c9e677984 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "8cde59ae-f4d6-4200-a3a7-5ff54b004083" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.209s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:34:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:34:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:34:56 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:34:56 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:34:56 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:35:00 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:35:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:35:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:35:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:35:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:35:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:35:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:35:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:35:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:35:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:35:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:35:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:35:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:35:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:35:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:35:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:35:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:35:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:35:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:35:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:35:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:35:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:35:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:35:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:35:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:35:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:35:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:35:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:35:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:35:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:35:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:35:41 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:35:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:35:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:35:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:35:41 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 11:35:41 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:35:41 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:35:41 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:35:41 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:35:41 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=8970MB free_disk=25.03411102294922GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 11:35:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:35:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:35:42 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance de04088f-264e-48ef-83bf-3b25b9b76352 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:35:42 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 8cde59ae-f4d6-4200-a3a7-5ff54b004083 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:35:42 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 11:35:42 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 11:35:42 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Refreshing inventories for resource provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 11:35:42 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Updating ProviderTree inventory for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 11:35:42 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Updating inventory in ProviderTree for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 11:35:42 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Refreshing aggregate associations for resource provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a, aggregates: None {{(pid=74994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 11:35:42 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Refreshing trait associations for resource provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=74994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 11:35:42 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:35:42 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:35:42 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 11:35:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.521s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:35:45 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:35:45 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 11:35:45 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:35:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:35:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:35:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:35:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:35:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:35:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:35:47 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:35:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:35:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:35:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:35:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:35:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:35:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:35:52 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:35:53 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:35:53 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 11:35:53 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Rebuilding the list of instances to heal {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 11:35:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "refresh_cache-de04088f-264e-48ef-83bf-3b25b9b76352" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:35:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquired lock "refresh_cache-de04088f-264e-48ef-83bf-3b25b9b76352" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:35:53 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Forcefully refreshing network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 11:35:53 user nova-compute[74994]: DEBUG nova.objects.instance [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lazy-loading 'info_cache' on Instance uuid de04088f-264e-48ef-83bf-3b25b9b76352 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:35:53 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Updating instance_info_cache with network_info: [{"id": "35fefd16-16bd-4dff-819c-ef13f7e84e94", "address": "fa:16:3e:f3:f2:3a", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35fefd16-16", "ovs_interfaceid": "35fefd16-16bd-4dff-819c-ef13f7e84e94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:35:53 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Releasing lock "refresh_cache-de04088f-264e-48ef-83bf-3b25b9b76352" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:35:53 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Updated the network info_cache for instance {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 11:35:53 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:35:53 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74994) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 11:35:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:35:56 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:35:56 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:35:57 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:36:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:36:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:36:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:36:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:36:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:36:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:36:01 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:36:05 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:36:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:36:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:36:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:36:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:36:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:36:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:36:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:36:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:36:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:36:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:36:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:36:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:36:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:36:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:36:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:36:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:36:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:36:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:36:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:36:21 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:36:21 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Cleaning up deleted instances {{(pid=74994) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 11:36:21 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] There are 0 instances to clean {{(pid=74994) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 11:36:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:36:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:36:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:36:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:36:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:36:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:36:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:36:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:36:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:36:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:36:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:36:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:36:32 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:36:33 user nova-compute[74994]: DEBUG nova.compute.manager [req-318f2d86-c845-4869-ad39-5224f5362f3e req-478cf220-3c6e-4240-8411-de0a515f2a9c service nova] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Received event network-changed-e4b1717f-2765-42ba-974a-3953f12c6b41 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:36:33 user nova-compute[74994]: DEBUG nova.compute.manager [req-318f2d86-c845-4869-ad39-5224f5362f3e req-478cf220-3c6e-4240-8411-de0a515f2a9c service nova] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Refreshing instance network info cache due to event network-changed-e4b1717f-2765-42ba-974a-3953f12c6b41. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:36:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-318f2d86-c845-4869-ad39-5224f5362f3e req-478cf220-3c6e-4240-8411-de0a515f2a9c service nova] Acquiring lock "refresh_cache-8cde59ae-f4d6-4200-a3a7-5ff54b004083" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:36:33 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-318f2d86-c845-4869-ad39-5224f5362f3e req-478cf220-3c6e-4240-8411-de0a515f2a9c service nova] Acquired lock "refresh_cache-8cde59ae-f4d6-4200-a3a7-5ff54b004083" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:36:33 user nova-compute[74994]: DEBUG nova.network.neutron [req-318f2d86-c845-4869-ad39-5224f5362f3e req-478cf220-3c6e-4240-8411-de0a515f2a9c service nova] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Refreshing network info cache for port e4b1717f-2765-42ba-974a-3953f12c6b41 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:36:34 user nova-compute[74994]: DEBUG nova.network.neutron [req-318f2d86-c845-4869-ad39-5224f5362f3e req-478cf220-3c6e-4240-8411-de0a515f2a9c service nova] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Updated VIF entry in instance network info cache for port e4b1717f-2765-42ba-974a-3953f12c6b41. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:36:34 user nova-compute[74994]: DEBUG nova.network.neutron [req-318f2d86-c845-4869-ad39-5224f5362f3e req-478cf220-3c6e-4240-8411-de0a515f2a9c service nova] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Updating instance_info_cache with network_info: [{"id": "e4b1717f-2765-42ba-974a-3953f12c6b41", "address": "fa:16:3e:fa:00:a3", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b1717f-27", "ovs_interfaceid": "e4b1717f-2765-42ba-974a-3953f12c6b41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:36:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-318f2d86-c845-4869-ad39-5224f5362f3e req-478cf220-3c6e-4240-8411-de0a515f2a9c service nova] Releasing lock "refresh_cache-8cde59ae-f4d6-4200-a3a7-5ff54b004083" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:36:34 user nova-compute[74994]: DEBUG nova.compute.manager [req-494f92c2-15dd-4067-a220-432e4de59003 req-7ccdf346-ed71-4998-af4c-cf25107c2a7b service nova] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Received event network-changed-e4b1717f-2765-42ba-974a-3953f12c6b41 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:36:34 user nova-compute[74994]: DEBUG nova.compute.manager [req-494f92c2-15dd-4067-a220-432e4de59003 req-7ccdf346-ed71-4998-af4c-cf25107c2a7b service nova] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Refreshing instance network info cache due to event network-changed-e4b1717f-2765-42ba-974a-3953f12c6b41. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:36:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-494f92c2-15dd-4067-a220-432e4de59003 req-7ccdf346-ed71-4998-af4c-cf25107c2a7b service nova] Acquiring lock "refresh_cache-8cde59ae-f4d6-4200-a3a7-5ff54b004083" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:36:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-494f92c2-15dd-4067-a220-432e4de59003 req-7ccdf346-ed71-4998-af4c-cf25107c2a7b service nova] Acquired lock "refresh_cache-8cde59ae-f4d6-4200-a3a7-5ff54b004083" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:36:34 user nova-compute[74994]: DEBUG nova.network.neutron [req-494f92c2-15dd-4067-a220-432e4de59003 req-7ccdf346-ed71-4998-af4c-cf25107c2a7b service nova] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Refreshing network info cache for port e4b1717f-2765-42ba-974a-3953f12c6b41 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:36:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3ef23464-0239-49a3-941a-df5375714ce8 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "8cde59ae-f4d6-4200-a3a7-5ff54b004083" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:36:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3ef23464-0239-49a3-941a-df5375714ce8 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "8cde59ae-f4d6-4200-a3a7-5ff54b004083" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:36:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3ef23464-0239-49a3-941a-df5375714ce8 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "8cde59ae-f4d6-4200-a3a7-5ff54b004083-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:36:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3ef23464-0239-49a3-941a-df5375714ce8 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "8cde59ae-f4d6-4200-a3a7-5ff54b004083-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:36:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3ef23464-0239-49a3-941a-df5375714ce8 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "8cde59ae-f4d6-4200-a3a7-5ff54b004083-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:36:34 user nova-compute[74994]: INFO nova.compute.manager [None req-3ef23464-0239-49a3-941a-df5375714ce8 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Terminating instance
Nov 28 11:36:34 user nova-compute[74994]: DEBUG nova.compute.manager [None req-3ef23464-0239-49a3-941a-df5375714ce8 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 11:36:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:36:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG nova.compute.manager [req-27665bc3-ced3-48e0-9e95-7a35489536e3 req-b212fca5-cc8f-40ac-bb5b-92316b537cc2 service nova] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Received event network-vif-unplugged-e4b1717f-2765-42ba-974a-3953f12c6b41 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-27665bc3-ced3-48e0-9e95-7a35489536e3 req-b212fca5-cc8f-40ac-bb5b-92316b537cc2 service nova] Acquiring lock "8cde59ae-f4d6-4200-a3a7-5ff54b004083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-27665bc3-ced3-48e0-9e95-7a35489536e3 req-b212fca5-cc8f-40ac-bb5b-92316b537cc2 service nova] Lock "8cde59ae-f4d6-4200-a3a7-5ff54b004083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-27665bc3-ced3-48e0-9e95-7a35489536e3 req-b212fca5-cc8f-40ac-bb5b-92316b537cc2 service nova] Lock "8cde59ae-f4d6-4200-a3a7-5ff54b004083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG nova.compute.manager [req-27665bc3-ced3-48e0-9e95-7a35489536e3 req-b212fca5-cc8f-40ac-bb5b-92316b537cc2 service nova] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] No waiting events found dispatching network-vif-unplugged-e4b1717f-2765-42ba-974a-3953f12c6b41 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG nova.compute.manager [req-27665bc3-ced3-48e0-9e95-7a35489536e3 req-b212fca5-cc8f-40ac-bb5b-92316b537cc2 service nova] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Received event network-vif-unplugged-e4b1717f-2765-42ba-974a-3953f12c6b41 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG nova.network.neutron [req-494f92c2-15dd-4067-a220-432e4de59003 req-7ccdf346-ed71-4998-af4c-cf25107c2a7b service nova] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Updated VIF entry in instance network info cache for port e4b1717f-2765-42ba-974a-3953f12c6b41. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG nova.network.neutron [req-494f92c2-15dd-4067-a220-432e4de59003 req-7ccdf346-ed71-4998-af4c-cf25107c2a7b service nova] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Updating instance_info_cache with network_info: [{"id": "e4b1717f-2765-42ba-974a-3953f12c6b41", "address": "fa:16:3e:fa:00:a3", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b1717f-27", "ovs_interfaceid": "e4b1717f-2765-42ba-974a-3953f12c6b41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-494f92c2-15dd-4067-a220-432e4de59003 req-7ccdf346-ed71-4998-af4c-cf25107c2a7b service nova] Releasing lock "refresh_cache-8cde59ae-f4d6-4200-a3a7-5ff54b004083" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:36:35 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Instance destroyed successfully.
Nov 28 11:36:35 user nova-compute[74994]: DEBUG nova.objects.instance [None req-3ef23464-0239-49a3-941a-df5375714ce8 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lazy-loading 'resources' on Instance uuid 8cde59ae-f4d6-4200-a3a7-5ff54b004083 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-3ef23464-0239-49a3-941a-df5375714ce8 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:34:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2084240881',display_name='tempest-TestVolumeBootPattern-server-2084240881',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2084240881',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJskGb8o7sKkkJHXfIeXjUMFdWljc0ALZAd51Odn5QFpQ6//wKpup5hgiLYGjHgIIEMC9O9O/gz4Xaxr/KZsMrjOgAbnCWxIK2QuPGlez3xcOsg8TTQkkpxGQHDunVpPZQ==',key_name='tempest-TestVolumeBootPattern-1373923849',keypairs=<?>,launch_index=0,launched_at=2023-11-28T11:34:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb427b7927364726907d9e90ef9a578f',ramdisk_id='',reservation_id='r-rh72kuzc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-169069415',owner_user_name='tempest-TestVolumeBootPattern-169069415-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T11:34:54Z,user_data=None,user_id='e1ebcd41891545f990e285b43c9eac90',uuid=8cde59ae-f4d6-4200-a3a7-5ff54b004083,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4b1717f-2765-42ba-974a-3953f12c6b41", "address": "fa:16:3e:fa:00:a3", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b1717f-27", "ovs_interfaceid": "e4b1717f-2765-42ba-974a-3953f12c6b41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-3ef23464-0239-49a3-941a-df5375714ce8 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Converting VIF {"id": "e4b1717f-2765-42ba-974a-3953f12c6b41", "address": "fa:16:3e:fa:00:a3", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b1717f-27", "ovs_interfaceid": "e4b1717f-2765-42ba-974a-3953f12c6b41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-3ef23464-0239-49a3-941a-df5375714ce8 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fa:00:a3,bridge_name='br-int',has_traffic_filtering=True,id=e4b1717f-2765-42ba-974a-3953f12c6b41,network=Network(2dad67e8-a656-4aa2-a2ed-f2875ee5e48a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b1717f-27') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG os_vif [None req-3ef23464-0239-49a3-941a-df5375714ce8 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:00:a3,bridge_name='br-int',has_traffic_filtering=True,id=e4b1717f-2765-42ba-974a-3953f12c6b41,network=Network(2dad67e8-a656-4aa2-a2ed-f2875ee5e48a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b1717f-27') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4b1717f-27, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ee7ac2f7-eab8-48c0-8a7b-a46a1a38d391) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:36:35 user nova-compute[74994]: INFO os_vif [None req-3ef23464-0239-49a3-941a-df5375714ce8 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:00:a3,bridge_name='br-int',has_traffic_filtering=True,id=e4b1717f-2765-42ba-974a-3953f12c6b41,network=Network(2dad67e8-a656-4aa2-a2ed-f2875ee5e48a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b1717f-27')
Nov 28 11:36:35 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ef23464-0239-49a3-941a-df5375714ce8 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ef23464-0239-49a3-941a-df5375714ce8 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RmZkLOUG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:36:35 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-3ef23464-0239-49a3-941a-df5375714ce8 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:36:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-3ef23464-0239-49a3-941a-df5375714ce8 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-3ef23464-0239-49a3-941a-df5375714ce8 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c92886-2a4c-428d-bfd5-a24ac625305f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ef23464-0239-49a3-941a-df5375714ce8 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 11:36:35 user nova-compute[74994]: No targets found.
Nov 28 11:36:35 user nova-compute[74994]: iSNS:
Nov 28 11:36:35 user nova-compute[74994]: No targets found.
Nov 28 11:36:35 user nova-compute[74994]: STATIC:
Nov 28 11:36:35 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330
Nov 28 11:36:35 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:36:35 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:36:35 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82
Nov 28 11:36:35 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:36:35 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:36:35 user nova-compute[74994]: FIRMWARE:
Nov 28 11:36:35 user nova-compute[74994]: No targets found.
Nov 28 11:36:35 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ef23464-0239-49a3-941a-df5375714ce8 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 11:36:35 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 11:36:35 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ef23464-0239-49a3-941a-df5375714ce8 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ea7cd5-1fd2-4ed2-baf9-1f3bec76a4be]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66edb16-c0cc-4bba-9298-a2a3b0cd536d]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ef23464-0239-49a3-941a-df5375714ce8 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 (non-flash)
Nov 28 11:36:35 user nova-compute[74994]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330 (non-flash)
Nov 28 11:36:35 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ef23464-0239-49a3-941a-df5375714ce8 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 (non-flash)
Nov 28 11:36:35 user nova-compute[74994]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330 (non-flash)
Nov 28 11:36:35 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ef23464-0239-49a3-941a-df5375714ce8 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb944696a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330'): ({'sdc'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-3ef23464-0239-49a3-941a-df5375714ce8 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Removing single pathed devices sdc {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbafcfab-a946-486a-9592-48fdf2f72e74]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6738efc9-bde1-456c-88c4-b2d163133537]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-3ef23464-0239-49a3-941a-df5375714ce8 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Flushing IO for device /dev/sdc {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f665e0-9dc7-4335-a77c-0cb96f5833fc]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-3ef23464-0239-49a3-941a-df5375714ce8 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a600fe2-970d-4843-a0ee-c6cdaa48eda6]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-3ef23464-0239-49a3-941a-df5375714ce8 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-3ef23464-0239-49a3-941a-df5375714ce8 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] SCSI volumes sdc have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOb571d3cf-03c2678424f59104', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_b571d3cf', '/dev/disk/by-id/scsi-23033633236373834') {{(pid=86494) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d900c02e-df56-45d5-88ad-1004748d9b4b]: (4, None) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ef23464-0239-49a3-941a-df5375714ce8 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70e65e2-787a-4471-84e6-1fd15294665f]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ef23464-0239-49a3-941a-df5375714ce8 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330 -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[90775e78-2085-4d40-8960-93d2874c772c]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ef23464-0239-49a3-941a-df5375714ce8 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330, portal: 172.16.0.220,3260]
Nov 28 11:36:35 user nova-compute[74994]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330, portal: 172.16.0.220,3260] successful.
Nov 28 11:36:35 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330 -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02b9e71d-034e-465f-80a0-d120af116330 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d61b701-994a-49d7-8b9a-805ad3752573]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ef23464-0239-49a3-941a-df5375714ce8 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-3ef23464-0239-49a3-941a-df5375714ce8 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ef23464-0239-49a3-941a-df5375714ce8 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] <== disconnect_volume: return (291ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:36:35 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ef23464-0239-49a3-941a-df5375714ce8 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 11:36:35 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-3ef23464-0239-49a3-941a-df5375714ce8 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Deleting instance files /opt/stack/data/nova/instances/8cde59ae-f4d6-4200-a3a7-5ff54b004083_del
Nov 28 11:36:35 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-3ef23464-0239-49a3-941a-df5375714ce8 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Deletion of /opt/stack/data/nova/instances/8cde59ae-f4d6-4200-a3a7-5ff54b004083_del complete
Nov 28 11:36:36 user nova-compute[74994]: INFO nova.compute.manager [None req-3ef23464-0239-49a3-941a-df5375714ce8 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 28 11:36:36 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-3ef23464-0239-49a3-941a-df5375714ce8 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 11:36:36 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 11:36:36 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 11:36:36 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:36:36 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Took 0.36 seconds to deallocate network for instance.
Nov 28 11:36:37 user nova-compute[74994]: INFO nova.compute.manager [None req-3ef23464-0239-49a3-941a-df5375714ce8 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Took 0.73 seconds to detach 1 volumes for instance.
Nov 28 11:36:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3ef23464-0239-49a3-941a-df5375714ce8 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:36:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3ef23464-0239-49a3-941a-df5375714ce8 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:36:37 user nova-compute[74994]: DEBUG nova.compute.manager [req-5835ae51-4293-4e20-afcc-69bd5516d943 req-96660554-675d-40fd-a6a8-aba2a6735023 service nova] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Received event network-vif-plugged-e4b1717f-2765-42ba-974a-3953f12c6b41 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:36:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-5835ae51-4293-4e20-afcc-69bd5516d943 req-96660554-675d-40fd-a6a8-aba2a6735023 service nova] Acquiring lock "8cde59ae-f4d6-4200-a3a7-5ff54b004083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:36:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-5835ae51-4293-4e20-afcc-69bd5516d943 req-96660554-675d-40fd-a6a8-aba2a6735023 service nova] Lock "8cde59ae-f4d6-4200-a3a7-5ff54b004083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:36:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-5835ae51-4293-4e20-afcc-69bd5516d943 req-96660554-675d-40fd-a6a8-aba2a6735023 service nova] Lock "8cde59ae-f4d6-4200-a3a7-5ff54b004083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:36:37 user nova-compute[74994]: DEBUG nova.compute.manager [req-5835ae51-4293-4e20-afcc-69bd5516d943 req-96660554-675d-40fd-a6a8-aba2a6735023 service nova] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] No waiting events found dispatching network-vif-plugged-e4b1717f-2765-42ba-974a-3953f12c6b41 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:36:37 user nova-compute[74994]: WARNING nova.compute.manager [req-5835ae51-4293-4e20-afcc-69bd5516d943 req-96660554-675d-40fd-a6a8-aba2a6735023 service nova] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Received unexpected event network-vif-plugged-e4b1717f-2765-42ba-974a-3953f12c6b41 for instance with vm_state deleted and task_state None.
Nov 28 11:36:37 user nova-compute[74994]: DEBUG nova.compute.manager [req-5835ae51-4293-4e20-afcc-69bd5516d943 req-96660554-675d-40fd-a6a8-aba2a6735023 service nova] [instance: 8cde59ae-f4d6-4200-a3a7-5ff54b004083] Received event network-vif-deleted-e4b1717f-2765-42ba-974a-3953f12c6b41 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:36:37 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-3ef23464-0239-49a3-941a-df5375714ce8 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:36:37 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-3ef23464-0239-49a3-941a-df5375714ce8 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:36:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3ef23464-0239-49a3-941a-df5375714ce8 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.146s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:36:37 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-3ef23464-0239-49a3-941a-df5375714ce8 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Deleted allocations for instance 8cde59ae-f4d6-4200-a3a7-5ff54b004083
Nov 28 11:36:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-3ef23464-0239-49a3-941a-df5375714ce8 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "8cde59ae-f4d6-4200-a3a7-5ff54b004083" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.546s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:36:39 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:36:39 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Triggering sync for uuid de04088f-264e-48ef-83bf-3b25b9b76352 {{(pid=74994) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 11:36:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "de04088f-264e-48ef-83bf-3b25b9b76352" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:36:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "de04088f-264e-48ef-83bf-3b25b9b76352" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:36:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "de04088f-264e-48ef-83bf-3b25b9b76352" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:36:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:36:41 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:36:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:36:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:36:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:36:41 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 11:36:41 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:36:41 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:36:41 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:36:41 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=9032MB free_disk=25.025421142578125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 11:36:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:36:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:36:41 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance de04088f-264e-48ef-83bf-3b25b9b76352 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:36:41 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 11:36:41 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 11:36:42 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:36:42 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:36:42 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 11:36:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.158s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:36:45 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:36:45 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 11:36:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:36:47 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:36:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:36:53 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:36:53 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 11:36:53 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Didn't find any instances for network info cache update. {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 11:36:54 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:36:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:36:57 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:36:57 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:36:58 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:37:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:37:03 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:37:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:37:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:37:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:37:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:37:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:37:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:37:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:37:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:37:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:37:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:37:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:37:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:37:34 user nova-compute[74994]: DEBUG nova.compute.manager [req-f0834c3b-1884-42c3-8dca-67658e092df4 req-0b53de39-4352-49ba-81c1-a1d581edbfdf service nova] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Received event network-changed-35fefd16-16bd-4dff-819c-ef13f7e84e94 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:37:34 user nova-compute[74994]: DEBUG nova.compute.manager [req-f0834c3b-1884-42c3-8dca-67658e092df4 req-0b53de39-4352-49ba-81c1-a1d581edbfdf service nova] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Refreshing instance network info cache due to event network-changed-35fefd16-16bd-4dff-819c-ef13f7e84e94. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:37:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f0834c3b-1884-42c3-8dca-67658e092df4 req-0b53de39-4352-49ba-81c1-a1d581edbfdf service nova] Acquiring lock "refresh_cache-de04088f-264e-48ef-83bf-3b25b9b76352" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:37:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f0834c3b-1884-42c3-8dca-67658e092df4 req-0b53de39-4352-49ba-81c1-a1d581edbfdf service nova] Acquired lock "refresh_cache-de04088f-264e-48ef-83bf-3b25b9b76352" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:37:34 user nova-compute[74994]: DEBUG nova.network.neutron [req-f0834c3b-1884-42c3-8dca-67658e092df4 req-0b53de39-4352-49ba-81c1-a1d581edbfdf service nova] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Refreshing network info cache for port 35fefd16-16bd-4dff-819c-ef13f7e84e94 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:37:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f61b1406-64c2-473c-aee6-2c588024d3a7 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "de04088f-264e-48ef-83bf-3b25b9b76352" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:37:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f61b1406-64c2-473c-aee6-2c588024d3a7 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "de04088f-264e-48ef-83bf-3b25b9b76352" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:37:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f61b1406-64c2-473c-aee6-2c588024d3a7 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "de04088f-264e-48ef-83bf-3b25b9b76352-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:37:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f61b1406-64c2-473c-aee6-2c588024d3a7 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "de04088f-264e-48ef-83bf-3b25b9b76352-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:37:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f61b1406-64c2-473c-aee6-2c588024d3a7 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "de04088f-264e-48ef-83bf-3b25b9b76352-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:37:34 user nova-compute[74994]: INFO nova.compute.manager [None req-f61b1406-64c2-473c-aee6-2c588024d3a7 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Terminating instance
Nov 28 11:37:34 user nova-compute[74994]: DEBUG nova.compute.manager [None req-f61b1406-64c2-473c-aee6-2c588024d3a7 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 11:37:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:37:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:37:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:37:34 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:37:34 user nova-compute[74994]: DEBUG nova.compute.manager [req-84de44ad-a42c-46e7-9f36-52115f7f46cf req-0e090ee9-4032-4ba6-9585-820cbfdce041 service nova] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Received event network-vif-unplugged-35fefd16-16bd-4dff-819c-ef13f7e84e94 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:37:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-84de44ad-a42c-46e7-9f36-52115f7f46cf req-0e090ee9-4032-4ba6-9585-820cbfdce041 service nova] Acquiring lock "de04088f-264e-48ef-83bf-3b25b9b76352-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:37:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-84de44ad-a42c-46e7-9f36-52115f7f46cf req-0e090ee9-4032-4ba6-9585-820cbfdce041 service nova] Lock "de04088f-264e-48ef-83bf-3b25b9b76352-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:37:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-84de44ad-a42c-46e7-9f36-52115f7f46cf req-0e090ee9-4032-4ba6-9585-820cbfdce041 service nova] Lock "de04088f-264e-48ef-83bf-3b25b9b76352-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:37:34 user nova-compute[74994]: DEBUG nova.compute.manager [req-84de44ad-a42c-46e7-9f36-52115f7f46cf req-0e090ee9-4032-4ba6-9585-820cbfdce041 service nova] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] No waiting events found dispatching network-vif-unplugged-35fefd16-16bd-4dff-819c-ef13f7e84e94 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:37:34 user nova-compute[74994]: DEBUG nova.compute.manager [req-84de44ad-a42c-46e7-9f36-52115f7f46cf req-0e090ee9-4032-4ba6-9585-820cbfdce041 service nova] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Received event network-vif-unplugged-35fefd16-16bd-4dff-819c-ef13f7e84e94 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG nova.network.neutron [req-f0834c3b-1884-42c3-8dca-67658e092df4 req-0b53de39-4352-49ba-81c1-a1d581edbfdf service nova] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Updated VIF entry in instance network info cache for port 35fefd16-16bd-4dff-819c-ef13f7e84e94. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG nova.network.neutron [req-f0834c3b-1884-42c3-8dca-67658e092df4 req-0b53de39-4352-49ba-81c1-a1d581edbfdf service nova] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Updating instance_info_cache with network_info: [{"id": "35fefd16-16bd-4dff-819c-ef13f7e84e94", "address": "fa:16:3e:f3:f2:3a", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35fefd16-16", "ovs_interfaceid": "35fefd16-16bd-4dff-819c-ef13f7e84e94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f0834c3b-1884-42c3-8dca-67658e092df4 req-0b53de39-4352-49ba-81c1-a1d581edbfdf service nova] Releasing lock "refresh_cache-de04088f-264e-48ef-83bf-3b25b9b76352" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:37:35 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Instance destroyed successfully.
Nov 28 11:37:35 user nova-compute[74994]: DEBUG nova.objects.instance [None req-f61b1406-64c2-473c-aee6-2c588024d3a7 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lazy-loading 'resources' on Instance uuid de04088f-264e-48ef-83bf-3b25b9b76352 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-f61b1406-64c2-473c-aee6-2c588024d3a7 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-422785220',display_name='tempest-TestVolumeBootPattern-server-422785220',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-422785220',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJskGb8o7sKkkJHXfIeXjUMFdWljc0ALZAd51Odn5QFpQ6//wKpup5hgiLYGjHgIIEMC9O9O/gz4Xaxr/KZsMrjOgAbnCWxIK2QuPGlez3xcOsg8TTQkkpxGQHDunVpPZQ==',key_name='tempest-TestVolumeBootPattern-1373923849',keypairs=<?>,launch_index=0,launched_at=2023-11-28T11:32:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb427b7927364726907d9e90ef9a578f',ramdisk_id='',reservation_id='r-83ou7405',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-169069415',owner_user_name='tempest-TestVolumeBootPattern-169069415-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T11:32:55Z,user_data=None,user_id='e1ebcd41891545f990e285b43c9eac90',uuid=de04088f-264e-48ef-83bf-3b25b9b76352,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35fefd16-16bd-4dff-819c-ef13f7e84e94", "address": "fa:16:3e:f3:f2:3a", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35fefd16-16", "ovs_interfaceid": "35fefd16-16bd-4dff-819c-ef13f7e84e94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-f61b1406-64c2-473c-aee6-2c588024d3a7 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Converting VIF {"id": "35fefd16-16bd-4dff-819c-ef13f7e84e94", "address": "fa:16:3e:f3:f2:3a", "network": {"id": "2dad67e8-a656-4aa2-a2ed-f2875ee5e48a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-221516350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb427b7927364726907d9e90ef9a578f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35fefd16-16", "ovs_interfaceid": "35fefd16-16bd-4dff-819c-ef13f7e84e94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-f61b1406-64c2-473c-aee6-2c588024d3a7 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:f2:3a,bridge_name='br-int',has_traffic_filtering=True,id=35fefd16-16bd-4dff-819c-ef13f7e84e94,network=Network(2dad67e8-a656-4aa2-a2ed-f2875ee5e48a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35fefd16-16') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG os_vif [None req-f61b1406-64c2-473c-aee6-2c588024d3a7 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:f2:3a,bridge_name='br-int',has_traffic_filtering=True,id=35fefd16-16bd-4dff-819c-ef13f7e84e94,network=Network(2dad67e8-a656-4aa2-a2ed-f2875ee5e48a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35fefd16-16') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap35fefd16-16, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=142e9804-70a7-41fa-a202-832f63017936) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:37:35 user nova-compute[74994]: INFO os_vif [None req-f61b1406-64c2-473c-aee6-2c588024d3a7 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:f2:3a,bridge_name='br-int',has_traffic_filtering=True,id=35fefd16-16bd-4dff-819c-ef13f7e84e94,network=Network(2dad67e8-a656-4aa2-a2ed-f2875ee5e48a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35fefd16-16')
Nov 28 11:37:35 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f61b1406-64c2-473c-aee6-2c588024d3a7 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61b1406-64c2-473c-aee6-2c588024d3a7 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'btnUjlSM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:37:35 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-f61b1406-64c2-473c-aee6-2c588024d3a7 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:37:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-f61b1406-64c2-473c-aee6-2c588024d3a7 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-f61b1406-64c2-473c-aee6-2c588024d3a7 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7069193c-999c-4f9c-9d06-f9e6f8fc3be9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61b1406-64c2-473c-aee6-2c588024d3a7 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 11:37:35 user nova-compute[74994]: No targets found.
Nov 28 11:37:35 user nova-compute[74994]: iSNS:
Nov 28 11:37:35 user nova-compute[74994]: No targets found.
Nov 28 11:37:35 user nova-compute[74994]: STATIC:
Nov 28 11:37:35 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82
Nov 28 11:37:35 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:37:35 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:37:35 user nova-compute[74994]: FIRMWARE:
Nov 28 11:37:35 user nova-compute[74994]: No targets found.
Nov 28 11:37:35 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61b1406-64c2-473c-aee6-2c588024d3a7 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 11:37:35 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 11:37:35 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61b1406-64c2-473c-aee6-2c588024d3a7 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0c80a0-5898-4e27-ae93-f1965818a5b4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7891d657-4148-412c-9a4f-4e1450094a7b]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61b1406-64c2-473c-aee6-2c588024d3a7 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 (non-flash)
Nov 28 11:37:35 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61b1406-64c2-473c-aee6-2c588024d3a7 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 (non-flash)
Nov 28 11:37:35 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61b1406-64c2-473c-aee6-2c588024d3a7 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9206b28c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82'): ({'sdb'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-f61b1406-64c2-473c-aee6-2c588024d3a7 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Removing single pathed devices sdb {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[45203e7e-d680-424b-b281-99651fb17e65]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ee1e7b-9ae3-45bc-95ef-74ad4a5c7437]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-f61b1406-64c2-473c-aee6-2c588024d3a7 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Flushing IO for device /dev/sdb {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[379c63ac-925f-4436-9d32-e4a4d2e70ae5]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-f61b1406-64c2-473c-aee6-2c588024d3a7 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[245e5fb6-018d-4a4d-81e0-3979293e8e04]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-f61b1406-64c2-473c-aee6-2c588024d3a7 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-f61b1406-64c2-473c-aee6-2c588024d3a7 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] SCSI volumes sdb have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOe6cef6a2-f7bdfc8d9961898b', '/dev/disk/by-id/scsi-26637626466633864', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e6cef6a2') {{(pid=86494) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8c9036-3ec5-4c9c-b7d1-6f7fec3bb9b9]: (4, None) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61b1406-64c2-473c-aee6-2c588024d3a7 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a15b75-8467-47fe-ac8e-06817402fca4]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61b1406-64c2-473c-aee6-2c588024d3a7 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7971e43d-cefe-435b-bef8-50892cde1728]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61b1406-64c2-473c-aee6-2c588024d3a7 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82, portal: 172.16.0.220,3260]
Nov 28 11:37:35 user nova-compute[74994]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82, portal: 172.16.0.220,3260] successful.
Nov 28 11:37:35 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4ab3363-a862-49e9-879b-46e91b07ce82 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44099d0-172d-45bd-8d82-7501ce3b9e34]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61b1406-64c2-473c-aee6-2c588024d3a7 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-f61b1406-64c2-473c-aee6-2c588024d3a7 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61b1406-64c2-473c-aee6-2c588024d3a7 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] <== disconnect_volume: return (291ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f61b1406-64c2-473c-aee6-2c588024d3a7 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 11:37:35 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-f61b1406-64c2-473c-aee6-2c588024d3a7 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Deleting instance files /opt/stack/data/nova/instances/de04088f-264e-48ef-83bf-3b25b9b76352_del
Nov 28 11:37:35 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-f61b1406-64c2-473c-aee6-2c588024d3a7 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Deletion of /opt/stack/data/nova/instances/de04088f-264e-48ef-83bf-3b25b9b76352_del complete
Nov 28 11:37:35 user nova-compute[74994]: INFO nova.compute.manager [None req-f61b1406-64c2-473c-aee6-2c588024d3a7 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 28 11:37:35 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-f61b1406-64c2-473c-aee6-2c588024d3a7 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 11:37:35 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 11:37:36 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:37:36 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Took 0.48 seconds to deallocate network for instance.
Nov 28 11:37:36 user nova-compute[74994]: DEBUG nova.compute.manager [req-993d43fd-45a2-49f7-bb9c-12b78627a9c3 req-6551fded-3145-4af9-9b53-a235211be96d service nova] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Received event network-vif-deleted-35fefd16-16bd-4dff-819c-ef13f7e84e94 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:37:36 user nova-compute[74994]: INFO nova.compute.manager [None req-f61b1406-64c2-473c-aee6-2c588024d3a7 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Took 0.73 seconds to detach 1 volumes for instance.
Nov 28 11:37:36 user nova-compute[74994]: DEBUG nova.compute.manager [req-55c9c384-0567-4995-92c6-f8be946795ed req-798cd574-8202-4d28-bad7-a91b836975e1 service nova] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Received event network-vif-plugged-35fefd16-16bd-4dff-819c-ef13f7e84e94 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:37:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-55c9c384-0567-4995-92c6-f8be946795ed req-798cd574-8202-4d28-bad7-a91b836975e1 service nova] Acquiring lock "de04088f-264e-48ef-83bf-3b25b9b76352-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:37:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-55c9c384-0567-4995-92c6-f8be946795ed req-798cd574-8202-4d28-bad7-a91b836975e1 service nova] Lock "de04088f-264e-48ef-83bf-3b25b9b76352-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:37:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-55c9c384-0567-4995-92c6-f8be946795ed req-798cd574-8202-4d28-bad7-a91b836975e1 service nova] Lock "de04088f-264e-48ef-83bf-3b25b9b76352-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:37:36 user nova-compute[74994]: DEBUG nova.compute.manager [req-55c9c384-0567-4995-92c6-f8be946795ed req-798cd574-8202-4d28-bad7-a91b836975e1 service nova] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] No waiting events found dispatching network-vif-plugged-35fefd16-16bd-4dff-819c-ef13f7e84e94 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:37:36 user nova-compute[74994]: WARNING nova.compute.manager [req-55c9c384-0567-4995-92c6-f8be946795ed req-798cd574-8202-4d28-bad7-a91b836975e1 service nova] [instance: de04088f-264e-48ef-83bf-3b25b9b76352] Received unexpected event network-vif-plugged-35fefd16-16bd-4dff-819c-ef13f7e84e94 for instance with vm_state active and task_state deleting.
Nov 28 11:37:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f61b1406-64c2-473c-aee6-2c588024d3a7 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:37:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f61b1406-64c2-473c-aee6-2c588024d3a7 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:37:37 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-f61b1406-64c2-473c-aee6-2c588024d3a7 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:37:37 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-f61b1406-64c2-473c-aee6-2c588024d3a7 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:37:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f61b1406-64c2-473c-aee6-2c588024d3a7 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.218s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:37:37 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-f61b1406-64c2-473c-aee6-2c588024d3a7 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Deleted allocations for instance de04088f-264e-48ef-83bf-3b25b9b76352
Nov 28 11:37:37 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f61b1406-64c2-473c-aee6-2c588024d3a7 tempest-TestVolumeBootPattern-169069415 tempest-TestVolumeBootPattern-169069415-project-member] Lock "de04088f-264e-48ef-83bf-3b25b9b76352" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.775s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:37:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:37:41 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:37:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:37:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:37:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:37:41 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 11:37:41 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:37:41 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:37:41 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=9145MB free_disk=25.024566650390625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 11:37:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:37:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:37:41 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 11:37:41 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 11:37:41 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:37:41 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:37:42 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 11:37:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:37:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:37:46 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:37:46 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 11:37:49 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:37:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:37:54 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:37:54 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 11:37:54 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Rebuilding the list of instances to heal {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 11:37:54 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Didn't find any instances for network info cache update. {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 11:37:54 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:37:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:37:58 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:37:59 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:38:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:38:00 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:38:03 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:38:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:38:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:38:10 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:38:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:38:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:38:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:38:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:38:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:38:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:38:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:38:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:38:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:38:31 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:38:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:38:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:38:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:38:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:38:42 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:38:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:38:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:38:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:38:42 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 11:38:42 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:38:42 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:38:42 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=9263MB free_disk=25.02267074584961GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 11:38:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:38:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:38:42 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 11:38:42 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 11:38:42 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:38:42 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:38:42 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 11:38:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.109s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:38:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:38:47 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:38:47 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 11:38:49 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:38:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:38:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:38:55 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:38:55 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 11:38:55 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Rebuilding the list of instances to heal {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 11:38:55 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Didn't find any instances for network info cache update. {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 11:38:55 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:38:59 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:39:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:39:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:39:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:39:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:39:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:39:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:39:00 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:39:01 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:39:02 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:39:03 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:39:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:39:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:39:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:39:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:39:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:39:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:39:14 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:39:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:39:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:39:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Acquiring lock "17b941df-a6d2-41f2-9b1d-79187335dca1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:39:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "17b941df-a6d2-41f2-9b1d-79187335dca1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:39:20 user nova-compute[74994]: DEBUG nova.compute.manager [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Starting instance... {{(pid=74994) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 11:39:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:39:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:39:20 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74994) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 11:39:20 user nova-compute[74994]: INFO nova.compute.claims [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Claim successful on node user
Nov 28 11:39:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:39:20 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:39:20 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:39:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.193s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:39:20 user nova-compute[74994]: DEBUG nova.compute.manager [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Start building networks asynchronously for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 11:39:20 user nova-compute[74994]: DEBUG nova.compute.manager [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Allocating IP information in the background. {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 11:39:20 user nova-compute[74994]: DEBUG nova.network.neutron [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] allocate_for_instance() {{(pid=74994) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 11:39:20 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 11:39:20 user nova-compute[74994]: DEBUG nova.compute.manager [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Start building block device mappings for instance. {{(pid=74994) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 11:39:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:39:20 user nova-compute[74994]: DEBUG nova.policy [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6e2d0899a8084528853a093147d8f3d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b604f100e934644a9e62136794b80b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74994) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 11:39:20 user nova-compute[74994]: DEBUG nova.compute.manager [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Start spawning the instance on the hypervisor. {{(pid=74994) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 11:39:20 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Creating instance directory {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 11:39:20 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Creating image(s)
Nov 28 11:39:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Acquiring lock "/opt/stack/data/nova/instances/17b941df-a6d2-41f2-9b1d-79187335dca1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:39:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "/opt/stack/data/nova/instances/17b941df-a6d2-41f2-9b1d-79187335dca1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:39:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "/opt/stack/data/nova/instances/17b941df-a6d2-41f2-9b1d-79187335dca1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:39:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:39:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.206s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:39:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Acquiring lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:39:20 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:39:20 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:39:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.217s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:39:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/17b941df-a6d2-41f2-9b1d-79187335dca1/disk 1073741824 {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:39:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188,backing_fmt=raw /opt/stack/data/nova/instances/17b941df-a6d2-41f2-9b1d-79187335dca1/disk 1073741824" returned: 0 in 0.066s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:39:21 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "fcc7b97cf95477e9f0e51c56d710b3067ade2188" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.297s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:39:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:39:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fcc7b97cf95477e9f0e51c56d710b3067ade2188 --force-share --output=json" returned: 0 in 0.188s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:39:21 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Checking if we can resize image /opt/stack/data/nova/instances/17b941df-a6d2-41f2-9b1d-79187335dca1/disk. size=1073741824 {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 11:39:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b941df-a6d2-41f2-9b1d-79187335dca1/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:39:21 user nova-compute[74994]: DEBUG nova.network.neutron [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Successfully created port: 673d4843-0ed2-4ab1-86f2-8150d521ece7 {{(pid=74994) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 11:39:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b941df-a6d2-41f2-9b1d-79187335dca1/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:39:21 user nova-compute[74994]: DEBUG nova.virt.disk.api [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Cannot resize image /opt/stack/data/nova/instances/17b941df-a6d2-41f2-9b1d-79187335dca1/disk to a smaller size. {{(pid=74994) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 11:39:21 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Created local disks {{(pid=74994) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 11:39:21 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Ensure instance console log exists: /opt/stack/data/nova/instances/17b941df-a6d2-41f2-9b1d-79187335dca1/console.log {{(pid=74994) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 11:39:21 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:39:21 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:39:21 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:39:22 user nova-compute[74994]: DEBUG nova.network.neutron [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Successfully updated port: 673d4843-0ed2-4ab1-86f2-8150d521ece7 {{(pid=74994) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 11:39:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Acquiring lock "refresh_cache-17b941df-a6d2-41f2-9b1d-79187335dca1" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:39:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Acquired lock "refresh_cache-17b941df-a6d2-41f2-9b1d-79187335dca1" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:39:22 user nova-compute[74994]: DEBUG nova.network.neutron [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Building network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 11:39:22 user nova-compute[74994]: DEBUG nova.compute.manager [req-5155513e-c649-4f03-b14f-1ca10db1a44b req-a30c43f6-a97a-4fc1-ba9f-6cfcaa0efe87 service nova] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Received event network-changed-673d4843-0ed2-4ab1-86f2-8150d521ece7 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:39:22 user nova-compute[74994]: DEBUG nova.compute.manager [req-5155513e-c649-4f03-b14f-1ca10db1a44b req-a30c43f6-a97a-4fc1-ba9f-6cfcaa0efe87 service nova] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Refreshing instance network info cache due to event network-changed-673d4843-0ed2-4ab1-86f2-8150d521ece7. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:39:22 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-5155513e-c649-4f03-b14f-1ca10db1a44b req-a30c43f6-a97a-4fc1-ba9f-6cfcaa0efe87 service nova] Acquiring lock "refresh_cache-17b941df-a6d2-41f2-9b1d-79187335dca1" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:39:22 user nova-compute[74994]: DEBUG nova.network.neutron [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Instance cache missing network info. {{(pid=74994) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 11:39:23 user nova-compute[74994]: DEBUG nova.network.neutron [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Updating instance_info_cache with network_info: [{"id": "673d4843-0ed2-4ab1-86f2-8150d521ece7", "address": "fa:16:3e:83:81:54", "network": {"id": "e39af230-9bea-48e4-80a4-f46475c01631", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-134807231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b604f100e934644a9e62136794b80b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap673d4843-0e", "ovs_interfaceid": "673d4843-0ed2-4ab1-86f2-8150d521ece7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:39:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Releasing lock "refresh_cache-17b941df-a6d2-41f2-9b1d-79187335dca1" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:39:23 user nova-compute[74994]: DEBUG nova.compute.manager [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Instance network_info: |[{"id": "673d4843-0ed2-4ab1-86f2-8150d521ece7", "address": "fa:16:3e:83:81:54", "network": {"id": "e39af230-9bea-48e4-80a4-f46475c01631", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-134807231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b604f100e934644a9e62136794b80b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap673d4843-0e", "ovs_interfaceid": "673d4843-0ed2-4ab1-86f2-8150d521ece7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74994) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 11:39:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-5155513e-c649-4f03-b14f-1ca10db1a44b req-a30c43f6-a97a-4fc1-ba9f-6cfcaa0efe87 service nova] Acquired lock "refresh_cache-17b941df-a6d2-41f2-9b1d-79187335dca1" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:39:23 user nova-compute[74994]: DEBUG nova.network.neutron [req-5155513e-c649-4f03-b14f-1ca10db1a44b req-a30c43f6-a97a-4fc1-ba9f-6cfcaa0efe87 service nova] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Refreshing network info cache for port 673d4843-0ed2-4ab1-86f2-8150d521ece7 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:39:23 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Start _get_guest_xml network_info=[{"id": "673d4843-0ed2-4ab1-86f2-8150d521ece7", "address": "fa:16:3e:83:81:54", "network": {"id": "e39af230-9bea-48e4-80a4-f46475c01631", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-134807231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b604f100e934644a9e62136794b80b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap673d4843-0e", "ovs_interfaceid": "673d4843-0ed2-4ab1-86f2-8150d521ece7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'aa939d1b-b8a6-4391-935b-0191bf5ccd0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 11:39:23 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:39:23 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:39:23 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 11:39:23 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] CPU controller missing on host. {{(pid=74994) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 11:39:23 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 11:39:23 user nova-compute[74994]: DEBUG nova.virt.libvirt.host [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] CPU controller found on host. {{(pid=74994) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 11:39:23 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74994) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 11:39:23 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T10:45:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T10:45:27Z,direct_url=<?>,disk_format='qcow2',id=aa939d1b-b8a6-4391-935b-0191bf5ccd0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ab811d435da94c6aaf6156b0c318c9ab',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T10:45:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 11:39:23 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Flavor limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 11:39:23 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Image limits 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 11:39:23 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Flavor pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 11:39:23 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Image pref 0:0:0 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 11:39:23 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 11:39:23 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 11:39:23 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 11:39:23 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Got 1 possible topologies {{(pid=74994) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 11:39:23 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 11:39:23 user nova-compute[74994]: DEBUG nova.virt.hardware [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74994) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 11:39:23 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1379585235',display_name='tempest-SnapshotDataIntegrityTests-server-1379585235',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1379585235',id=53,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFrZWCI/tzHwjkDy7L1B8EBPlwTDNOxBKrL4O7dwHffg8V6jPvs6Z2Xv5dDzoeGcFipc4/BQyRs5uGYZhHWj7qn4mbNv0gU6URWqp3rJTMfFOidSe6Y9U0mNoDlQQYQ1g==',key_name='tempest-keypair-346785877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b604f100e934644a9e62136794b80b6',ramdisk_id='',reservation_id='r-glayxowl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2090670151',owner_user_name='tempest-SnapshotDataIntegrityTests-2090670151-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:39:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e2d0899a8084528853a093147d8f3d5',uuid=17b941df-a6d2-41f2-9b1d-79187335dca1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "673d4843-0ed2-4ab1-86f2-8150d521ece7", "address": "fa:16:3e:83:81:54", "network": {"id": "e39af230-9bea-48e4-80a4-f46475c01631", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-134807231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b604f100e934644a9e62136794b80b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap673d4843-0e", "ovs_interfaceid": "673d4843-0ed2-4ab1-86f2-8150d521ece7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74994) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 11:39:23 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Converting VIF {"id": "673d4843-0ed2-4ab1-86f2-8150d521ece7", "address": "fa:16:3e:83:81:54", "network": {"id": "e39af230-9bea-48e4-80a4-f46475c01631", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-134807231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b604f100e934644a9e62136794b80b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap673d4843-0e", "ovs_interfaceid": "673d4843-0ed2-4ab1-86f2-8150d521ece7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:39:23 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:81:54,bridge_name='br-int',has_traffic_filtering=True,id=673d4843-0ed2-4ab1-86f2-8150d521ece7,network=Network(e39af230-9bea-48e4-80a4-f46475c01631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap673d4843-0e') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:39:23 user nova-compute[74994]: DEBUG nova.objects.instance [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lazy-loading 'pci_devices' on Instance uuid 17b941df-a6d2-41f2-9b1d-79187335dca1 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:39:23 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] End _get_guest_xml xml=<domain type="kvm">
Nov 28 11:39:23 user nova-compute[74994]:   <uuid>17b941df-a6d2-41f2-9b1d-79187335dca1</uuid>
Nov 28 11:39:23 user nova-compute[74994]:   <name>instance-00000035</name>
Nov 28 11:39:23 user nova-compute[74994]:   <memory>524288</memory>
Nov 28 11:39:23 user nova-compute[74994]:   <vcpu>1</vcpu>
Nov 28 11:39:23 user nova-compute[74994]:   <metadata>
Nov 28 11:39:23 user nova-compute[74994]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 11:39:23 user nova-compute[74994]:       <nova:package version="0.0.0"/>
Nov 28 11:39:23 user nova-compute[74994]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1379585235</nova:name>
Nov 28 11:39:23 user nova-compute[74994]:       <nova:creationTime>2023-11-28 11:39:23</nova:creationTime>
Nov 28 11:39:23 user nova-compute[74994]:       <nova:flavor name="m1.tiny">
Nov 28 11:39:23 user nova-compute[74994]:         <nova:memory>512</nova:memory>
Nov 28 11:39:23 user nova-compute[74994]:         <nova:disk>1</nova:disk>
Nov 28 11:39:23 user nova-compute[74994]:         <nova:swap>0</nova:swap>
Nov 28 11:39:23 user nova-compute[74994]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 11:39:23 user nova-compute[74994]:         <nova:vcpus>1</nova:vcpus>
Nov 28 11:39:23 user nova-compute[74994]:       </nova:flavor>
Nov 28 11:39:23 user nova-compute[74994]:       <nova:owner>
Nov 28 11:39:23 user nova-compute[74994]:         <nova:user uuid="6e2d0899a8084528853a093147d8f3d5">tempest-SnapshotDataIntegrityTests-2090670151-project-member</nova:user>
Nov 28 11:39:23 user nova-compute[74994]:         <nova:project uuid="0b604f100e934644a9e62136794b80b6">tempest-SnapshotDataIntegrityTests-2090670151</nova:project>
Nov 28 11:39:23 user nova-compute[74994]:       </nova:owner>
Nov 28 11:39:23 user nova-compute[74994]:       <nova:root type="image" uuid="aa939d1b-b8a6-4391-935b-0191bf5ccd0a"/>
Nov 28 11:39:23 user nova-compute[74994]:       <nova:ports>
Nov 28 11:39:23 user nova-compute[74994]:         <nova:port uuid="673d4843-0ed2-4ab1-86f2-8150d521ece7">
Nov 28 11:39:23 user nova-compute[74994]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 28 11:39:23 user nova-compute[74994]:         </nova:port>
Nov 28 11:39:23 user nova-compute[74994]:       </nova:ports>
Nov 28 11:39:23 user nova-compute[74994]:     </nova:instance>
Nov 28 11:39:23 user nova-compute[74994]:   </metadata>
Nov 28 11:39:23 user nova-compute[74994]:   <sysinfo type="smbios">
Nov 28 11:39:23 user nova-compute[74994]:     <system>
Nov 28 11:39:23 user nova-compute[74994]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 11:39:23 user nova-compute[74994]:       <entry name="product">OpenStack Nova</entry>
Nov 28 11:39:23 user nova-compute[74994]:       <entry name="version">0.0.0</entry>
Nov 28 11:39:23 user nova-compute[74994]:       <entry name="serial">17b941df-a6d2-41f2-9b1d-79187335dca1</entry>
Nov 28 11:39:23 user nova-compute[74994]:       <entry name="uuid">17b941df-a6d2-41f2-9b1d-79187335dca1</entry>
Nov 28 11:39:23 user nova-compute[74994]:       <entry name="family">Virtual Machine</entry>
Nov 28 11:39:23 user nova-compute[74994]:     </system>
Nov 28 11:39:23 user nova-compute[74994]:   </sysinfo>
Nov 28 11:39:23 user nova-compute[74994]:   <os>
Nov 28 11:39:23 user nova-compute[74994]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 11:39:23 user nova-compute[74994]:     <boot dev="hd"/>
Nov 28 11:39:23 user nova-compute[74994]:     <smbios mode="sysinfo"/>
Nov 28 11:39:23 user nova-compute[74994]:   </os>
Nov 28 11:39:23 user nova-compute[74994]:   <features>
Nov 28 11:39:23 user nova-compute[74994]:     <acpi/>
Nov 28 11:39:23 user nova-compute[74994]:     <apic/>
Nov 28 11:39:23 user nova-compute[74994]:     <vmcoreinfo/>
Nov 28 11:39:23 user nova-compute[74994]:   </features>
Nov 28 11:39:23 user nova-compute[74994]:   <clock offset="utc">
Nov 28 11:39:23 user nova-compute[74994]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 11:39:23 user nova-compute[74994]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 11:39:23 user nova-compute[74994]:     <timer name="hpet" present="no"/>
Nov 28 11:39:23 user nova-compute[74994]:   </clock>
Nov 28 11:39:23 user nova-compute[74994]:   <cpu mode="custom" match="exact">
Nov 28 11:39:23 user nova-compute[74994]:     <model>Nehalem</model>
Nov 28 11:39:23 user nova-compute[74994]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 11:39:23 user nova-compute[74994]:   </cpu>
Nov 28 11:39:23 user nova-compute[74994]:   <devices>
Nov 28 11:39:23 user nova-compute[74994]:     <disk type="file" device="disk">
Nov 28 11:39:23 user nova-compute[74994]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 11:39:23 user nova-compute[74994]:       <source file="/opt/stack/data/nova/instances/17b941df-a6d2-41f2-9b1d-79187335dca1/disk"/>
Nov 28 11:39:23 user nova-compute[74994]:       <target dev="vda" bus="virtio"/>
Nov 28 11:39:23 user nova-compute[74994]:     </disk>
Nov 28 11:39:23 user nova-compute[74994]:     <interface type="ethernet">
Nov 28 11:39:23 user nova-compute[74994]:       <mac address="fa:16:3e:83:81:54"/>
Nov 28 11:39:23 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:39:23 user nova-compute[74994]:       <mtu size="1442"/>
Nov 28 11:39:23 user nova-compute[74994]:       <target dev="tap673d4843-0e"/>
Nov 28 11:39:23 user nova-compute[74994]:     </interface>
Nov 28 11:39:23 user nova-compute[74994]:     <serial type="pty">
Nov 28 11:39:23 user nova-compute[74994]:       <log file="/opt/stack/data/nova/instances/17b941df-a6d2-41f2-9b1d-79187335dca1/console.log" append="off"/>
Nov 28 11:39:23 user nova-compute[74994]:     </serial>
Nov 28 11:39:23 user nova-compute[74994]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 11:39:23 user nova-compute[74994]:     <video>
Nov 28 11:39:23 user nova-compute[74994]:       <model type="virtio"/>
Nov 28 11:39:23 user nova-compute[74994]:     </video>
Nov 28 11:39:23 user nova-compute[74994]:     <rng model="virtio">
Nov 28 11:39:23 user nova-compute[74994]:       <backend model="random">/dev/urandom</backend>
Nov 28 11:39:23 user nova-compute[74994]:     </rng>
Nov 28 11:39:23 user nova-compute[74994]:     <controller type="usb" index="0" model="none"/>
Nov 28 11:39:23 user nova-compute[74994]:     <memballoon model="virtio">
Nov 28 11:39:23 user nova-compute[74994]:       <stats period="10"/>
Nov 28 11:39:23 user nova-compute[74994]:     </memballoon>
Nov 28 11:39:23 user nova-compute[74994]:   </devices>
Nov 28 11:39:23 user nova-compute[74994]: </domain>
Nov 28 11:39:23 user nova-compute[74994]:  {{(pid=74994) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 11:39:23 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1379585235',display_name='tempest-SnapshotDataIntegrityTests-server-1379585235',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1379585235',id=53,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFrZWCI/tzHwjkDy7L1B8EBPlwTDNOxBKrL4O7dwHffg8V6jPvs6Z2Xv5dDzoeGcFipc4/BQyRs5uGYZhHWj7qn4mbNv0gU6URWqp3rJTMfFOidSe6Y9U0mNoDlQQYQ1g==',key_name='tempest-keypair-346785877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b604f100e934644a9e62136794b80b6',ramdisk_id='',reservation_id='r-glayxowl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2090670151',owner_user_name='tempest-SnapshotDataIntegrityTests-2090670151-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T11:39:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e2d0899a8084528853a093147d8f3d5',uuid=17b941df-a6d2-41f2-9b1d-79187335dca1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "673d4843-0ed2-4ab1-86f2-8150d521ece7", "address": "fa:16:3e:83:81:54", "network": {"id": "e39af230-9bea-48e4-80a4-f46475c01631", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-134807231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b604f100e934644a9e62136794b80b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap673d4843-0e", "ovs_interfaceid": "673d4843-0ed2-4ab1-86f2-8150d521ece7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 11:39:23 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Converting VIF {"id": "673d4843-0ed2-4ab1-86f2-8150d521ece7", "address": "fa:16:3e:83:81:54", "network": {"id": "e39af230-9bea-48e4-80a4-f46475c01631", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-134807231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b604f100e934644a9e62136794b80b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap673d4843-0e", "ovs_interfaceid": "673d4843-0ed2-4ab1-86f2-8150d521ece7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:39:23 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:81:54,bridge_name='br-int',has_traffic_filtering=True,id=673d4843-0ed2-4ab1-86f2-8150d521ece7,network=Network(e39af230-9bea-48e4-80a4-f46475c01631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap673d4843-0e') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:39:23 user nova-compute[74994]: DEBUG os_vif [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:81:54,bridge_name='br-int',has_traffic_filtering=True,id=673d4843-0ed2-4ab1-86f2-8150d521ece7,network=Network(e39af230-9bea-48e4-80a4-f46475c01631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap673d4843-0e') {{(pid=74994) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 11:39:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:39:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:39:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 11:39:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:39:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5db56763-7cd0-5bd4-8c2c-9eb83bd1f7f7', '_type': 'linux-noop'}}, row=False) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:39:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:39:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:39:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:39:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap673d4843-0e, may_exist=True, interface_attrs={}) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:39:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap673d4843-0e, col_values=(('qos', UUID('fc762e97-8fe5-40e9-b824-89690e55e6f5')),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:39:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap673d4843-0e, col_values=(('external_ids', {'iface-id': '673d4843-0ed2-4ab1-86f2-8150d521ece7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:81:54', 'vm-uuid': '17b941df-a6d2-41f2-9b1d-79187335dca1'}),), if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:39:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:39:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:39:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:39:23 user nova-compute[74994]: INFO os_vif [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:81:54,bridge_name='br-int',has_traffic_filtering=True,id=673d4843-0ed2-4ab1-86f2-8150d521ece7,network=Network(e39af230-9bea-48e4-80a4-f46475c01631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap673d4843-0e')
Nov 28 11:39:23 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:39:23 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] No VIF found with MAC fa:16:3e:83:81:54, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:39:23 user nova-compute[74994]: DEBUG nova.network.neutron [req-5155513e-c649-4f03-b14f-1ca10db1a44b req-a30c43f6-a97a-4fc1-ba9f-6cfcaa0efe87 service nova] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Updated VIF entry in instance network info cache for port 673d4843-0ed2-4ab1-86f2-8150d521ece7. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:39:23 user nova-compute[74994]: DEBUG nova.network.neutron [req-5155513e-c649-4f03-b14f-1ca10db1a44b req-a30c43f6-a97a-4fc1-ba9f-6cfcaa0efe87 service nova] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Updating instance_info_cache with network_info: [{"id": "673d4843-0ed2-4ab1-86f2-8150d521ece7", "address": "fa:16:3e:83:81:54", "network": {"id": "e39af230-9bea-48e4-80a4-f46475c01631", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-134807231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b604f100e934644a9e62136794b80b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap673d4843-0e", "ovs_interfaceid": "673d4843-0ed2-4ab1-86f2-8150d521ece7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:39:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-5155513e-c649-4f03-b14f-1ca10db1a44b req-a30c43f6-a97a-4fc1-ba9f-6cfcaa0efe87 service nova] Releasing lock "refresh_cache-17b941df-a6d2-41f2-9b1d-79187335dca1" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:39:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:39:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:39:24 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:39:25 user nova-compute[74994]: DEBUG nova.compute.manager [req-8d873285-7fb7-4b70-94b7-a18ca1cad9f8 req-f7d98b91-60e8-47bc-b95c-bc3713506bf7 service nova] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Received event network-vif-plugged-673d4843-0ed2-4ab1-86f2-8150d521ece7 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:39:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8d873285-7fb7-4b70-94b7-a18ca1cad9f8 req-f7d98b91-60e8-47bc-b95c-bc3713506bf7 service nova] Acquiring lock "17b941df-a6d2-41f2-9b1d-79187335dca1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:39:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8d873285-7fb7-4b70-94b7-a18ca1cad9f8 req-f7d98b91-60e8-47bc-b95c-bc3713506bf7 service nova] Lock "17b941df-a6d2-41f2-9b1d-79187335dca1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:39:25 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-8d873285-7fb7-4b70-94b7-a18ca1cad9f8 req-f7d98b91-60e8-47bc-b95c-bc3713506bf7 service nova] Lock "17b941df-a6d2-41f2-9b1d-79187335dca1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:39:25 user nova-compute[74994]: DEBUG nova.compute.manager [req-8d873285-7fb7-4b70-94b7-a18ca1cad9f8 req-f7d98b91-60e8-47bc-b95c-bc3713506bf7 service nova] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] No waiting events found dispatching network-vif-plugged-673d4843-0ed2-4ab1-86f2-8150d521ece7 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:39:25 user nova-compute[74994]: WARNING nova.compute.manager [req-8d873285-7fb7-4b70-94b7-a18ca1cad9f8 req-f7d98b91-60e8-47bc-b95c-bc3713506bf7 service nova] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Received unexpected event network-vif-plugged-673d4843-0ed2-4ab1-86f2-8150d521ece7 for instance with vm_state building and task_state spawning.
Nov 28 11:39:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:39:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:39:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:39:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:39:26 user nova-compute[74994]: DEBUG nova.compute.manager [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Instance event wait completed in 0 seconds for  {{(pid=74994) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 11:39:26 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Guest created on hypervisor {{(pid=74994) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 11:39:26 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Instance spawned successfully.
Nov 28 11:39:26 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 11:39:27 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Found default for hw_cdrom_bus of ide {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:39:27 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Found default for hw_disk_bus of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:39:27 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Found default for hw_input_bus of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:39:27 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Found default for hw_pointer_model of None {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:39:27 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Found default for hw_video_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:39:27 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Found default for hw_vif_model of virtio {{(pid=74994) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 11:39:27 user nova-compute[74994]: DEBUG nova.compute.manager [req-0817c961-c4a0-4302-8523-b601de2edc55 req-693a8695-5d05-40d9-bea7-567447b7c484 service nova] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Received event network-vif-plugged-673d4843-0ed2-4ab1-86f2-8150d521ece7 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:39:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-0817c961-c4a0-4302-8523-b601de2edc55 req-693a8695-5d05-40d9-bea7-567447b7c484 service nova] Acquiring lock "17b941df-a6d2-41f2-9b1d-79187335dca1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:39:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-0817c961-c4a0-4302-8523-b601de2edc55 req-693a8695-5d05-40d9-bea7-567447b7c484 service nova] Lock "17b941df-a6d2-41f2-9b1d-79187335dca1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:39:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-0817c961-c4a0-4302-8523-b601de2edc55 req-693a8695-5d05-40d9-bea7-567447b7c484 service nova] Lock "17b941df-a6d2-41f2-9b1d-79187335dca1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:39:27 user nova-compute[74994]: DEBUG nova.compute.manager [req-0817c961-c4a0-4302-8523-b601de2edc55 req-693a8695-5d05-40d9-bea7-567447b7c484 service nova] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] No waiting events found dispatching network-vif-plugged-673d4843-0ed2-4ab1-86f2-8150d521ece7 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:39:27 user nova-compute[74994]: WARNING nova.compute.manager [req-0817c961-c4a0-4302-8523-b601de2edc55 req-693a8695-5d05-40d9-bea7-567447b7c484 service nova] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Received unexpected event network-vif-plugged-673d4843-0ed2-4ab1-86f2-8150d521ece7 for instance with vm_state building and task_state spawning.
Nov 28 11:39:27 user nova-compute[74994]: INFO nova.compute.manager [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Took 6.38 seconds to spawn the instance on the hypervisor.
Nov 28 11:39:27 user nova-compute[74994]: DEBUG nova.compute.manager [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Checking state {{(pid=74994) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 11:39:27 user nova-compute[74994]: INFO nova.compute.manager [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Took 6.98 seconds to build instance.
Nov 28 11:39:27 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-c80aa4d2-bd44-4cb0-8fa5-59e61ac3ae40 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "17b941df-a6d2-41f2-9b1d-79187335dca1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.160s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:39:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:39:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:39:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:39:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:39:37 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:39:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:39:42 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:39:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:39:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:39:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:39:42 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 11:39:42 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b941df-a6d2-41f2-9b1d-79187335dca1/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:39:42 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b941df-a6d2-41f2-9b1d-79187335dca1/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:39:42 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b941df-a6d2-41f2-9b1d-79187335dca1/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:39:42 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b941df-a6d2-41f2-9b1d-79187335dca1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:39:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:39:43 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:39:43 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:39:43 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=8828MB free_disk=24.981624603271484GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 11:39:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:39:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:39:43 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 17b941df-a6d2-41f2-9b1d-79187335dca1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:39:43 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 11:39:43 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 11:39:43 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:39:43 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:39:43 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 11:39:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.204s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:39:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:39:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:39:48 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:39:48 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 11:39:49 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:39:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:39:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:39:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:39:56 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:39:57 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:39:57 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 11:39:57 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Rebuilding the list of instances to heal {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 11:39:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "refresh_cache-17b941df-a6d2-41f2-9b1d-79187335dca1" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:39:57 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquired lock "refresh_cache-17b941df-a6d2-41f2-9b1d-79187335dca1" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:39:57 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Forcefully refreshing network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 11:39:57 user nova-compute[74994]: DEBUG nova.objects.instance [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lazy-loading 'info_cache' on Instance uuid 17b941df-a6d2-41f2-9b1d-79187335dca1 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:39:58 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Updating instance_info_cache with network_info: [{"id": "673d4843-0ed2-4ab1-86f2-8150d521ece7", "address": "fa:16:3e:83:81:54", "network": {"id": "e39af230-9bea-48e4-80a4-f46475c01631", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-134807231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b604f100e934644a9e62136794b80b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap673d4843-0e", "ovs_interfaceid": "673d4843-0ed2-4ab1-86f2-8150d521ece7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:39:58 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Releasing lock "refresh_cache-17b941df-a6d2-41f2-9b1d-79187335dca1" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:39:58 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Updated the network info_cache for instance {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 11:39:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:40:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:40:01 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:40:01 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:40:01 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:40:03 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:40:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:40:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:40:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:40:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:40:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:40:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:40:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:40:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:40:15 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:40:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:40:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:40:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:40:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:40:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:40:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:40:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:40:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:40:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:40:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:40:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:40:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:40:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:40:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:40:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:40:42 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:40:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:40:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:40:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:40:42 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 11:40:42 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b941df-a6d2-41f2-9b1d-79187335dca1/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:40:42 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b941df-a6d2-41f2-9b1d-79187335dca1/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:40:42 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b941df-a6d2-41f2-9b1d-79187335dca1/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:40:42 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b941df-a6d2-41f2-9b1d-79187335dca1/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:40:43 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:40:43 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:40:43 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=9040MB free_disk=24.977928161621094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 11:40:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:40:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:40:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:40:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:40:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:40:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:40:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:40:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:40:43 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 17b941df-a6d2-41f2-9b1d-79187335dca1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:40:43 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 11:40:43 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 11:40:43 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Refreshing inventories for resource provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 11:40:43 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Updating ProviderTree inventory for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 11:40:43 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Updating inventory in ProviderTree for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 11:40:43 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Refreshing aggregate associations for resource provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a, aggregates: None {{(pid=74994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 11:40:43 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Refreshing trait associations for resource provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=74994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 11:40:43 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:40:43 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:40:43 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 11:40:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.516s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:40:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:40:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:40:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:40:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:40:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:40:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:40:50 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:40:50 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:40:50 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 11:40:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:40:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:40:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:40:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:40:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:40:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:40:56 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:40:57 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:40:58 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:40:58 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 11:40:58 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Rebuilding the list of instances to heal {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 11:40:58 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "refresh_cache-17b941df-a6d2-41f2-9b1d-79187335dca1" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:40:58 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquired lock "refresh_cache-17b941df-a6d2-41f2-9b1d-79187335dca1" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:40:58 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Forcefully refreshing network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 11:40:58 user nova-compute[74994]: DEBUG nova.objects.instance [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lazy-loading 'info_cache' on Instance uuid 17b941df-a6d2-41f2-9b1d-79187335dca1 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:40:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:40:58 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Updating instance_info_cache with network_info: [{"id": "673d4843-0ed2-4ab1-86f2-8150d521ece7", "address": "fa:16:3e:83:81:54", "network": {"id": "e39af230-9bea-48e4-80a4-f46475c01631", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-134807231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b604f100e934644a9e62136794b80b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap673d4843-0e", "ovs_interfaceid": "673d4843-0ed2-4ab1-86f2-8150d521ece7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:40:58 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Releasing lock "refresh_cache-17b941df-a6d2-41f2-9b1d-79187335dca1" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:40:58 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Updated the network info_cache for instance {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 11:41:00 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:41:00 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74994) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 11:41:01 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:41:02 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:41:03 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:41:03 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:41:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:41:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:41:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:41:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:41:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:41:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:41:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:41:11 user nova-compute[74994]: DEBUG nova.compute.manager [req-f034049d-1a63-41d5-a1d8-97432097b2f6 req-c0172a9c-c4bb-4d11-8d91-a3b09c3428eb service nova] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Received event network-changed-673d4843-0ed2-4ab1-86f2-8150d521ece7 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:41:11 user nova-compute[74994]: DEBUG nova.compute.manager [req-f034049d-1a63-41d5-a1d8-97432097b2f6 req-c0172a9c-c4bb-4d11-8d91-a3b09c3428eb service nova] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Refreshing instance network info cache due to event network-changed-673d4843-0ed2-4ab1-86f2-8150d521ece7. {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 11:41:11 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f034049d-1a63-41d5-a1d8-97432097b2f6 req-c0172a9c-c4bb-4d11-8d91-a3b09c3428eb service nova] Acquiring lock "refresh_cache-17b941df-a6d2-41f2-9b1d-79187335dca1" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:41:11 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f034049d-1a63-41d5-a1d8-97432097b2f6 req-c0172a9c-c4bb-4d11-8d91-a3b09c3428eb service nova] Acquired lock "refresh_cache-17b941df-a6d2-41f2-9b1d-79187335dca1" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:41:11 user nova-compute[74994]: DEBUG nova.network.neutron [req-f034049d-1a63-41d5-a1d8-97432097b2f6 req-c0172a9c-c4bb-4d11-8d91-a3b09c3428eb service nova] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Refreshing network info cache for port 673d4843-0ed2-4ab1-86f2-8150d521ece7 {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 11:41:11 user nova-compute[74994]: DEBUG nova.network.neutron [req-f034049d-1a63-41d5-a1d8-97432097b2f6 req-c0172a9c-c4bb-4d11-8d91-a3b09c3428eb service nova] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Updated VIF entry in instance network info cache for port 673d4843-0ed2-4ab1-86f2-8150d521ece7. {{(pid=74994) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 11:41:11 user nova-compute[74994]: DEBUG nova.network.neutron [req-f034049d-1a63-41d5-a1d8-97432097b2f6 req-c0172a9c-c4bb-4d11-8d91-a3b09c3428eb service nova] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Updating instance_info_cache with network_info: [{"id": "673d4843-0ed2-4ab1-86f2-8150d521ece7", "address": "fa:16:3e:83:81:54", "network": {"id": "e39af230-9bea-48e4-80a4-f46475c01631", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-134807231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b604f100e934644a9e62136794b80b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap673d4843-0e", "ovs_interfaceid": "673d4843-0ed2-4ab1-86f2-8150d521ece7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:41:11 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-f034049d-1a63-41d5-a1d8-97432097b2f6 req-c0172a9c-c4bb-4d11-8d91-a3b09c3428eb service nova] Releasing lock "refresh_cache-17b941df-a6d2-41f2-9b1d-79187335dca1" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:41:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:41:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Acquiring lock "17b941df-a6d2-41f2-9b1d-79187335dca1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:41:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "17b941df-a6d2-41f2-9b1d-79187335dca1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:41:14 user nova-compute[74994]: DEBUG nova.objects.instance [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lazy-loading 'flavor' on Instance uuid 17b941df-a6d2-41f2-9b1d-79187335dca1 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:41:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "17b941df-a6d2-41f2-9b1d-79187335dca1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:41:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Acquiring lock "17b941df-a6d2-41f2-9b1d-79187335dca1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:41:14 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "17b941df-a6d2-41f2-9b1d-79187335dca1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:41:14 user nova-compute[74994]: INFO nova.compute.manager [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Attaching volume c7b2a73d-2a8a-46d0-a335-1957423695fd to /dev/vdb
Nov 28 11:41:14 user nova-compute[74994]: DEBUG os_brick.utils [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:41:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:41:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:41:14 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b32c01-927b-4482-90d9-d48caa223ebe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:41:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:41:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:41:14 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2164f2-49ce-408c-a44f-9b09e9eaa374]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:41:14 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:41:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:41:15 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc7c9e7-204a-4b13-b399-8df71426860c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:41:15 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[195dc40a-fd9e-475b-a50c-62636a88cedf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:41:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:41:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:41:15 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 11:41:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:41:15 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:41:15 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 11:41:15 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9107ae36-0e61-4ef3-9d5e-d79cda1d4735]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:41:15 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 11:41:15 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 11:41:15 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 11:41:15 user nova-compute[74994]: DEBUG os_brick.utils [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:41:15 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Updating existing volume attachment record: 38abb8c8-2818-4058-84d6-1e3757f6a988 {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 11:41:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:41:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:41:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c7b2a73d-2a8a-46d0-a335-1957423695fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aFpKheUg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:41:21 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:41:21 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:41:21 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:41:21 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7b2a73d-2a8a-46d0-a335-1957423695fd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7b2a73d-2a8a-46d0-a335-1957423695fd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:41:21 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 11:41:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b2a73d-2a8a-46d0-a335-1957423695fd -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b2a73d-2a8a-46d0-a335-1957423695fd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb96b50-a47e-4f87-b074-c92875546491]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 11:41:21 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b2a73d-2a8a-46d0-a335-1957423695fd -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b2a73d-2a8a-46d0-a335-1957423695fd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18ef69c-317c-404e-a248-8fdf3f48da2b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7b2a73d-2a8a-46d0-a335-1957423695fd] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7b2a73d-2a8a-46d0-a335-1957423695fd] added
Nov 28 11:41:21 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b2a73d-2a8a-46d0-a335-1957423695fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b2a73d-2a8a-46d0-a335-1957423695fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[027ddad8-289c-4474-bfbb-299205c6e6fa]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b2a73d-2a8a-46d0-a335-1957423695fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b2a73d-2a8a-46d0-a335-1957423695fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b217870b-ece0-43a1-be0a-0b905d9cc48f]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b2a73d-2a8a-46d0-a335-1957423695fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aFpKheUg {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b2a73d-2a8a-46d0-a335-1957423695fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aFpKheUg" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e1525a-8d64-46da-a4e4-b8051aa1b9e5]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aFpKheUg'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b2a73d-2a8a-46d0-a335-1957423695fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b2a73d-2a8a-46d0-a335-1957423695fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e7dc65-fe19-4503-8f5b-d19641f08ef7]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[868c47aa-1207-4dbe-8904-124342b5a0e4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 11:41:21 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 11:41:21 user nova-compute[74994]:  {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:41:21 user nova-compute[74994]: WARNING os_brick.initiator.connectors.iscsi [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 11:41:21 user nova-compute[74994]: 
Nov 28 11:41:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b2a73d-2a8a-46d0-a335-1957423695fd -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b2a73d-2a8a-46d0-a335-1957423695fd -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d7ba74-673f-4650-af94-ec98aa1b438a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7b2a73d-2a8a-46d0-a335-1957423695fd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c7b2a73d-2a8a-46d0-a335-1957423695fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7b2a73d-2a8a-46d0-a335-1957423695fd, portal: 172.16.0.220,3260]
Nov 28 11:41:21 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:c7b2a73d-2a8a-46d0-a335-1957423695fd, portal: 172.16.0.220,3260] successful.
Nov 28 11:41:21 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b2a73d-2a8a-46d0-a335-1957423695fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b2a73d-2a8a-46d0-a335-1957423695fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8edfd1a-4934-4ed5-bbbb-0fee5f1d1809]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[091b2354-1367-45dc-bd8a-61018afab78f]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b2a73d-2a8a-46d0-a335-1957423695fd (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b2a73d-2a8a-46d0-a335-1957423695fd (non-flash)
Nov 28 11:41:21 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b2a73d-2a8a-46d0-a335-1957423695fd (non-flash)
Nov 28 11:41:21 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7b2a73d-2a8a-46d0-a335-1957423695fd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84f2f07-d897-4246-91c5-4611ce128a8b]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 11:41:21 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c7b2a73d-2a8a-46d0-a335-1957423695fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aFpKheUg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 11:41:22 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:41:22 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '26638383730313437', 'path': '/dev/sdb'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:41:22 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638383730313437', 'path': '/dev/sdb'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 11:41:22 user nova-compute[74994]: DEBUG nova.objects.instance [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lazy-loading 'flavor' on Instance uuid 17b941df-a6d2-41f2-9b1d-79187335dca1 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:41:22 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 11:41:22 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:41:22 user nova-compute[74994]:   <source dev="/dev/sdb"/>
Nov 28 11:41:22 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:41:22 user nova-compute[74994]:   <serial>c7b2a73d-2a8a-46d0-a335-1957423695fd</serial>
Nov 28 11:41:22 user nova-compute[74994]: </disk>
Nov 28 11:41:22 user nova-compute[74994]:  {{(pid=74994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 11:41:23 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:41:23 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:41:23 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] No VIF found with MAC fa:16:3e:83:81:54, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:41:23 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-4f5f9ddc-9f54-4bd9-ae5b-74a820458db2 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "17b941df-a6d2-41f2-9b1d-79187335dca1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.455s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:41:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:41:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:41:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:41:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:41:32 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:41:32 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Cleaning up deleted instances {{(pid=74994) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 11:41:32 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] There are 0 instances to clean {{(pid=74994) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 11:41:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:41:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:41:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-fe6dc089-53fc-4c51-8065-315c2a283584 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Acquiring lock "17b941df-a6d2-41f2-9b1d-79187335dca1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:41:36 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-fe6dc089-53fc-4c51-8065-315c2a283584 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "17b941df-a6d2-41f2-9b1d-79187335dca1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:41:36 user nova-compute[74994]: INFO nova.compute.manager [None req-fe6dc089-53fc-4c51-8065-315c2a283584 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Detaching volume c7b2a73d-2a8a-46d0-a335-1957423695fd
Nov 28 11:41:36 user nova-compute[74994]: INFO nova.virt.block_device [None req-fe6dc089-53fc-4c51-8065-315c2a283584 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Attempting to driver detach volume c7b2a73d-2a8a-46d0-a335-1957423695fd from mountpoint /dev/vdb
Nov 28 11:41:36 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-fe6dc089-53fc-4c51-8065-315c2a283584 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Attempting to detach device vdb from instance 17b941df-a6d2-41f2-9b1d-79187335dca1 from the persistent domain config. {{(pid=74994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 11:41:36 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-fe6dc089-53fc-4c51-8065-315c2a283584 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 11:41:36 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:41:36 user nova-compute[74994]:   <source dev="/dev/sdb"/>
Nov 28 11:41:36 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:41:36 user nova-compute[74994]:   <serial>c7b2a73d-2a8a-46d0-a335-1957423695fd</serial>
Nov 28 11:41:36 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 11:41:36 user nova-compute[74994]: </disk>
Nov 28 11:41:36 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 11:41:36 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-fe6dc089-53fc-4c51-8065-315c2a283584 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Successfully detached device vdb from instance 17b941df-a6d2-41f2-9b1d-79187335dca1 from the persistent domain config.
Nov 28 11:41:36 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-fe6dc089-53fc-4c51-8065-315c2a283584 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 17b941df-a6d2-41f2-9b1d-79187335dca1 from the live domain config. {{(pid=74994) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 11:41:36 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-fe6dc089-53fc-4c51-8065-315c2a283584 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 11:41:36 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:41:36 user nova-compute[74994]:   <source dev="/dev/sdb"/>
Nov 28 11:41:36 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:41:36 user nova-compute[74994]:   <serial>c7b2a73d-2a8a-46d0-a335-1957423695fd</serial>
Nov 28 11:41:36 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 11:41:36 user nova-compute[74994]: </disk>
Nov 28 11:41:36 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 11:41:37 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-fe6dc089-53fc-4c51-8065-315c2a283584 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 17b941df-a6d2-41f2-9b1d-79187335dca1 {{(pid=74994) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 11:41:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:41:42 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:41:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:41:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:41:42 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:41:42 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 11:41:42 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b941df-a6d2-41f2-9b1d-79187335dca1/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:41:42 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b941df-a6d2-41f2-9b1d-79187335dca1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:41:42 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b941df-a6d2-41f2-9b1d-79187335dca1/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:41:42 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b941df-a6d2-41f2-9b1d-79187335dca1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:41:43 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:41:43 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:41:43 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=9029MB free_disk=24.976612091064453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 11:41:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:41:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:41:43 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 17b941df-a6d2-41f2-9b1d-79187335dca1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:41:43 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 11:41:43 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 11:41:43 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:41:43 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:41:43 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 11:41:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:41:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:41:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:41:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:41:51 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:41:51 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:41:51 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 11:41:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:41:57 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-fe6dc089-53fc-4c51-8065-315c2a283584 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 17b941df-a6d2-41f2-9b1d-79187335dca1 is timed out.
Nov 28 11:41:57 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-fe6dc089-53fc-4c51-8065-315c2a283584 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Successfully detached device vdb from instance 17b941df-a6d2-41f2-9b1d-79187335dca1 from the live domain config.
Nov 28 11:41:57 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe6dc089-53fc-4c51-8065-315c2a283584 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 11:41:57 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6dc089-53fc-4c51-8065-315c2a283584 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:c7b2a73d-2a8a-46d0-a335-1957423695fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aFpKheUg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:41:57 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-fe6dc089-53fc-4c51-8065-315c2a283584 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:41:57 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-fe6dc089-53fc-4c51-8065-315c2a283584 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:41:57 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-fe6dc089-53fc-4c51-8065-315c2a283584 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:41:57 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:41:57 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:41:57 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8672f686-2c6e-4d8d-921f-22aaf3120b46]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c7b2a73d-2a8a-46d0-a335-1957423695fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:41:57 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6dc089-53fc-4c51-8065-315c2a283584 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 11:41:57 user nova-compute[74994]: No targets found.
Nov 28 11:41:57 user nova-compute[74994]: iSNS:
Nov 28 11:41:57 user nova-compute[74994]: No targets found.
Nov 28 11:41:57 user nova-compute[74994]: STATIC:
Nov 28 11:41:57 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:c7b2a73d-2a8a-46d0-a335-1957423695fd
Nov 28 11:41:57 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:41:57 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:41:57 user nova-compute[74994]: FIRMWARE:
Nov 28 11:41:57 user nova-compute[74994]: No targets found.
Nov 28 11:41:57 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:41:57 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6dc089-53fc-4c51-8065-315c2a283584 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 11:41:57 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 11:41:57 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 11:41:57 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6dc089-53fc-4c51-8065-315c2a283584 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7b2a73d-2a8a-46d0-a335-1957423695fd', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 11:41:57 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:41:57 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:41:57 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f487dd-58ba-460e-b26a-2cd10f9d5388]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7b2a73d-2a8a-46d0-a335-1957423695fd\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:41:57 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:41:57 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:41:57 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b64bae6-4633-46d7-908d-4b9299add929]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b2a73d-2a8a-46d0-a335-1957423695fd (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:41:57 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6dc089-53fc-4c51-8065-315c2a283584 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b2a73d-2a8a-46d0-a335-1957423695fd (non-flash)
Nov 28 11:41:57 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:41:57 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6dc089-53fc-4c51-8065-315c2a283584 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b2a73d-2a8a-46d0-a335-1957423695fd (non-flash)
Nov 28 11:41:57 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:41:57 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6dc089-53fc-4c51-8065-315c2a283584 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb92071b7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7b2a73d-2a8a-46d0-a335-1957423695fd'): ({'sdb'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 11:41:57 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-fe6dc089-53fc-4c51-8065-315c2a283584 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Removing single pathed devices sdb {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 11:41:57 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:41:57 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:41:57 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7e9118-936a-471d-a90f-608f1316580d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:41:57 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:41:57 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:41:57 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a79c3bc-2d2e-4808-be54-5aea03b6a220]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:41:57 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-fe6dc089-53fc-4c51-8065-315c2a283584 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Flushing IO for device /dev/sdb {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 11:41:57 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:41:57 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:41:57 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[06168c31-fa6a-413b-8c19-3665c107b833]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:41:57 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-fe6dc089-53fc-4c51-8065-315c2a283584 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 11:41:57 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:41:57 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:41:57 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb0ffb1-39eb-4a0a-8d39-ff8c0e6edcb5]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:41:57 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-fe6dc089-53fc-4c51-8065-315c2a283584 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 11:41:57 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-fe6dc089-53fc-4c51-8065-315c2a283584 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] SCSI volumes sdb have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 11:41:57 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6dc089-53fc-4c51-8065-315c2a283584 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7b2a73d-2a8a-46d0-a335-1957423695fd')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 11:41:57 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b2a73d-2a8a-46d0-a335-1957423695fd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:41:57 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b2a73d-2a8a-46d0-a335-1957423695fd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:41:57 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3729b0a5-1be2-4587-a33b-a9d5b094a0b0]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:41:57 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6dc089-53fc-4c51-8065-315c2a283584 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:41:57 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b2a73d-2a8a-46d0-a335-1957423695fd -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:41:57 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b2a73d-2a8a-46d0-a335-1957423695fd -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:41:57 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d368e8-bce2-422d-a296-99ea6d240a37]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:c7b2a73d-2a8a-46d0-a335-1957423695fd, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:c7b2a73d-2a8a-46d0-a335-1957423695fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:41:57 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6dc089-53fc-4c51-8065-315c2a283584 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:c7b2a73d-2a8a-46d0-a335-1957423695fd, portal: 172.16.0.220,3260]
Nov 28 11:41:57 user nova-compute[74994]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:c7b2a73d-2a8a-46d0-a335-1957423695fd, portal: 172.16.0.220,3260] successful.
Nov 28 11:41:57 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:41:57 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b2a73d-2a8a-46d0-a335-1957423695fd -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:41:57 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b2a73d-2a8a-46d0-a335-1957423695fd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:41:57 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dbcdcbc-4f04-4c65-b896-a909873edceb]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:41:57 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6dc089-53fc-4c51-8065-315c2a283584 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:41:57 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-fe6dc089-53fc-4c51-8065-315c2a283584 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:41:57 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6dc089-53fc-4c51-8065-315c2a283584 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] <== disconnect_volume: return (281ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:41:57 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe6dc089-53fc-4c51-8065-315c2a283584 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 11:41:58 user nova-compute[74994]: DEBUG nova.objects.instance [None req-fe6dc089-53fc-4c51-8065-315c2a283584 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lazy-loading 'flavor' on Instance uuid 17b941df-a6d2-41f2-9b1d-79187335dca1 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:41:58 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:41:58 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 11:41:58 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Rebuilding the list of instances to heal {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 11:41:58 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-fe6dc089-53fc-4c51-8065-315c2a283584 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "17b941df-a6d2-41f2-9b1d-79187335dca1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.670s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:41:58 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "refresh_cache-17b941df-a6d2-41f2-9b1d-79187335dca1" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:41:58 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquired lock "refresh_cache-17b941df-a6d2-41f2-9b1d-79187335dca1" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:41:58 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Forcefully refreshing network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 11:41:58 user nova-compute[74994]: DEBUG nova.objects.instance [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lazy-loading 'info_cache' on Instance uuid 17b941df-a6d2-41f2-9b1d-79187335dca1 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:41:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:41:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:41:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:41:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:41:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:41:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:41:59 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Updating instance_info_cache with network_info: [{"id": "673d4843-0ed2-4ab1-86f2-8150d521ece7", "address": "fa:16:3e:83:81:54", "network": {"id": "e39af230-9bea-48e4-80a4-f46475c01631", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-134807231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b604f100e934644a9e62136794b80b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap673d4843-0e", "ovs_interfaceid": "673d4843-0ed2-4ab1-86f2-8150d521ece7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:41:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Releasing lock "refresh_cache-17b941df-a6d2-41f2-9b1d-79187335dca1" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:41:59 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Updated the network info_cache for instance {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 11:41:59 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:42:01 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:42:03 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:42:03 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:42:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:42:04 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:42:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:42:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:42:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:42:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:42:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:42:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:42:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:42:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:42:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:42:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:42:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:42:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:42:18 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:42:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:42:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:42:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:42:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:42:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:42:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:42:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:42:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:42:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:42:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:42:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:42:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:42:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:42:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Acquiring lock "17b941df-a6d2-41f2-9b1d-79187335dca1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:42:29 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "17b941df-a6d2-41f2-9b1d-79187335dca1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:42:29 user nova-compute[74994]: DEBUG nova.objects.instance [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lazy-loading 'flavor' on Instance uuid 17b941df-a6d2-41f2-9b1d-79187335dca1 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:42:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "17b941df-a6d2-41f2-9b1d-79187335dca1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:42:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Acquiring lock "17b941df-a6d2-41f2-9b1d-79187335dca1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:42:30 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "17b941df-a6d2-41f2-9b1d-79187335dca1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:42:30 user nova-compute[74994]: INFO nova.compute.manager [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Attaching volume cdce55c1-465a-494d-b088-c89e5b9d753f to /dev/vdb
Nov 28 11:42:30 user nova-compute[74994]: DEBUG os_brick.utils [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:42:30 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:42:30 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:42:30 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb6fc04-63d7-4992-9b97-185835a281d9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:42:30 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:42:30 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:42:30 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf3f525-557e-4dbb-8b70-176fea0a8c76]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:42:30 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:42:30 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:42:30 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3105da68-413d-4850-8fa8-771112af3f2b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:42:30 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[57620fe2-0861-49cd-8896-8be1693c895b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:42:30 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:42:30 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:42:30 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 11:42:30 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:42:30 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:42:30 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 11:42:30 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ac488a-e766-47e0-a7ec-2398d35b5b86]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:42:30 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 11:42:30 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 11:42:30 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 11:42:30 user nova-compute[74994]: DEBUG os_brick.utils [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:42:30 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Updating existing volume attachment record: 3363be1f-6199-49c2-b4fb-aa5db03c5526 {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 11:42:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:42:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:42:36 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 11:42:36 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cdce55c1-465a-494d-b088-c89e5b9d753f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xDnWTSyQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:42:36 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:42:36 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:42:36 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:42:36 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:42:36 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cdce55c1-465a-494d-b088-c89e5b9d753f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:42:36 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cdce55c1-465a-494d-b088-c89e5b9d753f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:42:36 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 11:42:36 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdce55c1-465a-494d-b088-c89e5b9d753f -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:42:36 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdce55c1-465a-494d-b088-c89e5b9d753f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:42:36 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb1448c-fc23-4e35-9b36-52c7cf1a4c03]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:42:36 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 11:42:36 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:42:36 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdce55c1-465a-494d-b088-c89e5b9d753f -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:42:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdce55c1-465a-494d-b088-c89e5b9d753f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:42:37 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[132608a2-0451-46e4-b053-9f24a6a977fa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cdce55c1-465a-494d-b088-c89e5b9d753f] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:42:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cdce55c1-465a-494d-b088-c89e5b9d753f] added
Nov 28 11:42:37 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:42:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdce55c1-465a-494d-b088-c89e5b9d753f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:42:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdce55c1-465a-494d-b088-c89e5b9d753f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:42:37 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[198a8dab-6885-4cb9-8052-5a59e7de07e2]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:42:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:42:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdce55c1-465a-494d-b088-c89e5b9d753f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:42:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdce55c1-465a-494d-b088-c89e5b9d753f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:42:37 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92127c2-bf45-4ae1-b371-36df32781ee3]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:42:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:42:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdce55c1-465a-494d-b088-c89e5b9d753f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xDnWTSyQ {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:42:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdce55c1-465a-494d-b088-c89e5b9d753f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xDnWTSyQ" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:42:37 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[829afb3f-4a00-41a9-aebb-396136c867ff]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:42:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xDnWTSyQ'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:42:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdce55c1-465a-494d-b088-c89e5b9d753f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:42:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdce55c1-465a-494d-b088-c89e5b9d753f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:42:37 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[252265f4-d0c2-41cc-8c61-a34abe2c4051]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:42:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:42:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:42:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:42:37 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c534caa-3b59-407f-812a-fec4aa8069d5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:42:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 11:42:37 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:42:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 11:42:37 user nova-compute[74994]:  {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:42:37 user nova-compute[74994]: WARNING os_brick.initiator.connectors.iscsi [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 11:42:37 user nova-compute[74994]: 
Nov 28 11:42:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdce55c1-465a-494d-b088-c89e5b9d753f -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:42:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdce55c1-465a-494d-b088-c89e5b9d753f -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:42:37 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96faef6-abd3-4b27-a54d-5eed682e0cf5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cdce55c1-465a-494d-b088-c89e5b9d753f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cdce55c1-465a-494d-b088-c89e5b9d753f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:42:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cdce55c1-465a-494d-b088-c89e5b9d753f, portal: 172.16.0.220,3260]
Nov 28 11:42:37 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:cdce55c1-465a-494d-b088-c89e5b9d753f, portal: 172.16.0.220,3260] successful.
Nov 28 11:42:37 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:42:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdce55c1-465a-494d-b088-c89e5b9d753f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:42:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdce55c1-465a-494d-b088-c89e5b9d753f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:42:37 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6f16f7-cc34-4b7a-bc0a-0fbe74011808]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:42:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:42:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:42:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:42:37 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e550a8f-498a-4ca7-87f5-4bfb53a770d5]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdce55c1-465a-494d-b088-c89e5b9d753f (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:42:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdce55c1-465a-494d-b088-c89e5b9d753f (non-flash)
Nov 28 11:42:37 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:42:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdce55c1-465a-494d-b088-c89e5b9d753f (non-flash)
Nov 28 11:42:37 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:42:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cdce55c1-465a-494d-b088-c89e5b9d753f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:42:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 11:42:37 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 11:42:37 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 11:42:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:42:37 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:42:37 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[572e34da-1632-4bf5-9be2-61fd47071252]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:42:37 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 11:42:37 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cdce55c1-465a-494d-b088-c89e5b9d753f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xDnWTSyQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 11:42:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:42:38 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23031623736613833', 'path': '/dev/sdb'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:42:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031623736613833', 'path': '/dev/sdb'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 11:42:38 user nova-compute[74994]: DEBUG nova.objects.instance [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lazy-loading 'flavor' on Instance uuid 17b941df-a6d2-41f2-9b1d-79187335dca1 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:42:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 11:42:38 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:42:38 user nova-compute[74994]:   <source dev="/dev/sdb"/>
Nov 28 11:42:38 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:42:38 user nova-compute[74994]:   <serial>cdce55c1-465a-494d-b088-c89e5b9d753f</serial>
Nov 28 11:42:38 user nova-compute[74994]: </disk>
Nov 28 11:42:38 user nova-compute[74994]:  {{(pid=74994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 11:42:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:42:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:42:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:42:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:42:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:42:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:42:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:42:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:42:38 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] No VIF found with MAC fa:16:3e:83:81:54, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:42:38 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-9896594c-45e3-4aa5-b117-551c4107465a tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "17b941df-a6d2-41f2-9b1d-79187335dca1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.618s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:42:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:42:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-84f15936-fe99-4c83-8aac-39a2781fc121 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Acquiring lock "17b941df-a6d2-41f2-9b1d-79187335dca1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:42:41 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-84f15936-fe99-4c83-8aac-39a2781fc121 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "17b941df-a6d2-41f2-9b1d-79187335dca1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:42:41 user nova-compute[74994]: INFO nova.compute.manager [None req-84f15936-fe99-4c83-8aac-39a2781fc121 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Detaching volume cdce55c1-465a-494d-b088-c89e5b9d753f
Nov 28 11:42:41 user nova-compute[74994]: INFO nova.virt.block_device [None req-84f15936-fe99-4c83-8aac-39a2781fc121 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Attempting to driver detach volume cdce55c1-465a-494d-b088-c89e5b9d753f from mountpoint /dev/vdb
Nov 28 11:42:41 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-84f15936-fe99-4c83-8aac-39a2781fc121 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Attempting to detach device vdb from instance 17b941df-a6d2-41f2-9b1d-79187335dca1 from the persistent domain config. {{(pid=74994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 11:42:41 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-84f15936-fe99-4c83-8aac-39a2781fc121 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 11:42:41 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:42:41 user nova-compute[74994]:   <source dev="/dev/sdb"/>
Nov 28 11:42:41 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:42:41 user nova-compute[74994]:   <serial>cdce55c1-465a-494d-b088-c89e5b9d753f</serial>
Nov 28 11:42:41 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 11:42:41 user nova-compute[74994]: </disk>
Nov 28 11:42:41 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 11:42:41 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-84f15936-fe99-4c83-8aac-39a2781fc121 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Successfully detached device vdb from instance 17b941df-a6d2-41f2-9b1d-79187335dca1 from the persistent domain config.
Nov 28 11:42:41 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-84f15936-fe99-4c83-8aac-39a2781fc121 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 17b941df-a6d2-41f2-9b1d-79187335dca1 from the live domain config. {{(pid=74994) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 11:42:41 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-84f15936-fe99-4c83-8aac-39a2781fc121 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 11:42:41 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:42:41 user nova-compute[74994]:   <source dev="/dev/sdb"/>
Nov 28 11:42:41 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:42:41 user nova-compute[74994]:   <serial>cdce55c1-465a-494d-b088-c89e5b9d753f</serial>
Nov 28 11:42:41 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 11:42:41 user nova-compute[74994]: </disk>
Nov 28 11:42:41 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 11:42:41 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-84f15936-fe99-4c83-8aac-39a2781fc121 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 17b941df-a6d2-41f2-9b1d-79187335dca1 {{(pid=74994) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 11:42:43 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:42:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:42:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:42:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:42:43 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 11:42:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b941df-a6d2-41f2-9b1d-79187335dca1/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:42:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:42:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b941df-a6d2-41f2-9b1d-79187335dca1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:42:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b941df-a6d2-41f2-9b1d-79187335dca1/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:42:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b941df-a6d2-41f2-9b1d-79187335dca1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:42:44 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:42:44 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:42:44 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=9016MB free_disk=24.975677490234375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 11:42:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:42:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:42:44 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 17b941df-a6d2-41f2-9b1d-79187335dca1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:42:44 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 11:42:44 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 11:42:44 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:42:44 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:42:44 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 11:42:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.156s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:42:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:42:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:42:53 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:42:53 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:42:53 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 11:42:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:42:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:42:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:42:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:42:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:42:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:42:58 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:42:58 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 11:42:58 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Rebuilding the list of instances to heal {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 11:42:58 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "refresh_cache-17b941df-a6d2-41f2-9b1d-79187335dca1" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:42:58 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquired lock "refresh_cache-17b941df-a6d2-41f2-9b1d-79187335dca1" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:42:58 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Forcefully refreshing network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 11:42:58 user nova-compute[74994]: DEBUG nova.objects.instance [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lazy-loading 'info_cache' on Instance uuid 17b941df-a6d2-41f2-9b1d-79187335dca1 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:42:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:42:59 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Updating instance_info_cache with network_info: [{"id": "673d4843-0ed2-4ab1-86f2-8150d521ece7", "address": "fa:16:3e:83:81:54", "network": {"id": "e39af230-9bea-48e4-80a4-f46475c01631", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-134807231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b604f100e934644a9e62136794b80b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap673d4843-0e", "ovs_interfaceid": "673d4843-0ed2-4ab1-86f2-8150d521ece7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:42:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Releasing lock "refresh_cache-17b941df-a6d2-41f2-9b1d-79187335dca1" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:42:59 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Updated the network info_cache for instance {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 11:43:00 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:43:01 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-84f15936-fe99-4c83-8aac-39a2781fc121 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 17b941df-a6d2-41f2-9b1d-79187335dca1 is timed out.
Nov 28 11:43:01 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-84f15936-fe99-4c83-8aac-39a2781fc121 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Successfully detached device vdb from instance 17b941df-a6d2-41f2-9b1d-79187335dca1 from the live domain config.
Nov 28 11:43:01 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84f15936-fe99-4c83-8aac-39a2781fc121 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 11:43:01 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f15936-fe99-4c83-8aac-39a2781fc121 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:cdce55c1-465a-494d-b088-c89e5b9d753f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xDnWTSyQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:43:01 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-84f15936-fe99-4c83-8aac-39a2781fc121 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:43:01 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-84f15936-fe99-4c83-8aac-39a2781fc121 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:43:01 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-84f15936-fe99-4c83-8aac-39a2781fc121 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:43:01 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:43:01 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:43:01 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0a8527-c681-40e7-8de2-4c2dd6632da5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cdce55c1-465a-494d-b088-c89e5b9d753f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:43:01 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f15936-fe99-4c83-8aac-39a2781fc121 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 11:43:01 user nova-compute[74994]: No targets found.
Nov 28 11:43:01 user nova-compute[74994]: iSNS:
Nov 28 11:43:01 user nova-compute[74994]: No targets found.
Nov 28 11:43:01 user nova-compute[74994]: STATIC:
Nov 28 11:43:01 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:cdce55c1-465a-494d-b088-c89e5b9d753f
Nov 28 11:43:01 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:43:01 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:43:01 user nova-compute[74994]: FIRMWARE:
Nov 28 11:43:01 user nova-compute[74994]: No targets found.
Nov 28 11:43:01 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:43:01 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f15936-fe99-4c83-8aac-39a2781fc121 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 11:43:01 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 11:43:01 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 11:43:01 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f15936-fe99-4c83-8aac-39a2781fc121 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cdce55c1-465a-494d-b088-c89e5b9d753f', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 11:43:01 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:43:01 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:43:01 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eaa7cad-9d0d-430c-bc84-e4e15dd187f4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdce55c1-465a-494d-b088-c89e5b9d753f\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:43:01 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:43:02 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:43:02 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bebcd9-bc86-483b-950b-0ed4e0d40381]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdce55c1-465a-494d-b088-c89e5b9d753f (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:43:02 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f15936-fe99-4c83-8aac-39a2781fc121 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdce55c1-465a-494d-b088-c89e5b9d753f (non-flash)
Nov 28 11:43:02 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:43:02 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f15936-fe99-4c83-8aac-39a2781fc121 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdce55c1-465a-494d-b088-c89e5b9d753f (non-flash)
Nov 28 11:43:02 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:43:02 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f15936-fe99-4c83-8aac-39a2781fc121 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9206e3a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cdce55c1-465a-494d-b088-c89e5b9d753f'): ({'sdb'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 11:43:02 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-84f15936-fe99-4c83-8aac-39a2781fc121 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Removing single pathed devices sdb {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 11:43:02 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:43:02 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:43:02 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5affdb94-d5ee-420c-b2dd-9b9495b2b8d5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:43:02 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:43:02 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:43:02 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92ab4bd-7c55-41a2-bdc4-7e637c40fc50]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:43:02 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-84f15936-fe99-4c83-8aac-39a2781fc121 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Flushing IO for device /dev/sdb {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 11:43:02 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:43:02 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:43:02 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf237e1-2406-4df5-8c42-bd58f1c5a1fb]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:43:02 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-84f15936-fe99-4c83-8aac-39a2781fc121 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 11:43:02 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:43:02 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.071s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:43:02 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[62efcdb6-8612-4384-9887-8d5c24525638]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:43:02 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-84f15936-fe99-4c83-8aac-39a2781fc121 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 11:43:02 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-84f15936-fe99-4c83-8aac-39a2781fc121 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] SCSI volumes sdb have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 11:43:02 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f15936-fe99-4c83-8aac-39a2781fc121 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cdce55c1-465a-494d-b088-c89e5b9d753f')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 11:43:02 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdce55c1-465a-494d-b088-c89e5b9d753f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:43:02 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdce55c1-465a-494d-b088-c89e5b9d753f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:43:02 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc32e845-d1aa-4c5a-9ee8-8cbf002a2a26]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:43:02 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f15936-fe99-4c83-8aac-39a2781fc121 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:43:02 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdce55c1-465a-494d-b088-c89e5b9d753f -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:43:02 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdce55c1-465a-494d-b088-c89e5b9d753f -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:43:02 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c4607d-85e7-48b5-ac42-6e5d02cec8d1]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:cdce55c1-465a-494d-b088-c89e5b9d753f, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:cdce55c1-465a-494d-b088-c89e5b9d753f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:43:02 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f15936-fe99-4c83-8aac-39a2781fc121 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:cdce55c1-465a-494d-b088-c89e5b9d753f, portal: 172.16.0.220,3260]
Nov 28 11:43:02 user nova-compute[74994]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:cdce55c1-465a-494d-b088-c89e5b9d753f, portal: 172.16.0.220,3260] successful.
Nov 28 11:43:02 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:43:02 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdce55c1-465a-494d-b088-c89e5b9d753f -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:43:02 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdce55c1-465a-494d-b088-c89e5b9d753f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:43:02 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0f46b4-ddfb-41ec-8ceb-0965793a9c25]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:43:02 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f15936-fe99-4c83-8aac-39a2781fc121 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:43:02 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-84f15936-fe99-4c83-8aac-39a2781fc121 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:43:02 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-84f15936-fe99-4c83-8aac-39a2781fc121 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] <== disconnect_volume: return (332ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:43:02 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84f15936-fe99-4c83-8aac-39a2781fc121 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 11:43:02 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:43:03 user nova-compute[74994]: DEBUG nova.objects.instance [None req-84f15936-fe99-4c83-8aac-39a2781fc121 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lazy-loading 'flavor' on Instance uuid 17b941df-a6d2-41f2-9b1d-79187335dca1 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:43:03 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-84f15936-fe99-4c83-8aac-39a2781fc121 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "17b941df-a6d2-41f2-9b1d-79187335dca1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.944s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:43:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:43:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:43:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:43:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:43:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:43:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:43:04 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:43:04 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:43:05 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:43:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:43:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:43:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:43:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:43:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:43:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:43:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:43:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:43:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:43:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:43:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:43:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:43:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:43:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:43:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:43:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:43:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:43:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:43:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:43:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:43:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:43:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:43:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:43:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:43:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:43:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:43:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Acquiring lock "17b941df-a6d2-41f2-9b1d-79187335dca1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:43:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "17b941df-a6d2-41f2-9b1d-79187335dca1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:43:34 user nova-compute[74994]: DEBUG nova.objects.instance [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lazy-loading 'flavor' on Instance uuid 17b941df-a6d2-41f2-9b1d-79187335dca1 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:43:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "17b941df-a6d2-41f2-9b1d-79187335dca1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:43:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Acquiring lock "17b941df-a6d2-41f2-9b1d-79187335dca1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:43:34 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "17b941df-a6d2-41f2-9b1d-79187335dca1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:43:34 user nova-compute[74994]: INFO nova.compute.manager [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Attaching volume 4cd2a1e2-f631-4639-8ed2-407d3bbed199 to /dev/vdb
Nov 28 11:43:34 user nova-compute[74994]: DEBUG os_brick.utils [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:43:34 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:43:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:43:35 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f04f61-ec1b-4a50-85b7-1503874deb24]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:43:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:43:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:43:35 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e628e4-6436-4f91-9d3f-9b8cb4ce683b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:43:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:43:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:43:35 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c70d20a-6552-4a9b-b44c-87e9f83f8b5a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:43:35 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5537912-a723-4641-88b6-6318d1e34065]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:43:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:43:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:43:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 11:43:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:43:35 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:43:35 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 11:43:35 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d62acd-fef4-469d-8f35-0a92f1e4873f]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:43:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 11:43:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 11:43:35 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 11:43:35 user nova-compute[74994]: DEBUG os_brick.utils [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:43:35 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Updating existing volume attachment record: ade8ba6f-96ea-4015-98fb-d88ea881ceb9 {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 11:43:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:43:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4cd2a1e2-f631-4639-8ed2-407d3bbed199', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jdsvNPFu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:43:41 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:43:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:43:41 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:43:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4cd2a1e2-f631-4639-8ed2-407d3bbed199" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4cd2a1e2-f631-4639-8ed2-407d3bbed199" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:43:41 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 11:43:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cd2a1e2-f631-4639-8ed2-407d3bbed199 -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cd2a1e2-f631-4639-8ed2-407d3bbed199 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98750a7-bc0d-42de-9009-b6440bc657cd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 11:43:41 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cd2a1e2-f631-4639-8ed2-407d3bbed199 -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cd2a1e2-f631-4639-8ed2-407d3bbed199 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e0d6df-609a-4f6a-9c5b-b1036365e0be]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4cd2a1e2-f631-4639-8ed2-407d3bbed199] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4cd2a1e2-f631-4639-8ed2-407d3bbed199] added
Nov 28 11:43:41 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cd2a1e2-f631-4639-8ed2-407d3bbed199 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cd2a1e2-f631-4639-8ed2-407d3bbed199 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ccaa20b-d6a8-45ba-9f82-b40481257673]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cd2a1e2-f631-4639-8ed2-407d3bbed199 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cd2a1e2-f631-4639-8ed2-407d3bbed199 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb559a3c-d40a-44db-8040-930116efc849]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cd2a1e2-f631-4639-8ed2-407d3bbed199 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jdsvNPFu {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cd2a1e2-f631-4639-8ed2-407d3bbed199 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jdsvNPFu" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee0f17d-350c-4019-898b-b8bc661203ea]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jdsvNPFu'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cd2a1e2-f631-4639-8ed2-407d3bbed199 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cd2a1e2-f631-4639-8ed2-407d3bbed199 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b677ab8-4950-48b1-8360-28a6724e60c3]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c45989-9da4-4432-b979-050deb30024b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 11:43:41 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 11:43:41 user nova-compute[74994]:  {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:43:41 user nova-compute[74994]: WARNING os_brick.initiator.connectors.iscsi [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 11:43:41 user nova-compute[74994]: 
Nov 28 11:43:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cd2a1e2-f631-4639-8ed2-407d3bbed199 -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cd2a1e2-f631-4639-8ed2-407d3bbed199 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0955cc9-282c-4579-9447-42420bf49ec1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4cd2a1e2-f631-4639-8ed2-407d3bbed199, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4cd2a1e2-f631-4639-8ed2-407d3bbed199, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4cd2a1e2-f631-4639-8ed2-407d3bbed199, portal: 172.16.0.220,3260]
Nov 28 11:43:41 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:4cd2a1e2-f631-4639-8ed2-407d3bbed199, portal: 172.16.0.220,3260] successful.
Nov 28 11:43:41 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cd2a1e2-f631-4639-8ed2-407d3bbed199 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cd2a1e2-f631-4639-8ed2-407d3bbed199 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[193c6d29-1d2f-4081-8a1f-452ecea033a8]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b698c0c4-144d-4cb4-a30e-03c6b05415f3]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd2a1e2-f631-4639-8ed2-407d3bbed199 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd2a1e2-f631-4639-8ed2-407d3bbed199 (non-flash)
Nov 28 11:43:41 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd2a1e2-f631-4639-8ed2-407d3bbed199 (non-flash)
Nov 28 11:43:41 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4cd2a1e2-f631-4639-8ed2-407d3bbed199" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[da72bae6-2e00-417e-b81d-770ef6b06964]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 11:43:41 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4cd2a1e2-f631-4639-8ed2-407d3bbed199', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jdsvNPFu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 11:43:42 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:43:42 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23537643939616464', 'path': '/dev/sdb'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:43:42 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537643939616464', 'path': '/dev/sdb'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 11:43:42 user nova-compute[74994]: DEBUG nova.objects.instance [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lazy-loading 'flavor' on Instance uuid 17b941df-a6d2-41f2-9b1d-79187335dca1 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:43:42 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 11:43:42 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:43:42 user nova-compute[74994]:   <source dev="/dev/sdb"/>
Nov 28 11:43:42 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:43:42 user nova-compute[74994]:   <serial>4cd2a1e2-f631-4639-8ed2-407d3bbed199</serial>
Nov 28 11:43:42 user nova-compute[74994]: </disk>
Nov 28 11:43:42 user nova-compute[74994]:  {{(pid=74994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 11:43:43 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:43:43 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:43:43 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] No VIF found with MAC fa:16:3e:83:81:54, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:43:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-f98c7870-1a24-4808-b0c1-81504cbe68f3 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "17b941df-a6d2-41f2-9b1d-79187335dca1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.573s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:43:43 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:43:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:43:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:43:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:43:43 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 11:43:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b941df-a6d2-41f2-9b1d-79187335dca1/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:43:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b941df-a6d2-41f2-9b1d-79187335dca1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:43:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b941df-a6d2-41f2-9b1d-79187335dca1/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:43:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:43:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b941df-a6d2-41f2-9b1d-79187335dca1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:43:43 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74994) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 11:43:44 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:43:44 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:43:44 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=9034MB free_disk=24.97476577758789GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 11:43:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:43:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:43:44 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 17b941df-a6d2-41f2-9b1d-79187335dca1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:43:44 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 11:43:44 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 11:43:44 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:43:44 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:43:44 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 11:43:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.340s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:43:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:43:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e0077bbb-296b-49fd-b011-38eba4b2f515 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Acquiring lock "17b941df-a6d2-41f2-9b1d-79187335dca1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:43:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e0077bbb-296b-49fd-b011-38eba4b2f515 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "17b941df-a6d2-41f2-9b1d-79187335dca1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:43:46 user nova-compute[74994]: INFO nova.compute.manager [None req-e0077bbb-296b-49fd-b011-38eba4b2f515 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Detaching volume 4cd2a1e2-f631-4639-8ed2-407d3bbed199
Nov 28 11:43:46 user nova-compute[74994]: INFO nova.virt.block_device [None req-e0077bbb-296b-49fd-b011-38eba4b2f515 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Attempting to driver detach volume 4cd2a1e2-f631-4639-8ed2-407d3bbed199 from mountpoint /dev/vdb
Nov 28 11:43:46 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-e0077bbb-296b-49fd-b011-38eba4b2f515 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Attempting to detach device vdb from instance 17b941df-a6d2-41f2-9b1d-79187335dca1 from the persistent domain config. {{(pid=74994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 11:43:46 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-e0077bbb-296b-49fd-b011-38eba4b2f515 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 11:43:46 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:43:46 user nova-compute[74994]:   <source dev="/dev/sdb"/>
Nov 28 11:43:46 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:43:46 user nova-compute[74994]:   <serial>4cd2a1e2-f631-4639-8ed2-407d3bbed199</serial>
Nov 28 11:43:46 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 11:43:46 user nova-compute[74994]: </disk>
Nov 28 11:43:46 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 11:43:46 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-e0077bbb-296b-49fd-b011-38eba4b2f515 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Successfully detached device vdb from instance 17b941df-a6d2-41f2-9b1d-79187335dca1 from the persistent domain config.
Nov 28 11:43:46 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-e0077bbb-296b-49fd-b011-38eba4b2f515 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 17b941df-a6d2-41f2-9b1d-79187335dca1 from the live domain config. {{(pid=74994) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 11:43:46 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-e0077bbb-296b-49fd-b011-38eba4b2f515 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 11:43:46 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:43:46 user nova-compute[74994]:   <source dev="/dev/sdb"/>
Nov 28 11:43:46 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:43:46 user nova-compute[74994]:   <serial>4cd2a1e2-f631-4639-8ed2-407d3bbed199</serial>
Nov 28 11:43:46 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 11:43:46 user nova-compute[74994]: </disk>
Nov 28 11:43:46 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 11:43:46 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-e0077bbb-296b-49fd-b011-38eba4b2f515 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 17b941df-a6d2-41f2-9b1d-79187335dca1 {{(pid=74994) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 11:43:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:43:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:43:53 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:43:53 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:43:53 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 11:43:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:43:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:43:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:43:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:43:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:43:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:43:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:43:59 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:43:59 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 11:43:59 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Rebuilding the list of instances to heal {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 11:43:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "refresh_cache-17b941df-a6d2-41f2-9b1d-79187335dca1" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:43:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquired lock "refresh_cache-17b941df-a6d2-41f2-9b1d-79187335dca1" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:43:59 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Forcefully refreshing network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 11:43:59 user nova-compute[74994]: DEBUG nova.objects.instance [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lazy-loading 'info_cache' on Instance uuid 17b941df-a6d2-41f2-9b1d-79187335dca1 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:44:00 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Updating instance_info_cache with network_info: [{"id": "673d4843-0ed2-4ab1-86f2-8150d521ece7", "address": "fa:16:3e:83:81:54", "network": {"id": "e39af230-9bea-48e4-80a4-f46475c01631", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-134807231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b604f100e934644a9e62136794b80b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap673d4843-0e", "ovs_interfaceid": "673d4843-0ed2-4ab1-86f2-8150d521ece7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:44:00 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Releasing lock "refresh_cache-17b941df-a6d2-41f2-9b1d-79187335dca1" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:44:00 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Updated the network info_cache for instance {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 11:44:01 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:44:02 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:44:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:44:05 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:44:06 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-e0077bbb-296b-49fd-b011-38eba4b2f515 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 17b941df-a6d2-41f2-9b1d-79187335dca1 is timed out.
Nov 28 11:44:06 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-e0077bbb-296b-49fd-b011-38eba4b2f515 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Successfully detached device vdb from instance 17b941df-a6d2-41f2-9b1d-79187335dca1 from the live domain config.
Nov 28 11:44:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0077bbb-296b-49fd-b011-38eba4b2f515 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0077bbb-296b-49fd-b011-38eba4b2f515 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:4cd2a1e2-f631-4639-8ed2-407d3bbed199', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jdsvNPFu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:44:06 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-e0077bbb-296b-49fd-b011-38eba4b2f515 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:44:06 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-e0077bbb-296b-49fd-b011-38eba4b2f515 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-e0077bbb-296b-49fd-b011-38eba4b2f515 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[15118e21-fd6a-4652-ba75-9e7fb26f7664]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4cd2a1e2-f631-4639-8ed2-407d3bbed199\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0077bbb-296b-49fd-b011-38eba4b2f515 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 11:44:06 user nova-compute[74994]: No targets found.
Nov 28 11:44:06 user nova-compute[74994]: iSNS:
Nov 28 11:44:06 user nova-compute[74994]: No targets found.
Nov 28 11:44:06 user nova-compute[74994]: STATIC:
Nov 28 11:44:06 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:4cd2a1e2-f631-4639-8ed2-407d3bbed199
Nov 28 11:44:06 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:44:06 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:44:06 user nova-compute[74994]: FIRMWARE:
Nov 28 11:44:06 user nova-compute[74994]: No targets found.
Nov 28 11:44:06 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0077bbb-296b-49fd-b011-38eba4b2f515 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 11:44:06 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 11:44:06 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0077bbb-296b-49fd-b011-38eba4b2f515 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4cd2a1e2-f631-4639-8ed2-407d3bbed199', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02c1e92-d9a5-43d0-8f50-75ada10caedb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4cd2a1e2-f631-4639-8ed2-407d3bbed199\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e39aaed-e1db-48e9-8dc1-9cb9d579e61a]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd2a1e2-f631-4639-8ed2-407d3bbed199 (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0077bbb-296b-49fd-b011-38eba4b2f515 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd2a1e2-f631-4639-8ed2-407d3bbed199 (non-flash)
Nov 28 11:44:06 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0077bbb-296b-49fd-b011-38eba4b2f515 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd2a1e2-f631-4639-8ed2-407d3bbed199 (non-flash)
Nov 28 11:44:06 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0077bbb-296b-49fd-b011-38eba4b2f515 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9206e32e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4cd2a1e2-f631-4639-8ed2-407d3bbed199'): ({'sdb'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-e0077bbb-296b-49fd-b011-38eba4b2f515 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Removing single pathed devices sdb {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b553e8d-9aca-4ac7-9a1c-2739f2a4da01]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2821cef6-1e37-4cc8-bdfb-f95f460c5bc9]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-e0077bbb-296b-49fd-b011-38eba4b2f515 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Flushing IO for device /dev/sdb {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d25da3-3c5b-41c6-8647-c5275528825b]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-e0077bbb-296b-49fd-b011-38eba4b2f515 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[95473429-7af7-4ee8-9800-f45f05bac245]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-e0077bbb-296b-49fd-b011-38eba4b2f515 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-e0077bbb-296b-49fd-b011-38eba4b2f515 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] SCSI volumes sdb have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0077bbb-296b-49fd-b011-38eba4b2f515 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4cd2a1e2-f631-4639-8ed2-407d3bbed199')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cd2a1e2-f631-4639-8ed2-407d3bbed199 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cd2a1e2-f631-4639-8ed2-407d3bbed199 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[48cee37b-7c33-4b76-b8a2-60f868203273]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0077bbb-296b-49fd-b011-38eba4b2f515 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cd2a1e2-f631-4639-8ed2-407d3bbed199 -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cd2a1e2-f631-4639-8ed2-407d3bbed199 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d895742a-478a-496d-a185-7f7e70bd62e7]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:4cd2a1e2-f631-4639-8ed2-407d3bbed199, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:4cd2a1e2-f631-4639-8ed2-407d3bbed199, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0077bbb-296b-49fd-b011-38eba4b2f515 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:4cd2a1e2-f631-4639-8ed2-407d3bbed199, portal: 172.16.0.220,3260]
Nov 28 11:44:06 user nova-compute[74994]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:4cd2a1e2-f631-4639-8ed2-407d3bbed199, portal: 172.16.0.220,3260] successful.
Nov 28 11:44:06 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cd2a1e2-f631-4639-8ed2-407d3bbed199 -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cd2a1e2-f631-4639-8ed2-407d3bbed199 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4cd99b-1239-44dc-bd36-63459a94c284]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0077bbb-296b-49fd-b011-38eba4b2f515 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-e0077bbb-296b-49fd-b011-38eba4b2f515 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0077bbb-296b-49fd-b011-38eba4b2f515 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] <== disconnect_volume: return (294ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:44:06 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0077bbb-296b-49fd-b011-38eba4b2f515 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 11:44:07 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:44:07 user nova-compute[74994]: DEBUG nova.objects.instance [None req-e0077bbb-296b-49fd-b011-38eba4b2f515 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lazy-loading 'flavor' on Instance uuid 17b941df-a6d2-41f2-9b1d-79187335dca1 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:44:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-e0077bbb-296b-49fd-b011-38eba4b2f515 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "17b941df-a6d2-41f2-9b1d-79187335dca1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.689s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:44:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:44:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:44:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:44:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:44:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:44:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:44:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:44:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:44:19 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:44:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:44:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:44:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:44:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:44:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:44:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:44:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:44:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:44:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:44:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:44:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:44:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:44:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:44:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:44:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:44:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:44:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:44:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:44:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:44:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Acquiring lock "17b941df-a6d2-41f2-9b1d-79187335dca1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:44:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "17b941df-a6d2-41f2-9b1d-79187335dca1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:44:39 user nova-compute[74994]: DEBUG nova.objects.instance [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lazy-loading 'flavor' on Instance uuid 17b941df-a6d2-41f2-9b1d-79187335dca1 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:44:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "17b941df-a6d2-41f2-9b1d-79187335dca1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:44:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Acquiring lock "17b941df-a6d2-41f2-9b1d-79187335dca1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:44:39 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "17b941df-a6d2-41f2-9b1d-79187335dca1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:44:39 user nova-compute[74994]: INFO nova.compute.manager [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Attaching volume ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a to /dev/vdb
Nov 28 11:44:39 user nova-compute[74994]: DEBUG os_brick.utils [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:44:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:44:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:44:39 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27df160-09a5-4a43-baa9-81af7bc14107]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:47b1d45847a0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:44:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:44:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:44:39 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f38d108-ec83-4cc1-ae09-bd07080dccf0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:44:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:44:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:44:39 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9cc97f-badd-4c97-8c54-ff0fa5f60b66]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:44:39 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4338189-9fb1-412b-92bb-8af027cedab3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:44:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Running cmd (subprocess): nvme version {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:44:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] 'nvme version' failed. Not Retrying. {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:44:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.nvmeof [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] nvme not present on system {{(pid=74994) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 11:44:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:44:39 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 11:44:39 user nova-compute[74994]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 11:44:39 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb01382-0e8a-4162-9152-f3a369a515d5]: (4, '') {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:44:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74994) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 11:44:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 11:44:39 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.lightos [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] LIGHTOS: no hostnqn found. {{(pid=74994) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 11:44:39 user nova-compute[74994]: DEBUG os_brick.utils [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:47b1d45847a0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:44:39 user nova-compute[74994]: DEBUG nova.virt.block_device [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Updating existing volume attachment record: 7d83abba-526f-4b05-b188-c34fcdeed367 {{(pid=74994) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 11:44:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:44:43 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:44:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:44:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:44:43 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:44:43 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 11:44:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b941df-a6d2-41f2-9b1d-79187335dca1/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:44:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b941df-a6d2-41f2-9b1d-79187335dca1/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:44:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b941df-a6d2-41f2-9b1d-79187335dca1/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:44:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:44:43 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b941df-a6d2-41f2-9b1d-79187335dca1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:44:44 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:44:44 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:44:44 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=9035MB free_disk=24.973892211914062GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 11:44:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:44:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:44:44 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 17b941df-a6d2-41f2-9b1d-79187335dca1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:44:44 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 11:44:44 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 11:44:44 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:44:44 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:44:44 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 11:44:44 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Calling os-brick to attach iSCSI Volume {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lonmBPtk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:44:46 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:44:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:44:46 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:44:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:44:46 user nova-compute[74994]: INFO os_brick.initiator.connectors.iscsi [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 11:44:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a -p 172.16.0.220:3260 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4d61e9-9148-48fc-baa3-955ab8de153e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 11:44:46 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a -p 172.16.0.220:3260 --interface default --op new {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55b62d9-49f3-471a-90c5-416e7692e5be]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a] added\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a] added
Nov 28 11:44:46 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f8840a-df9d-41c5-bc0f-d6f58b2a025a]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e75ad47-86fc-42a8-ae1c-c26c32956f2f]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lonmBPtk {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lonmBPtk" returned: 0 in 0.018s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b1c875-57fc-433e-b2a3-f88059b273ba]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lonmBPtk'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1bfbf8-f0d0-4cc9-b9d1-db8d0eae10bc]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e54ae6-ec42-4407-b5ab-52caa23a0413]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 11:44:46 user nova-compute[74994]:  {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 11:44:46 user nova-compute[74994]:  {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:44:46 user nova-compute[74994]: WARNING os_brick.initiator.connectors.iscsi [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 11:44:46 user nova-compute[74994]: 
Nov 28 11:44:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a -p 172.16.0.220:3260 --login {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a5c5a3-3070-4efd-992a-87f172b8d63e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a, portal: 172.16.0.220,3260]
Nov 28 11:44:46 user nova-compute[74994]: Login to [iface: default, target: iqn.2010-10.org.openstack:ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a, portal: 172.16.0.220,3260] successful.
Nov 28 11:44:46 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde8794b-f545-4236-9475-047a3dfaeafd]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[489e5ab1-4028-474c-a222-1a11ce599ff7]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a (non-flash)
Nov 28 11:44:46 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a (non-flash)
Nov 28 11:44:46 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Connected to 172.16.0.220:3260 {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=74994) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74994) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4758fc98-02d5-4d8c-9316-be59559a5875]: (4, ('- - 0', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74994) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 11:44:46 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lonmBPtk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74994) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 11:44:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:44:47 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23635346161316137', 'path': '/dev/sdb'} {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:44:47 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23635346161316137', 'path': '/dev/sdb'} {{(pid=74994) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 11:44:47 user nova-compute[74994]: DEBUG nova.objects.instance [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lazy-loading 'flavor' on Instance uuid 17b941df-a6d2-41f2-9b1d-79187335dca1 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:44:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 11:44:48 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:44:48 user nova-compute[74994]:   <source dev="/dev/sdb"/>
Nov 28 11:44:48 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:44:48 user nova-compute[74994]:   <serial>ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a</serial>
Nov 28 11:44:48 user nova-compute[74994]: </disk>
Nov 28 11:44:48 user nova-compute[74994]:  {{(pid=74994) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 11:44:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] No BDM found with device name vda, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:44:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74994) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 11:44:48 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] No VIF found with MAC fa:16:3e:83:81:54, not building metadata {{(pid=74994) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 11:44:48 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-498c36e4-b1e8-4d0c-91ba-b6cd026c84a1 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "17b941df-a6d2-41f2-9b1d-79187335dca1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.857s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:44:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:44:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:44:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-eaacc534-93c1-45a3-b020-61c0a5b6d973 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Acquiring lock "17b941df-a6d2-41f2-9b1d-79187335dca1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:44:51 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-eaacc534-93c1-45a3-b020-61c0a5b6d973 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "17b941df-a6d2-41f2-9b1d-79187335dca1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:44:51 user nova-compute[74994]: INFO nova.compute.manager [None req-eaacc534-93c1-45a3-b020-61c0a5b6d973 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Detaching volume ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a
Nov 28 11:44:51 user nova-compute[74994]: INFO nova.virt.block_device [None req-eaacc534-93c1-45a3-b020-61c0a5b6d973 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Attempting to driver detach volume ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a from mountpoint /dev/vdb
Nov 28 11:44:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-eaacc534-93c1-45a3-b020-61c0a5b6d973 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Attempting to detach device vdb from instance 17b941df-a6d2-41f2-9b1d-79187335dca1 from the persistent domain config. {{(pid=74994) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 11:44:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-eaacc534-93c1-45a3-b020-61c0a5b6d973 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 11:44:51 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:44:51 user nova-compute[74994]:   <source dev="/dev/sdb"/>
Nov 28 11:44:51 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:44:51 user nova-compute[74994]:   <serial>ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a</serial>
Nov 28 11:44:51 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 11:44:51 user nova-compute[74994]: </disk>
Nov 28 11:44:51 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 11:44:51 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-eaacc534-93c1-45a3-b020-61c0a5b6d973 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Successfully detached device vdb from instance 17b941df-a6d2-41f2-9b1d-79187335dca1 from the persistent domain config.
Nov 28 11:44:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-eaacc534-93c1-45a3-b020-61c0a5b6d973 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 17b941df-a6d2-41f2-9b1d-79187335dca1 from the live domain config. {{(pid=74994) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 11:44:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.guest [None req-eaacc534-93c1-45a3-b020-61c0a5b6d973 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 11:44:51 user nova-compute[74994]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 11:44:51 user nova-compute[74994]:   <source dev="/dev/sdb"/>
Nov 28 11:44:51 user nova-compute[74994]:   <target dev="vdb" bus="virtio"/>
Nov 28 11:44:51 user nova-compute[74994]:   <serial>ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a</serial>
Nov 28 11:44:51 user nova-compute[74994]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 11:44:51 user nova-compute[74994]: </disk>
Nov 28 11:44:51 user nova-compute[74994]:  {{(pid=74994) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 11:44:51 user nova-compute[74994]: DEBUG nova.virt.libvirt.driver [None req-eaacc534-93c1-45a3-b020-61c0a5b6d973 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 17b941df-a6d2-41f2-9b1d-79187335dca1 {{(pid=74994) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 11:44:53 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:44:53 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 11:44:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:44:54 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:44:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:44:58 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:44:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:44:59 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:44:59 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 11:44:59 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Rebuilding the list of instances to heal {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 11:44:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "refresh_cache-17b941df-a6d2-41f2-9b1d-79187335dca1" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:44:59 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquired lock "refresh_cache-17b941df-a6d2-41f2-9b1d-79187335dca1" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:44:59 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Forcefully refreshing network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 11:44:59 user nova-compute[74994]: DEBUG nova.objects.instance [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lazy-loading 'info_cache' on Instance uuid 17b941df-a6d2-41f2-9b1d-79187335dca1 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:45:00 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Updating instance_info_cache with network_info: [{"id": "673d4843-0ed2-4ab1-86f2-8150d521ece7", "address": "fa:16:3e:83:81:54", "network": {"id": "e39af230-9bea-48e4-80a4-f46475c01631", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-134807231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b604f100e934644a9e62136794b80b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap673d4843-0e", "ovs_interfaceid": "673d4843-0ed2-4ab1-86f2-8150d521ece7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:45:00 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Releasing lock "refresh_cache-17b941df-a6d2-41f2-9b1d-79187335dca1" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:45:00 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Updated the network info_cache for instance {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 11:45:02 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:45:03 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:45:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:45:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:45:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:45:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:45:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:45:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:45:07 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:45:07 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:45:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:45:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:45:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:45:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:45:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:45:08 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:45:09 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:45:11 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-eaacc534-93c1-45a3-b020-61c0a5b6d973 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 17b941df-a6d2-41f2-9b1d-79187335dca1 is timed out.
Nov 28 11:45:11 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-eaacc534-93c1-45a3-b020-61c0a5b6d973 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Successfully detached device vdb from instance 17b941df-a6d2-41f2-9b1d-79187335dca1 from the live domain config.
Nov 28 11:45:11 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaacc534-93c1-45a3-b020-61c0a5b6d973 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] calling os-brick to detach iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 11:45:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaacc534-93c1-45a3-b020-61c0a5b6d973 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9443c4640>, {'target_iqn': 'iqn.2010-10.org.openstack:ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lonmBPtk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 11:45:11 user nova-compute[74994]: WARNING os_brick.initiator.connectors.base [None req-eaacc534-93c1-45a3-b020-61c0a5b6d973 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 11:45:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-eaacc534-93c1-45a3-b020-61c0a5b6d973 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 11:45:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-eaacc534-93c1-45a3-b020-61c0a5b6d973 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 11:45:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:45:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:45:11 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[715f7a9b-8aad-4e17-b80e-0bcdeed497f7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:45:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaacc534-93c1-45a3-b020-61c0a5b6d973 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 11:45:11 user nova-compute[74994]: No targets found.
Nov 28 11:45:11 user nova-compute[74994]: iSNS:
Nov 28 11:45:11 user nova-compute[74994]: No targets found.
Nov 28 11:45:11 user nova-compute[74994]: STATIC:
Nov 28 11:45:11 user nova-compute[74994]: Target: iqn.2010-10.org.openstack:ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a
Nov 28 11:45:11 user nova-compute[74994]:         Portal: 172.16.0.220:3260,-1
Nov 28 11:45:11 user nova-compute[74994]:                 Iface Name: default
Nov 28 11:45:11 user nova-compute[74994]: FIRMWARE:
Nov 28 11:45:11 user nova-compute[74994]: No targets found.
Nov 28 11:45:11 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:45:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaacc534-93c1-45a3-b020-61c0a5b6d973 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 11:45:11 user nova-compute[74994]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 11:45:11 user nova-compute[74994]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74994) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 11:45:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaacc534-93c1-45a3-b020-61c0a5b6d973 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a', 0)] {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 11:45:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:45:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:45:11 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d64c365-1949-4aeb-aecd-5c0d4dc24af1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:45:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:45:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:45:11 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ca50db-0f1e-4fd2-a1ff-529ba957a504]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a (non-flash)\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:45:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaacc534-93c1-45a3-b020-61c0a5b6d973 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a (non-flash)
Nov 28 11:45:11 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 11:45:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaacc534-93c1-45a3-b020-61c0a5b6d973 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a (non-flash)
Nov 28 11:45:11 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 11:45:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaacc534-93c1-45a3-b020-61c0a5b6d973 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb94447cca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a'): ({'sdb'}, set())}) {{(pid=74994) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 11:45:11 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-eaacc534-93c1-45a3-b020-61c0a5b6d973 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Removing single pathed devices sdb {{(pid=74994) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 11:45:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:45:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:45:11 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67e3b35-2a92-4c3d-a5c0-f43a71b11b50]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:45:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:45:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:45:11 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc278c4-1bf9-46dc-91e7-d2070a8a8888]: (4, ('ok\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:45:11 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-eaacc534-93c1-45a3-b020-61c0a5b6d973 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Flushing IO for device /dev/sdb {{(pid=74994) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 11:45:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:45:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:45:11 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[e179ee03-66d8-4c1b-9578-d350d2cfa92d]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:45:11 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-eaacc534-93c1-45a3-b020-61c0a5b6d973 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74994) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 11:45:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:45:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:45:11 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ceca901-06bd-4d45-834c-43d105f1843a]: (4, ('1', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:45:11 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-eaacc534-93c1-45a3-b020-61c0a5b6d973 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 11:45:11 user nova-compute[74994]: DEBUG os_brick.initiator.linuxscsi [None req-eaacc534-93c1-45a3-b020-61c0a5b6d973 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] SCSI volumes sdb have been removed. {{(pid=74994) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 11:45:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaacc534-93c1-45a3-b020-61c0a5b6d973 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a')] {{(pid=74994) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 11:45:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:45:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:45:11 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca816843-6b6c-42b1-a2b8-76fce7ba72da]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:45:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaacc534-93c1-45a3-b020-61c0a5b6d973 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:45:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a -p 172.16.0.220:3260 --logout {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:45:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:45:11 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfde51cb-4df8-49bd-b3a9-d67efbe611bb]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:45:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaacc534-93c1-45a3-b020-61c0a5b6d973 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a, portal: 172.16.0.220,3260]
Nov 28 11:45:11 user nova-compute[74994]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a, portal: 172.16.0.220,3260] successful.
Nov 28 11:45:11 user nova-compute[74994]:  stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:45:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a -p 172.16.0.220:3260 --op delete {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:45:11 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddaf2581-2d2b-498e-b7fe-c2a532ad6d6a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86494) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:45:11 user nova-compute[74994]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44e2b7d-972b-46e0-998a-8c00b644266a]: (4, ('', '')) {{(pid=86494) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 11:45:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaacc534-93c1-45a3-b020-61c0a5b6d973 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74994) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 11:45:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.base [None req-eaacc534-93c1-45a3-b020-61c0a5b6d973 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 11:45:11 user nova-compute[74994]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaacc534-93c1-45a3-b020-61c0a5b6d973 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] <== disconnect_volume: return (295ms) None {{(pid=74994) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 11:45:11 user nova-compute[74994]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaacc534-93c1-45a3-b020-61c0a5b6d973 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Disconnected iSCSI Volume {{(pid=74994) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 11:45:12 user nova-compute[74994]: DEBUG nova.objects.instance [None req-eaacc534-93c1-45a3-b020-61c0a5b6d973 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lazy-loading 'flavor' on Instance uuid 17b941df-a6d2-41f2-9b1d-79187335dca1 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:45:12 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-eaacc534-93c1-45a3-b020-61c0a5b6d973 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "17b941df-a6d2-41f2-9b1d-79187335dca1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.633s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:45:13 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:45:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:45:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:45:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:45:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:45:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:45:18 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:45:23 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:45:28 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:45:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:45:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:45:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:45:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:45:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:45:33 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:45:38 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:45:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:45:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:45:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:45:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:45:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:45:43 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:45:45 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:45:45 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:45:45 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:45:45 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:45:45 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 11:45:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b941df-a6d2-41f2-9b1d-79187335dca1/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:45:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b941df-a6d2-41f2-9b1d-79187335dca1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:45:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b941df-a6d2-41f2-9b1d-79187335dca1/disk --force-share --output=json {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 11:45:45 user nova-compute[74994]: DEBUG oslo_concurrency.processutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b941df-a6d2-41f2-9b1d-79187335dca1/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74994) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 11:45:46 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:45:46 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:45:46 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=9037MB free_disk=24.972984313964844GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 11:45:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:45:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:45:46 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Instance 17b941df-a6d2-41f2-9b1d-79187335dca1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74994) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 11:45:46 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 11:45:46 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 11:45:46 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Refreshing inventories for resource provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 11:45:46 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Updating ProviderTree inventory for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 11:45:46 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Updating inventory in ProviderTree for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 11:45:46 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Refreshing aggregate associations for resource provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a, aggregates: None {{(pid=74994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 11:45:46 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Refreshing trait associations for resource provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=74994) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 11:45:46 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:45:46 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:45:46 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 11:45:46 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.306s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:45:48 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:45:53 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:45:53 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 11:45:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:45:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:45:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:45:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:45:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:45:53 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:45:54 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:45:58 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:45:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:45:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:45:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:45:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:45:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:45:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:46:00 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:46:00 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74994) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 11:46:01 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:46:01 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 11:46:01 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Rebuilding the list of instances to heal {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 11:46:01 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "refresh_cache-17b941df-a6d2-41f2-9b1d-79187335dca1" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 11:46:01 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquired lock "refresh_cache-17b941df-a6d2-41f2-9b1d-79187335dca1" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 11:46:01 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Forcefully refreshing network info cache for instance {{(pid=74994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 11:46:01 user nova-compute[74994]: DEBUG nova.objects.instance [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lazy-loading 'info_cache' on Instance uuid 17b941df-a6d2-41f2-9b1d-79187335dca1 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:46:01 user nova-compute[74994]: DEBUG nova.network.neutron [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Updating instance_info_cache with network_info: [{"id": "673d4843-0ed2-4ab1-86f2-8150d521ece7", "address": "fa:16:3e:83:81:54", "network": {"id": "e39af230-9bea-48e4-80a4-f46475c01631", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-134807231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b604f100e934644a9e62136794b80b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap673d4843-0e", "ovs_interfaceid": "673d4843-0ed2-4ab1-86f2-8150d521ece7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:46:02 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Releasing lock "refresh_cache-17b941df-a6d2-41f2-9b1d-79187335dca1" {{(pid=74994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 11:46:02 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Updated the network info_cache for instance {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 11:46:03 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:46:03 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:46:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-cf62c878-580d-4faf-b221-271250631f92 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Acquiring lock "17b941df-a6d2-41f2-9b1d-79187335dca1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:46:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-cf62c878-580d-4faf-b221-271250631f92 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "17b941df-a6d2-41f2-9b1d-79187335dca1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:46:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-cf62c878-580d-4faf-b221-271250631f92 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Acquiring lock "17b941df-a6d2-41f2-9b1d-79187335dca1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:46:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-cf62c878-580d-4faf-b221-271250631f92 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "17b941df-a6d2-41f2-9b1d-79187335dca1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:46:04 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-cf62c878-580d-4faf-b221-271250631f92 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "17b941df-a6d2-41f2-9b1d-79187335dca1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:46:04 user nova-compute[74994]: INFO nova.compute.manager [None req-cf62c878-580d-4faf-b221-271250631f92 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Terminating instance
Nov 28 11:46:04 user nova-compute[74994]: DEBUG nova.compute.manager [None req-cf62c878-580d-4faf-b221-271250631f92 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Start destroying the instance on the hypervisor. {{(pid=74994) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 11:46:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:46:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:46:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:46:04 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:46:05 user nova-compute[74994]: DEBUG nova.compute.manager [req-e04e1385-b523-48b6-a7ce-d336dd4d00e5 req-2fd80138-f497-431d-8719-c56771a16766 service nova] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Received event network-vif-unplugged-673d4843-0ed2-4ab1-86f2-8150d521ece7 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:46:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-e04e1385-b523-48b6-a7ce-d336dd4d00e5 req-2fd80138-f497-431d-8719-c56771a16766 service nova] Acquiring lock "17b941df-a6d2-41f2-9b1d-79187335dca1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:46:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-e04e1385-b523-48b6-a7ce-d336dd4d00e5 req-2fd80138-f497-431d-8719-c56771a16766 service nova] Lock "17b941df-a6d2-41f2-9b1d-79187335dca1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:46:05 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-e04e1385-b523-48b6-a7ce-d336dd4d00e5 req-2fd80138-f497-431d-8719-c56771a16766 service nova] Lock "17b941df-a6d2-41f2-9b1d-79187335dca1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:46:05 user nova-compute[74994]: DEBUG nova.compute.manager [req-e04e1385-b523-48b6-a7ce-d336dd4d00e5 req-2fd80138-f497-431d-8719-c56771a16766 service nova] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] No waiting events found dispatching network-vif-unplugged-673d4843-0ed2-4ab1-86f2-8150d521ece7 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:46:05 user nova-compute[74994]: DEBUG nova.compute.manager [req-e04e1385-b523-48b6-a7ce-d336dd4d00e5 req-2fd80138-f497-431d-8719-c56771a16766 service nova] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Received event network-vif-unplugged-673d4843-0ed2-4ab1-86f2-8150d521ece7 for instance with task_state deleting. {{(pid=74994) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 11:46:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:46:05 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:46:05 user nova-compute[74994]: INFO nova.virt.libvirt.driver [-] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Instance destroyed successfully.
Nov 28 11:46:05 user nova-compute[74994]: DEBUG nova.objects.instance [None req-cf62c878-580d-4faf-b221-271250631f92 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lazy-loading 'resources' on Instance uuid 17b941df-a6d2-41f2-9b1d-79187335dca1 {{(pid=74994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 11:46:05 user nova-compute[74994]: DEBUG nova.virt.libvirt.vif [None req-cf62c878-580d-4faf-b221-271250631f92 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T11:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1379585235',display_name='tempest-SnapshotDataIntegrityTests-server-1379585235',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1379585235',id=53,image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFrZWCI/tzHwjkDy7L1B8EBPlwTDNOxBKrL4O7dwHffg8V6jPvs6Z2Xv5dDzoeGcFipc4/BQyRs5uGYZhHWj7qn4mbNv0gU6URWqp3rJTMfFOidSe6Y9U0mNoDlQQYQ1g==',key_name='tempest-keypair-346785877',keypairs=<?>,launch_index=0,launched_at=2023-11-28T11:39:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b604f100e934644a9e62136794b80b6',ramdisk_id='',reservation_id='r-glayxowl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aa939d1b-b8a6-4391-935b-0191bf5ccd0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-2090670151',owner_user_name='tempest-SnapshotDataIntegrityTests-2090670151-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T11:39:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e2d0899a8084528853a093147d8f3d5',uuid=17b941df-a6d2-41f2-9b1d-79187335dca1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "673d4843-0ed2-4ab1-86f2-8150d521ece7", "address": "fa:16:3e:83:81:54", "network": {"id": "e39af230-9bea-48e4-80a4-f46475c01631", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-134807231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b604f100e934644a9e62136794b80b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap673d4843-0e", "ovs_interfaceid": "673d4843-0ed2-4ab1-86f2-8150d521ece7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 11:46:05 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-cf62c878-580d-4faf-b221-271250631f92 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Converting VIF {"id": "673d4843-0ed2-4ab1-86f2-8150d521ece7", "address": "fa:16:3e:83:81:54", "network": {"id": "e39af230-9bea-48e4-80a4-f46475c01631", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-134807231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b604f100e934644a9e62136794b80b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap673d4843-0e", "ovs_interfaceid": "673d4843-0ed2-4ab1-86f2-8150d521ece7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 11:46:05 user nova-compute[74994]: DEBUG nova.network.os_vif_util [None req-cf62c878-580d-4faf-b221-271250631f92 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:81:54,bridge_name='br-int',has_traffic_filtering=True,id=673d4843-0ed2-4ab1-86f2-8150d521ece7,network=Network(e39af230-9bea-48e4-80a4-f46475c01631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap673d4843-0e') {{(pid=74994) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 11:46:05 user nova-compute[74994]: DEBUG os_vif [None req-cf62c878-580d-4faf-b221-271250631f92 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:81:54,bridge_name='br-int',has_traffic_filtering=True,id=673d4843-0ed2-4ab1-86f2-8150d521ece7,network=Network(e39af230-9bea-48e4-80a4-f46475c01631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap673d4843-0e') {{(pid=74994) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 11:46:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:46:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap673d4843-0e, bridge=br-int, if_exists=True) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:46:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:46:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:46:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:46:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fc762e97-8fe5-40e9-b824-89690e55e6f5) {{(pid=74994) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 11:46:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:46:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:46:05 user nova-compute[74994]: INFO os_vif [None req-cf62c878-580d-4faf-b221-271250631f92 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:81:54,bridge_name='br-int',has_traffic_filtering=True,id=673d4843-0ed2-4ab1-86f2-8150d521ece7,network=Network(e39af230-9bea-48e4-80a4-f46475c01631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap673d4843-0e')
Nov 28 11:46:05 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-cf62c878-580d-4faf-b221-271250631f92 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Deleting instance files /opt/stack/data/nova/instances/17b941df-a6d2-41f2-9b1d-79187335dca1_del
Nov 28 11:46:05 user nova-compute[74994]: INFO nova.virt.libvirt.driver [None req-cf62c878-580d-4faf-b221-271250631f92 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Deletion of /opt/stack/data/nova/instances/17b941df-a6d2-41f2-9b1d-79187335dca1_del complete
Nov 28 11:46:05 user nova-compute[74994]: INFO nova.compute.manager [None req-cf62c878-580d-4faf-b221-271250631f92 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 28 11:46:05 user nova-compute[74994]: DEBUG oslo.service.loopingcall [None req-cf62c878-580d-4faf-b221-271250631f92 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74994) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 11:46:05 user nova-compute[74994]: DEBUG nova.compute.manager [-] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Deallocating network for instance {{(pid=74994) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 11:46:05 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] deallocate_for_instance() {{(pid=74994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 11:46:06 user nova-compute[74994]: DEBUG nova.network.neutron [-] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Updating instance_info_cache with network_info: [] {{(pid=74994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 11:46:06 user nova-compute[74994]: INFO nova.compute.manager [-] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Took 0.74 seconds to deallocate network for instance.
Nov 28 11:46:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-cf62c878-580d-4faf-b221-271250631f92 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:46:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-cf62c878-580d-4faf-b221-271250631f92 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:46:06 user nova-compute[74994]: DEBUG nova.compute.manager [req-90b04f0b-1bbe-42ec-8175-4d1b2c953a81 req-3058569a-8ec0-4ef2-a3ff-b55e00c44c92 service nova] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Received event network-vif-deleted-673d4843-0ed2-4ab1-86f2-8150d521ece7 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:46:06 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-cf62c878-580d-4faf-b221-271250631f92 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:46:06 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-cf62c878-580d-4faf-b221-271250631f92 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:46:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-cf62c878-580d-4faf-b221-271250631f92 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.113s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:46:06 user nova-compute[74994]: INFO nova.scheduler.client.report [None req-cf62c878-580d-4faf-b221-271250631f92 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Deleted allocations for instance 17b941df-a6d2-41f2-9b1d-79187335dca1
Nov 28 11:46:06 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-cf62c878-580d-4faf-b221-271250631f92 tempest-SnapshotDataIntegrityTests-2090670151 tempest-SnapshotDataIntegrityTests-2090670151-project-member] Lock "17b941df-a6d2-41f2-9b1d-79187335dca1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.900s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:46:07 user nova-compute[74994]: DEBUG nova.compute.manager [req-cfc30e8c-5580-48e0-984a-4898b8b29d1a req-a26407d6-4d4f-465b-9c4e-0810a33f1dc9 service nova] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Received event network-vif-plugged-673d4843-0ed2-4ab1-86f2-8150d521ece7 {{(pid=74994) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 11:46:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-cfc30e8c-5580-48e0-984a-4898b8b29d1a req-a26407d6-4d4f-465b-9c4e-0810a33f1dc9 service nova] Acquiring lock "17b941df-a6d2-41f2-9b1d-79187335dca1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:46:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-cfc30e8c-5580-48e0-984a-4898b8b29d1a req-a26407d6-4d4f-465b-9c4e-0810a33f1dc9 service nova] Lock "17b941df-a6d2-41f2-9b1d-79187335dca1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:46:07 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [req-cfc30e8c-5580-48e0-984a-4898b8b29d1a req-a26407d6-4d4f-465b-9c4e-0810a33f1dc9 service nova] Lock "17b941df-a6d2-41f2-9b1d-79187335dca1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:46:07 user nova-compute[74994]: DEBUG nova.compute.manager [req-cfc30e8c-5580-48e0-984a-4898b8b29d1a req-a26407d6-4d4f-465b-9c4e-0810a33f1dc9 service nova] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] No waiting events found dispatching network-vif-plugged-673d4843-0ed2-4ab1-86f2-8150d521ece7 {{(pid=74994) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 11:46:07 user nova-compute[74994]: WARNING nova.compute.manager [req-cfc30e8c-5580-48e0-984a-4898b8b29d1a req-a26407d6-4d4f-465b-9c4e-0810a33f1dc9 service nova] [instance: 17b941df-a6d2-41f2-9b1d-79187335dca1] Received unexpected event network-vif-plugged-673d4843-0ed2-4ab1-86f2-8150d521ece7 for instance with vm_state deleted and task_state None.
Nov 28 11:46:09 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:46:09 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:46:10 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:46:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:46:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:46:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:46:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:46:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:46:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:46:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:46:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:46:22 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:46:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:46:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:46:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:46:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:46:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:46:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:46:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:46:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:46:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:46:43 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:46:43 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Cleaning up deleted instances {{(pid=74994) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 11:46:43 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] There are 0 instances to clean {{(pid=74994) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 11:46:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:46:46 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:46:47 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:46:47 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:46:47 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:46:47 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:46:47 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 11:46:47 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:46:47 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:46:47 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=9170MB free_disk=25.000179290771484GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 11:46:47 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:46:47 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:46:47 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 11:46:47 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 11:46:47 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:46:47 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:46:47 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 11:46:47 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.155s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:46:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:46:53 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:46:53 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 11:46:54 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:46:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:46:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:46:57 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:46:58 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:47:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:47:01 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:47:03 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:47:03 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 11:47:03 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Rebuilding the list of instances to heal {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 11:47:03 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Didn't find any instances for network info cache update. {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 11:47:05 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:47:05 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:47:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:47:09 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:47:10 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:47:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:47:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:47:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:47:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:47:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:47:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:47:11 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:47:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:47:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:47:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:47:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:47:35 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:47:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:47:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:47:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:47:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:47:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:47:40 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:47:45 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:47:49 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:47:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:47:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:47:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:47:49 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Auditing locally available compute resources for user (node: user) {{(pid=74994) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 11:47:49 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:47:49 user nova-compute[74994]: WARNING nova.virt.libvirt.driver [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 11:47:49 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Hypervisor/Node resource view: name=user free_ram=9309MB free_disk=24.992115020751953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74994) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 11:47:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 11:47:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 11:47:49 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 11:47:49 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74994) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 11:47:49 user nova-compute[74994]: DEBUG nova.compute.provider_tree [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed in ProviderTree for provider: fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a {{(pid=74994) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 11:47:49 user nova-compute[74994]: DEBUG nova.scheduler.client.report [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Inventory has not changed for provider fb1e6f92-c74f-4ed3-9bd2-6f0b94bff21a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74994) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 11:47:49 user nova-compute[74994]: DEBUG nova.compute.resource_tracker [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Compute_service record updated for user:user {{(pid=74994) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 11:47:49 user nova-compute[74994]: DEBUG oslo_concurrency.lockutils [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.119s {{(pid=74994) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 11:47:50 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:47:53 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:47:53 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74994) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 11:47:55 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:47:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:47:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:47:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74994) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 11:47:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:47:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74994) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 11:47:55 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:48:00 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:48:04 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:48:04 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Starting heal instance info cache {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 11:48:04 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Rebuilding the list of instances to heal {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 11:48:04 user nova-compute[74994]: DEBUG nova.compute.manager [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Didn't find any instances for network info cache update. {{(pid=74994) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 11:48:05 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:48:05 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:48:06 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:48:09 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:48:10 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:48:11 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:48:11 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:48:15 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:48:20 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 11:48:25 user nova-compute[74994]: DEBUG oslo_service.periodic_task [None req-8e1010ad-f9c2-4e54-b0a2-88e50456d953 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74994) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 11:48:25 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 11:48:30 user nova-compute[74994]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74994) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}